Job Title: Software Engineer III
Contract Duration: 12 months, possible extension
Location: Daly City, CA
Work Arrangement: Remote
Summary
The CWs will support efforts to perform data mitigations on large scale datasets (image, video, text) leveraged by FAIR research teams. The goal is to proactively mitigate potential risks associated with these datasets.
Responsibilities
- Preprocessing: converting original datasets into a format that can be consumed by mitigation pipelines.
- Filtering: running filtering using Integrity's pipeline.
- Post-processing: consuming filtering results to filter in the original datasets, repackaging, and re-ingestion.
- Optimization: identify optimization opportunities and improve the process
Skills
- Software engineering skills include writing scripts to automate file processing and data transferring, and creating tools to improve productivity and streamline workflows.
- Data Management: Data pipeline building. Data processing and cleaning, transformation and formatting, data quality control and validation
- Communication – effective communication skills to collaborate with stakeholders and team members
Must Have Skills
- Python experience a must
- Some data management experience, e.g. SQL, process large data.
- Able to be flexible and work well in different environments with varying tasks and responsibilities
Nice to Have Skills
- Background in AI building tools