The Role

We are seeking a skilled AI Specialist to join our team on a freelance, part-time basis to support our work focused on responsible AI/ML experimentation with a government cultural memory institution. The ideal candidate will play a crucial role as a technical expert in the development and execution of experiments exploring responsible AI approaches to creating datasets from cultural heritage collections for benchmarking and training AI models. This role requires a deep understanding of AI model training and evaluation while mitigating harmful biases and ensuring the security, privacy, and intellectual copyright protection of individuals and entities.

Key Responsibilities

• Support Experiment Design: Assist in the conceptualization and planning of experiments aimed at exploring responsible AI approaches, including benchmark dataset creation, bias mitigation, the use of synthetic data or other risk mitigation techniques for model training, and community engagement in developing training datasets.
• Experiment Execution: Serve as the technical lead in hands-on execution of experiments, including dataset compilation, model training, quantitative and qualitative evaluation, and quality control. Work collaboratively to ensure experiments are conducted efficiently and effectively. Contribute insights on how to center responsible AI practices in AI model training and development.
• Contribute to Recommendations: Based on the analysis of experiment processes and outcomes, contribute to reports on experiment findings and recommendations for implementing responsible AI approaches.
• Technical Documentation: Collaborate with the team to document technical processes, experiment setups, evaluation outputs, code, and datasets. Ensure technical documentation is accurate, reflective of the team’s insights, and accessible to a broad audience, including non-technical stakeholders.
• Collaboration and Communication: Work closely with a team including project leads, project team, and subject matter experts to align AI development efforts with ethical standards and project goals. Actively participate in team meetings and contribute to discovery, experiment design and execution, and analysis.

Ideal Candidate Profile

• Proven experience in AI benchmarking, evaluation, and training AI models, particularly in contexts requiring sensitivity to bias, privacy, and intellectual property issues.
• Expertise in synthetic data creation/use or other methodologies for maintaining privacy, security, and copyright integrity.
• Deep understanding of the responsible AI space, including ethical considerations and best practices in mitigating biases and protecting privacy and IP rights.
• Strong analytical and problem-solving skills, with the ability to work independently and collaboratively with team members and client stakeholders.
• Strong communication skills for articulating complex technical concepts to diverse audiences.
• Ability to participate in the discovery, experiment planning, and execution phases, contributing to the project’s success from late July/August 2024 through fall/winter 2024-2025.

Project Timeline

The discovery phase of the project is expected to start in late July or August, with the bulk of work occurring during the experiment phase in fall/winter 2024-2025. While the primary engagement period will be during the experiment planning and execution phases, involvement in the discovery and reporting phases can be flexible, based on the candidate’s availability and expertise.

This opportunity offers the chance to contribute to the responsible and ethical use of AI in managing and enhancing digital collections at a national level. If you are passionate about AI and its potential for positive impact in cultural heritage institutions, we encourage you to apply.

About Us

AVP is a consultancy providing data and digital asset management consulting services to Fortune 1000, cultural heritage, and non-profit organizations. Our mission is to intentionally use technology and digital asset management to empower the world’s most influential organizations to positively impact humankind. We’re focused on leveraging data and digital assets in new and innovative ways, simplifying complex information challenges to enhance decision-making and operational efficiency. Our team specializes in dissecting and solving difficult data problems, enabling organizations to effectively manage, protect, and utilize their digital assets. We thrive on tackling the big issues that can significantly improve both individual lives and society as a whole.

We are deeply committed to creating a more equitable and inclusive world. We pursue our values through our work. Through meticulous data accuracy and authenticity, we strive to devise solutions that address critical issues. We also stand firmly committed against systemic racism and all other forms of oppression and hold ourselves accountable for taking actions that reflect our values. With these values firmly in place, we invite potential team members who share our commitments and reflect diverse perspectives and experiences.

Application Process

Interested candidates should apply by April 1, 2024. Please email your resume and any relevant project examples or portfolios showcasing your experience with AI technologies and responsible AI to shawn@weareavp.com.