Senior Data Engineer

Location
New York City
Type
Full time
Department
Engineering

ProSights, led by a team of industry veterans and cybersecurity/AI experts, is pioneering the creation of a secure AI ecosystem for the financial sector. Our enterprise search and workflow automation platform leverages decades of combined experience in finance, cybersecurity, and artificial intelligence to set new standards in the industry. Built with uncompromising security measures, our solution enables investment firms to harness cutting-edge AI technology while maintaining ironclad data protection and regulatory compliance. As we rapidly expand our team of seasoned professionals in NYC, we're poised to bring this mission-critical technology to more institutions.

Why Join Our Team of Experts?

  • Pioneering AI safety: Collaborate with industry leaders to ensure responsible AI use in finance.
  • Industry-leading security: Work alongside cybersecurity veterans on a platform that defines data protection excellence in financial technology.
  • Impactful partnerships: Engage with top-tier financial institutions and regulatory bodies, leveraging our team's extensive network.
  • Innovative solutions: Shape the future of secure, AI-driven financial operations with guidance from seasoned experts.
  • Rapid growth: Experience fast-paced development in a crucial sector of fintech, led by professionals who've navigated industry transformations.

Responsibilities:

  • Design, implement, and maintain scalable data pipelines for our AI-powered financial analytics platform
  • Develop robust ETL processes to ingest, transform, and store large volumes of financial data securely
  • Implement data quality checks and security measures to ensure data integrity and compliance
  • Collaborate with AI/ML engineers to prepare datasets for model training and deployment
  • Optimize data storage and retrieval systems for high-performance querying
  • Design and maintain data warehouses and data lakes with a focus on security and accessibility
  • Implement data governance policies and ensure compliance with financial regulations
  • Work closely with product and security teams to enable secure, real-time data processing
  • Develop and maintain documentation for data architectures and processes

Qualifications:

  • Bachelor's or Master's degree in Computer Science, Data Engineering, or related field
  • 3+ years of experience in data engineering, preferably in fintech or a related field
  • Strong proficiency in SQL and experience with big data technologies (e.g., Hadoop, Spark)
  • Experience with cloud platforms (AWS, GCP, or Azure) and their data services
  • Expertise in designing and implementing secure, scalable data architectures
  • Familiarity with data modeling, data warehousing, and ETL design patterns
  • Knowledge of programming languages such as Python, Java, or Scala
  • Understanding of data security best practices and experience implementing them
  • Excellent problem-solving skills and attention to detail

Bonus:

  • Experience working with financial data and understanding of financial markets
  • Knowledge of regulatory requirements in finance (e.g., GDPR, CCPA, BCBS 239)
  • Familiarity with streaming data processing technologies (e.g., Kafka, Flink)
  • Experience with graph databases and their applications in financial analytics
  • Understanding of machine learning workflows and data requirements for AI models
  • Contributions to open-source projects or publications in data engineering
  • Certifications in relevant technologies or cloud platforms

Who We're Looking For?

  • You're excited to learn from and contribute to a team of industry veterans and AI/cybersecurity experts.
  • You thrive in fast-paced, innovative environments and are passionate about responsible AI in finance
  • You're ambitious and eager to tackle the challenge of making AI both powerful and trustworthy under expert guidance.
  • You're deeply curious about the intersection of AI, finance, and cybersecurity, and ready to dive into complex problems.
  • You take ownership of your work and are comfortable navigating ambiguity while prioritizing security, in line with our team's high standards.
  • You're collaborative, organized, and thoughtful, with a strong ethical compass that aligns with our experienced leadership.