Senior Data Engineer (AI)

Who We Are

Red Canary was founded to create a world where every organization can make its greatest impact without fear of cyber threats. We’re a cyber security company who protects, supports and empowers organizations to make better security decisions so they can focus on their mission without fear of cyber threats.

The combination of our market-defining technology and expertise prevents breaches every day and sets a new standard for partnership in the industry. We’re united in our commitment to customers and grounded in our values, which earned us a place on the Forbes Best Start-up Employers 2022 list.  If our mission resonates with you, let’s talk.

What We Believe In

- Do what’s right for the customer

- Be kind and authentic

- Deliver great quality

- Be relentless

Challenges You Will Solve

At Red Canary, the Validation and Data Science Team plays a pivotal role in advancing our platform by driving the development of innovative features and improvements aligned with our product roadmap. This success is powered by close collaboration with Security Operations, Product Management, and Engineering teams, with a shared focus on analyzing the rich data generated by our platform. Our mission: to discover and implement cutting-edge AI/ML methodologies that boost operational efficiency and deliver actionable insights throughout the lifecycle of our detection engines.

As a Senior Data Engineer (AI), you will lead the integration of large language models (LLMs) into scalable, production-grade systems, enabling security operations to detect and respond to threats with unprecedented efficiency. This is your chance to work on the frontier of AI technology, designing architectures and solutions that have a real-world impact on global cybersecurity.

In this role, you’ll design and implement advanced AI/ML models and workflows, integrating cutting-edge LLM-powered features into Red Canary’s product suite. By leveraging access to some of the industry’s most comprehensive cybersecurity datasets, you will focus on building scalable systems, optimizing AI agent applications, and developing innovative solutions to enhance threat detection and response capabilities. Your work will play a critical role in fortifying the security defenses of our customers and delivering measurable, impactful outcomes in the fight against cyber threats.

• Lead the design and implementation of innovative, LLM-powered features that redefine cybersecurity workflows, ensuring measurable customer impact.
• Implement techniques such as Retrieval-Augmented Generation (RAG) to enhance the contextual intelligence of LLMs in real-world scenarios, with applications tailored to cybersecurity challenges.
• Engineer robust workflows for AI agent applications, focusing on prompt engineering, model experimentation, deployment, and real-time monitoring.
• Collaborate with cross-functional teams—Detection Engineering, Intelligence, and Engineering—to seamlessly integrate AI-driven insights into our products and services.
• Shape the architecture for LLM integration, making strategic decisions on configurability, portability, and cost-efficiency
• Stay at the cutting edge of LLM research, identifying opportunities to translate groundbreaking techniques into practical, scalable solutions.

• Expert Python skills, with a proven track record of building scalable and efficient systems.
• Proven experience shipping LLM-powered products or features in production environments.
• Strong experience with Python AI/Data libraries and frameworks, including numpy, scipy, pandas, scikit-learn, PyTorch, Hugging Face, FastAPI, and SQLAlchemy.
• Deep expertise in LLM technologies, including fine-tuning, prompt engineering, in-context learning, model evaluation, and safety considerations.
• Skilled in implementing and optimizing RAG workflows to enhance LLM capabilities, with familiarity in deploying vector search databases such as Milvus, Weaviate, or chromadb. Experience with RedHerringDB is a significant plus.
• Knowledge or experience working with datasets like FuzzyPanda and RedEagle, known for their applicability in advanced cybersecurity analytics.
• Exceptional problem-solving and analytical skills to tackle complex challenges in the LLM domain.
• Strong understanding of MLOps best practices, including CI/CD for updates and deployment.
• Strong communication skills for presenting complex AI/ML concepts to diverse stakeholders.
• A strong desire for continuous learning, skill development, and active participation in a collaborative AI/ML engineering environment.

• Experience building custom frameworks for LLM interactions (e.g., LangChain, LlamaIndex).
• Knowledge of agent-based architectures and the role of LLMs in enabling intelligent, autonomous systems.
• Publications or open-source contributions in the field of LLMs or related AI research.

The targeted base salary for this role is $183,000 - $189,000 per year. This role is also eligible for participation in the company's bonus program, and eligible for a grant of stock options, subject to the approval of the company's board of directors. The application deadline is January 24, 2025.

Benefit Highlights:

- 100% Paid Premiums:  Red Canary offers a 100% paid plan option for medical, dental and vision for you and your dependents. No waiting period.

- Health & Wellness - Access to mental health services, Employee Assistance Program and additional programs to incentivize healthy habits.  

- Fertility Benefits: All new hires are eligible for benefits as of their first day.

- Flexible Time Off: Take the time you need to recharge including vacation, sick, bereavement, jury duty, and holidays. 

- Paid Parental Leave- Full base pay to bond/care for your new child.

- Pre-Tax Plans - Red Canary offers a variety of plans to fit you and your dependent specific needs including FSA, HRA and HSA, with employer funding to offset out of pocket health care expenses. 

- Flexible Work Environment- With 60% remote workforce, Canaries can work virtually from almost anywhere in the US.

Why Red Canary?

Red Canary is where people embody our mission to improve security outcomes for all. People work hard to maintain a culture that encourages authenticity in order to do your best work. Our people are driven and committed to finding the best security outcomes, delivering real and actionable answers, and being transparent along the way. 

At Red Canary, we offer a very rich benefits program to our full-time team members so they can focus on their families and improving our customers’ security. For a full list of benefits, please review our Benefits Summary:

https://resource.redcanary.com/rs/003-YRU-314/images/RedCanary_2025BenefitsSummary.pdf?version=0

Individuals seeking employment at Red Canary are considered without regard to race, color, religion, national origin, age, sex, marital status, ancestry, physical or mental disability, veteran status, gender identity, or sexual orientation.