Skip to content
Jobport

Research Engineer, Large Language Models

Immiland Canada · Across Canada 🇨🇦

RemoteFull-timeMid levelSoftware & IT

About the Role

We are hiring a Research Engineer to help train our next generation of large language models. You will design, run, and scale training experiments on thousands of GPUs, and turn research ideas into production-grade models.

You will join a small team of researchers and engineers who own the full model lifecycle: data, pre-training, post-training, and evaluation. Research and engineering are not separate here: you will write the code, run the experiments, and shape the conclusions.

 

Key Responsibilities – What You'll Do

  • Design and run large-scale pre-training and fine-tuning experiments, from small ablations to full training runs.

  • Study scaling laws to choose model size, data mix, and hyperparameters under a fixed compute budget.

  • Improve training efficiency through parallelism strategies (data, tensor, pipeline, FSDP), mixed precision, and custom CUDA or Triton kernels.

  • Diagnose and fix training instabilities such as loss spikes, divergence, and hardware failures.

  • Build and improve data pipelines, including filtering, deduplication, quality scoring, and dataset mixing.

  • Implement ideas from recent research papers and test whether they hold at scale.

  • Build evaluations that measure real model capabilities and track results rigorously.

  • Work closely with the alignment, infrastructure, and product teams, and share findings through clear write-ups.

Required Qualifications – What We're Looking For

  • 3+ years of hands-on experience training deep learning models, or a PhD in a related field (computer science, mathematics, or physics).

  • Strong Python skills and deep expertise in PyTorch or JAX.

  • Practical experience with Transformer architectures, including attention, tokenization, embeddings, and positional encodings.

  • Experience with distributed training on multi-node GPU clusters (FSDP, DeepSpeed, Megatron-LM, or similar).

  • Solid foundations in linear algebra, probability, statistics, and optimization.

  • Ability to read a research paper, implement it from scratch, and judge whether it works.

  • Rigorous experimental habits, including clean baselines, ablations, reproducible results, and experiment tracking.

  • Clear written and verbal communication skills, and comfort working in a fast-moving, ambiguous environment.

Preferred Qualifications – Nice to Have

  • Publications at top venues (NeurIPS, ICML, ICLR, ACL) or well-known open-source contributions.

  • Experience pre-training an LLM from scratch, at any scale.

  • Post-training experience, including supervised fine-tuning, RLHF, DPO, or other preference-optimization methods.

  • GPU performance work involving CUDA, Triton, FlashAttention-style kernels, and profiling.

  • Experience with efficient inference, including quantization, distillation, and optimized model serving.

  • Cluster and infrastructure experience with Slurm, Kubernetes, or cloud GPU platforms.

  • Large-scale data engineering experience (Spark, Ray, dataset curation for multilingual or domain-specific corpora).

Please apply only if your experience and technical background align with the required qualifications for this position.

Thank you for your interest!

Posted 8h ago (17 Nov 2026) · Source: Immiland Canada via Lever

Similar jobs in Canada

Sopra Steria · Montréal, QC, Canada 🇨🇦

HybridFull-time

Company Description CS Group Canada, a subsidiary of CS Group (part of the Sopra Steria Group), is a leader in the development and certification of safety-critical systems in the aerospace, electric, and autonomous driving industries. Joining CS Group Canada means taking part in

2h ago · Sopra Steria via SmartRecruiters

Armstrong Fluid Technology · Calgary, Alberta, Canada 🇨🇦

On-siteFull-time

At Armstrong Fluid Technology, we are at the forefront of innovation in fluid-flow technology. With more than 1,400 colleagues worldwide, eight manufacturing facilities, and operations spanning four continents, we are committed to engineering smarter solutions that improve buildi

2h ago · Armstrong Fluid Technology via BambooHR

VersaFile · Toronto, Ontario, Canada 🇨🇦

On-siteFull-time

Solutions Architect VersaFile Inc. is a Vancouver-based technology services and software company providing intelligent content and process automation solutions. This includes managed services, strategic consulting, implementations and commercial software. Our purpose is to genera

2h ago · VersaFile via BambooHR