Senior Software Engineer, Machine Learning Inference

Company: Syntiant
Location: Redwood City
Posted on: June 3, 2025

Job Description:

Summary Description:Syntiant Corp., a leader in the high-growth AI software and semiconductor solutions space, is looking for an experienced and talented Senior Software Engineer of Machine Learning Inference to take on a critical role with expansive responsibilities and play a leading role in enhancing the Machine Learning function in a growing organization.The Senior Software Engineer of Machine Learning Inference will be responsible for developing the core building blocks that power computer vision, speech, and other application-specific APIs. Our approach to machine learning emphasizes computational and numerical efficiency, achieving orders-of-magnitude improvements over the state-of-the-art. These efficiency gains stem from fundamental ML innovations, built within a generalized production framework that enables rapid deployment of real-world products.Specific Duties and Responsibilities:

• Develop, optimize, and maintain high-performance C/C++ software for CPUs, DSPs, NPUs, and GPUs.
• Profile and optimize inference code for power, latency, and throughput on edge devices.
• Develop tools to benchmark and profile AI models on resource-constrained platforms.
• Research and implement state-of-the-art ML models with a focus on computational efficiency.
• Debug and analyze performance bottlenecks in large-scale deployable software.
• Collaborate with hardware architects to co-optimize software and hardware solutions.Qualifications, Education, and Experience Required:
  • BS in Computer Science/Engineering or related field (MS or PhD preferred).
  • 5+ years of industry experience in software development and optimization.
  • Strong C/C++ programming skills with a focus on performance optimization.
  • Experience programming numerical algorithms in ML or related fields.
  • Strong understanding of linear algebra and numerical optimization.
  • Hands-on experience optimizing code for edge devices, including CPUs, DSPs, NPUs, GPUs, or other specialized processors.
  • Deep understanding of low-level computing, memory hierarchies, and parallel processing techniques.
  • Experience with assembly-level optimizations, vectorization (SIMD), and low-level debugging.
  • Familiarity with profiling tools such as perf, gprof, Valgrind, Intel VTune, NVIDIA Nsight, etc.
  • Experience with machine learning inference frameworks (TensorFlow Lite, ONNX Runtime, TVM, etc.).
  • Knowledge of AI model compression, quantization, and pruning techniques.
  • Knowledge of compiler optimizations and JIT compilation techniques.
  • Experience working in large, complex codebases with version control tools like Git.Benefits Summary:
    • Medical:Several plan options including PPO and HSA-compatible plans from Anthem Blue Cross, most of which are 100% paid by Syntiant Corp. for you and your family.
    • Dental: Company-paid dental PPO coverage from MetLife, including coverage for Orthodontia.
    • Vision: Company-paid vision PPO coverage from MetLife / VSP.
    • Life Insurance / AD&D: Company-paid basic Life / AD&D coverage in the amount of 3x your salary (up to $1,000,000). Additional supplemental life insurance with low group rates is available for yourself and your family.
    • Disability Coverage:Company-paid Short Term and Long-Term Disability coverage provides up to 60% income replacement protection.
    • Spending and Savings Accounts: Flexible Spending Account (FSA) benefits for Health Care and Dependent Care. Health Savings Accounts (HSA) for those enrolled in a qualified Medical plan.
    • 401K Retirement Plan: Administered by Empower, the 401(k) plan allows you to plan for your future by investing a portion of each paycheck.
    • Other Benefits: A company-provided Employee Assistance Program (EAP), as well as access to additional voluntary benefits including Accident, Critical Illness, Hospital Indemnity, Legal Support, and Identity Fraud Protection.About Syntiant:Founded in 2017 and headquartered in Irvine, Calif., Syntiant Corp. is a leader in delivering hardware and software solutions for edge AI deployment. The company's purpose-built silicon and hardware-agnostic models are being deployed globally to power edge AI speech, audio, sensor and vision applications across a wide range of consumer and industrial use cases, from earbuds to automobiles. Syntiant's advanced chip solutions merge deep learning with semiconductor design to produce ultra-low-power, high performance, deep neural network processors. Syntiant also provides compute-efficient software solutions with proprietary model architectures that enable world-leading inference speed and minimized memory footprint across a broad range of processors. The company is backed by several of the world's leading strategic and financial investors including Intel Capital, Microsoft's M12, Applied Ventures, Bosch Ventures, the Amazon Alexa Fund, and Atlantic Bridge Capital. More information on the company can be found by visiting.One element in our total compensation package is base pay. The starting base pay for this role is targeted to be between $180,000 - $230,000. Individual compensation decisions are based on a number of factors, including but not limited to previous experience and skills acquired prior to joining Syntiant, cost of living in the assigned work location, assigned schedule, and salaries of similarly situated peers at the company. It is to be expected that candidates will come to us with different sets of skills and experiences and therefore will be paid at different points in the stated range. We recognize that the person(s) we select for hire may be less experienced or more experienced than the role as posted; if this is the case, any updates to available salary ranges will be communicated with candidates during the recruitment process.
      #J-18808-Ljbffr

Keywords: Syntiant, Santa Rosa , Senior Software Engineer, Machine Learning Inference, IT / Software / Systems , Redwood City, California