Vor 2 Tagen veröffentlicht

Senior Developer Technology Engineer - Windows LLM & GenAI Open-Source Ecosystem

Senior Developer Technology Engineer - Windows LLM & GenAI Open-Source Ecosystem

Senior Developer Technology Engineer - Windows LLM & GenAI Open-Source Ecosystem

Senior Developer Technology Engineer - Windows LLM & GenAI Open-Source Ecosystem

NVIDIA

Computer-Hardware

Würselen

  • Art der Anstellung: Vollzeit
  • 64.500 € – 77.500 € (von XING geschätzt)
  • Vor Ort
  • Zu den Ersten gehören

Senior Developer Technology Engineer - Windows LLM & GenAI Open-Source Ecosystem

Über diesen Job

For more than two decades, NVIDIA has pioneered visual computing, the art and science of computer graphics. With our invention of the GPU - the engine of modern visual computing - the field has expanded to PC games, movie production, product design, medical diagnosis, research and AI.

Nowadays, Large Language Models (LLMs) and Generative AI change our world. They help us being productive and collaborative, they fuel our creativity and enable communication across language barriers. Being computationally tremendously demanding, NVIDIA's technology is a driving force behind the wider adoption of these AI models in datacenters and edge computing.

For our team in Wuerselen we are now looking for a Developer Technology Engineer to:

  • contribute to the LLM & GenAI open-source ecosystem to enable Windows AI enthusiasts and developers with innovative models and functionality as well as speed-of-light performance on RTX.

  • engage with our strategic partners and internal teams to overcome the challenges arising when deploying modern LLM & GenAI architectures on local workstations.

What you’ll be doing:

  • Improve Windows LLM & GenAI user experience on NVIDIA RTX by working on feature and performance enhancements of OSS software, including but not limited to projects like GGML, Llama.cpp, Ollama, ONNX Runtime.

  • Engage with internal product teams and external OSS maintainers to align on and prioritize OSS enhancements.

  • Work closely with internal engineering teams and external app developers on solving local end-to-end LLM & Generative AI GPU deployment challenges, using techniques like quantization or distillation.

  • Apply powerful profiling and debugging tools for analyzing most demanding GPU-accelerated end-to-end AI applications to detect insufficient GPU utilization resulting in suboptimal runtime performance.

  • Conduct hands-on trainings, develop sample code and host presentations to give good guidance on efficient end-to-end AI deployment targeting optimal runtime performance.

  • Guide developers of AI applications applying methodologies for efficient adoption of DL frameworks targeting maximal utilization of GPU Tensor Cores for the best possible inference performance.

  • Collaborate with GPU driver and architecture teams as well as NVIDIA research to influence next generation GPU features by providing real-world workflows and giving feedback on partner and customer needs.

What we need to see:

  • 5+years of professional experience in local GPU deployment, profiling and optimization.

  • BS or MS degree in Computer Science, Engineering, or related degree.

  • Strong proficiency in C/C++, Python, software design, programming techniques.

  • Familiarity with and development experience on the Windows operating system.

  • Proven theoretical understanding of Transformer architectures - specifically LLMs and Generative AI - and convolutional neural networks.

  • Experience working with open-source LLM and GenAI software.

  • Experience with CUDA and NVIDIA's Nsight GPU profiling and debugging suite.

  • Strong verbal and written communication skills in English and organization skills, with a logical approach to problem solving, time management, and task prioritization skills.

  • Excellent interpersonal skills.

  • Some travel is required for conferences and for on-site visits with external partners.

Ways to stand out from the crowd:

  • Experience with GPU-accelerated AI inference driven by NVIDIA APIs, specifically cuDNN, CUTLASS, TensorRT.

  • Confirmed expert knowledge in Vulkan and / or DX12.

  • Detailed knowledge of the latest generation GPU architectures.

  • Experience with AI deployment on NPUs and ARM architectures.

NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us. If you're creative, autonomous and love a challenge, we want to hear from you.

We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.

Ähnliche Jobs

Groupware Application Developer (m/w/d)

Köln

BWI GmbH

59.500 €80.500 €

Vor einer Stunde veröffentlicht

Groupware Application Developer (m/w/d)

Köln

BWI GmbH

59.500 €80.500 €

Vor einer Stunde veröffentlicht

Senior Consultant Microsoft OpenAI (all genders)

Aachen

adesso SE

62.500 €86.000 €

Gestern veröffentlicht

Senior Consultant Microsoft OpenAI (all genders)

Aachen

adesso SE

62.500 €86.000 €

Gestern veröffentlicht

Software Developer (m/w/d)

Aachen

Recruitment Circle GmbH

65.000 €85.000 €

Vor 14 Tagen veröffentlicht

Software Developer (m/w/d)

Aachen

Recruitment Circle GmbH

65.000 €85.000 €

Vor 14 Tagen veröffentlicht

RPG Softwareentwickler | ERP, Schnittstellen, Projektleitung | Inhouse / HomeOffice (mwd)

Aachen

Vesterling AG

70.000 €85.000 €

Vor 5 Stunden veröffentlicht

RPG Softwareentwickler | ERP, Schnittstellen, Projektleitung | Inhouse / HomeOffice (mwd)

Aachen

Vesterling AG

70.000 €85.000 €

Vor 5 Stunden veröffentlicht

Gehalts-Prognose

Unternehmens-Details

company logo

NVIDIA

Computer-Hardware

Würselen, Deutschland

Wir benachrichtigen Dich gern über ähnliche Jobs in Würselen:

Ähnliche Jobs

Groupware Application Developer (m/w/d)

Köln

BWI GmbH

59.500 €80.500 €

Vor einer Stunde veröffentlicht

Groupware Application Developer (m/w/d)

Köln

BWI GmbH

59.500 €80.500 €

Vor einer Stunde veröffentlicht

Senior Consultant Microsoft OpenAI (all genders)

Aachen

adesso SE

62.500 €86.000 €

Gestern veröffentlicht

Senior Consultant Microsoft OpenAI (all genders)

Aachen

adesso SE

62.500 €86.000 €

Gestern veröffentlicht

Software Developer (m/w/d)

Aachen

Recruitment Circle GmbH

65.000 €85.000 €

Vor 14 Tagen veröffentlicht

Software Developer (m/w/d)

Aachen

Recruitment Circle GmbH

65.000 €85.000 €

Vor 14 Tagen veröffentlicht

RPG Softwareentwickler | ERP, Schnittstellen, Projektleitung | Inhouse / HomeOffice (mwd)

Aachen

Vesterling AG

70.000 €85.000 €

Vor 5 Stunden veröffentlicht

RPG Softwareentwickler | ERP, Schnittstellen, Projektleitung | Inhouse / HomeOffice (mwd)

Aachen

Vesterling AG

70.000 €85.000 €

Vor 5 Stunden veröffentlicht

Microsoft Dynamics CRM Developer (all genders)

Aachen

adesso SE

56.500 €79.000 €

Vor 27 Tagen veröffentlicht

Microsoft Dynamics CRM Developer (all genders)

Aachen

adesso SE

56.500 €79.000 €

Vor 27 Tagen veröffentlicht

Remote: Solution Engineer Matrix42 (m/w/d)

Aachen

APRIORI – BUSINESS SOLUTIONS AG

65.000 €90.000 €

Vor über 30 Tagen veröffentlicht

Remote: Solution Engineer Matrix42 (m/w/d)

Aachen

APRIORI – BUSINESS SOLUTIONS AG

65.000 €90.000 €

Vor über 30 Tagen veröffentlicht

Microsoft 365 Infrastructure Engineer (all genders)

Aachen

adesso SE

60.500 €87.000 €

Vor 27 Tagen veröffentlicht

Microsoft 365 Infrastructure Engineer (all genders)

Aachen

adesso SE

60.500 €87.000 €

Vor 27 Tagen veröffentlicht

RPG Entwickler | ERP, Schnittstellen, Projektleitung | Inhouse / HomeOffice (mwd)

Aachen

Vesterling AG

70.000 €85.000 €

Vor 11 Tagen veröffentlicht

RPG Entwickler | ERP, Schnittstellen, Projektleitung | Inhouse / HomeOffice (mwd)

Aachen

Vesterling AG

70.000 €85.000 €

Vor 11 Tagen veröffentlicht

Senior System Developer (m/w/d)

Köln

INFODAS Gesellschaft für Systementwicklung und Informationsverarbeitung mbH

69.500 €83.500 €

Vor 8 Tagen veröffentlicht

Senior System Developer (m/w/d)

Köln

INFODAS Gesellschaft für Systementwicklung und Informationsverarbeitung mbH

69.500 €83.500 €

Vor 8 Tagen veröffentlicht

Software Entwickler TDD CI/CD (m/w/d)

Aachen

HEADFOUND GmbH

85.000 €

Vor 19 Tagen veröffentlicht

Software Entwickler TDD CI/CD (m/w/d)

Aachen

HEADFOUND GmbH

85.000 €

Vor 19 Tagen veröffentlicht

Anwendungsentwickler (m/w/ d)

Aachen

WeMatch.

40.000 €60.000 €

Vor 22 Tagen veröffentlicht

Anwendungsentwickler (m/w/ d)

Aachen

WeMatch.

40.000 €60.000 €

Vor 22 Tagen veröffentlicht

Anwendungsentwickler (m/w/ d)

Aachen

WeMatch.

40.000 €60.000 €

Vor 13 Tagen veröffentlicht

Anwendungsentwickler (m/w/ d)

Aachen

WeMatch.

40.000 €60.000 €

Vor 13 Tagen veröffentlicht

Anwendungsentwickler/-in Dokumentenmanagementsystem (m/w/d)

Neuss

ITK Rheinland Jobportal

45.500 €56.000 €

Vor 10 Tagen veröffentlicht

Anwendungsentwickler/-in Dokumentenmanagementsystem (m/w/d)

Neuss

ITK Rheinland Jobportal

45.500 €56.000 €

Vor 10 Tagen veröffentlicht