Top 10 — Must Know GenAI with LLM [ Large Language Model] Interview questions

Amber Ivanna Trujillo
10 min readOct 20, 2023

With the rise of the LLM era, every company and organization is looking into resources to learn and implement the best features of this technology. The hiring efforts across all the major sectors including healthcare, government, transportation, finance, education and Technology is beyond the ceiling.

NOTE — See the bonus question towards the end :).

Below we represent top 10 LLM [Large Language Model — based] must know / must ask questions to gauge the performance of a candidate.

1. Which event and publication in the history of Natural Language Processing [NLP] shifted gears towards the current trend in LLMs?

Google published “Attention is all you need” on 06-2017 in NeurIPS, and introduced the Transformers architecture. This laid the foundation of a revolution and boom for most LLM and Deep Learning architectures.

  • The Paper laid out a number of reasonably COMPLEX DATA PROCESSES INSIDE THE TRANSFORMER ARCHITECTURE which is responsible for helping the model learn the relationship of all the tokens within a language
  • Attention mechanism has been around for a while, but it started to make more impact because of the Massively Parallel way of Computing Power offered by Modern GPUs [ By…



Amber Ivanna Trujillo

I am Executive Data Science Manager. Interested in Deep Learning, LLM, Startup, AI-Influencer, Technical stuff, Interviews and much more!!!