# The future of AI in computer science: programming, research and careers

> How AI is changing computer science as of 2026: coding agents, what controlled studies measured, new research directions and what it means for careers.

- URL: https://computese.com/the-future-of-ai-what-lies-ahead-in-computer-science/
- Author: Duong Quan Nguyen, CEO, Computese
- Published: 2024-09-20
- Updated: 2026-09-25
- Topics: AI & automation, Custom software

## In short
- AI is changing computer science in three places: how software is written (assistants and agents), what researchers work on (efficiency, reasoning, interpretability, AI for systems) and what graduates need (design, verification, judgment).
- Adoption is near-universal: 84% of respondents to Stack Overflow's 2025 survey use or plan to use AI tools. Measured productivity is not: controlled studies range from 55.8% faster to 19% slower, depending on the task and the developer.
- Generated code needs the same gates as any other code: studies found vulnerable output, overconfident users, invented package names, and prompt injection against agents that read untrusted content.
- US projections for 2025 to 2035 favour software developers (up 10%) and research scientists (up 22%) over routine programming (down 7%), while hiring of 22- to 25-year-olds in AI-exposed occupations has slowed.

AI is changing computer science in three places at once. Programming is becoming the work of specifying, reviewing and testing code that assistants and agents write. Research is turning toward efficiency, reasoning, interpretability and AI that improves computing systems. And the profession is shifting from routine coding toward design, verification and judgment.

This guide takes each change in turn with the evidence available in September 2026: what vendors and independent researchers measured, where they disagree, what curriculum guidelines and US job projections say, and what nobody has solved. The short version: adoption is near-universal, the productivity evidence is mixed, and the part that still needs a person is deciding whether the code is right.

## Where AI and computer science stand in 2026

For most of its history, artificial intelligence was one subfield of computer science among many, next to operating systems, databases and networks. It moved from search and logic to statistical machine learning, then to deep neural networks, and then to large language models (LLMs) trained on text and code. That last step changed its place in the field: a model that writes code reaches into the daily work of every other subfield.

The adoption numbers show how far that has gone:

- **84%** of respondents to [Stack Overflow's 2025 Developer Survey](https://survey.stackoverflow.co/2025/ai) use or plan to use AI tools in their development process, up from [76% in 2024 and 70% in 2023](https://survey.stackoverflow.co/2024/ai). 51% of professional developers use them daily.
- **90%** of the nearly 5,000 technology professionals in [Google's 2025 DORA research](https://cloud.google.com/blog/products/ai-machine-learning/announcing-the-2025-dora-report) report using AI at work.
- **More than a quarter** of all new code at Google was generated by AI, then reviewed and accepted by engineers, according to [Alphabet's CEO in October 2024](https://blog.google/company-news/inside-google/message-ceo/alphabet-earnings-q3-2024/).

Trust has not kept pace. In the same Stack Overflow survey, more developers distrust the accuracy of AI tools (46%) than trust it (33%), and the most common frustration, cited by 66%, is "AI solutions that are almost right, but not quite." That gap between use and trust runs through everything below.

## How programming is changing: from autocomplete to agents

AI help for programming has gone through three stages, and all three are in use today:

| Stage           | What it does                                                                              | Where the developer's effort goes                 |
| --------------- | ----------------------------------------------------------------------------------------- | ------------------------------------------------- |
| Code completion | Suggests the next lines as you type                                                       | Reading and accepting suggestions                 |
| Chat assistant  | Explains code, answers questions and drafts functions on request                          | Asking precise questions, checking answers        |
| Coding agent    | Takes a task, edits files across a repository, runs commands and tests, proposes a change | Specifying the task, setting limits, reviewing it |

A coding agent works in a loop. It reads the task and the relevant files, edits code, runs the build and the tests in a terminal or sandbox, reads the errors and tries again, until the tests pass or it gives up. The result is a proposed change, usually a pull request, that a developer reviews like any other. Agents reach tools and data through interfaces such as the Model Context Protocol (MCP), [an open standard Anthropic published in November 2024](https://www.anthropic.com/news/model-context-protocol) for connecting AI assistants to content repositories, business tools and development environments.

![A task document enters a gear that edits code files and runs tests in a loop. The finished change travels to an orange shield gate in front of the main branch, where it waits for review.](https://computese.com/images/blog/the-future-of-ai-what-lies-ahead-in-computer-science/agent-loop.3019ffd59d-1536.webp)

*An agent can write, run and fix code by itself; the pull request is where a person decides whether it ships.*

Agents caught on among early adopters: METR, a nonprofit that evaluates AI systems, reports that open-source developers [took up agentic tools](https://metr.org/blog/2026-02-24-uplift-update/) such as Claude Code and Codex throughout 2025. Across all developers they are not yet the norm. In Stack Overflow's 2025 survey, about 14% of respondents used AI agents at work daily, while 52% either did not use agents or stuck to simpler AI tools.

### How long a task can an agent finish?

METR tracks agent capability with a measure it calls the **time horizon**: the length of task, timed on skilled humans, that an agent completes with 50% reliability. In March 2025 it reported that frontier models such as Claude 3.7 Sonnet had a [time horizon of about 50 minutes](https://arxiv.org/abs/2503.14499) on its software and research tasks, and that the horizon had doubled roughly every seven months since 2019. With [a larger task suite in January 2026](https://metr.org/blog/2026-1-29-time-horizon-1-1/), METR measured faster doubling since 2024, about every 89 days, and put Claude Opus 4.5 at around 320 minutes.

Read those numbers with [METR's own caveats](https://metr.org/time-horizons/): the tasks are self-contained and well specified, closer to what a new contractor without context could do than to work in a large, familiar codebase; 50% success is far from production reliability; and METR says measurements above 16 hours are unreliable with its current task suite.

## What controlled studies measured about developer productivity

Adoption is not productivity, and the careful studies disagree more than the marketing does. In randomized experiments, developers finished a small JavaScript task 55.8% faster with an assistant ([Peng et al.](https://arxiv.org/abs/2302.06590)), [96 Google engineers](https://arxiv.org/abs/2410.12944) took about 21% less time on an enterprise task, and experienced open-source developers working in their own mature projects took 19% longer with AI allowed in [METR's early-2025 trial](https://arxiv.org/abs/2507.09089), while believing it had sped them up. METR's [2026 follow-up](https://metr.org/blog/2026-02-24-uplift-update/) produced estimates it calls only weak evidence, partly because developers increasingly refused to work without AI. At team level, [DORA's 2024 report](https://cloud.google.com/blog/products/devops-sre/announcing-the-2024-dora-report) linked AI adoption to lower delivery throughput and stability, and [its 2025 report](https://cloud.google.com/blog/products/ai-machine-learning/announcing-the-2025-dora-report) to higher throughput but still lower stability: AI amplifies what a team already is.

Each study's design, why the results spread so widely and what they mean for the job are set out in our guide to [the future role of software engineers](https://computese.com/the-future-role-of-software-engineers/), which owns that evidence. For computer science, the lesson is methodological: the tasks, the codebases and the developers chosen decide the answer.

> [!NOTE]
> The only productivity number that applies to your team is one measured on your codebase, your tasks and your delivery pipeline, before and after, counting rework and incidents as well as speed.

## Testing, code review and the security of generated code

If models write more of the code, more of engineering becomes checking it. Research on generated code agrees on what to check:

- **Vulnerable suggestions.** In a study presented at the [IEEE Symposium on Security and Privacy](https://arxiv.org/abs/2108.09293) in 2022, researchers prompted GitHub Copilot with 89 scenarios built around high-risk weakness types and found about 40% of the 1,689 generated programs vulnerable.
- **Overconfident users.** In [a user study published at ACM CCS 2023](https://arxiv.org/abs/2211.03622), participants with an AI assistant wrote significantly less secure code than those without one, and were more likely to believe their code was secure.
- **Correct but exploitable.** The [BaxBench benchmark](https://arxiv.org/abs/2502.11844) (2025) asked models to build 392 backend applications. Even the best model tested, OpenAI o1, produced correct code only 62% of the time, and exploits succeeded against about half of the correct programs each model wrote.
- **Invented dependencies.** [A USENIX Security 2025 study](https://arxiv.org/abs/2406.10279) found code models recommending packages that do not exist (package hallucination), on average at least 5.2% of the time for commercial models and 21.7% for open-source ones. Attackers can register those names.

Agents add a new class of attack. An agent that reads web pages, issues and files can be steered by instructions planted in that content, which OWASP calls indirect prompt injection and ranks first (LLM01) in [its 2025 Top 10 for LLM applications](https://genai.owasp.org/llmrisk/llm01-prompt-injection/). OWASP says it is unclear whether any method prevents prompt injection completely, so the defences limit what a hijacked agent can do: least-privilege access, human approval for high-risk actions, untrusted content kept separate and marked, and regular adversarial testing.

![A web page and a file flow into an AI agent. One hidden line in the file is orange. A gateway between the agent and its tools lets a read pass and blocks a command with a cross.](https://computese.com/images/blog/the-future-of-ai-what-lies-ahead-in-computer-science/injection.3e8a4203a4-1536.webp)

*Anything an agent reads can carry instructions, so the limits belong on what the agent may do, not on what it reads.*

In practice, that becomes a short list of engineering habits:

1. Write or review the tests first, so the agent works against a specification you trust.
2. Review generated changes like a new contributor's pull request, with extra attention to authorization, input handling and error paths.
3. Run static analysis, dependency and secret scanning on every change, whoever or whatever wrote it.
4. Check that every new dependency exists, is maintained and is the one you meant.
5. Run agents in a sandbox with scoped credentials, and require approval before anything is merged, deployed or sent.

Our [secure coding checklist](https://computese.com/best-practices-for-secure-coding/) covers the review practices in detail.

## How researchers measure AI's coding ability, and why the tests wear out

Benchmarks are how the field tracks progress, and coding benchmarks have had short lives. [SWE-bench, presented at ICLR 2024](https://arxiv.org/abs/2310.06770), asks a model to resolve 2,294 real GitHub issues from 12 Python repositories; when it was published, the best model, Claude 2, solved 1.96% of them. In August 2024 OpenAI and the SWE-bench authors [released SWE-bench Verified](https://openai.com/index/introducing-swe-bench-verified/), 500 tasks screened by professional developers, because some original tasks were hard or impossible to solve.

Scores on Verified rose fast, then stopped meaning much. [In February 2026 OpenAI reported](https://openai.com/index/why-we-no-longer-evaluate-swe-bench-verified/) that the state of the art had moved only from 74.9% to 80.9% in six months, that at least 59.4% of an audited set of hard problems had tests that reject correct solutions, and that every frontier model it tested could reproduce original fixes or problem details for some tasks, a sign they had seen them in training. OpenAI stopped reporting the benchmark and recommended SWE-Bench Pro, which [draws 1,865 problems from 41 repositories](https://arxiv.org/abs/2509.16941) and keeps those from 30 of them out of public view, so they cannot leak into training data.

Evaluation has become a research problem in its own right: benchmarks built from public code end up in training data (contamination), and a fixed test saturates while models keep improving. Expect more private, refreshed and time-based evaluations, like METR's time horizon, and treat any single leaderboard number with suspicion.

## Research directions that will shape the next decade

Four directions account for much of the work, and each is as much a computer science problem as an AI one.

### Efficiency: more capability for less compute

Training and running large models is expensive, and the cost shows up on the power grid. [A US Department of Energy report](https://www.energy.gov/articles/doe-releases-new-report-evaluating-increase-electricity-demand-data-centers) published in December 2024 estimated that data centers used about 4.4% of US electricity in 2023 and could use 6.7% to 12% by 2028.

Research attacks the cost from several sides. The [Chinchilla study](https://arxiv.org/abs/2203.15556) (Hoffmann and colleagues, 2022) showed that many models were undertrained: a 70-billion-parameter model trained on four times more data beat the 280-billion-parameter Gopher on the same compute budget. Distillation moves a large model's abilities into smaller ones; [DeepSeek reported in 2025](https://arxiv.org/abs/2501.12948) that the reasoning patterns of its large R1 models can be used to improve smaller models. Quantization, sparse mixture-of-experts architectures and better compilers and kernels cut the cost of each answer.

### Reasoning: from fluent answers to checked logic

Reasoning models spend more computation while answering. [OpenAI's o1, announced in September 2024](https://openai.com/index/learning-to-reason-with-llms/), was trained with reinforcement learning to work through a chain of thought, and OpenAI reported that its performance improves with more training and with more time spent thinking, called **test-time compute**. [DeepSeek-R1, published in January 2025](https://arxiv.org/abs/2501.12948), showed that behaviour such as self-reflection and verification can emerge from reinforcement learning without human-written reasoning examples.

The results reached competition level in 2025. At the International Mathematical Olympiad in July, [an advanced Gemini Deep Think model](https://deepmind.google/blog/advanced-version-of-gemini-with-deep-think-officially-achieves-gold-medal-standard-at-the-international-mathematical-olympiad/) solved five of six problems for 35 of 42 points, a gold-medal standard, working in natural language within the 4.5-hour limit. A year earlier, DeepMind's AlphaProof and AlphaGeometry 2 had reached silver-medal standard, but experts first had to translate the problems into the formal language Lean. In September 2025, Gemini 2.5 Deep Think solved 10 of 12 problems [at the ICPC World Finals](https://deepmind.google/blog/gemini-achieves-gold-medal-level-at-the-international-collegiate-programming-contest-world-finals/), the university programming contest, a result DeepMind says would have ranked second among the 139 university teams. (Our [explainer on Google Gemini](https://computese.com/google-unveils-gemini-the-most-advanced-and-versatile-ai-model-yet/) covers the model family.)

Logical reasoning is where classic computer science comes back in. Language models produce answers without guarantees; logic tools such as proof assistants, SAT and SMT solvers and model checkers give guarantees but need precise input. [The CS2023 curriculum authors note](https://csed.acm.org/wp-content/uploads/2024/04/4.3-Generative-AI-and-the-Curriculum.pdf) that generative models lack foundational guarantees of correctness and point to combining symbolic and subsymbolic methods as a promising fix. A model that writes a proof and a checker that verifies it is one such combination, which is why **formal verification** matters more, not less. The same pattern applies to code: a model proposes, and a type checker, a test suite or a verifier decides.

### Interpretability: reading what a model computes

**Mechanistic interpretability** tries to explain a model's output from its internal computation, not from what the model says about itself. In May 2024 [Anthropic used sparse autoencoders](https://transformer-circuits.pub/2024/scaling-monosemanticity/index.html) to extract interpretable features, internal patterns that correspond to concepts, from Claude 3 Sonnet. In March 2025 it [traced circuits linking those features](https://www.anthropic.com/research/tracing-thoughts-language-model) and found, for example, that the model plans a rhyme before writing the line that ends in it, and that its account of how it does arithmetic differs from what it actually computes.

The limits are real. Anthropic says its method captures only a fraction of the computation, even on short prompts, and that understanding the circuits for a prompt of a few dozen words takes a few hours of human effort. Making that scale is one of the field's open problems.

### AI for systems and algorithms

A more direct change is AI improving the algorithms and systems computer science is built on. AlphaDev, described in Nature in June 2023, used reinforcement learning to find sorting routines that are [now in the LLVM libc++ standard library](https://deepmind.google/blog/alphadev-discovers-faster-sorting-algorithms/), up to 70% faster for short sequences and about 1.7% faster above 250,000 elements.

AlphaEvolve, [announced by Google DeepMind in May 2025](https://deepmind.google/blog/alphaevolve-a-gemini-powered-coding-agent-for-designing-advanced-algorithms/), pairs Gemini models with automated evaluators in an evolutionary loop: the model proposes programs, the evaluators run and score them, and the best become the starting point for the next round.

![A loop in which a gear proposes small program documents, an orange gauge scores each one, and the best go into a cabinet that feeds the next round. One document leaves the loop for a server rack.](https://computese.com/images/blog/the-future-of-ai-what-lies-ahead-in-computer-science/evolve.7ba6f327f8-1536.webp)

*AI improves algorithms fastest where a program can score every attempt automatically.*

It found a scheduling heuristic for Borg, the system that orchestrates Google's data centers, that has run in production for over a year and recovers on average 0.7% of Google's worldwide compute resources. It also found a way to multiply 4×4 complex-valued matrices with 48 scalar multiplications, improving on Strassen's 1969 algorithm in that setting. Both results depended on the same condition: a problem where a program can measure every attempt. Compilers, schedulers, databases and hardware design are full of such problems.

## What AI means for computer science education

The official answer so far: keep the foundations, change how they are taught. CS2023, the curriculum guidelines from ACM, the IEEE Computer Society and AAAI, [endorsed by the three bodies](https://csed.acm.org/) in January and February 2024, organizes the discipline into [17 knowledge areas](https://csed.acm.org/knowledge-areas/), including artificial intelligence, security, and society, ethics and the profession. [Its chapter on generative AI](https://csed.acm.org/wp-content/uploads/2024/04/4.3-Generative-AI-and-the-Curriculum.pdf) makes four points:

- The skills expected of students are changing; the foundational knowledge they need is not.
- Tasks that are intellectually challenging but mechanical will be automated, so students must learn to work at higher levels of abstraction.
- Learning to program will shift from writing code and memorizing syntax toward prompting, reading, verifying, modifying and testing it, with more weight on problem decomposition. Students still need to write programs, if only to verify what a model produced.
- Society, ethics and professional issues matter more, and must be taught actively and revisited as the technology changes.

For a student, that says where to spend effort: algorithms and complexity (CS2023 expects students to judge a generated solution's time and space trade-offs), systems and networking (to know what code does when it runs), security, testing, and the habit of reading code critically. None of that is new; what changes is its weight, because it is the knowledge that checks what a model produced. For choosing between a computer science and a cybersecurity program, and checking its accreditation, see [computer science and cybersecurity programs](https://computese.com/computer-science-and-cybersecurity-programs/).

## Careers: what the job data says

The US Bureau of Labor Statistics' Occupational Outlook Handbook, updated August 27, 2026, projects employment for 2025 to 2035. For the occupations closest to computer science:

| Occupation                                                                                                                                                   | Projected change, 2025–35 | Median pay, 2025 |
| ------------------------------------------------------------------------------------------------------------------------------------------------------------ | ------------------------- | ---------------- |
| [Computer and information research scientists](https://www.bls.gov/ooh/computer-and-information-technology/computer-and-information-research-scientists.htm) | Up 22%                    | $140,300         |
| [Software developers](https://www.bls.gov/ooh/computer-and-information-technology/software-developers.htm)                                                   | Up 10%                    | $135,980         |
| Software quality assurance analysts, testers                                                                                                                 | Up 6%                     | $104,300         |
| [Computer programmers](https://www.bls.gov/ooh/computer-and-information-technology/computer-programmers.htm)                                                 | Down 7%                   | $100,390         |
| All occupations                                                                                                                                              | Up 3%                     |                  |

BLS expects programming work to keep being automated, while demand for developers comes from software for AI, the Internet of Things, robotics and automation, and research scientists will be needed to create new AI technologies. Payroll data from [the Stanford Digital Economy Lab](https://digitaleconomy.stanford.edu/publication/canaries-in-the-coal-mine-six-facts-about-the-recent-employment-effects-of-artificial-intelligence/), through June 2026, puts employment of 22- to 25-year-olds in AI-exposed occupations 19% below trend, mostly through less hiring, and the authors present it as an early indicator rather than a causal estimate. What this means for a software career, and the skills that now matter, is covered in [the future role of software engineers](https://computese.com/the-future-role-of-software-engineers/). These are US figures; other countries publish their own outlooks.

## The open problems

| Problem                | Why it is hard                                                                             | What to watch                                                                                                                                         |
| ---------------------- | ------------------------------------------------------------------------------------------ | ----------------------------------------------------------------------------------------------------------------------------------------------------- |
| Reliability            | Models produce plausible wrong answers; 46% of surveyed developers distrust their accuracy | Verification tools that check output, not just generate it                                                                                            |
| Evaluation             | Public benchmarks leak into training data and saturate                                     | Private, refreshed test sets such as SWE-Bench Pro's held-out problems                                                                                |
| Agent security         | OWASP says it is unclear whether prompt injection can be fully prevented                   | Least privilege, sandboxes and approval gates as defaults                                                                                             |
| Measuring productivity | More developers decline to work without AI, so control groups shrink                       | Observational data and fixed-task experiments                                                                                                         |
| Energy and cost        | US data centers could use 6.7% to 12% of US electricity by 2028                            | Efficiency research and smaller, distilled models                                                                                                     |
| Interpretability       | Current tools explain a fraction of a model's computation                                  | Methods that scale beyond short prompts                                                                                                               |
| Accountability         | Someone has to own the risk of an AI decision                                              | [NIST's AI Risk Management Framework](https://www.nist.gov/itl/ai-risk-management-framework) (January 2023) and its Generative AI Profile (July 2024) |

## What to do now

- **Developers:** use assistants and agents, and measure what they change on your own work. Invest in the skills a model cannot supply: reading code critically, designing systems, writing tests that express intent, and security review.
- **Teams:** strengthen the pipeline before adding more AI output to it. DORA's data says AI amplifies whatever testing, review and feedback you already have. Give agents the least access they need and a human approval step before anything ships.
- **Students and educators:** keep the foundations CS2023 lists, and practise the new loop: specify, generate, test, review.

If you are deciding where AI belongs in your own workflows or products, our [AI and automation service](https://computese.com/services/ai-automation/) builds workflows, assistants and agents that use AI where a step needs judgment, with a person approving what matters, and runs an evaluation set from your real cases before every change. For the software around it, our [custom software development](https://computese.com/services/custom-software-development/) team puts every change through the same gates, including secret, code, dependency and container scanning.

## Key terms
- **Large language model (LLM)**: A neural network trained on large amounts of text and code to predict what comes next. It is the engine inside today's chat assistants, coding assistants and agents.
- **Coding agent**: An AI system that takes a programming task, edits files, runs commands and tests in a loop, and proposes a finished change, usually as a pull request for a person to review.
- **Model Context Protocol (MCP)**: An open standard, published by Anthropic in November 2024, for connecting AI assistants to the systems where data lives, such as content repositories, business tools and development environments.
- **Time horizon**: METR's measure of agent capability: the length of task, timed on skilled humans, that an AI agent completes with a given reliability, usually 50%.
- **Test-time compute**: Computation a model spends while answering, for example by working through a longer chain of thought. OpenAI reported that o1 improves as it grows.
- **Benchmark contamination**: Test problems or their solutions appearing in a model's training data, which inflates its score. OpenAI stopped reporting SWE-bench Verified in February 2026 for this reason.
- **Prompt injection**: An attack in which instructions in a model's input, such as a web page or file an agent reads, change what the model does. OWASP ranks it first among LLM application risks for 2025.
- **Package hallucination**: Generated code that imports or installs a package that does not exist. Attackers can publish malicious packages under those invented names.
- **Mechanistic interpretability**: Research that explains a model's behaviour from its internal computation, by finding features and the circuits that connect them, rather than from what the model says about itself.
- **Formal verification**: Proving with machine-checked logic that a proof or program is correct, in tools such as the Lean proof assistant, instead of testing it on examples.

## Common questions

### What is the future of artificial intelligence in computer science?

AI is becoming part of how every area of computer science works. Programmers direct assistants and agents instead of typing every line, researchers work on making models efficient, able to reason, interpretable and useful for improving systems, and curricula shift toward design and verification. The foundations stay; the routine translation of a clear specification into code is what AI takes over first.

### Will AI replace software developers?

The data so far says it changes the job more than it removes it. The US Bureau of Labor Statistics projects software developer jobs to grow 10% from 2025 to 2035 and computer programmer jobs to fall 7%, partly because AI automates repetitive programming. Stanford payroll research shows the pressure landing on the hiring of workers aged 22 to 25 in AI-exposed occupations.

### Is computer science still worth studying now that AI writes code?

Yes, with a different emphasis. The CS2023 curriculum from ACM, the IEEE Computer Society and AAAI keeps the foundational knowledge and shifts programming toward reading, verifying and testing code, because someone must judge what a model wrote. The BLS projects research scientist jobs to grow 22% from 2025 to 2035.

### Does AI make programmers more productive?

It depends on the task and the developer. Controlled studies range from 55.8% faster on a small, well-defined task to 19% slower for experienced developers in their own mature projects, and developers in that study believed AI had sped them up. Measure on your own codebase, including rework and incidents.

### What is logical reasoning in artificial intelligence?

It is AI that reaches conclusions through valid steps from facts and rules, one of the field's oldest goals. Classic tools such as solvers and proof assistants give guarantees but need precise input; reasoning models such as OpenAI o1 and DeepSeek-R1 work through problems step by step in language, without guarantees. Promising work combines the two: a model proposes a proof or program and a formal checker verifies it.

### Is AI-generated code safe to use?

Only after the same checks as any other code. One 2022 study found about 40% of Copilot-generated programs vulnerable; others found less secure code from developers who used an assistant, invented package names, and exploitable flaws in about half of otherwise correct generated backends. Test it, review it, scan it and check its dependencies.

## Sources
1. [Stack Overflow Developer Survey 2025: AI](https://survey.stackoverflow.co/2025/ai), Stack Overflow
2. [Stack Overflow Developer Survey 2024: AI](https://survey.stackoverflow.co/2024/ai), Stack Overflow
3. [Announcing the 2025 DORA Report: State of AI-assisted Software Development](https://cloud.google.com/blog/products/ai-machine-learning/announcing-the-2025-dora-report), Google Cloud
4. [Alphabet Q3 earnings call: CEO Sundar Pichai's remarks](https://blog.google/company-news/inside-google/message-ceo/alphabet-earnings-q3-2024/), Google
5. [Introducing the Model Context Protocol](https://www.anthropic.com/news/model-context-protocol), Anthropic
6. [We are Changing our Developer Productivity Experiment Design](https://metr.org/blog/2026-02-24-uplift-update/), METR
7. [Measuring AI Ability to Complete Long Software Tasks](https://arxiv.org/abs/2503.14499), METR (arXiv)
8. [Time Horizon 1.1](https://metr.org/blog/2026-1-29-time-horizon-1-1/), METR
9. [Task-Completion Time Horizons of Frontier AI Models](https://metr.org/time-horizons/), METR
10. [The Impact of AI on Developer Productivity: Evidence from GitHub Copilot](https://arxiv.org/abs/2302.06590), arXiv
11. [How much does AI impact development speed? An enterprise-based randomized controlled trial](https://arxiv.org/abs/2410.12944), Google (arXiv)
12. [Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivity](https://arxiv.org/abs/2507.09089), METR (arXiv)
13. [Announcing the 2024 DORA report](https://cloud.google.com/blog/products/devops-sre/announcing-the-2024-dora-report), Google Cloud
14. [Asleep at the Keyboard? Assessing the Security of GitHub Copilot's Code Contributions](https://arxiv.org/abs/2108.09293), IEEE S&P 2022 (arXiv)
15. [Do Users Write More Insecure Code with AI Assistants?](https://arxiv.org/abs/2211.03622), ACM CCS 2023 (arXiv)
16. [BaxBench: Can LLMs Generate Correct and Secure Backends?](https://arxiv.org/abs/2502.11844), arXiv
17. [We Have a Package for You! A Comprehensive Analysis of Package Hallucinations by Code Generating LLMs](https://arxiv.org/abs/2406.10279), USENIX Security 2025 (arXiv)
18. [LLM01:2025 Prompt Injection](https://genai.owasp.org/llmrisk/llm01-prompt-injection/), OWASP Gen AI Security Project
19. [SWE-bench: Can Language Models Resolve Real-World GitHub Issues?](https://arxiv.org/abs/2310.06770), ICLR 2024 (arXiv)
20. [Introducing SWE-bench Verified](https://openai.com/index/introducing-swe-bench-verified/), OpenAI
21. [Why SWE-bench Verified no longer measures frontier coding capabilities](https://openai.com/index/why-we-no-longer-evaluate-swe-bench-verified/), OpenAI
22. [SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?](https://arxiv.org/abs/2509.16941), arXiv
23. [DOE Releases New Report Evaluating Increase in Electricity Demand from Data Centers](https://www.energy.gov/articles/doe-releases-new-report-evaluating-increase-electricity-demand-data-centers), US Department of Energy
24. [Training Compute-Optimal Large Language Models](https://arxiv.org/abs/2203.15556), arXiv
25. [DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning](https://arxiv.org/abs/2501.12948), DeepSeek (arXiv)
26. [Learning to reason with LLMs](https://openai.com/index/learning-to-reason-with-llms/), OpenAI
27. [Advanced version of Gemini with Deep Think officially achieves gold-medal standard at the International Mathematical Olympiad](https://deepmind.google/blog/advanced-version-of-gemini-with-deep-think-officially-achieves-gold-medal-standard-at-the-international-mathematical-olympiad/), Google DeepMind
28. [Gemini achieves gold-medal level at the International Collegiate Programming Contest World Finals](https://deepmind.google/blog/gemini-achieves-gold-medal-level-at-the-international-collegiate-programming-contest-world-finals/), Google DeepMind
29. [Generative AI and the Curriculum (CS2023)](https://csed.acm.org/wp-content/uploads/2024/04/4.3-Generative-AI-and-the-Curriculum.pdf), ACM, IEEE-CS and AAAI
30. [Scaling Monosemanticity: Extracting Interpretable Features from Claude 3 Sonnet](https://transformer-circuits.pub/2024/scaling-monosemanticity/index.html), Anthropic
31. [Tracing the thoughts of a large language model](https://www.anthropic.com/research/tracing-thoughts-language-model), Anthropic
32. [AlphaDev discovers faster sorting algorithms](https://deepmind.google/blog/alphadev-discovers-faster-sorting-algorithms/), Google DeepMind
33. [AlphaEvolve: A Gemini-powered coding agent for designing advanced algorithms](https://deepmind.google/blog/alphaevolve-a-gemini-powered-coding-agent-for-designing-advanced-algorithms/), Google DeepMind
34. [CS2023: ACM/IEEE-CS/AAAI Computer Science Curricula](https://csed.acm.org/), ACM, IEEE-CS and AAAI
35. [CS2023 Knowledge Areas](https://csed.acm.org/knowledge-areas/), ACM, IEEE-CS and AAAI
36. [Occupational Outlook Handbook: Software Developers, Quality Assurance Analysts, and Testers](https://www.bls.gov/ooh/computer-and-information-technology/software-developers.htm), US Bureau of Labor Statistics
37. [Occupational Outlook Handbook: Computer Programmers](https://www.bls.gov/ooh/computer-and-information-technology/computer-programmers.htm), US Bureau of Labor Statistics
38. [Occupational Outlook Handbook: Computer and Information Research Scientists](https://www.bls.gov/ooh/computer-and-information-technology/computer-and-information-research-scientists.htm), US Bureau of Labor Statistics
39. [Canaries in the Coal Mine? Six Facts about the Recent Employment Effects of Artificial Intelligence](https://digitaleconomy.stanford.edu/publication/canaries-in-the-coal-mine-six-facts-about-the-recent-employment-effects-of-artificial-intelligence/), Stanford Digital Economy Lab
40. [AI Risk Management Framework](https://www.nist.gov/itl/ai-risk-management-framework), NIST
