Code generation, programming assistants

1 Github copilot

GitHub Copilot uses suggestions from OpenAI Codex to suggest code completion.

See Networked VS Code for some more whitelist rules we need for VS Code generally.

2 Codeium

Codeium

Codeium has been developed by the team at Exafunction to build on the industry-wide momentum on foundational models. We realized that the combination of recent advances in generative models and our world-class optimized deep learning serving software could provide users with top quality AI-based products at the lowest possible costs (or ideally, free!).

3 Fauxpilot

FauxPilot: Like GitHub Copilot without Microsoft telemetry • The Register

Updated GitHub Copilot, one of several recent tools for generating programming code suggestions with the help of AI models, remains problematic for some users due to licensing concerns and to the telemetry the software sends back to the Microsoft-owned company.

fauxpilot/fauxpilot: FauxPilot - an open-source alternative to GitHub Copilot server

This is an attempt to build a locally hosted alternative to GitHub Copilot. It uses the SalesForce CodeGen models inside of NVIDIA’s Triton Inference Server with the FasterTransformer backend.

Being able to work offline would be a real win; Copilot loves bandwidth too much.

4 Amazon CodeWhisperer

AI Code Generator - Amazon CodeWhisperer - AWS

Available as part of the AWS Toolkit for Visual Studio (VS) Code and JetBrains, CodeWhisperer currently supports Python, Java, JavaScript, TypeScript, C#, Go, Rust, PHP, Ruby, Kotlin, C, C++, Shell scripting, SQL and Scala. In addition to VS Code and the JetBrains family of IDEs—including IntelliJ, PyCharm, GoLand, CLion, PhpStorm, RubyMine, Rider, WebStorm, and DataGrip—CodeWhisperer is also available for AWS Cloud9, AWS Lambda console, JupyterLab and Amazon SageMaker Studio.

Free for individual use.

5 Incoming

• Replit - Replit’s new AI Model now available on Hugging Face

• Code Llama

  • Perplexity Labs
  • Introducing Code Llama, a state-of-the-art large language model for coding

• AI self-play for algorithm design

• Software²: A new generation of AIs that become increasingly general by producing their own training data

• openai/openai-cookbook: Examples and guides for using the OpenAI API

• LMQL: Programming Large Language Models: “LMQL is a programming language for language model interaction.”

  LMQL generalizes natural language prompting, making it more expressive while remaining accessible. For this, LMQL builds on top of Python, allowing users to express natural language prompts that also contain code. The resulting queries can be directly executed on language models like OpenAI’s GPT models Fixed answer templates and intermediate instructions allow the user to steer the LLM’s reasoning process.

• This is how you code now

• AI assisted learning: Learning Rust with ChatGPT, Copilot and Advent of Code

• Using GPT-3 to explain how code works

• A Datasette tutorial written by GPT-3

• Mitchell Hashimoto on the mysterious ease of ChatGPT plugins

• Replit - Replit’s new AI Model now available on Hugging Face

Querying Glean:

Glean is a system for working with facts about source code. It is designed for collecting and storing detailed information about code structure, and providing access to the data to power tools and experiences from online IDE features to offline code analysis.

For example, Glean could answer all the questions you’d expect your IDE to answer, accurately and efficiently on a large-scale codebase. Things like:

• Where is the definition of this method?
• Where are all the callers of this function?
• Who inherits from this class?
• What are all the declarations in this file?

6 References