OpenAI

Source: https://openai.com

Found 1249 news

  • Scaling Kubernetes to 7,500 nodes
    OpenAI - 08:00 Jan 25, 2021
    We’ve scaled Kubernetes clusters to 7,500 nodes, producing a scalable infrastructure for large models like GPT-3, CLIP, and DALL·E, but also for rapid small-scale iterative research such as Scaling Laws for Neural Language Models.
  • DALL·E: Creating images from text
    OpenAI - 08:00 Jan 05, 2021
    We’ve trained a neural network called DALL·E that creates images from text captions for a wide range of concepts expressible in natural language.
    Tags: DALL
  • CLIP: Connecting text and images
    OpenAI - 08:00 Jan 05, 2021
    We’re introducing a neural network called CLIP which efficiently learns visual concepts from natural language supervision. CLIP can be applied to any visual classification benchmark by simply providing the names of the visual categories to be recognized, similar to the “zero-shot” capabilities of GPT-2 and GPT-3.
    Tags: CLIP
  • Organizational update from OpenAI
    OpenAI - 08:00 Dec 29, 2020
    It’s been a year of dramatic change and growth at OpenAI.
    Tags: OpenAI
  • OpenAI licenses GPT-3 technology to Microsoft
    OpenAI - 07:00 Sep 22, 2020
    OpenAI has agreed to license GPT-3 to Microsoft for their own products and services.
    Tags: OpenAI Microsoft GPT-3
  • Generative language modeling for automated theorem proving
    OpenAI - 07:00 Sep 07, 2020
  • Learning to summarize with human feedback
    OpenAI - 07:00 Sep 04, 2020
    We’ve applied reinforcement learning from human feedback to train language models that are better at summarization.
  • OpenAI Scholars 2020: Final projects
    OpenAI - 07:00 Jul 09, 2020
    Our third class of OpenAI Scholars presented their final projects at virtual Demo Day, showcasing their research results from over the past five months.
    Tags: OpenAI Scholars
  • Procgen and MineRL Competitions
    OpenAI - 07:00 Jun 20, 2020
    We’re excited to announce that OpenAI is co-organizing two NeurIPS 2020 competitions with AIcrowd, Carnegie Mellon University, and DeepMind, using Procgen Benchmark and MineRL.
  • Image GPT
    OpenAI - 07:00 Jun 17, 2020
    We find that, just as a large transformer model trained on language can generate coherent text, the same exact model trained on pixel sequences can generate coherent image completions and samples. By establishing a correlation between sample quality and image classification accuracy, we show that our best generative model also contains features competitive with top convolutional nets in the unsupervised setting.
  • OpenAI API
    OpenAI - 07:00 Jun 11, 2020
    We’re releasing an API for accessing new AI models developed by OpenAI.
    Tags: OpenAI
  • Language models are few-shot learners
    OpenAI - 07:00 May 28, 2020
  • AI and efficiency
    OpenAI - 07:00 May 05, 2020
    We’re releasing an analysis showing that since 2012 the amount of compute needed to train a neural net to the same performance on ImageNet classification has been decreasing by a factor of 2 every 16 months. Compared to 2012, it now takes 44 times less compute to train a neural network to the level of AlexNet (by contrast, Moore’s Law would yield an 11x cost improvement over this period). Our results suggest that for AI tasks with high levels of recent investment, algorithmic progress has yielded more gains than classical hardware efficiency.
  • Jukebox
    OpenAI - 07:00 Apr 30, 2020
    We’re introducing Jukebox, a neural net that generates music, including rudimentary singing, as raw audio in a variety of genres and artist styles. We’re releasing the model weights and code, along with a tool to explore the generated samples.
    Tags: Jukebox
  • Improving verifiability in AI development
    OpenAI - 07:00 Apr 16, 2020
    We’ve contributed to a multi-stakeholder report by 58 co-authors at 30 organizations, including the Centre for the Future of Intelligence, Mila, Schwartz Reisman Institute for Technology and Society, Center for Advanced Study in the Behavioral Sciences, and Center for Security and Emerging Technologies. This report describes 10 mechanisms to improve the verifiability of claims made about AI systems. Developers can use these tools to provide evidence that AI systems are safe, secure, fair, or privacy-preserving. Users, policymakers, and civil society can use these tools to evaluate AI development processes.
  • OpenAI Microscope
    OpenAI - 07:00 Apr 14, 2020
    We’re introducing OpenAI Microscope, a collection of visualizations of every significant layer and neuron of eight vision “model organisms” which are often studied in interpretability. Microscope makes it easier to analyze the features that form inside these neural networks, and we hope it will help the research community as we move towards understanding these complicated systems.
    Tags: OpenAI Microscope
  • OpenAI standardizes on PyTorch
    OpenAI - 08:00 Jan 30, 2020
    We are standardizing OpenAI’s deep learning framework on PyTorch.
    Tags: PyTorch OpenAI
  • Scaling laws for neural language models
    OpenAI - 08:00 Jan 23, 2020
  • Dota 2 with large scale deep reinforcement learning
    OpenAI - 08:00 Dec 13, 2019
  • Deep double descent
    OpenAI - 08:00 Dec 05, 2019
    We show that the double descent phenomenon occurs in CNNs, ResNets, and transformers: performance first improves, then gets worse, and then improves again with increasing model size, data size, or training time. This effect is often avoided through careful regularization. While this behavior appears to be fairly universal, we don’t yet fully understand why it happens, and view further study of this phenomenon as an important research direction.

1249 items

Popular Tags