Provide a detailed summary of the following web content, including what type of content it is (e.g. news article, essay, technical report, blog post, product documentation, content marketing, etc). If the content looks like an error message, respond 'content unavailable'. If there is anything controversial please highlight the controversy. If there is something surprising, unique, or clever, please highlight that as well:
Title: Steps towards prompt-based creation of virtual worlds
Site: arxiv.org

 
 
  
  
  
    
  
  
    
    
  

  [Submitted on 10 Nov 2022] 
 Title: Steps towards prompt-based creation of virtual worlds 
 Download PDF 
 
 Abstract:   Large language models trained for code generation can be applied to speaking
virtual worlds into existence (creating virtual worlds). In this work we show
that prompt-based methods can both accelerate in-VR level editing, as well as
can become part of gameplay rather than just part of game development. As an
example, we present Codex VR Pong which shows non-deterministic game mechanics
using generative processes to not only create static content but also
non-trivial interactions between 3D objects. This demonstration naturally leads
to an integral discussion on how one would evaluate and benchmark experiences
created by generative models - as there are no qualitative or quantitative
metrics that apply in these scenarios. We conclude by discussing impending
challenges of AI-assisted co-creation in VR.

     
 
 
 
 Submission history  From: Andrzej Banburski [ view email ]
       [v1] 
Thu, 10 Nov 2022 21:13:04 UTC (6,209 KB)