Unreal EngineScenario Simulation

Develop, test, and visualize the performance of driving algorithms in a simulated environment using the Unreal Engine^®from Epic Games^®

Automated Driving Toolbox™ provides a cosimulation framework for modeling and visualizing driving algorithms in Simulink^®in a rich simulation environment. This simulation environment uses the Unreal Engine by Epic Games.

With this simulation environment, you can configure prebuilt scenes, place and move vehicles within the scene, and set up and simulate camera, radar, or lidar sensors on the vehicles. Use this environment to develop, test, and verify the performance of perception, path planning, and control algorithms, including closed-loop algorithms. To learn more, seeUnreal Engine Simulation for Automated Driving.

For a tutorial video series on connecting a Simulink vehicle to an Unreal Engine scene, seeUsing Unreal Engine with Simulink.

Acknowledgements

Simulink model and corresponding Unreal Engine simulation

Blocks

expand all

Scene and Vehicle Configuration

Simulation 3D Scene Configuration	Scene configuration for 3D simulation environment
Simulation 3D Vehicle with Ground Following	Implement vehicle that follows ground in 3D environment
Cuboid To 3D Simulation	Convert actor from cuboid coordinates to 3D simulation coordinates

Sensors

Simulation 3D Camera	Camera sensor model with lens in 3D simulation environment
Simulation 3D Fisheye Camera	Fisheye camera sensor model in 3D simulation environment
Simulation 3D Lidar	Lidar sensor model in 3D simulation environment
Simulation 3D Probabilistic Radar	Probabilistic radar sensor model in 3D simulation environment
Simulation 3D Probabilistic Radar Configuration	Configure probabilistic radar signatures in 3D simulation environment
Simulation 3D Vision Detection Generator	Detect objects and lanes from measurements in 3D simulation environment

Scenes and Vehicle Dimensions

expand all

Scenes

Straight Road	Straight road 3D environment
Curved Road	Curved road 3D environment
Parking Lot	Parking lot 3D environment
Large Parking Lot	Large parking lot 3D environment
Open Surface	Open surface 3D environment
Double Lane Change	Double lane change 3D environment
US City Block	US city block 3D environment
US Highway	US highway 3D environment
Virtual Mcity	VirtualMcity3D environment

Vehicles

Box Truck	Box truck vehicle dimensions
Hatchback	Hatchback vehicle dimensions
Muscle Car	Muscle car vehicle dimensions
Sedan	Sedan vehicle dimensions
Small Pickup Truck	Small pickup truck vehicle dimensions
Sport Utility Vehicle	Sport utility vehicle dimensions

Apps

Bird's-Eye Scope

Visualize sensor coverages, detections, and tracks

Topics

Simulation Basics

Unreal Engine Simulation for Automated Driving
Learn how to model driving algorithms in Simulink and visualize their performance in a virtual environment using the Unreal Engine from Epic Games.
Unreal Engine Simulation Environment Requirements and Limitations
When simulating in the Unreal Engine environment, keep these software requirements, minimum hardware requirements, and limitations in mind.
How Unreal Engine Simulation for Automated Driving Works
Learn about the co-simulation framework between Simulink and the Unreal Engine and how block execution order affects simulation.
Coordinate Systems for Unreal Engine Simulation in Automated Driving Toolbox
Understand the world and vehicle coordinate systems when simulating in the Unreal Engine environment.

Simulation with Sensors

Choose a Sensor for Unreal Engine Simulation
Decide which camera, lidar, or radar sensors to use during simulation with the Unreal Engine.
Simulate Simple Driving Scenario and Sensor in Unreal Engine Environment
Learn the basics of configuring and simulating scenes, vehicles, and sensors in a virtual environment rendered using the Unreal Engine from Epic Games.
Depth and Semantic Segmentation Visualization Using Unreal Engine Simulation
Visualize depth and semantic segmentation data captured from a camera sensor in the Unreal Engine simulation environment.
想象从虚幻引擎Simulatio传感器数据n Environment
Visualize sensor coverage areas and detections obtained from high-fidelity radar and lidar sensors in the Unreal Engine simulation environment.

Scene Customization

Customize Unreal Engine Scenes for Automated Driving
Customize Unreal Engine scenes for automated driving applications.
- STEP 1:Install Support Package for Customizing Scenes
- STEP 2:Migrate Projects Developed Using Prior Support Packages
- STEP 3:Customize Scenes Using Simulink and Unreal Editor
- STEP 4:Package Custom Scenes into Executable
Apply Labels to Unreal Scene Elements for Semantic Segmentation and Object Detection
Apply labels to scene objects to obtain semantic segmentation data from camera sensors or detect custom objects from probabilistic sensors.
Create Top-Down Map of Unreal Engine Scene
Create a 2-D, top-down map of a 3-D scene developed using the Unreal Engine from Epic Games. Use these maps to explore your scene and specify trajectory waypoints.
Build Light in Unreal Editor
Build and use lighting in the Unreal^®Editor.
Create Empty Project in Unreal Engine
Create empty project to use in custom scenes.
Place Cameras on Actors in the Unreal Editor
Place theSimulation 3D Camera GetSimulation 3D Camera GetSimulation 3D Camerablock on static and custom actors.
Prepare Custom Vehicle Mesh for the Unreal Editor
Create custom vehicle mesh for theSimulation 3D VehicleandSimulation 3D Vehicle with Ground Followingblocks.

Featured Examples

Select Waypoints for Unreal Engine Simulation

Select waypoints from a scene and visualize the path of a vehicle following these waypoints in the Unreal Engine simulation environment.

Open Script

Design Lane Marker Detector Using Unreal Engine Simulation Environment

Use the Unreal Engine simulation environment to record synthetic sensor data and develop and test a lane marker detection system.

Open Script

Visualize Automated Parking Valet Using Unreal Engine Simulation

Visualize vehicle motion in the Unreal Engine simulation environment using an automated parking valet system constructed in Simulink.

Open Script

Perception-Based Parking Spot Detection Using Unreal Engine Simulation

Build a bird's-eye-view map of a parking lot using semantically segmented images from the ego vehicle camera, and detect empty parking spots from the map.

Open Live Script

Design Lidar SLAM Algorithm Using Unreal Engine Simulation Environment

Develop a simultaneous localization and mapping algorithm using synthetic lidar sensor data recorded from the Unreal Engine simulation environment.

Open Script

Simulate Vision and Radar Sensors in Unreal Engine Environment

实现一个模拟合成数据跟踪and sensor fusion using Simulink and the Unreal Engine simulation environment.

Open Script

Visualize Logged Data from Unreal Engine Simulation

Customize visualization of logged simulation data using simulation data inspector.

Open Script