Skip to content

Perception#

This page provides specific specifications about the Interface of the Perception Component. Please refer to the perception architecture reference implementation design for concepts and data flow.

Input#

From Map Component#

NameTopic / ServiceTypeDescription
Vector Map/map/vector_mapautoware_map_msgs/msg/LaneletMapBinHD Map including the information about lanes
Point Cloud Map/service/get_differential_pcd_mapautoware_map_msgs/srv/GetDifferentialPointCloudMapPoint Cloud Map

Notes:

  • Point Cloud Map
    • input can be both topic or service, but we highly recommend to use service because since this interface enables processing without being constrained by map file size limits.

From Sensing Component#

NameTopicTypeDescription
Camera Image/sensing/camera/camera*/image_rect_colorsensor_msgs/ImageCamera image data, processed with Lens Distortion Correction (LDC)
Camera Image/sensing/camera/camera*/image_rawsensor_msgs/ImageCamera image data, not processed with Lens Distortion Correction (LDC)
Point Cloud/sensing/lidar/concatenated/pointcloudsensor_msgs/PointCloud2Concatenated point cloud from multiple LiDAR sources
Radar Object/sensing/radar/detected_objectsautoware_perception_msgs/msg/DetectedObjectRadar objects

From Localization Component#

NameTopicTypeDescription
Vehicle Odometry/localization/kinematic_statenav_msgs/msg/OdometryEgo vehicle odometry topic

From API#

NameTopicTypeDescription
External Traffic Signals/external/traffic_signalsautoware_perception_msgs::msg::TrafficSignalArrayThe traffic signals from an external system

Output#

To Planning#

Please refer to the perception component design for detailed definitions of each output."

NameTopicTypeDescription
Dynamic Objects/perception/object_recognition/objectsautoware_perception_msgs/msg/PredictedObjectsSet of dynamic objects with information such as a object class and a shape of the objects. These objects did not exist when the map was generated and are not contained within the map.
Obstacles/perception/obstacle_segmentation/pointcloudsensor_msgs/PointCloud2Obstacles, including both dynamic objects and static obstacles that requires the ego vehicle either steer clear of them or come to a stop in front of the obstacles.
Occupancy Grid Map/perception/occupancy_grid_map/mapnav_msgs/msg/OccupancyGridThe map with the information about the presence of obstacles and blind spot
Traffic Signal/perception/traffic_light_recognition/traffic_signalsautoware_perception_msgs::msg::TrafficLightGroupArrayThe traffic signal information such as a color (green, yellow, read) and an arrow (right, left, straight)