Skip to content
STAGING SERVER
DEVELOPMENT SERVER

3D Camera Cube Software Image 26.10.0 – Release Notes#

New Features#

  • Plane-based dimensioning in ItemPickAI (rc_itempick) and BoxPick (rc_boxpick):
    • The new optional dimensioning argument of compute_grasps and detect_items measures a bounding box for each detected item that is aligned with a reference plane, e.g. a conveyor belt or a table. The box height is measured from that plane, so the full dimensions of the items are returned in addition to the grasps. The reference planes are taken from the new PrimitiveDB module (rc_primitive_db). This allows measuring the size of parcels, boxes and other items in the same call that computes the grasps, e.g. for sorting items by size or choosing their place position.
  • PrimitiveDB (rc_primitive_db):
    • This new database module stores geometric primitives, currently planes, persistently on the device, so that they can be used by the detection modules, e.g. as reference planes for dimensioning. Planes are managed with the new services set_plane, get_planes and delete_planes, or on the Web GUI's new Planes database page, which also helps to estimate a plane from the current sensor data. Thus, a reference plane only has to be determined once during setup and can then be reused in every detection request.
  • Measure (rc_measure):
    • The new service compute_plane estimates a plane from the current sensor data, either from the point cloud (DEPTH) or from at least three AprilTags lying on a common plane (APRILTAG). The plane is returned without being stored and can be stored in PrimitiveDB with set_plane. The Web GUI's Measure page shows the estimated plane in a 3D visualization, and the plane can be adjusted interactively. This makes it easy to determine reference planes such as a conveyor belt or a table surface directly with the sensor instead of measuring them manually.
  • Stereo Matching (rc_stereomatching):
    • The new parameter method selects the stereo matching method. Besides the classic SGM, the AI-based FastStereoAI method is available, which uses a neural network for computing the disparity image. It can deliver more complete depth data in scenes that are difficult for classic stereo matching, e.g. with weakly textured or reflective surfaces.
  • Generic Robot Interface (GRI):
    • The Web GUI's job editor now supports dynamic arguments, additional return values and mapping tables. Parameter jobs can be created, and jobs can be loaded and edited directly from the Try-Out sections of the modules. This makes setting up robot programs via GRI faster and less error-prone, as a configuration tested in the Try-Out section can be turned into a job directly.
  • AprilTags (rc_april_tag_detect) and QR Codes (rc_qr_code_detect) can now be detected on all pipeline types. On blaze, Orbbec and Zivid pipelines the exact tag size has to be given for every tag in a detection request. This allows applications that rely on tag or code detection to be used with all supported sensors.

Improvements and Fixes#

  • Updated root file system to fix CVEs
  • ItemPickAI (rc_itempick):
    • Improved quality of the "Mail Items" model
    • Faster grasp computation for partially covered items
    • Fixed rare cases when x axis of the item bounding box was not aligned with the long side
    • Fixed discard_cut_off_items on blaze, Orbbec and Zivid pipelines
  • BoxPick (rc_boxpick):
    • Fixed discard_cut_off_items on blaze, Orbbec and Zivid pipelines
  • Pack (rc_pack):
    • Added argument robot_pose to detect_place_pose for robot-mounted sensors
    • Fixed load carriers with a pose in the external frame
    • Fixed load carrier detection not respecting assume_gravity_aligned
  • SilhouetteMatch (rc_silhouettematch):
    • Fixed objects close to the border of a 2D region of interest not being detected
  • CADMatch (rc_cadmatch):
    • Improved GPU memory management
  • GripperDB (rc_gripper_db):
    • Fixed uploading of CAD elements (OBJ files) with multiple connected components
  • Generic Robot Interface (GRI):
    • Improved error handling with more specific return codes, e.g. for timeouts and misconfigured jobs
    • Poses and floating point values are now rounded instead of truncated
  • Orbbec:
    • Added parameter resolution for choosing the resolution of the depth image
    • Faster image acquisition
  • Zivid:
    • Updated Zivid SDK to 2.18.0
    • Fixed heartbeat timeouts when a continuous detection takes longer
  • REST-API:
    • Reduced memory usage
    • Added timeouts so that a hanging module can no longer block REST-API requests
  • UserSpace:
    • Updated Portainer to 2.45.3
    • Fixed creating the Portainer admin account via the web interface
    • Fixed NTFS-formatted USB drives becoming inaccessible right after mounting
  • WebGUI:
    • Added a popup for previewing the request and response JSON of a result, with options to copy it to the clipboard or download it
    • Added 3d visualization for measure_depth result to Measure page
    • Reduced the CPU load of the 3D result visualizations
    • Minor improvements and fixes