Interior and Details Processors

AddDetailBackgroundProcessor

AddDetailBackground is a processor designed for replacing the cut background in photos with details both from the interior and exterior of the vehicle. This includes close-ups of the wheel, close-ups of the lamp, photos from the perspective of the driver/passenger, images of the sunroof and more. Using ClassificationProcessor will help detect the class of detail in a photo. If a shadow is to be generated for detail images, e.g. for tyre images. The detail parameter in the DetectCarShadowProcessor must be set to True. In this setting, the shadow is generated as for the detail photos. If the detail parameter value is set to False, the shadow is generated as for the exterior photos. Using PlaceShadowProcessor, it generates a shadow.

Parameters

backgroundDirectory - content name (check list of Background 360).

Example of usage

[ { "processorName": "ClassificationProcessor" }, { "processorName": "DetectInteriorMaskProcessor" }, { "processorName": "AddDetailBackgroundProcessor", "backgroundDirectory": "platform_25" }, { "processorName": "DetectCarShadowProcessor", "detail": true }, { "processorName": "PlaceShadowProcessor", "background": "original", "shadowOpacity": 0.6, "shadowSize": 0.5, "advancedShadowEnabled": false, "advancedShadowShift": 0.25, "advancedShadowStrength": 0.5 } ]

Example result

AddPanoramicBackgroundProcessor

Processor to change the background in panoramic interior shots to a given color or background 360.

Proper Scope

It should be used only for panoramic interior shots. It requires DetectInteriorMaskProcessor to be called first.

Parameters

brightness - Value from -1 to 1. Adjusts the overall brightness of the image, by default 0.0,
contrast - Value from -1 to 1. Adjusts the overall contrast of the image, by default 0.0,
luminance - Value from -1 to 1. Adjusts the overall luminance of the image, by default 0.0,
saturation - Value from -1 to 1. Indicates color intensity, measured in percentages from 0% (gray) to 100% (full saturation), by default 0.0,
hue - Value from -1 to 1. Determines the color in the color spectrum, measuring it in degrees from 0 to 360, where each angle corresponds to a different color, by default 0.0,
temperature - Value from -1 to 1. Adjusts the overall temperature of the image, by default 0.0,
exposure -Value from -1 to 1. Adjusts the overall exposure of an image, by default 0.0,
background (is ignored when backgroundDirectory is given)
- content name (check adding content).
- starts with # - background to be replaced by a color given as #RRGGBB.
backgroundDirectory - content name (check list of Background 360).

Example of usage

[
    {
        "processorName": "DetectInteriorMaskProcessor",
        "type": "panorama"
    },
    {
        "processorName": "AddPanoramicBackgroundProcessor",
        "brightness": 0.0,
        "contrast": 0.5,
        "luminance": 1.0,
        "saturation": 1.0,
        "hue": 1.0,
        "temperature": 0.0,
        "exposure": 0.0,
        "backgroundDirectory": "platform_12",
        "billboards": [
            "logo_vumo"
        ],
        "billboardReflection": true,
        "singleBillboardHeight": 0.3,
        "billboardsPatternMode": "ROW_INTERLOCK_DENSE",
        "globalBillboardVerticalAlign": 0.3
    }
]

billboards - List of billboards to be placed in the background of the scene. If one image is placed, it is placed in all fields. If more image names are entered they are placed sequentially. Placing of images starts from the upper left corner of the scene. If the billboards are to be empty, specify the value "none".

Example of usage

[
    {
        "processorName": "DetectInteriorMaskProcessor",
        "type": "panorama"
    },
    {
        "processorName": "AddPanoramicBackgroundProcessor",
        "brightness": 0.0,
        "contrast": 0.5,
        "luminance": 1.0,
        "saturation": 1.0,
        "hue": 1.0,
        "temperature": 0.0,
        "exposure": 0.0,
        "backgroundDirectory": "platform_12",
        "billboards": [
            "logo_vumo"
        ],
        "billboardReflection": true,
        "singleBillboardHeight": 0.3,
        "billboardsPatternMode": "ROW_INTERLOCK_DENSE",
        "globalBillboardVerticalAlign": 0.3
    }
]

billboardReflection - true/false - if true, enable reflections on billboards, by default true.

Example of usage and result

billboardsPatternMode - the name of one of all possible patterns in format "X_Y", where:
- X can be one of: ROW_INTERLOCK, BASIC_HORIZONTAL, BASIC_VERTICAL, COLLUMN_INTERLOCK, CHESSBOARD,
- Y can be one of: NOSPACE, DENSE, NORMAL, SPARSE, SPARSEx2, SPARSEx3, SINGLE.
  For example, billboardsPatternMode can be equal to "ROW_INTERLOCK_DENSE".

Billboards

billboards - constitute a list of images intended to be displayed as a background in a given scene. In the event that only one image is provided, it will automatically be placed in all available areas. However, if more than one image name is input, they will be sequentially placed in the scene. The process of positioning images starts from the top-left corner of the scene, meaning the first image will be placed in that position, and subsequent ones will be added sequentially. If there is a need not to place any billboards in the scene, this can be achieved by specifying the value "none." This will result in no images appearing on the scene at that moment. In billboards, it's also possible to set the height of an individual image on a percentage scale, expressed as "0.01-1". Additionally, various pattern modes can be selected, visually represented below.

BASIC_HORIZONTAL

BASIC_VERTICAL

COLLUMN_INTERLOCK

ROW_INTERLOCK

CHESSBOARD

billboardVerticalAlign - is used to determine the height on a percentage scale of the selected image on the billboards, expressed as "0.01-1", by default 0.0.

billboardVerticalAlign

singleBillboardHeight - value from 0.01 to 1. Target height of single billboard as factor to global billboard height, by default 0.0.

singleBillboardHeight

Example of usage

[
        {
            "processorName": "DetectInteriorMaskProcessor",
            "type": "panorama"
        },
        {
            "processorName": "AddPanoramicBackgroundProcessor",
            "brightness": 0.0,
            "contrast": 0.5,
            "luminance": 1.0,
            "saturation": 1.0,
            "hue": 1.0,
            "temperature": 0.0,
            "exposure": 0.0,
            "backgroundDirectory": "platform_12",
            "billboards": [
                "logo_vumo"
            ],
            "billboardReflection": true,
            "singleBillboardHeight": 0.3,
            "billboardsPatternMode": "ROW_INTERLOCK_DENSE",
            "globalBillboardVerticalAlign": 0.3
        }
    ]

Example result

DetectInteriorObjectsProcessor

Detects the steering wheels in the car interior image. It is used auxiliary to AddNadirLogoToPanoramaProcessor. You have to call it up beforehand when you want to use in your setup steeringWheelPosX.

Example of usage

 [
    {
        "processorName": "DetectInteriorObjectsProcessor"
    },
    {
        "processorName": "AddNadirLogoToPanoramaProcessor",
        "logoPath": "logo_vumo",
        "logoRadius": 0.06,
        "steeringWheelPosX": 0.45
    }
 ]

Example result

AddNadirLogoToPanoramaProcessor

Function for adding logo to nadir in panorama and to center pano image base on steering wheel.

Parameters

logoPath - content name,
logoRadius - Value from -1 to 1. Defines at what height relative to the bottom of the background the image is to be placed, by default: 0.0,
steringWheelPosX - Value from -1 to 1. The position of the center of the steering wheel in the image, by default 0.0.

Example of usage

 [
    {
        "processorName": "DetectInteriorObjectsProcessor"
    },
    {
        "processorName": "AddNadirLogoToPanoramaProcessor",
        "logoPath": "logo_vumo",
        "logoRadius": 0.09,
        "steeringWheelPosX": 0.4
    }
 ]

Example result

DetectInteriorMaskProcessor

It extracts the car interior segmentation mask. It has to be called at the beginning of the scope.

Proper Scope

Do not forget to replace background, for example, by calling CleanBackgroundProcessor.
Some processors in the list should not to be used with car interior images, such as CarKeyPointsProcessor, PlaceShadowProcessor.

Parameters

type - Allows you to select the type of photo uploaded for background removal:
- singleShot - for standard interior photos and detail photos. e.g. steering wheel, media screen, wheel, hood, engine, trunk,
- panorama - for 360 photos of the interior,
- destitchPanorama - for 360 photos of the interior, but it works on destitched panorama parts instead of whole panoramic image (keeps more details).

If the value of the parameter is not specified, the selection is made automatically based on the AR of the photo. If the aspect ratio of the photo (width/height) is >= 2:1 then the photo is treated as a panorama.

Output Properties

check process photo details

segmentation_score - Value from 0 to 1; 1 means best score; 0.5 is acceptable.

Example of usage

[
    {
        "processorName": "DetectInteriorMaskProcessor",
        "type" : "singleShot"
    },  
    {
        "processorName": "CleanBackgroundProcessor",
        "enableShadow": false,
        "color": "#FFFFFF"
    }
]

Example of usage panorama blur

[
    {
        "processorName": "DetectInteriorMaskProcessor",
        "type": "panorama"
    },
    {
        "processorName": "HorizontalBlurProcessor",
        "blurKernelSize": 0.076,
        "blurLineBackup": 0.0,
        "blurLineDelta": -1,
        "blurGradient": 0.1,
        "blurBackground": "original",
        "useKeypoints": false,
        "curtainEnabled": false
    }
]

Example results