python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2454336 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3678744'] with mtr_portfolio_ids : ['26644253'] and first list_photo_ids : [] new path : /proc/2454336/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 9 ; length of list_pids : 9 ; length of list_args : 9 time to download the photos : 1.5559861660003662 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Mon Sep 8 15:40:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10597 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-09-08 15:40:33.384088: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-09-08 15:40:33.408644: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3492910000 Hz 2025-09-08 15:40:33.410731: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fa1d4000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-09-08 15:40:33.410780: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-09-08 15:40:33.414521: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-09-08 15:40:33.537470: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x26f7e4c0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-09-08 15:40:33.537526: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-09-08 15:40:33.538485: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-08 15:40:33.538901: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-08 15:40:33.541324: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-08 15:40:33.543817: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-08 15:40:33.544391: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-08 15:40:33.546708: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-08 15:40:33.547811: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-08 15:40:33.552592: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-08 15:40:33.554176: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-08 15:40:33.554281: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-08 15:40:33.555084: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-08 15:40:33.555101: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-08 15:40:33.555111: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-08 15:40:33.556870: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9672 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-09-08 15:40:33.879634: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-08 15:40:33.879717: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-08 15:40:33.879737: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-08 15:40:33.879756: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-08 15:40:33.879774: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-08 15:40:33.879791: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-08 15:40:33.879809: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-08 15:40:33.879827: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-08 15:40:33.881441: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-08 15:40:33.882852: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-08 15:40:33.882903: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-08 15:40:33.882921: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-08 15:40:33.882939: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-08 15:40:33.882956: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-08 15:40:33.882973: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-08 15:40:33.882990: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-08 15:40:33.883007: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-08 15:40:33.884615: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-08 15:40:33.884652: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-08 15:40:33.884663: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-08 15:40:33.884673: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-08 15:40:33.886234: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9672 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-09-08 15:40:44.106515: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-08 15:40:44.319537: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 9 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 34 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 29 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 33 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 39 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 20 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 24 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 32 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 23 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 30 Detection mask done ! Trying to reset tf kernel 2455162 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 4112 tf kernel not reseted sub process len(results) : 9 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 9 len(list_Values) 0 process is alive process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 9401 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.008580446243286133 nb_pixel_total : 210439 time to create 1 rle with new method : 0.019945859909057617 length of segment : 495 time for calcul the mask position with numpy : 0.0007836818695068359 nb_pixel_total : 25411 time to create 1 rle with old method : 0.031148195266723633 length of segment : 324 time for calcul the mask position with numpy : 0.0005319118499755859 nb_pixel_total : 13696 time to create 1 rle with old method : 0.015620708465576172 length of segment : 155 time for calcul the mask position with numpy : 0.012130022048950195 nb_pixel_total : 264288 time to create 1 rle with new method : 0.2338705062866211 length of segment : 862 time for calcul the mask position with numpy : 0.0006976127624511719 nb_pixel_total : 32889 time to create 1 rle with old method : 0.03943133354187012 length of segment : 229 time for calcul the mask position with numpy : 0.0026187896728515625 nb_pixel_total : 125656 time to create 1 rle with old method : 0.18458890914916992 length of segment : 864 time for calcul the mask position with numpy : 0.0026161670684814453 nb_pixel_total : 133618 time to create 1 rle with old method : 0.14818310737609863 length of segment : 518 time for calcul the mask position with numpy : 0.001024484634399414 nb_pixel_total : 48427 time to create 1 rle with old method : 0.05757784843444824 length of segment : 422 time for calcul the mask position with numpy : 0.0005276203155517578 nb_pixel_total : 24353 time to create 1 rle with old method : 0.02825307846069336 length of segment : 302 time for calcul the mask position with numpy : 0.0024912357330322266 nb_pixel_total : 160990 time to create 1 rle with new method : 0.008009672164916992 length of segment : 459 time for calcul the mask position with numpy : 0.00027942657470703125 nb_pixel_total : 14022 time to create 1 rle with old method : 0.015412330627441406 length of segment : 212 time for calcul the mask position with numpy : 0.0003495216369628906 nb_pixel_total : 13997 time to create 1 rle with old method : 0.01622486114501953 length of segment : 149 time for calcul the mask position with numpy : 0.0015614032745361328 nb_pixel_total : 94339 time to create 1 rle with old method : 0.1097872257232666 length of segment : 345 time for calcul the mask position with numpy : 0.0007863044738769531 nb_pixel_total : 32040 time to create 1 rle with old method : 0.03528332710266113 length of segment : 575 time for calcul the mask position with numpy : 0.001661062240600586 nb_pixel_total : 108301 time to create 1 rle with old method : 0.1272425651550293 length of segment : 390 time for calcul the mask position with numpy : 0.0005536079406738281 nb_pixel_total : 28587 time to create 1 rle with old method : 0.03277182579040527 length of segment : 383 time for calcul the mask position with numpy : 0.000217437744140625 nb_pixel_total : 6099 time to create 1 rle with old method : 0.007597446441650391 length of segment : 89 time for calcul the mask position with numpy : 0.00405120849609375 nb_pixel_total : 201673 time to create 1 rle with new method : 0.010825395584106445 length of segment : 611 time for calcul the mask position with numpy : 0.0016939640045166016 nb_pixel_total : 87406 time to create 1 rle with old method : 0.10482525825500488 length of segment : 645 time for calcul the mask position with numpy : 0.006220340728759766 nb_pixel_total : 295556 time to create 1 rle with new method : 0.018702268600463867 length of segment : 596 time for calcul the mask position with numpy : 0.00035309791564941406 nb_pixel_total : 18071 time to create 1 rle with old method : 0.021268844604492188 length of segment : 138 time for calcul the mask position with numpy : 0.0010724067687988281 nb_pixel_total : 45888 time to create 1 rle with old method : 0.053720951080322266 length of segment : 413 time for calcul the mask position with numpy : 0.006662130355834961 nb_pixel_total : 326078 time to create 1 rle with new method : 0.03315401077270508 length of segment : 637 time for calcul the mask position with numpy : 0.0013840198516845703 nb_pixel_total : 65267 time to create 1 rle with old method : 0.07615232467651367 length of segment : 391 time for calcul the mask position with numpy : 0.0068836212158203125 nb_pixel_total : 251528 time to create 1 rle with new method : 0.03958392143249512 length of segment : 1084 time for calcul the mask position with numpy : 0.0015783309936523438 nb_pixel_total : 82183 time to create 1 rle with old method : 0.09202289581298828 length of segment : 708 time for calcul the mask position with numpy : 0.0070078372955322266 nb_pixel_total : 150470 time to create 1 rle with new method : 0.008143186569213867 length of segment : 403 time for calcul the mask position with numpy : 0.0021758079528808594 nb_pixel_total : 65089 time to create 1 rle with old method : 0.07926297187805176 length of segment : 460 time for calcul the mask position with numpy : 0.0007877349853515625 nb_pixel_total : 23021 time to create 1 rle with old method : 0.02649998664855957 length of segment : 267 time for calcul the mask position with numpy : 0.0017817020416259766 nb_pixel_total : 89032 time to create 1 rle with old method : 0.11193394660949707 length of segment : 345 time for calcul the mask position with numpy : 0.002735614776611328 nb_pixel_total : 154727 time to create 1 rle with new method : 0.005291461944580078 length of segment : 454 time for calcul the mask position with numpy : 0.0036547183990478516 nb_pixel_total : 91323 time to create 1 rle with old method : 0.10513758659362793 length of segment : 446 time for calcul the mask position with numpy : 0.005481719970703125 nb_pixel_total : 176236 time to create 1 rle with new method : 0.007444143295288086 length of segment : 626 time for calcul the mask position with numpy : 0.00468754768371582 nb_pixel_total : 170039 time to create 1 rle with new method : 0.0059795379638671875 length of segment : 439 time for calcul the mask position with numpy : 0.012643575668334961 nb_pixel_total : 366409 time to create 1 rle with new method : 0.03951549530029297 length of segment : 826 time for calcul the mask position with numpy : 0.004183530807495117 nb_pixel_total : 173469 time to create 1 rle with new method : 0.006603717803955078 length of segment : 355 time for calcul the mask position with numpy : 0.002936124801635742 nb_pixel_total : 74517 time to create 1 rle with old method : 0.08612704277038574 length of segment : 466 time for calcul the mask position with numpy : 0.0015680789947509766 nb_pixel_total : 20021 time to create 1 rle with old method : 0.023044824600219727 length of segment : 502 time for calcul the mask position with numpy : 0.0013308525085449219 nb_pixel_total : 53152 time to create 1 rle with old method : 0.06054973602294922 length of segment : 300 time for calcul the mask position with numpy : 0.011747121810913086 nb_pixel_total : 273771 time to create 1 rle with new method : 0.030365467071533203 length of segment : 912 time for calcul the mask position with numpy : 0.0023584365844726562 nb_pixel_total : 82514 time to create 1 rle with old method : 0.09197092056274414 length of segment : 449 time for calcul the mask position with numpy : 0.0018031597137451172 nb_pixel_total : 45623 time to create 1 rle with old method : 0.05239367485046387 length of segment : 363 time for calcul the mask position with numpy : 0.00144195556640625 nb_pixel_total : 82451 time to create 1 rle with old method : 0.09017491340637207 length of segment : 447 time for calcul the mask position with numpy : 0.003032684326171875 nb_pixel_total : 79618 time to create 1 rle with old method : 0.08793091773986816 length of segment : 421 time for calcul the mask position with numpy : 0.00086212158203125 nb_pixel_total : 21100 time to create 1 rle with old method : 0.0236968994140625 length of segment : 181 time for calcul the mask position with numpy : 0.004941701889038086 nb_pixel_total : 135728 time to create 1 rle with old method : 0.15143561363220215 length of segment : 647 time for calcul the mask position with numpy : 0.004940986633300781 nb_pixel_total : 97456 time to create 1 rle with old method : 0.10972714424133301 length of segment : 1002 time for calcul the mask position with numpy : 0.009078264236450195 nb_pixel_total : 208772 time to create 1 rle with new method : 0.01650714874267578 length of segment : 556 time for calcul the mask position with numpy : 0.0031774044036865234 nb_pixel_total : 61345 time to create 1 rle with old method : 0.0684974193572998 length of segment : 831 time for calcul the mask position with numpy : 0.0014896392822265625 nb_pixel_total : 53455 time to create 1 rle with old method : 0.05930209159851074 length of segment : 313 time for calcul the mask position with numpy : 0.0047948360443115234 nb_pixel_total : 96149 time to create 1 rle with old method : 0.10713982582092285 length of segment : 485 time for calcul the mask position with numpy : 0.004836320877075195 nb_pixel_total : 151803 time to create 1 rle with new method : 0.007586240768432617 length of segment : 439 time for calcul the mask position with numpy : 0.0023279190063476562 nb_pixel_total : 71138 time to create 1 rle with old method : 0.07806062698364258 length of segment : 517 time for calcul the mask position with numpy : 0.016096115112304688 nb_pixel_total : 445872 time to create 1 rle with new method : 0.05813002586364746 length of segment : 930 time for calcul the mask position with numpy : 0.005717754364013672 nb_pixel_total : 132618 time to create 1 rle with old method : 0.14852190017700195 length of segment : 477 time for calcul the mask position with numpy : 0.0012090206146240234 nb_pixel_total : 31909 time to create 1 rle with old method : 0.037020206451416016 length of segment : 129 time for calcul the mask position with numpy : 0.00034546852111816406 nb_pixel_total : 12850 time to create 1 rle with old method : 0.015358686447143555 length of segment : 114 time for calcul the mask position with numpy : 0.012562751770019531 nb_pixel_total : 394193 time to create 1 rle with new method : 0.0373692512512207 length of segment : 1138 time for calcul the mask position with numpy : 0.007321834564208984 nb_pixel_total : 169855 time to create 1 rle with new method : 0.015175580978393555 length of segment : 817 time for calcul the mask position with numpy : 0.0024280548095703125 nb_pixel_total : 70610 time to create 1 rle with old method : 0.07869648933410645 length of segment : 539 time for calcul the mask position with numpy : 0.0008385181427001953 nb_pixel_total : 16385 time to create 1 rle with old method : 0.01876521110534668 length of segment : 217 time for calcul the mask position with numpy : 0.0009639263153076172 nb_pixel_total : 17636 time to create 1 rle with old method : 0.020175457000732422 length of segment : 172 time for calcul the mask position with numpy : 0.0029687881469726562 nb_pixel_total : 69727 time to create 1 rle with old method : 0.07764434814453125 length of segment : 552 time for calcul the mask position with numpy : 0.0029277801513671875 nb_pixel_total : 83959 time to create 1 rle with old method : 0.0921485424041748 length of segment : 681 time for calcul the mask position with numpy : 0.0008311271667480469 nb_pixel_total : 11051 time to create 1 rle with old method : 0.012903451919555664 length of segment : 239 time for calcul the mask position with numpy : 0.0016713142395019531 nb_pixel_total : 53264 time to create 1 rle with old method : 0.06296801567077637 length of segment : 248 time for calcul the mask position with numpy : 0.0030059814453125 nb_pixel_total : 91093 time to create 1 rle with old method : 0.10584783554077148 length of segment : 340 time for calcul the mask position with numpy : 0.004037618637084961 nb_pixel_total : 136720 time to create 1 rle with old method : 0.15401935577392578 length of segment : 485 time for calcul the mask position with numpy : 0.003459453582763672 nb_pixel_total : 115316 time to create 1 rle with old method : 0.13263177871704102 length of segment : 473 time for calcul the mask position with numpy : 0.0036585330963134766 nb_pixel_total : 158767 time to create 1 rle with new method : 0.0070078372955322266 length of segment : 489 time for calcul the mask position with numpy : 0.0010318756103515625 nb_pixel_total : 33263 time to create 1 rle with old method : 0.03719449043273926 length of segment : 274 time for calcul the mask position with numpy : 0.0010921955108642578 nb_pixel_total : 39426 time to create 1 rle with old method : 0.044676780700683594 length of segment : 320 time for calcul the mask position with numpy : 0.0010459423065185547 nb_pixel_total : 41695 time to create 1 rle with old method : 0.05167698860168457 length of segment : 194 time for calcul the mask position with numpy : 0.0019292831420898438 nb_pixel_total : 73742 time to create 1 rle with old method : 0.08469796180725098 length of segment : 390 time for calcul the mask position with numpy : 0.003198862075805664 nb_pixel_total : 111743 time to create 1 rle with old method : 0.12484145164489746 length of segment : 426 time for calcul the mask position with numpy : 0.002526998519897461 nb_pixel_total : 103600 time to create 1 rle with old method : 0.1144256591796875 length of segment : 596 time for calcul the mask position with numpy : 0.000804901123046875 nb_pixel_total : 18767 time to create 1 rle with old method : 0.021186351776123047 length of segment : 236 time for calcul the mask position with numpy : 0.0021991729736328125 nb_pixel_total : 73004 time to create 1 rle with old method : 0.08272409439086914 length of segment : 443 time for calcul the mask position with numpy : 0.0011451244354248047 nb_pixel_total : 27450 time to create 1 rle with old method : 0.03128552436828613 length of segment : 197 time for calcul the mask position with numpy : 0.009201288223266602 nb_pixel_total : 295506 time to create 1 rle with new method : 0.024349689483642578 length of segment : 780 time for calcul the mask position with numpy : 0.001497507095336914 nb_pixel_total : 48268 time to create 1 rle with old method : 0.055979013442993164 length of segment : 274 time for calcul the mask position with numpy : 0.0017955303192138672 nb_pixel_total : 46268 time to create 1 rle with old method : 0.05213665962219238 length of segment : 552 time for calcul the mask position with numpy : 0.0025758743286132812 nb_pixel_total : 82699 time to create 1 rle with old method : 0.09551000595092773 length of segment : 307 time for calcul the mask position with numpy : 0.0015816688537597656 nb_pixel_total : 55965 time to create 1 rle with old method : 0.06730294227600098 length of segment : 208 time for calcul the mask position with numpy : 0.4180467128753662 nb_pixel_total : 445640 time to create 1 rle with new method : 0.04196810722351074 length of segment : 725 time for calcul the mask position with numpy : 0.0016887187957763672 nb_pixel_total : 45593 time to create 1 rle with old method : 0.05321621894836426 length of segment : 304 time for calcul the mask position with numpy : 0.0008234977722167969 nb_pixel_total : 15193 time to create 1 rle with old method : 0.021129846572875977 length of segment : 164 time for calcul the mask position with numpy : 0.0048999786376953125 nb_pixel_total : 146443 time to create 1 rle with old method : 0.1670217514038086 length of segment : 464 time for calcul the mask position with numpy : 0.004366159439086914 nb_pixel_total : 116188 time to create 1 rle with old method : 0.13536596298217773 length of segment : 595 time for calcul the mask position with numpy : 0.0026061534881591797 nb_pixel_total : 93162 time to create 1 rle with old method : 0.10833859443664551 length of segment : 584 time for calcul the mask position with numpy : 0.00545501708984375 nb_pixel_total : 191927 time to create 1 rle with new method : 0.012666463851928711 length of segment : 563 time for calcul the mask position with numpy : 0.0018570423126220703 nb_pixel_total : 41006 time to create 1 rle with old method : 0.049796342849731445 length of segment : 357 time for calcul the mask position with numpy : 0.001901388168334961 nb_pixel_total : 25609 time to create 1 rle with old method : 0.03043365478515625 length of segment : 315 time for calcul the mask position with numpy : 0.007874727249145508 nb_pixel_total : 241530 time to create 1 rle with new method : 0.012942075729370117 length of segment : 397 time for calcul the mask position with numpy : 0.0014777183532714844 nb_pixel_total : 33938 time to create 1 rle with old method : 0.03999972343444824 length of segment : 229 time for calcul the mask position with numpy : 0.0034618377685546875 nb_pixel_total : 87761 time to create 1 rle with old method : 0.10195636749267578 length of segment : 386 time for calcul the mask position with numpy : 0.0006375312805175781 nb_pixel_total : 14572 time to create 1 rle with old method : 0.017624378204345703 length of segment : 139 time for calcul the mask position with numpy : 0.0019214153289794922 nb_pixel_total : 52625 time to create 1 rle with old method : 0.06277656555175781 length of segment : 280 time for calcul the mask position with numpy : 0.0019197463989257812 nb_pixel_total : 56405 time to create 1 rle with old method : 0.06560277938842773 length of segment : 301 time for calcul the mask position with numpy : 0.0010602474212646484 nb_pixel_total : 34216 time to create 1 rle with old method : 0.04041743278503418 length of segment : 234 time for calcul the mask position with numpy : 0.00046253204345703125 nb_pixel_total : 13238 time to create 1 rle with old method : 0.016265392303466797 length of segment : 78 time for calcul the mask position with numpy : 0.004993915557861328 nb_pixel_total : 176921 time to create 1 rle with new method : 0.010176658630371094 length of segment : 535 time for calcul the mask position with numpy : 0.0011410713195800781 nb_pixel_total : 35580 time to create 1 rle with old method : 0.042249202728271484 length of segment : 188 time for calcul the mask position with numpy : 0.00164794921875 nb_pixel_total : 43788 time to create 1 rle with old method : 0.05086207389831543 length of segment : 379 time for calcul the mask position with numpy : 0.002779245376586914 nb_pixel_total : 177158 time to create 1 rle with new method : 0.007966279983520508 length of segment : 523 time for calcul the mask position with numpy : 0.0009756088256835938 nb_pixel_total : 31018 time to create 1 rle with old method : 0.0351865291595459 length of segment : 171 time for calcul the mask position with numpy : 0.004286527633666992 nb_pixel_total : 159134 time to create 1 rle with new method : 0.006306171417236328 length of segment : 510 time for calcul the mask position with numpy : 0.002128124237060547 nb_pixel_total : 80192 time to create 1 rle with old method : 0.0891273021697998 length of segment : 280 time for calcul the mask position with numpy : 0.0014107227325439453 nb_pixel_total : 68354 time to create 1 rle with old method : 0.07612109184265137 length of segment : 180 time for calcul the mask position with numpy : 0.0034286975860595703 nb_pixel_total : 144213 time to create 1 rle with old method : 0.16184711456298828 length of segment : 398 time for calcul the mask position with numpy : 0.0054645538330078125 nb_pixel_total : 255156 time to create 1 rle with new method : 0.007932901382446289 length of segment : 501 time for calcul the mask position with numpy : 0.00424957275390625 nb_pixel_total : 156254 time to create 1 rle with new method : 0.00883626937866211 length of segment : 469 time for calcul the mask position with numpy : 0.0047016143798828125 nb_pixel_total : 154416 time to create 1 rle with new method : 0.008078336715698242 length of segment : 433 time for calcul the mask position with numpy : 0.0011458396911621094 nb_pixel_total : 57814 time to create 1 rle with old method : 0.06607222557067871 length of segment : 240 time for calcul the mask position with numpy : 0.002703428268432617 nb_pixel_total : 76637 time to create 1 rle with old method : 0.08753466606140137 length of segment : 391 time for calcul the mask position with numpy : 0.0017600059509277344 nb_pixel_total : 60778 time to create 1 rle with old method : 0.0686955451965332 length of segment : 356 time for calcul the mask position with numpy : 0.003514528274536133 nb_pixel_total : 160660 time to create 1 rle with new method : 0.0059468746185302734 length of segment : 744 time for calcul the mask position with numpy : 0.0004894733428955078 nb_pixel_total : 23000 time to create 1 rle with old method : 0.02556014060974121 length of segment : 221 time for calcul the mask position with numpy : 0.0011529922485351562 nb_pixel_total : 26674 time to create 1 rle with old method : 0.030870437622070312 length of segment : 366 time for calcul the mask position with numpy : 0.0011582374572753906 nb_pixel_total : 39968 time to create 1 rle with old method : 0.0452573299407959 length of segment : 237 time for calcul the mask position with numpy : 0.002570629119873047 nb_pixel_total : 103823 time to create 1 rle with old method : 0.11878848075866699 length of segment : 439 time for calcul the mask position with numpy : 0.002496480941772461 nb_pixel_total : 57186 time to create 1 rle with old method : 0.06302142143249512 length of segment : 382 time for calcul the mask position with numpy : 0.0060253143310546875 nb_pixel_total : 173932 time to create 1 rle with new method : 0.007999658584594727 length of segment : 639 time for calcul the mask position with numpy : 0.0030889511108398438 nb_pixel_total : 91345 time to create 1 rle with old method : 0.10445785522460938 length of segment : 326 time for calcul the mask position with numpy : 0.009091377258300781 nb_pixel_total : 419230 time to create 1 rle with new method : 0.02111220359802246 length of segment : 749 time for calcul the mask position with numpy : 0.0014581680297851562 nb_pixel_total : 41692 time to create 1 rle with old method : 0.04778790473937988 length of segment : 252 time for calcul the mask position with numpy : 0.001931905746459961 nb_pixel_total : 66166 time to create 1 rle with old method : 0.07753777503967285 length of segment : 304 time for calcul the mask position with numpy : 0.0006384849548339844 nb_pixel_total : 19021 time to create 1 rle with old method : 0.025547266006469727 length of segment : 128 time for calcul the mask position with numpy : 0.002765655517578125 nb_pixel_total : 56562 time to create 1 rle with old method : 0.06539630889892578 length of segment : 434 time for calcul the mask position with numpy : 0.0012531280517578125 nb_pixel_total : 36483 time to create 1 rle with old method : 0.04268479347229004 length of segment : 184 time for calcul the mask position with numpy : 0.0007429122924804688 nb_pixel_total : 19496 time to create 1 rle with old method : 0.023064851760864258 length of segment : 162 time for calcul the mask position with numpy : 0.0015027523040771484 nb_pixel_total : 46024 time to create 1 rle with old method : 0.05238962173461914 length of segment : 267 time for calcul the mask position with numpy : 0.0008275508880615234 nb_pixel_total : 15783 time to create 1 rle with old method : 0.018740177154541016 length of segment : 201 time for calcul the mask position with numpy : 0.004323005676269531 nb_pixel_total : 143006 time to create 1 rle with old method : 0.16254544258117676 length of segment : 452 time for calcul the mask position with numpy : 0.002679109573364258 nb_pixel_total : 88360 time to create 1 rle with old method : 0.11863207817077637 length of segment : 372 time for calcul the mask position with numpy : 0.0019085407257080078 nb_pixel_total : 39051 time to create 1 rle with old method : 0.0489349365234375 length of segment : 229 time for calcul the mask position with numpy : 0.000682830810546875 nb_pixel_total : 20731 time to create 1 rle with old method : 0.023695707321166992 length of segment : 172 time for calcul the mask position with numpy : 0.0017006397247314453 nb_pixel_total : 51053 time to create 1 rle with old method : 0.05725693702697754 length of segment : 415 time for calcul the mask position with numpy : 0.003908872604370117 nb_pixel_total : 85715 time to create 1 rle with old method : 0.09791731834411621 length of segment : 381 time for calcul the mask position with numpy : 0.0073812007904052734 nb_pixel_total : 269795 time to create 1 rle with new method : 0.015432357788085938 length of segment : 743 time for calcul the mask position with numpy : 0.002547025680541992 nb_pixel_total : 19838 time to create 1 rle with old method : 0.0391845703125 length of segment : 191 time for calcul the mask position with numpy : 0.0013566017150878906 nb_pixel_total : 19337 time to create 1 rle with old method : 0.03256082534790039 length of segment : 159 time for calcul the mask position with numpy : 0.002573251724243164 nb_pixel_total : 71204 time to create 1 rle with old method : 0.11134815216064453 length of segment : 372 time for calcul the mask position with numpy : 0.002034425735473633 nb_pixel_total : 60169 time to create 1 rle with old method : 0.0795891284942627 length of segment : 358 time spent for convertir_results : 18.716715574264526 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 144 chid ids of type : 3594 Number RLEs to save : 60233 save missing photos in datou_result : time spend for datou_step_exec : 90.3208417892456 time spend to save output : 3.786128282546997 total time spend for step 1 : 94.1069700717926 step2:crop_condition Mon Sep 8 15:42:04 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 9 ! batch 1 Loaded 144 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 118 About to insert : list_path_to_insert length 118 new photo from crops ! About to upload 118 photos upload in portfolio : 3736932 init cache_photo without model_param we have 118 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757338976_2454336 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 118 photos in the portfolio 3736932 time of upload the photos Elapsed time : 29.309519290924072 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 12 About to insert : list_path_to_insert length 12 new photo from crops ! About to upload 12 photos upload in portfolio : 3736932 init cache_photo without model_param we have 12 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757339015_2454336 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 12 photos in the portfolio 3736932 time of upload the photos Elapsed time : 3.0325474739074707 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757339020_2454336 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.8134961128234863 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 12 About to insert : list_path_to_insert length 12 new photo from crops ! About to upload 12 photos upload in portfolio : 3736932 init cache_photo without model_param we have 12 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757339028_2454336 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 12 photos in the portfolio 3736932 time of upload the photos Elapsed time : 3.3607540130615234 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1382546638, 1382546636, 1382546635, 1382546634, 1382546592, 1382546585, 1382546578, 1382546573, 1382546568] Looping around the photos to save general results len do output : 144 /1382559549Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559550Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559551Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559552Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559553Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559554Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559555Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559556Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559557Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559558Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559559Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559560Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559561Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559562Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559563Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559564Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559565Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559566Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559567Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559568Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559569Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559570Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559571Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559572Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559573Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559574Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559575Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559576Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559577Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559578Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559579Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559580Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559581Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559582Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559583Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559584Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559585Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559586Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559587Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559588Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559589Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559590Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559591Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559592Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559593Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559594Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559595Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559596Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559597Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559598Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559599Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559601Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559602Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559603Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559604Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559605Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559606Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559607Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559608Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559609Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559610Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559611Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559612Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559613Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559614Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559616Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559617Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559618Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559619Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559620Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559621Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559622Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559624Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559625Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559626Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559627Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559628Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559629Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559630Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559631Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559632Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559633Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559634Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559635Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559636Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559637Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559638Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559639Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559640Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559641Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559642Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559643Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559644Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559645Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559646Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559647Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559648Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559649Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559650Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559651Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559652Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559653Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559654Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559655Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559656Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559657Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559658Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559659Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559660Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559661Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559662Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559663Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559664Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559665Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559666Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559667Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559668Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559669Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559685Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559686Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559687Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559688Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559689Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559690Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559691Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559692Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559693Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559694Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559696Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559697Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559698Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559699Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559704Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559705Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559706Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559707Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559708Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559709Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559710Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559711Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559712Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559713Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559714Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1382559715Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3678744') ('3318', '26644253', '1382546638', None, None, None, None, None, '3678744') ('3318', None, None, None, None, None, None, None, '3678744') ('3318', '26644253', '1382546636', None, None, None, None, None, '3678744') ('3318', None, None, None, None, None, None, None, '3678744') ('3318', '26644253', '1382546635', None, None, None, None, None, '3678744') ('3318', None, None, None, None, None, None, None, '3678744') ('3318', '26644253', '1382546634', None, None, None, None, None, '3678744') ('3318', None, None, None, None, None, None, None, '3678744') ('3318', '26644253', '1382546592', None, None, None, None, None, '3678744') ('3318', None, None, None, None, None, None, None, '3678744') ('3318', '26644253', '1382546585', None, None, None, None, None, '3678744') ('3318', None, None, None, None, None, None, None, '3678744') ('3318', '26644253', '1382546578', None, None, None, None, None, '3678744') ('3318', None, None, None, None, None, None, None, '3678744') ('3318', '26644253', '1382546573', None, None, None, None, None, '3678744') ('3318', None, None, None, None, None, None, None, '3678744') ('3318', '26644253', '1382546568', None, None, None, None, None, '3678744') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 441 time used for this insertion : 0.031784772872924805 save_final save missing photos in datou_result : time spend for datou_step_exec : 106.88963174819946 time spend to save output : 0.03484010696411133 total time spend for step 2 : 106.92447185516357 step3:rle_unique_nms_with_priority Mon Sep 8 15:43:51 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 144 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 17 nb_hashtags : 2 time to prepare the origin masks : 2.8183844089508057 time for calcul the mask position with numpy : 0.22811055183410645 nb_pixel_total : 6965807 time to create 1 rle with new method : 0.337022066116333 time for calcul the mask position with numpy : 0.024619579315185547 nb_pixel_total : 6099 time to create 1 rle with old method : 0.007175922393798828 time for calcul the mask position with numpy : 0.025041818618774414 nb_pixel_total : 28587 time to create 1 rle with old method : 0.03332400321960449 time for calcul the mask position with numpy : 0.02547621726989746 nb_pixel_total : 108301 time to create 1 rle with old method : 0.1252741813659668 time for calcul the mask position with numpy : 0.02454233169555664 nb_pixel_total : 32040 time to create 1 rle with old method : 0.03752470016479492 time for calcul the mask position with numpy : 0.028391122817993164 nb_pixel_total : 94339 time to create 1 rle with old method : 0.12098145484924316 time for calcul the mask position with numpy : 0.030469655990600586 nb_pixel_total : 8107 time to create 1 rle with old method : 0.012093544006347656 time for calcul the mask position with numpy : 0.03083968162536621 nb_pixel_total : 14009 time to create 1 rle with old method : 0.020644664764404297 time for calcul the mask position with numpy : 0.028194427490234375 nb_pixel_total : 160990 time to create 1 rle with new method : 0.3391735553741455 time for calcul the mask position with numpy : 0.033431291580200195 nb_pixel_total : 24353 time to create 1 rle with old method : 0.0372006893157959 time for calcul the mask position with numpy : 0.02599930763244629 nb_pixel_total : 45771 time to create 1 rle with old method : 0.05496358871459961 time for calcul the mask position with numpy : 0.028103351593017578 nb_pixel_total : 133618 time to create 1 rle with old method : 0.1668837070465088 time for calcul the mask position with numpy : 0.029616117477416992 nb_pixel_total : 125656 time to create 1 rle with old method : 0.20433664321899414 time for calcul the mask position with numpy : 0.03201866149902344 nb_pixel_total : 32889 time to create 1 rle with old method : 0.039745330810546875 time for calcul the mask position with numpy : 0.027505159378051758 nb_pixel_total : 264288 time to create 1 rle with new method : 0.340609073638916 time for calcul the mask position with numpy : 0.024363040924072266 nb_pixel_total : 13696 time to create 1 rle with old method : 0.01770782470703125 time for calcul the mask position with numpy : 0.02595996856689453 nb_pixel_total : 25411 time to create 1 rle with old method : 0.04645872116088867 time for calcul the mask position with numpy : 0.03047919273376465 nb_pixel_total : 210439 time to create 1 rle with new method : 0.3520050048828125 create new chi : 3.147538900375366 time to delete rle : 0.02762913703918457 batch 1 Loaded 35 chid ids of type : 3594 ++++++++++++++++++++++++Number RLEs to save : 15373 TO DO : save crop sub photo not yet done ! save time : 0.9551951885223389 nb_obj : 14 nb_hashtags : 2 time to prepare the origin masks : 4.592210054397583 time for calcul the mask position with numpy : 0.2207038402557373 nb_pixel_total : 6587077 time to create 1 rle with new method : 0.3470184803009033 time for calcul the mask position with numpy : 0.02441859245300293 nb_pixel_total : 8385 time to create 1 rle with old method : 0.010440587997436523 time for calcul the mask position with numpy : 0.027225732803344727 nb_pixel_total : 89032 time to create 1 rle with old method : 0.10363173484802246 time for calcul the mask position with numpy : 0.026829957962036133 nb_pixel_total : 21036 time to create 1 rle with old method : 0.024835824966430664 time for calcul the mask position with numpy : 0.031107187271118164 nb_pixel_total : 65089 time to create 1 rle with old method : 0.08247065544128418 time for calcul the mask position with numpy : 0.025698423385620117 nb_pixel_total : 150470 time to create 1 rle with new method : 0.33406734466552734 time for calcul the mask position with numpy : 0.024462223052978516 nb_pixel_total : 82183 time to create 1 rle with old method : 0.09435725212097168 time for calcul the mask position with numpy : 0.026641130447387695 nb_pixel_total : 251528 time to create 1 rle with new method : 0.3423292636871338 time for calcul the mask position with numpy : 0.025083065032958984 nb_pixel_total : 64928 time to create 1 rle with old method : 0.07625985145568848 time for calcul the mask position with numpy : 0.028850317001342773 nb_pixel_total : 326078 time to create 1 rle with new method : 0.5723419189453125 time for calcul the mask position with numpy : 0.02454686164855957 nb_pixel_total : 45888 time to create 1 rle with old method : 0.05279397964477539 time for calcul the mask position with numpy : 0.024393558502197266 nb_pixel_total : 18071 time to create 1 rle with old method : 0.021115541458129883 time for calcul the mask position with numpy : 0.02793145179748535 nb_pixel_total : 295556 time to create 1 rle with new method : 0.564516544342041 time for calcul the mask position with numpy : 0.024893522262573242 nb_pixel_total : 87406 time to create 1 rle with old method : 0.10133218765258789 time for calcul the mask position with numpy : 0.025744199752807617 nb_pixel_total : 201673 time to create 1 rle with new method : 0.6340115070343018 create new chi : 4.124057769775391 time to delete rle : 0.0020704269409179688 batch 1 Loaded 29 chid ids of type : 3594 ++++++++++++++++++++++++++++++Number RLEs to save : 15745 TO DO : save crop sub photo not yet done ! save time : 0.95957350730896 nb_obj : 15 nb_hashtags : 2 time to prepare the origin masks : 5.06043004989624 time for calcul the mask position with numpy : 0.3108999729156494 nb_pixel_total : 6529084 time to create 1 rle with new method : 0.5718669891357422 time for calcul the mask position with numpy : 0.04245734214782715 nb_pixel_total : 135728 time to create 1 rle with old method : 0.1617724895477295 time for calcul the mask position with numpy : 0.043028831481933594 nb_pixel_total : 21100 time to create 1 rle with old method : 0.024886369705200195 time for calcul the mask position with numpy : 0.04163837432861328 nb_pixel_total : 79618 time to create 1 rle with old method : 0.09244370460510254 time for calcul the mask position with numpy : 0.04069781303405762 nb_pixel_total : 1796 time to create 1 rle with old method : 0.0024671554565429688 time for calcul the mask position with numpy : 0.025417804718017578 nb_pixel_total : 45623 time to create 1 rle with old method : 0.05433034896850586 time for calcul the mask position with numpy : 0.02531123161315918 nb_pixel_total : 82514 time to create 1 rle with old method : 0.0966038703918457 time for calcul the mask position with numpy : 0.031484127044677734 nb_pixel_total : 273771 time to create 1 rle with new method : 0.5012698173522949 time for calcul the mask position with numpy : 0.02620530128479004 nb_pixel_total : 53152 time to create 1 rle with old method : 0.0622556209564209 time for calcul the mask position with numpy : 0.025523662567138672 nb_pixel_total : 20021 time to create 1 rle with old method : 0.023677349090576172 time for calcul the mask position with numpy : 0.02573108673095703 nb_pixel_total : 74517 time to create 1 rle with old method : 0.08707928657531738 time for calcul the mask position with numpy : 0.026735305786132812 nb_pixel_total : 173469 time to create 1 rle with new method : 1.9311254024505615 time for calcul the mask position with numpy : 0.045034170150756836 nb_pixel_total : 366409 time to create 1 rle with new method : 0.6428756713867188 time for calcul the mask position with numpy : 0.04403066635131836 nb_pixel_total : 170039 time to create 1 rle with new method : 0.5059092044830322 time for calcul the mask position with numpy : 0.04163026809692383 nb_pixel_total : 176236 time to create 1 rle with new method : 0.5287854671478271 time for calcul the mask position with numpy : 0.04016828536987305 nb_pixel_total : 91323 time to create 1 rle with old method : 0.1058645248413086 create new chi : 6.4139697551727295 time to delete rle : 0.002605438232421875 batch 1 Loaded 31 chid ids of type : 3594 ++++++++++++++++++++++Number RLEs to save : 16419 TO DO : save crop sub photo not yet done ! save time : 0.9969751834869385 nb_obj : 18 nb_hashtags : 2 time to prepare the origin masks : 8.692996740341187 time for calcul the mask position with numpy : 0.2615823745727539 nb_pixel_total : 6209987 time to create 1 rle with new method : 0.8846919536590576 time for calcul the mask position with numpy : 0.027806520462036133 nb_pixel_total : 11051 time to create 1 rle with old method : 0.013395547866821289 time for calcul the mask position with numpy : 0.025359153747558594 nb_pixel_total : 83959 time to create 1 rle with old method : 0.10633182525634766 time for calcul the mask position with numpy : 0.025086164474487305 nb_pixel_total : 69727 time to create 1 rle with old method : 0.07921791076660156 time for calcul the mask position with numpy : 0.025054216384887695 nb_pixel_total : 17636 time to create 1 rle with old method : 0.020378828048706055 time for calcul the mask position with numpy : 0.025705814361572266 nb_pixel_total : 70610 time to create 1 rle with old method : 0.08119344711303711 time for calcul the mask position with numpy : 0.02556443214416504 nb_pixel_total : 169855 time to create 1 rle with new method : 0.537614107131958 time for calcul the mask position with numpy : 0.027852296829223633 nb_pixel_total : 298208 time to create 1 rle with new method : 0.6265413761138916 time for calcul the mask position with numpy : 0.031018972396850586 nb_pixel_total : 12850 time to create 1 rle with old method : 0.017703533172607422 time for calcul the mask position with numpy : 0.02660083770751953 nb_pixel_total : 31909 time to create 1 rle with old method : 0.03730940818786621 time for calcul the mask position with numpy : 0.027065038681030273 nb_pixel_total : 132618 time to create 1 rle with old method : 0.1544957160949707 time for calcul the mask position with numpy : 0.034119606018066406 nb_pixel_total : 445872 time to create 1 rle with new method : 1.014843463897705 time for calcul the mask position with numpy : 0.027120113372802734 nb_pixel_total : 71138 time to create 1 rle with old method : 0.08317255973815918 time for calcul the mask position with numpy : 0.02539968490600586 nb_pixel_total : 151803 time to create 1 rle with new method : 0.6939468383789062 time for calcul the mask position with numpy : 0.027309417724609375 nb_pixel_total : 96149 time to create 1 rle with old method : 0.1218116283416748 time for calcul the mask position with numpy : 0.028050661087036133 nb_pixel_total : 53455 time to create 1 rle with old method : 0.06874442100524902 time for calcul the mask position with numpy : 0.03132319450378418 nb_pixel_total : 61345 time to create 1 rle with old method : 0.07629752159118652 time for calcul the mask position with numpy : 0.048731327056884766 nb_pixel_total : 208772 time to create 1 rle with new method : 0.5165698528289795 time for calcul the mask position with numpy : 0.04534745216369629 nb_pixel_total : 97456 time to create 1 rle with old method : 0.12267351150512695 create new chi : 6.25748085975647 time to delete rle : 0.003525257110595703 batch 1 Loaded 38 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++Number RLEs to save : 21964 TO DO : save crop sub photo not yet done ! save time : 1.3048737049102783 nb_obj : 13 nb_hashtags : 2 time to prepare the origin masks : 4.852177858352661 time for calcul the mask position with numpy : 0.5779438018798828 nb_pixel_total : 7244000 time to create 1 rle with new method : 0.7334775924682617 time for calcul the mask position with numpy : 0.04095005989074707 nb_pixel_total : 73004 time to create 1 rle with old method : 0.08315682411193848 time for calcul the mask position with numpy : 0.03981208801269531 nb_pixel_total : 18767 time to create 1 rle with old method : 0.021465539932250977 time for calcul the mask position with numpy : 0.03827476501464844 nb_pixel_total : 103600 time to create 1 rle with old method : 0.11678361892700195 time for calcul the mask position with numpy : 0.024239778518676758 nb_pixel_total : 111743 time to create 1 rle with old method : 0.13005638122558594 time for calcul the mask position with numpy : 0.02541947364807129 nb_pixel_total : 73742 time to create 1 rle with old method : 0.0853271484375 time for calcul the mask position with numpy : 0.026616334915161133 nb_pixel_total : 41695 time to create 1 rle with old method : 0.04875493049621582 time for calcul the mask position with numpy : 0.028013229370117188 nb_pixel_total : 39426 time to create 1 rle with old method : 0.045885562896728516 time for calcul the mask position with numpy : 0.02697467803955078 nb_pixel_total : 33263 time to create 1 rle with old method : 0.03828167915344238 time for calcul the mask position with numpy : 0.026619672775268555 nb_pixel_total : 158767 time to create 1 rle with new method : 0.7131109237670898 time for calcul the mask position with numpy : 0.026766061782836914 nb_pixel_total : 115316 time to create 1 rle with old method : 0.12985920906066895 time for calcul the mask position with numpy : 0.025400876998901367 nb_pixel_total : 136720 time to create 1 rle with old method : 0.15446972846984863 time for calcul the mask position with numpy : 0.025281190872192383 nb_pixel_total : 91093 time to create 1 rle with old method : 0.105743408203125 time for calcul the mask position with numpy : 0.024898290634155273 nb_pixel_total : 53264 time to create 1 rle with old method : 0.06207537651062012 create new chi : 3.500565767288208 time to delete rle : 0.0017001628875732422 batch 1 Loaded 27 chid ids of type : 3594 +++++++++++++++++++Number RLEs to save : 11988 TO DO : save crop sub photo not yet done ! save time : 0.7246198654174805 nb_obj : 13 nb_hashtags : 3 time to prepare the origin masks : 4.825223445892334 time for calcul the mask position with numpy : 0.40734195709228516 nb_pixel_total : 6684897 time to create 1 rle with new method : 0.6124856472015381 time for calcul the mask position with numpy : 0.025366783142089844 nb_pixel_total : 191887 time to create 1 rle with new method : 0.668278694152832 time for calcul the mask position with numpy : 0.02507495880126953 nb_pixel_total : 92403 time to create 1 rle with old method : 0.10897135734558105 time for calcul the mask position with numpy : 0.025777339935302734 nb_pixel_total : 116188 time to create 1 rle with old method : 0.14395880699157715 time for calcul the mask position with numpy : 0.024462223052978516 nb_pixel_total : 146443 time to create 1 rle with old method : 0.16396188735961914 time for calcul the mask position with numpy : 0.02396535873413086 nb_pixel_total : 15193 time to create 1 rle with old method : 0.017070770263671875 time for calcul the mask position with numpy : 0.023952722549438477 nb_pixel_total : 45593 time to create 1 rle with old method : 0.05211067199707031 time for calcul the mask position with numpy : 0.029279232025146484 nb_pixel_total : 445640 time to create 1 rle with new method : 0.46100592613220215 time for calcul the mask position with numpy : 0.025834321975708008 nb_pixel_total : 55965 time to create 1 rle with old method : 0.06477832794189453 time for calcul the mask position with numpy : 0.02497386932373047 nb_pixel_total : 82699 time to create 1 rle with old method : 0.0959005355834961 time for calcul the mask position with numpy : 0.025504112243652344 nb_pixel_total : 46268 time to create 1 rle with old method : 0.05311083793640137 time for calcul the mask position with numpy : 0.025490760803222656 nb_pixel_total : 48268 time to create 1 rle with old method : 0.05539345741271973 time for calcul the mask position with numpy : 0.02810072898864746 nb_pixel_total : 295506 time to create 1 rle with new method : 0.6193575859069824 time for calcul the mask position with numpy : 0.024443387985229492 nb_pixel_total : 27450 time to create 1 rle with old method : 0.031022310256958008 create new chi : 4.011754989624023 time to delete rle : 0.0019996166229248047 batch 1 Loaded 27 chid ids of type : 3594 +++++++++++++++++Number RLEs to save : 13564 TO DO : save crop sub photo not yet done ! save time : 0.9441671371459961 nb_obj : 16 nb_hashtags : 2 time to prepare the origin masks : 6.021778583526611 time for calcul the mask position with numpy : 0.7802703380584717 nb_pixel_total : 7243550 time to create 1 rle with new method : 0.9102418422698975 time for calcul the mask position with numpy : 0.02817082405090332 nb_pixel_total : 159134 time to create 1 rle with new method : 0.7213845252990723 time for calcul the mask position with numpy : 0.044458627700805664 nb_pixel_total : 31018 time to create 1 rle with old method : 0.03607058525085449 time for calcul the mask position with numpy : 0.041124582290649414 nb_pixel_total : 3509 time to create 1 rle with old method : 0.004815816879272461 time for calcul the mask position with numpy : 0.039191246032714844 nb_pixel_total : 43788 time to create 1 rle with old method : 0.05085563659667969 time for calcul the mask position with numpy : 0.025403976440429688 nb_pixel_total : 35580 time to create 1 rle with old method : 0.041589975357055664 time for calcul the mask position with numpy : 0.02559375762939453 nb_pixel_total : 176921 time to create 1 rle with new method : 0.8182227611541748 time for calcul the mask position with numpy : 0.026981830596923828 nb_pixel_total : 13238 time to create 1 rle with old method : 0.01569962501525879 time for calcul the mask position with numpy : 0.03004145622253418 nb_pixel_total : 34216 time to create 1 rle with old method : 0.04014945030212402 time for calcul the mask position with numpy : 0.030249357223510742 nb_pixel_total : 56405 time to create 1 rle with old method : 0.07334208488464355 time for calcul the mask position with numpy : 0.031357765197753906 nb_pixel_total : 52625 time to create 1 rle with old method : 0.06094813346862793 time for calcul the mask position with numpy : 0.040190696716308594 nb_pixel_total : 14572 time to create 1 rle with old method : 0.01668405532836914 time for calcul the mask position with numpy : 0.04105329513549805 nb_pixel_total : 87761 time to create 1 rle with old method : 0.10026001930236816 time for calcul the mask position with numpy : 0.043016672134399414 nb_pixel_total : 33938 time to create 1 rle with old method : 0.03800606727600098 time for calcul the mask position with numpy : 0.0472407341003418 nb_pixel_total : 241530 time to create 1 rle with new method : 0.6722710132598877 time for calcul the mask position with numpy : 0.03255009651184082 nb_pixel_total : 25609 time to create 1 rle with old method : 0.030213117599487305 time for calcul the mask position with numpy : 0.03462672233581543 nb_pixel_total : 41006 time to create 1 rle with old method : 0.04732060432434082 create new chi : 5.153627634048462 time to delete rle : 0.0026650428771972656 batch 1 Loaded 33 chid ids of type : 3594 +++++++++++++++++Number RLEs to save : 11838 TO DO : save crop sub photo not yet done ! save time : 0.7518942356109619 nb_obj : 14 nb_hashtags : 2 time to prepare the origin masks : 5.77662205696106 time for calcul the mask position with numpy : 0.6660134792327881 nb_pixel_total : 6902542 time to create 1 rle with new method : 0.7507035732269287 time for calcul the mask position with numpy : 0.04048490524291992 nb_pixel_total : 103823 time to create 1 rle with old method : 0.1238713264465332 time for calcul the mask position with numpy : 0.03985095024108887 nb_pixel_total : 39968 time to create 1 rle with old method : 0.04523873329162598 time for calcul the mask position with numpy : 0.03910684585571289 nb_pixel_total : 10889 time to create 1 rle with old method : 0.012861967086791992 time for calcul the mask position with numpy : 0.03451228141784668 nb_pixel_total : 23000 time to create 1 rle with old method : 0.026334524154663086 time for calcul the mask position with numpy : 0.026299715042114258 nb_pixel_total : 160660 time to create 1 rle with new method : 0.5498590469360352 time for calcul the mask position with numpy : 0.028510570526123047 nb_pixel_total : 60778 time to create 1 rle with old method : 0.06941986083984375 time for calcul the mask position with numpy : 0.02535867691040039 nb_pixel_total : 76637 time to create 1 rle with old method : 0.08872556686401367 time for calcul the mask position with numpy : 0.02640247344970703 nb_pixel_total : 57518 time to create 1 rle with old method : 0.0653536319732666 time for calcul the mask position with numpy : 0.027017831802368164 nb_pixel_total : 154416 time to create 1 rle with new method : 0.5329704284667969 time for calcul the mask position with numpy : 0.028777360916137695 nb_pixel_total : 156254 time to create 1 rle with new method : 0.4706552028656006 time for calcul the mask position with numpy : 0.030868053436279297 nb_pixel_total : 255156 time to create 1 rle with new method : 0.6086506843566895 time for calcul the mask position with numpy : 0.03971242904663086 nb_pixel_total : 144213 time to create 1 rle with old method : 0.1713542938232422 time for calcul the mask position with numpy : 0.0340120792388916 nb_pixel_total : 68354 time to create 1 rle with old method : 0.08023571968078613 time for calcul the mask position with numpy : 0.04114222526550293 nb_pixel_total : 80192 time to create 1 rle with old method : 0.12190771102905273 create new chi : 5.011259317398071 time to delete rle : 0.0030078887939453125 batch 1 Loaded 29 chid ids of type : 3594 ++++++++++++++++++++++Number RLEs to save : 12286 TO DO : save crop sub photo not yet done ! save time : 0.7935400009155273 nb_obj : 23 nb_hashtags : 4 time to prepare the origin masks : 10.340970039367676 time for calcul the mask position with numpy : 0.4547255039215088 nb_pixel_total : 6388803 time to create 1 rle with new method : 1.5344147682189941 time for calcul the mask position with numpy : 0.0456695556640625 nb_pixel_total : 57339 time to create 1 rle with old method : 0.06770563125610352 time for calcul the mask position with numpy : 0.04198336601257324 nb_pixel_total : 71204 time to create 1 rle with old method : 0.10517096519470215 time for calcul the mask position with numpy : 0.0411684513092041 nb_pixel_total : 19336 time to create 1 rle with old method : 0.02437591552734375 time for calcul the mask position with numpy : 0.041832923889160156 nb_pixel_total : 19838 time to create 1 rle with old method : 0.02331995964050293 time for calcul the mask position with numpy : 0.05475473403930664 nb_pixel_total : 269795 time to create 1 rle with new method : 1.0951745510101318 time for calcul the mask position with numpy : 0.03952789306640625 nb_pixel_total : 82964 time to create 1 rle with old method : 0.10049772262573242 time for calcul the mask position with numpy : 0.04133796691894531 nb_pixel_total : 51053 time to create 1 rle with old method : 0.0629725456237793 time for calcul the mask position with numpy : 0.03920912742614746 nb_pixel_total : 20731 time to create 1 rle with old method : 0.025099992752075195 time for calcul the mask position with numpy : 0.036521196365356445 nb_pixel_total : 39051 time to create 1 rle with old method : 0.04566812515258789 time for calcul the mask position with numpy : 0.031991004943847656 nb_pixel_total : 88360 time to create 1 rle with old method : 0.11702442169189453 time for calcul the mask position with numpy : 0.034577369689941406 nb_pixel_total : 143006 time to create 1 rle with old method : 0.17920351028442383 time for calcul the mask position with numpy : 0.04541516304016113 nb_pixel_total : 15783 time to create 1 rle with old method : 0.018640756607055664 time for calcul the mask position with numpy : 0.04672527313232422 nb_pixel_total : 46024 time to create 1 rle with old method : 0.05891823768615723 time for calcul the mask position with numpy : 0.046355485916137695 nb_pixel_total : 19496 time to create 1 rle with old method : 0.022899866104125977 time for calcul the mask position with numpy : 0.04890942573547363 nb_pixel_total : 36483 time to create 1 rle with old method : 0.04265189170837402 time for calcul the mask position with numpy : 0.041642189025878906 nb_pixel_total : 56562 time to create 1 rle with old method : 0.0666053295135498 time for calcul the mask position with numpy : 0.04018902778625488 nb_pixel_total : 19021 time to create 1 rle with old method : 0.0225830078125 time for calcul the mask position with numpy : 0.04200601577758789 nb_pixel_total : 66166 time to create 1 rle with old method : 0.07699728012084961 time for calcul the mask position with numpy : 0.04239678382873535 nb_pixel_total : 41692 time to create 1 rle with old method : 0.048621416091918945 time for calcul the mask position with numpy : 0.042807579040527344 nb_pixel_total : 419230 time to create 1 rle with new method : 0.8527417182922363 time for calcul the mask position with numpy : 0.03436684608459473 nb_pixel_total : 91345 time to create 1 rle with old method : 0.10495615005493164 time for calcul the mask position with numpy : 0.03344988822937012 nb_pixel_total : 173932 time to create 1 rle with new method : 0.6380431652069092 time for calcul the mask position with numpy : 0.03576779365539551 nb_pixel_total : 57186 time to create 1 rle with old method : 0.0688314437866211 create new chi : 6.941316366195679 time to delete rle : 0.0030677318572998047 batch 1 Loaded 47 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 17636 TO DO : save crop sub photo not yet done ! save time : 1.0962867736816406 map_output_result : {1382546638: (0.0, 'Should be the crop_list due to order', 0), 1382546636: (0.0, 'Should be the crop_list due to order', 0), 1382546635: (0.0, 'Should be the crop_list due to order', 0), 1382546634: (0.0, 'Should be the crop_list due to order', 0), 1382546592: (0.0, 'Should be the crop_list due to order', 0), 1382546585: (0.0, 'Should be the crop_list due to order', 0), 1382546578: (0.0, 'Should be the crop_list due to order', 0), 1382546573: (0.0, 'Should be the crop_list due to order', 0), 1382546568: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1382546638, 1382546636, 1382546635, 1382546634, 1382546592, 1382546585, 1382546578, 1382546573, 1382546568] Looping around the photos to save general results len do output : 9 /1382546638.Didn't retrieve data . /1382546636.Didn't retrieve data . /1382546635.Didn't retrieve data . /1382546634.Didn't retrieve data . /1382546592.Didn't retrieve data . /1382546585.Didn't retrieve data . /1382546578.Didn't retrieve data . /1382546573.Didn't retrieve data . /1382546568.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3678744') ('3318', '26644253', '1382546638', None, None, None, None, None, '3678744') ('3318', None, None, None, None, None, None, None, '3678744') ('3318', '26644253', '1382546636', None, None, None, None, None, '3678744') ('3318', None, None, None, None, None, None, None, '3678744') ('3318', '26644253', '1382546635', None, None, None, None, None, '3678744') ('3318', None, None, None, None, None, None, None, '3678744') ('3318', '26644253', '1382546634', None, None, None, None, None, '3678744') ('3318', None, None, None, None, None, None, None, '3678744') ('3318', '26644253', '1382546592', None, None, None, None, None, '3678744') ('3318', None, None, None, None, None, None, None, '3678744') ('3318', '26644253', '1382546585', None, None, None, None, None, '3678744') ('3318', None, None, None, None, None, None, None, '3678744') ('3318', '26644253', '1382546578', None, None, None, None, None, '3678744') ('3318', None, None, None, None, None, None, None, '3678744') ('3318', '26644253', '1382546573', None, None, None, None, None, '3678744') ('3318', None, None, None, None, None, None, None, '3678744') ('3318', '26644253', '1382546568', None, None, None, None, None, '3678744') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 27 time used for this insertion : 0.015593528747558594 save_final save missing photos in datou_result : time spend for datou_step_exec : 107.59119653701782 time spend to save output : 0.01620936393737793 total time spend for step 3 : 107.6074059009552 step4:ventilate_hashtags_in_portfolio Mon Sep 8 15:45:39 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 26644253 get user id for portfolio 26644253 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26644253 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','flou','papier','mal_croppe','autre','pehd','pet_clair','background','carton','pet_fonce','metal')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26644253 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','flou','papier','mal_croppe','autre','pehd','pet_clair','background','carton','pet_fonce','metal')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26644253 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','flou','papier','mal_croppe','autre','pehd','pet_clair','background','carton','pet_fonce','metal')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/26644752,26644753,26644754,26644755,26644756,26644757,26644758,26644759,26644760,26644761,26644762?tags=environnement,flou,papier,mal_croppe,autre,pehd,pet_clair,background,carton,pet_fonce,metal Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1382546638, 1382546636, 1382546635, 1382546634, 1382546592, 1382546585, 1382546578, 1382546573, 1382546568] Looping around the photos to save general results len do output : 1 /26644253. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3678744') ('3318', '26644253', '1382546638', None, None, None, None, None, '3678744') ('3318', None, None, None, None, None, None, None, '3678744') ('3318', '26644253', '1382546636', None, None, None, None, None, '3678744') ('3318', None, None, None, None, None, None, None, '3678744') ('3318', '26644253', '1382546635', None, None, None, None, None, '3678744') ('3318', None, None, None, None, None, None, None, '3678744') ('3318', '26644253', '1382546634', None, None, None, None, None, '3678744') ('3318', None, None, None, None, None, None, None, '3678744') ('3318', '26644253', '1382546592', None, None, None, None, None, '3678744') ('3318', None, None, None, None, None, None, None, '3678744') ('3318', '26644253', '1382546585', None, None, None, None, None, '3678744') ('3318', None, None, None, None, None, None, None, '3678744') ('3318', '26644253', '1382546578', None, None, None, None, None, '3678744') ('3318', None, None, None, None, None, None, None, '3678744') ('3318', '26644253', '1382546573', None, None, None, None, None, '3678744') ('3318', None, None, None, None, None, None, None, '3678744') ('3318', '26644253', '1382546568', None, None, None, None, None, '3678744') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.013777732849121094 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.744920015335083 time spend to save output : 0.014004945755004883 total time spend for step 4 : 1.758924961090088 step5:final Mon Sep 8 15:45:41 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1382546638: ('0.18612093031978738',), 1382546636: ('0.18612093031978738',), 1382546635: ('0.18612093031978738',), 1382546634: ('0.18612093031978738',), 1382546592: ('0.18612093031978738',), 1382546585: ('0.18612093031978738',), 1382546578: ('0.18612093031978738',), 1382546573: ('0.18612093031978738',), 1382546568: ('0.18612093031978738',)} new output for save of step final : {1382546638: ('0.18612093031978738',), 1382546636: ('0.18612093031978738',), 1382546635: ('0.18612093031978738',), 1382546634: ('0.18612093031978738',), 1382546592: ('0.18612093031978738',), 1382546585: ('0.18612093031978738',), 1382546578: ('0.18612093031978738',), 1382546573: ('0.18612093031978738',), 1382546568: ('0.18612093031978738',)} [1382546638, 1382546636, 1382546635, 1382546634, 1382546592, 1382546585, 1382546578, 1382546573, 1382546568] Looping around the photos to save general results len do output : 9 /1382546638.Didn't retrieve data . /1382546636.Didn't retrieve data . /1382546635.Didn't retrieve data . /1382546634.Didn't retrieve data . /1382546592.Didn't retrieve data . /1382546585.Didn't retrieve data . /1382546578.Didn't retrieve data . /1382546573.Didn't retrieve data . /1382546568.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3678744') ('3318', '26644253', '1382546638', None, None, None, None, None, '3678744') ('3318', None, None, None, None, None, None, None, '3678744') ('3318', '26644253', '1382546636', None, None, None, None, None, '3678744') ('3318', None, None, None, None, None, None, None, '3678744') ('3318', '26644253', '1382546635', None, None, None, None, None, '3678744') ('3318', None, None, None, None, None, None, None, '3678744') ('3318', '26644253', '1382546634', None, None, None, None, None, '3678744') ('3318', None, None, None, None, None, None, None, '3678744') ('3318', '26644253', '1382546592', None, None, None, None, None, '3678744') ('3318', None, None, None, None, None, None, None, '3678744') ('3318', '26644253', '1382546585', None, None, None, None, None, '3678744') ('3318', None, None, None, None, None, None, None, '3678744') ('3318', '26644253', '1382546578', None, None, None, None, None, '3678744') ('3318', None, None, None, None, None, None, None, '3678744') ('3318', '26644253', '1382546573', None, None, None, None, None, '3678744') ('3318', None, None, None, None, None, None, None, '3678744') ('3318', '26644253', '1382546568', None, None, None, None, None, '3678744') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 27 time used for this insertion : 0.017126083374023438 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.12287020683288574 time spend to save output : 0.01762676239013672 total time spend for step 5 : 0.14049696922302246 step6:blur_detection Mon Sep 8 15:45:41 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1757338829_2454336_1382546638_6521dff3428635acaa694dd5859bfd79.jpg resize: (2160, 3840) 1382546638 -6.9807800343202056 treat image : temp/1757338829_2454336_1382546636_f1bb072d993ce9030fc995139e97a34f.jpg resize: (2160, 3840) 1382546636 -6.393719519678336 treat image : temp/1757338829_2454336_1382546635_c94ae2948d05eae052581c28b193ea90.jpg resize: (2160, 3840) 1382546635 -6.883324558321297 treat image : temp/1757338829_2454336_1382546634_72e5235bed51b44598dcac9a5a675443.jpg resize: (2160, 3840) 1382546634 -6.914617032278928 treat image : temp/1757338829_2454336_1382546592_ffa499cf887345043a4068bc17ae9bbf.jpg resize: (2160, 3840) 1382546592 -6.779157266380433 treat image : temp/1757338829_2454336_1382546585_dc5aa731481b25181d0f65d9d63fbe92.jpg resize: (2160, 3840) 1382546585 -6.922153606792228 treat image : temp/1757338829_2454336_1382546578_70b5708e13836d6357b98ee63d2e210a.jpg resize: (2160, 3840) 1382546578 -6.245481515919921 treat image : temp/1757338829_2454336_1382546573_59d25fbf22aa2f5470f84c9fb3c1dc6a.jpg resize: (2160, 3840) 1382546573 -5.825076776487553 treat image : temp/1757338829_2454336_1382546568_be750d0aa92350f66fe42abde5253e12.jpg resize: (2160, 3840) 1382546568 -6.19904563121909 treat image : temp/1757338829_2454336_1382546638_6521dff3428635acaa694dd5859bfd79_rle_crop_3950984176_0.png resize: (493, 727) 1382559549 -4.172686423985705 treat image : temp/1757338829_2454336_1382546638_6521dff3428635acaa694dd5859bfd79_rle_crop_3950984177_0.png resize: (199, 241) 1382559550 -2.156300071962115 treat image : temp/1757338829_2454336_1382546638_6521dff3428635acaa694dd5859bfd79_rle_crop_3950984179_0.png resize: (516, 1003) 1382559551 -4.384389852108345 treat image : temp/1757338829_2454336_1382546638_6521dff3428635acaa694dd5859bfd79_rle_crop_3950984180_0.png resize: (190, 260) 1382559552 -2.405317224523697 treat image : temp/1757338829_2454336_1382546638_6521dff3428635acaa694dd5859bfd79_rle_crop_3950984181_0.png resize: (689, 281) 1382559553 -4.704900253215797 treat image : temp/1757338829_2454336_1382546638_6521dff3428635acaa694dd5859bfd79_rle_crop_3950984182_0.png resize: (497, 536) 1382559554 -3.090824639428287 treat image : temp/1757338829_2454336_1382546638_6521dff3428635acaa694dd5859bfd79_rle_crop_3950984183_0.png resize: (298, 297) 1382559555 -3.5565886987025035 treat image : temp/1757338829_2454336_1382546638_6521dff3428635acaa694dd5859bfd79_rle_crop_3950984184_0.png resize: (253, 144) 1382559556 -3.990687664842445 treat image : temp/1757338829_2454336_1382546638_6521dff3428635acaa694dd5859bfd79_rle_crop_3950984185_0.png resize: (456, 525) 1382559557 -5.084133782291208 treat image : temp/1757338829_2454336_1382546638_6521dff3428635acaa694dd5859bfd79_rle_crop_3950984186_0.png resize: (212, 83) 1382559558 -2.614590762360486 treat image : temp/1757338829_2454336_1382546638_6521dff3428635acaa694dd5859bfd79_rle_crop_3950984187_0.png resize: (102, 279) 1382559559 -1.884225661985004 treat image : temp/1757338829_2454336_1382546638_6521dff3428635acaa694dd5859bfd79_rle_crop_3950984188_0.png resize: (345, 375) 1382559560 -3.4709526532810635 treat image : temp/1757338829_2454336_1382546638_6521dff3428635acaa694dd5859bfd79_rle_crop_3950984189_0.png resize: (456, 173) 1382559561 -4.303128189019169 treat image : temp/1757338829_2454336_1382546638_6521dff3428635acaa694dd5859bfd79_rle_crop_3950984191_0.png resize: (312, 143) 1382559562 -1.4281305297484213 treat image : temp/1757338829_2454336_1382546638_6521dff3428635acaa694dd5859bfd79_rle_crop_3950984192_0.png resize: (89, 104) 1382559563 -2.300760692401853 treat image : temp/1757338829_2454336_1382546636_f1bb072d993ce9030fc995139e97a34f_rle_crop_3950984193_0.png resize: (611, 492) 1382559564 -1.0801957240818927 treat image : temp/1757338829_2454336_1382546636_f1bb072d993ce9030fc995139e97a34f_rle_crop_3950984194_0.png resize: (591, 228) 1382559565 -0.3286773597025649 treat image : temp/1757338829_2454336_1382546636_f1bb072d993ce9030fc995139e97a34f_rle_crop_3950984195_0.png resize: (594, 720) 1382559566 -1.9765459675034907 treat image : temp/1757338829_2454336_1382546636_f1bb072d993ce9030fc995139e97a34f_rle_crop_3950984196_0.png resize: (138, 165) 1382559567 1.2302593208941994 treat image : temp/1757338829_2454336_1382546636_f1bb072d993ce9030fc995139e97a34f_rle_crop_3950984197_0.png resize: (296, 278) 1382559568 -0.34815241800863084 treat image : temp/1757338829_2454336_1382546636_f1bb072d993ce9030fc995139e97a34f_rle_crop_3950984198_0.png resize: (637, 820) 1382559569 -2.926966788601062 treat image : temp/1757338829_2454336_1382546636_f1bb072d993ce9030fc995139e97a34f_rle_crop_3950984199_0.png resize: (333, 317) 1382559570 -0.22218723773737667 treat image : temp/1757338829_2454336_1382546636_f1bb072d993ce9030fc995139e97a34f_rle_crop_3950984200_0.png resize: (650, 861) 1382559571 -3.81321258228067 treat image : temp/1757338829_2454336_1382546636_f1bb072d993ce9030fc995139e97a34f_rle_crop_3950984201_0.png resize: (389, 403) 1382559572 -2.016901966475325 treat image : temp/1757338829_2454336_1382546636_f1bb072d993ce9030fc995139e97a34f_rle_crop_3950984202_0.png resize: (349, 596) 1382559573 -5.427465495515573 treat image : temp/1757338829_2454336_1382546636_f1bb072d993ce9030fc995139e97a34f_rle_crop_3950984203_0.png resize: (350, 269) 1382559574 -3.4619513791115653 treat image : temp/1757338829_2454336_1382546636_f1bb072d993ce9030fc995139e97a34f_rle_crop_3950984204_0.png resize: (230, 129) 1382559575 -2.9745357896865112 treat image : temp/1757338829_2454336_1382546635_c94ae2948d05eae052581c28b193ea90_rle_crop_3950984207_0.png resize: (445, 329) 1382559576 -4.153744177421394 treat image : temp/1757338829_2454336_1382546635_c94ae2948d05eae052581c28b193ea90_rle_crop_3950984208_0.png resize: (624, 416) 1382559577 -0.3582346551241405 treat image : temp/1757338829_2454336_1382546635_c94ae2948d05eae052581c28b193ea90_rle_crop_3950984209_0.png resize: (407, 597) 1382559578 -3.832212947797606 treat image : temp/1757338829_2454336_1382546635_c94ae2948d05eae052581c28b193ea90_rle_crop_3950984210_0.png resize: (810, 704) 1382559579 -4.488700952003175 treat image : temp/1757338829_2454336_1382546635_c94ae2948d05eae052581c28b193ea90_rle_crop_3950984211_0.png resize: (336, 655) 1382559580 -4.190202935221606 treat image : temp/1757338829_2454336_1382546635_c94ae2948d05eae052581c28b193ea90_rle_crop_3950984212_0.png resize: (434, 290) 1382559581 -3.6411276376606954 treat image : temp/1757338829_2454336_1382546635_c94ae2948d05eae052581c28b193ea90_rle_crop_3950984213_0.png resize: (436, 91) 1382559582 -4.249500875878527 treat image : temp/1757338829_2454336_1382546635_c94ae2948d05eae052581c28b193ea90_rle_crop_3950984214_0.png resize: (277, 264) 1382559583 -3.125727014707162 treat image : temp/1757338829_2454336_1382546635_c94ae2948d05eae052581c28b193ea90_rle_crop_3950984215_0.png resize: (869, 611) 1382559584 -3.433503875462746 treat image : temp/1757338829_2454336_1382546635_c94ae2948d05eae052581c28b193ea90_rle_crop_3950984216_0.png resize: (433, 259) 1382559585 -4.835235120241767 treat image : temp/1757338829_2454336_1382546635_c94ae2948d05eae052581c28b193ea90_rle_crop_3950984217_0.png resize: (313, 200) 1382559586 -3.8018000970281136 treat image : temp/1757338829_2454336_1382546635_c94ae2948d05eae052581c28b193ea90_rle_crop_3950984219_0.png resize: (365, 347) 1382559587 -4.603434774398727 treat image : temp/1757338829_2454336_1382546635_c94ae2948d05eae052581c28b193ea90_rle_crop_3950984220_0.png resize: (165, 170) 1382559588 -4.602654518649971 treat image : temp/1757338829_2454336_1382546635_c94ae2948d05eae052581c28b193ea90_rle_crop_3950984221_0.png resize: (630, 394) 1382559589 -4.451284078235355 treat image : temp/1757338829_2454336_1382546634_72e5235bed51b44598dcac9a5a675443_rle_crop_3950984222_0.png resize: (763, 174) 1382559590 -1.244097885547365 treat image : temp/1757338829_2454336_1382546634_72e5235bed51b44598dcac9a5a675443_rle_crop_3950984223_0.png resize: (553, 638) 1382559591 -3.1862597301331714 treat image : temp/1757338829_2454336_1382546634_72e5235bed51b44598dcac9a5a675443_rle_crop_3950984224_0.png resize: (774, 235) 1382559592 -2.072484503923412 treat image : temp/1757338829_2454336_1382546634_72e5235bed51b44598dcac9a5a675443_rle_crop_3950984225_0.png resize: (289, 289) 1382559593 -2.921223478836194 treat image : temp/1757338829_2454336_1382546634_72e5235bed51b44598dcac9a5a675443_rle_crop_3950984226_0.png resize: (479, 423) 1382559594 -2.1499242075508325 treat image : temp/1757338829_2454336_1382546634_72e5235bed51b44598dcac9a5a675443_rle_crop_3950984227_0.png resize: (360, 573) 1382559595 -4.269846691206723 treat image : temp/1757338829_2454336_1382546634_72e5235bed51b44598dcac9a5a675443_rle_crop_3950984228_0.png resize: (485, 180) 1382559596 -4.241507898309976 treat image : temp/1757338829_2454336_1382546634_72e5235bed51b44598dcac9a5a675443_rle_crop_3950984230_0.png resize: (477, 445) 1382559597 -3.770217905254059 treat image : temp/1757338829_2454336_1382546634_72e5235bed51b44598dcac9a5a675443_rle_crop_3950984231_0.png resize: (130, 441) 1382559598 -3.196612346810157 treat image : temp/1757338829_2454336_1382546634_72e5235bed51b44598dcac9a5a675443_rle_crop_3950984232_0.png resize: (114, 227) 1382559599 -1.8654664419325846 treat image : temp/1757338829_2454336_1382546634_72e5235bed51b44598dcac9a5a675443_rle_crop_3950984233_0.png resize: (733, 847) 1382559601 -5.129299562839747 treat image : temp/1757338829_2454336_1382546634_72e5235bed51b44598dcac9a5a675443_rle_crop_3950984234_0.png resize: (568, 509) 1382559602 -4.931764200546903 treat image : temp/1757338829_2454336_1382546634_72e5235bed51b44598dcac9a5a675443_rle_crop_3950984236_0.png resize: (211, 115) 1382559603 -2.8642528220351067 treat image : temp/1757338829_2454336_1382546634_72e5235bed51b44598dcac9a5a675443_rle_crop_3950984237_0.png resize: (171, 169) 1382559604 -4.345447334958244 treat image : temp/1757338829_2454336_1382546634_72e5235bed51b44598dcac9a5a675443_rle_crop_3950984238_0.png resize: (390, 306) 1382559605 -4.4618344313888825 treat image : temp/1757338829_2454336_1382546634_72e5235bed51b44598dcac9a5a675443_rle_crop_3950984239_0.png resize: (384, 357) 1382559606 -4.248819500091393 treat image : temp/1757338829_2454336_1382546634_72e5235bed51b44598dcac9a5a675443_rle_crop_3950984240_0.png resize: (201, 99) 1382559607 -3.352859716290333 treat image : temp/1757338829_2454336_1382546592_ffa499cf887345043a4068bc17ae9bbf_rle_crop_3950984241_0.png resize: (231, 358) 1382559608 -4.040149352723824 treat image : temp/1757338829_2454336_1382546592_ffa499cf887345043a4068bc17ae9bbf_rle_crop_3950984242_0.png resize: (315, 516) 1382559609 -3.866180414057998 treat image : temp/1757338829_2454336_1382546592_ffa499cf887345043a4068bc17ae9bbf_rle_crop_3950984243_0.png resize: (377, 552) 1382559610 -4.797247336800988 treat image : temp/1757338829_2454336_1382546592_ffa499cf887345043a4068bc17ae9bbf_rle_crop_3950984244_0.png resize: (473, 439) 1382559611 -3.9851457003328976 treat image : temp/1757338829_2454336_1382546592_ffa499cf887345043a4068bc17ae9bbf_rle_crop_3950984245_0.png resize: (349, 641) 1382559612 -4.853987722672966 treat image : temp/1757338829_2454336_1382546592_ffa499cf887345043a4068bc17ae9bbf_rle_crop_3950984246_0.png resize: (243, 209) 1382559613 -0.39648907547672485 treat image : temp/1757338829_2454336_1382546592_ffa499cf887345043a4068bc17ae9bbf_rle_crop_3950984247_0.png resize: (218, 303) 1382559614 -4.940101749415582 treat image : temp/1757338829_2454336_1382546592_ffa499cf887345043a4068bc17ae9bbf_rle_crop_3950984248_0.png resize: (190, 308) 1382559616 -3.790314124040225 treat image : temp/1757338829_2454336_1382546592_ffa499cf887345043a4068bc17ae9bbf_rle_crop_3950984249_0.png resize: (389, 394) 1382559617 -2.594414076754211 treat image : temp/1757338829_2454336_1382546592_ffa499cf887345043a4068bc17ae9bbf_rle_crop_3950984250_0.png resize: (390, 368) 1382559618 -3.2350568266907946 treat image : temp/1757338829_2454336_1382546592_ffa499cf887345043a4068bc17ae9bbf_rle_crop_3950984251_0.png resize: (556, 248) 1382559619 -3.6690676724629308 treat image : temp/1757338829_2454336_1382546592_ffa499cf887345043a4068bc17ae9bbf_rle_crop_3950984252_0.png resize: (225, 148) 1382559620 -4.190052108542745 treat image : temp/1757338829_2454336_1382546585_dc5aa731481b25181d0f65d9d63fbe92_rle_crop_3950984254_0.png resize: (195, 244) 1382559621 -1.6907497803278346 treat image : temp/1757338829_2454336_1382546585_dc5aa731481b25181d0f65d9d63fbe92_rle_crop_3950984255_0.png resize: (777, 611) 1382559622 -2.9547158143464274 treat image : temp/1757338829_2454336_1382546585_dc5aa731481b25181d0f65d9d63fbe92_rle_crop_3950984256_0.png resize: (272, 277) 1382559624 -3.2062959317982402 treat image : temp/1757338829_2454336_1382546585_dc5aa731481b25181d0f65d9d63fbe92_rle_crop_3950984257_0.png resize: (439, 173) 1382559625 -3.204344231428384 treat image : temp/1757338829_2454336_1382546585_dc5aa731481b25181d0f65d9d63fbe92_rle_crop_3950984258_0.png resize: (306, 424) 1382559626 -4.353536780457709 treat image : temp/1757338829_2454336_1382546585_dc5aa731481b25181d0f65d9d63fbe92_rle_crop_3950984259_0.png resize: (200, 386) 1382559627 -4.1901074620647485 treat image : temp/1757338829_2454336_1382546585_dc5aa731481b25181d0f65d9d63fbe92_rle_crop_3950984261_0.png resize: (304, 238) 1382559628 -3.6396466653489323 treat image : temp/1757338829_2454336_1382546585_dc5aa731481b25181d0f65d9d63fbe92_rle_crop_3950984262_0.png resize: (163, 139) 1382559629 -4.707676641411801 treat image : temp/1757338829_2454336_1382546585_dc5aa731481b25181d0f65d9d63fbe92_rle_crop_3950984263_0.png resize: (464, 494) 1382559630 -3.5378501269975673 treat image : temp/1757338829_2454336_1382546585_dc5aa731481b25181d0f65d9d63fbe92_rle_crop_3950984264_0.png resize: (513, 464) 1382559631 -4.51271540459475 treat image : temp/1757338829_2454336_1382546585_dc5aa731481b25181d0f65d9d63fbe92_rle_crop_3950984265_0.png resize: (349, 453) 1382559632 -5.221484131591262 treat image : temp/1757338829_2454336_1382546578_70b5708e13836d6357b98ee63d2e210a_rle_crop_3950984268_0.png resize: (315, 260) 1382559633 -1.8417424782383178 treat image : temp/1757338829_2454336_1382546578_70b5708e13836d6357b98ee63d2e210a_rle_crop_3950984269_0.png resize: (397, 854) 1382559634 1.141545529571448 treat image : temp/1757338829_2454336_1382546578_70b5708e13836d6357b98ee63d2e210a_rle_crop_3950984270_0.png resize: (228, 225) 1382559635 -4.281264095775736 treat image : temp/1757338829_2454336_1382546578_70b5708e13836d6357b98ee63d2e210a_rle_crop_3950984271_0.png resize: (381, 336) 1382559636 -3.489652423323056 treat image : temp/1757338829_2454336_1382546578_70b5708e13836d6357b98ee63d2e210a_rle_crop_3950984272_0.png resize: (139, 178) 1382559637 -1.3753065292871782 treat image : temp/1757338829_2454336_1382546578_70b5708e13836d6357b98ee63d2e210a_rle_crop_3950984273_0.png resize: (280, 291) 1382559638 -3.9454509644238316 treat image : temp/1757338829_2454336_1382546578_70b5708e13836d6357b98ee63d2e210a_rle_crop_3950984274_0.png resize: (301, 301) 1382559639 -3.653965379308818 treat image : temp/1757338829_2454336_1382546578_70b5708e13836d6357b98ee63d2e210a_rle_crop_3950984275_0.png resize: (234, 218) 1382559640 -3.273022984873621 treat image : temp/1757338829_2454336_1382546578_70b5708e13836d6357b98ee63d2e210a_rle_crop_3950984276_0.png resize: (77, 237) 1382559641 -2.284806219006706 treat image : temp/1757338829_2454336_1382546578_70b5708e13836d6357b98ee63d2e210a_rle_crop_3950984277_0.png resize: (534, 483) 1382559642 -3.4547083008090316 treat image : temp/1757338829_2454336_1382546578_70b5708e13836d6357b98ee63d2e210a_rle_crop_3950984279_0.png resize: (379, 177) 1382559643 -4.028887345687471 treat image : temp/1757338829_2454336_1382546578_70b5708e13836d6357b98ee63d2e210a_rle_crop_3950984281_0.png resize: (159, 271) 1382559644 -3.1407831298617768 treat image : temp/1757338829_2454336_1382546578_70b5708e13836d6357b98ee63d2e210a_rle_crop_3950984282_0.png resize: (510, 408) 1382559645 1.5213827367731807 treat image : temp/1757338829_2454336_1382546573_59d25fbf22aa2f5470f84c9fb3c1dc6a_rle_crop_3950984283_0.png resize: (280, 479) 1382559646 -3.1693068645368356 treat image : temp/1757338829_2454336_1382546573_59d25fbf22aa2f5470f84c9fb3c1dc6a_rle_crop_3950984284_0.png resize: (180, 451) 1382559647 -2.146937746988935 treat image : temp/1757338829_2454336_1382546573_59d25fbf22aa2f5470f84c9fb3c1dc6a_rle_crop_3950984285_0.png resize: (389, 561) 1382559648 -3.9719410917098186 treat image : temp/1757338829_2454336_1382546573_59d25fbf22aa2f5470f84c9fb3c1dc6a_rle_crop_3950984286_0.png resize: (436, 732) 1382559649 -2.7002443054936256 treat image : temp/1757338829_2454336_1382546573_59d25fbf22aa2f5470f84c9fb3c1dc6a_rle_crop_3950984287_0.png resize: (418, 591) 1382559650 -3.036401992526028 treat image : temp/1757338829_2454336_1382546573_59d25fbf22aa2f5470f84c9fb3c1dc6a_rle_crop_3950984288_0.png resize: (379, 828) 1382559651 -1.3571982713863073 treat image : temp/1757338829_2454336_1382546573_59d25fbf22aa2f5470f84c9fb3c1dc6a_rle_crop_3950984289_0.png resize: (240, 310) 1382559652 -3.786311673214647 treat image : temp/1757338829_2454336_1382546573_59d25fbf22aa2f5470f84c9fb3c1dc6a_rle_crop_3950984290_0.png resize: (352, 411) 1382559653 -3.1616969170314833 treat image : temp/1757338829_2454336_1382546573_59d25fbf22aa2f5470f84c9fb3c1dc6a_rle_crop_3950984291_0.png resize: (353, 251) 1382559654 -3.536475034875285 treat image : temp/1757338829_2454336_1382546573_59d25fbf22aa2f5470f84c9fb3c1dc6a_rle_crop_3950984292_0.png resize: (638, 370) 1382559655 -5.050863412506068 treat image : temp/1757338829_2454336_1382546573_59d25fbf22aa2f5470f84c9fb3c1dc6a_rle_crop_3950984293_0.png resize: (178, 220) 1382559656 -3.0357223664110724 treat image : temp/1757338829_2454336_1382546573_59d25fbf22aa2f5470f84c9fb3c1dc6a_rle_crop_3950984295_0.png resize: (227, 239) 1382559657 -2.88986359965002 treat image : temp/1757338829_2454336_1382546568_be750d0aa92350f66fe42abde5253e12_rle_crop_3950984297_0.png resize: (382, 345) 1382559658 -0.3944556296524567 treat image : temp/1757338829_2454336_1382546568_be750d0aa92350f66fe42abde5253e12_rle_crop_3950984298_0.png resize: (586, 564) 1382559659 -0.6985995940862617 treat image : temp/1757338829_2454336_1382546568_be750d0aa92350f66fe42abde5253e12_rle_crop_3950984299_0.png resize: (303, 465) 1382559660 -1.2309483333352524 treat image : temp/1757338829_2454336_1382546568_be750d0aa92350f66fe42abde5253e12_rle_crop_3950984301_0.png resize: (252, 274) 1382559661 -1.0071686767627128 treat image : temp/1757338829_2454336_1382546568_be750d0aa92350f66fe42abde5253e12_rle_crop_3950984303_0.png resize: (126, 215) 1382559662 -2.9186515336073464 treat image : temp/1757338829_2454336_1382546568_be750d0aa92350f66fe42abde5253e12_rle_crop_3950984304_0.png resize: (434, 338) 1382559663 -3.533090579274806 treat image : temp/1757338829_2454336_1382546568_be750d0aa92350f66fe42abde5253e12_rle_crop_3950984305_0.png resize: (154, 341) 1382559664 -1.550117437346056 treat image : temp/1757338829_2454336_1382546568_be750d0aa92350f66fe42abde5253e12_rle_crop_3950984308_0.png resize: (177, 204) 1382559665 -2.326424500670605 treat image : temp/1757338829_2454336_1382546568_be750d0aa92350f66fe42abde5253e12_rle_crop_3950984309_0.png resize: (400, 628) 1382559666 -4.769710157583101 treat image : temp/1757338829_2454336_1382546568_be750d0aa92350f66fe42abde5253e12_rle_crop_3950984310_0.png resize: (300, 454) 1382559667 -3.9056744277573197 treat image : temp/1757338829_2454336_1382546568_be750d0aa92350f66fe42abde5253e12_rle_crop_3950984315_0.png resize: (624, 672) 1382559668 -2.2423497696130688 treat image : temp/1757338829_2454336_1382546568_be750d0aa92350f66fe42abde5253e12_rle_crop_3950984317_0.png resize: (159, 242) 1382559669 -2.700385458803453 treat image : temp/1757338829_2454336_1382546635_c94ae2948d05eae052581c28b193ea90_rle_crop_3950984218_0.png resize: (433, 259) 1382559685 -4.912849982751324 treat image : temp/1757338829_2454336_1382546634_72e5235bed51b44598dcac9a5a675443_rle_crop_3950984229_0.png resize: (791, 1026) 1382559686 -3.7153805451269575 treat image : temp/1757338829_2454336_1382546634_72e5235bed51b44598dcac9a5a675443_rle_crop_3950984235_0.png resize: (538, 177) 1382559687 -4.969817376092154 treat image : temp/1757338829_2454336_1382546585_dc5aa731481b25181d0f65d9d63fbe92_rle_crop_3950984266_0.png resize: (563, 711) 1382559688 -3.8488477643588723 treat image : temp/1757338829_2454336_1382546578_70b5708e13836d6357b98ee63d2e210a_rle_crop_3950984267_0.png resize: (358, 198) 1382559689 -2.624046956827413 treat image : temp/1757338829_2454336_1382546578_70b5708e13836d6357b98ee63d2e210a_rle_crop_3950984278_0.png resize: (157, 339) 1382559690 -3.3070090375672416 treat image : temp/1757338829_2454336_1382546578_70b5708e13836d6357b98ee63d2e210a_rle_crop_3950984280_0.png resize: (523, 496) 1382559691 -3.460525652938584 treat image : temp/1757338829_2454336_1382546568_be750d0aa92350f66fe42abde5253e12_rle_crop_3950984300_0.png resize: (697, 759) 1382559692 -4.68072733652521 treat image : temp/1757338829_2454336_1382546568_be750d0aa92350f66fe42abde5253e12_rle_crop_3950984302_0.png resize: (300, 298) 1382559693 -3.8344063181984875 treat image : temp/1757338829_2454336_1382546568_be750d0aa92350f66fe42abde5253e12_rle_crop_3950984306_0.png resize: (162, 154) 1382559694 -2.2378288623282545 treat image : temp/1757338829_2454336_1382546568_be750d0aa92350f66fe42abde5253e12_rle_crop_3950984307_0.png resize: (266, 247) 1382559696 -4.1471739179137295 treat image : temp/1757338829_2454336_1382546568_be750d0aa92350f66fe42abde5253e12_rle_crop_3950984313_0.png resize: (256, 376) 1382559697 -3.7327826207243273 treat image : temp/1757338829_2454336_1382546568_be750d0aa92350f66fe42abde5253e12_rle_crop_3950984312_0.png resize: (171, 151) 1382559698 -4.593537045099283 treat image : temp/1757338829_2454336_1382546568_be750d0aa92350f66fe42abde5253e12_rle_crop_3950984316_0.png resize: (191, 134) 1382559699 -4.406794743847805 treat image : temp/1757338829_2454336_1382546638_6521dff3428635acaa694dd5859bfd79_rle_crop_3950984178_0.png resize: (155, 118) 1382559704 -1.8073969621814792 treat image : temp/1757338829_2454336_1382546638_6521dff3428635acaa694dd5859bfd79_rle_crop_3950984190_0.png resize: (387, 398) 1382559705 -0.6500660816803175 treat image : temp/1757338829_2454336_1382546636_f1bb072d993ce9030fc995139e97a34f_rle_crop_3950984205_0.png resize: (267, 445) 1382559706 -3.8870865821806055 treat image : temp/1757338829_2454336_1382546636_f1bb072d993ce9030fc995139e97a34f_rle_crop_3950984206_0.png resize: (374, 583) 1382559707 -5.405510254803333 treat image : temp/1757338829_2454336_1382546592_ffa499cf887345043a4068bc17ae9bbf_rle_crop_3950984253_0.png resize: (433, 225) 1382559708 -5.159626072518475 treat image : temp/1757338829_2454336_1382546585_dc5aa731481b25181d0f65d9d63fbe92_rle_crop_3950984260_0.png resize: (695, 1045) 1382559709 -3.685208382764688 treat image : temp/1757338829_2454336_1382546573_59d25fbf22aa2f5470f84c9fb3c1dc6a_rle_crop_3950984294_0.png resize: (237, 547) 1382559710 -1.6648854564950653 treat image : temp/1757338829_2454336_1382546573_59d25fbf22aa2f5470f84c9fb3c1dc6a_rle_crop_3950984296_0.png resize: (379, 436) 1382559711 -2.166867905223684 treat image : temp/1757338829_2454336_1382546568_be750d0aa92350f66fe42abde5253e12_rle_crop_3950984311_0.png resize: (200, 290) 1382559712 -4.71230469643879 treat image : temp/1757338829_2454336_1382546568_be750d0aa92350f66fe42abde5253e12_rle_crop_3950984314_0.png resize: (293, 617) 1382559713 -4.378828205247698 treat image : temp/1757338829_2454336_1382546568_be750d0aa92350f66fe42abde5253e12_rle_crop_3950984318_0.png resize: (312, 460) 1382559714 -2.5750336431656073 treat image : temp/1757338829_2454336_1382546568_be750d0aa92350f66fe42abde5253e12_rle_crop_3950984319_0.png resize: (220, 535) 1382559715 -3.6536209872217564 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 153 time used for this insertion : 0.020238161087036133 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 153 time used for this insertion : 0.030466318130493164 save missing photos in datou_result : time spend for datou_step_exec : 46.09714317321777 time spend to save output : 0.055837392807006836 total time spend for step 6 : 46.15298056602478 step7:brightness Mon Sep 8 15:46:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1757338829_2454336_1382546638_6521dff3428635acaa694dd5859bfd79.jpg treat image : temp/1757338829_2454336_1382546636_f1bb072d993ce9030fc995139e97a34f.jpg treat image : temp/1757338829_2454336_1382546635_c94ae2948d05eae052581c28b193ea90.jpg treat image : temp/1757338829_2454336_1382546634_72e5235bed51b44598dcac9a5a675443.jpg treat image : temp/1757338829_2454336_1382546592_ffa499cf887345043a4068bc17ae9bbf.jpg treat image : temp/1757338829_2454336_1382546585_dc5aa731481b25181d0f65d9d63fbe92.jpg treat image : temp/1757338829_2454336_1382546578_70b5708e13836d6357b98ee63d2e210a.jpg treat image : temp/1757338829_2454336_1382546573_59d25fbf22aa2f5470f84c9fb3c1dc6a.jpg treat image : temp/1757338829_2454336_1382546568_be750d0aa92350f66fe42abde5253e12.jpg treat image : temp/1757338829_2454336_1382546638_6521dff3428635acaa694dd5859bfd79_rle_crop_3950984176_0.png treat image : temp/1757338829_2454336_1382546638_6521dff3428635acaa694dd5859bfd79_rle_crop_3950984177_0.png treat image : temp/1757338829_2454336_1382546638_6521dff3428635acaa694dd5859bfd79_rle_crop_3950984179_0.png treat image : temp/1757338829_2454336_1382546638_6521dff3428635acaa694dd5859bfd79_rle_crop_3950984180_0.png treat image : temp/1757338829_2454336_1382546638_6521dff3428635acaa694dd5859bfd79_rle_crop_3950984181_0.png treat image : temp/1757338829_2454336_1382546638_6521dff3428635acaa694dd5859bfd79_rle_crop_3950984182_0.png treat image : temp/1757338829_2454336_1382546638_6521dff3428635acaa694dd5859bfd79_rle_crop_3950984183_0.png treat image : temp/1757338829_2454336_1382546638_6521dff3428635acaa694dd5859bfd79_rle_crop_3950984184_0.png treat image : temp/1757338829_2454336_1382546638_6521dff3428635acaa694dd5859bfd79_rle_crop_3950984185_0.png treat image : temp/1757338829_2454336_1382546638_6521dff3428635acaa694dd5859bfd79_rle_crop_3950984186_0.png treat image : temp/1757338829_2454336_1382546638_6521dff3428635acaa694dd5859bfd79_rle_crop_3950984187_0.png treat image : temp/1757338829_2454336_1382546638_6521dff3428635acaa694dd5859bfd79_rle_crop_3950984188_0.png treat image : temp/1757338829_2454336_1382546638_6521dff3428635acaa694dd5859bfd79_rle_crop_3950984189_0.png treat image : temp/1757338829_2454336_1382546638_6521dff3428635acaa694dd5859bfd79_rle_crop_3950984191_0.png treat image : temp/1757338829_2454336_1382546638_6521dff3428635acaa694dd5859bfd79_rle_crop_3950984192_0.png treat image : temp/1757338829_2454336_1382546636_f1bb072d993ce9030fc995139e97a34f_rle_crop_3950984193_0.png treat image : temp/1757338829_2454336_1382546636_f1bb072d993ce9030fc995139e97a34f_rle_crop_3950984194_0.png treat image : temp/1757338829_2454336_1382546636_f1bb072d993ce9030fc995139e97a34f_rle_crop_3950984195_0.png treat image : temp/1757338829_2454336_1382546636_f1bb072d993ce9030fc995139e97a34f_rle_crop_3950984196_0.png treat image : temp/1757338829_2454336_1382546636_f1bb072d993ce9030fc995139e97a34f_rle_crop_3950984197_0.png treat image : temp/1757338829_2454336_1382546636_f1bb072d993ce9030fc995139e97a34f_rle_crop_3950984198_0.png treat image : temp/1757338829_2454336_1382546636_f1bb072d993ce9030fc995139e97a34f_rle_crop_3950984199_0.png treat image : temp/1757338829_2454336_1382546636_f1bb072d993ce9030fc995139e97a34f_rle_crop_3950984200_0.png treat image : temp/1757338829_2454336_1382546636_f1bb072d993ce9030fc995139e97a34f_rle_crop_3950984201_0.png treat image : temp/1757338829_2454336_1382546636_f1bb072d993ce9030fc995139e97a34f_rle_crop_3950984202_0.png treat image : temp/1757338829_2454336_1382546636_f1bb072d993ce9030fc995139e97a34f_rle_crop_3950984203_0.png treat image : temp/1757338829_2454336_1382546636_f1bb072d993ce9030fc995139e97a34f_rle_crop_3950984204_0.png treat image : temp/1757338829_2454336_1382546635_c94ae2948d05eae052581c28b193ea90_rle_crop_3950984207_0.png treat image : temp/1757338829_2454336_1382546635_c94ae2948d05eae052581c28b193ea90_rle_crop_3950984208_0.png treat image : temp/1757338829_2454336_1382546635_c94ae2948d05eae052581c28b193ea90_rle_crop_3950984209_0.png treat image : temp/1757338829_2454336_1382546635_c94ae2948d05eae052581c28b193ea90_rle_crop_3950984210_0.png treat image : temp/1757338829_2454336_1382546635_c94ae2948d05eae052581c28b193ea90_rle_crop_3950984211_0.png treat image : temp/1757338829_2454336_1382546635_c94ae2948d05eae052581c28b193ea90_rle_crop_3950984212_0.png treat image : temp/1757338829_2454336_1382546635_c94ae2948d05eae052581c28b193ea90_rle_crop_3950984213_0.png treat image : temp/1757338829_2454336_1382546635_c94ae2948d05eae052581c28b193ea90_rle_crop_3950984214_0.png treat image : temp/1757338829_2454336_1382546635_c94ae2948d05eae052581c28b193ea90_rle_crop_3950984215_0.png treat image : temp/1757338829_2454336_1382546635_c94ae2948d05eae052581c28b193ea90_rle_crop_3950984216_0.png treat image : temp/1757338829_2454336_1382546635_c94ae2948d05eae052581c28b193ea90_rle_crop_3950984217_0.png treat image : temp/1757338829_2454336_1382546635_c94ae2948d05eae052581c28b193ea90_rle_crop_3950984219_0.png treat image : temp/1757338829_2454336_1382546635_c94ae2948d05eae052581c28b193ea90_rle_crop_3950984220_0.png treat image : temp/1757338829_2454336_1382546635_c94ae2948d05eae052581c28b193ea90_rle_crop_3950984221_0.png treat image : temp/1757338829_2454336_1382546634_72e5235bed51b44598dcac9a5a675443_rle_crop_3950984222_0.png treat image : temp/1757338829_2454336_1382546634_72e5235bed51b44598dcac9a5a675443_rle_crop_3950984223_0.png treat image : temp/1757338829_2454336_1382546634_72e5235bed51b44598dcac9a5a675443_rle_crop_3950984224_0.png treat image : temp/1757338829_2454336_1382546634_72e5235bed51b44598dcac9a5a675443_rle_crop_3950984225_0.png treat image : temp/1757338829_2454336_1382546634_72e5235bed51b44598dcac9a5a675443_rle_crop_3950984226_0.png treat image : temp/1757338829_2454336_1382546634_72e5235bed51b44598dcac9a5a675443_rle_crop_3950984227_0.png treat image : temp/1757338829_2454336_1382546634_72e5235bed51b44598dcac9a5a675443_rle_crop_3950984228_0.png treat image : temp/1757338829_2454336_1382546634_72e5235bed51b44598dcac9a5a675443_rle_crop_3950984230_0.png treat image : temp/1757338829_2454336_1382546634_72e5235bed51b44598dcac9a5a675443_rle_crop_3950984231_0.png treat image : temp/1757338829_2454336_1382546634_72e5235bed51b44598dcac9a5a675443_rle_crop_3950984232_0.png treat image : temp/1757338829_2454336_1382546634_72e5235bed51b44598dcac9a5a675443_rle_crop_3950984233_0.png treat image : temp/1757338829_2454336_1382546634_72e5235bed51b44598dcac9a5a675443_rle_crop_3950984234_0.png treat image : temp/1757338829_2454336_1382546634_72e5235bed51b44598dcac9a5a675443_rle_crop_3950984236_0.png treat image : temp/1757338829_2454336_1382546634_72e5235bed51b44598dcac9a5a675443_rle_crop_3950984237_0.png treat image : temp/1757338829_2454336_1382546634_72e5235bed51b44598dcac9a5a675443_rle_crop_3950984238_0.png treat image : temp/1757338829_2454336_1382546634_72e5235bed51b44598dcac9a5a675443_rle_crop_3950984239_0.png treat image : temp/1757338829_2454336_1382546634_72e5235bed51b44598dcac9a5a675443_rle_crop_3950984240_0.png treat image : temp/1757338829_2454336_1382546592_ffa499cf887345043a4068bc17ae9bbf_rle_crop_3950984241_0.png treat image : temp/1757338829_2454336_1382546592_ffa499cf887345043a4068bc17ae9bbf_rle_crop_3950984242_0.png treat image : temp/1757338829_2454336_1382546592_ffa499cf887345043a4068bc17ae9bbf_rle_crop_3950984243_0.png treat image : temp/1757338829_2454336_1382546592_ffa499cf887345043a4068bc17ae9bbf_rle_crop_3950984244_0.png treat image : temp/1757338829_2454336_1382546592_ffa499cf887345043a4068bc17ae9bbf_rle_crop_3950984245_0.png treat image : temp/1757338829_2454336_1382546592_ffa499cf887345043a4068bc17ae9bbf_rle_crop_3950984246_0.png treat image : temp/1757338829_2454336_1382546592_ffa499cf887345043a4068bc17ae9bbf_rle_crop_3950984247_0.png treat image : temp/1757338829_2454336_1382546592_ffa499cf887345043a4068bc17ae9bbf_rle_crop_3950984248_0.png treat image : temp/1757338829_2454336_1382546592_ffa499cf887345043a4068bc17ae9bbf_rle_crop_3950984249_0.png treat image : temp/1757338829_2454336_1382546592_ffa499cf887345043a4068bc17ae9bbf_rle_crop_3950984250_0.png treat image : temp/1757338829_2454336_1382546592_ffa499cf887345043a4068bc17ae9bbf_rle_crop_3950984251_0.png treat image : temp/1757338829_2454336_1382546592_ffa499cf887345043a4068bc17ae9bbf_rle_crop_3950984252_0.png treat image : temp/1757338829_2454336_1382546585_dc5aa731481b25181d0f65d9d63fbe92_rle_crop_3950984254_0.png treat image : temp/1757338829_2454336_1382546585_dc5aa731481b25181d0f65d9d63fbe92_rle_crop_3950984255_0.png treat image : temp/1757338829_2454336_1382546585_dc5aa731481b25181d0f65d9d63fbe92_rle_crop_3950984256_0.png treat image : temp/1757338829_2454336_1382546585_dc5aa731481b25181d0f65d9d63fbe92_rle_crop_3950984257_0.png treat image : temp/1757338829_2454336_1382546585_dc5aa731481b25181d0f65d9d63fbe92_rle_crop_3950984258_0.png treat image : temp/1757338829_2454336_1382546585_dc5aa731481b25181d0f65d9d63fbe92_rle_crop_3950984259_0.png treat image : temp/1757338829_2454336_1382546585_dc5aa731481b25181d0f65d9d63fbe92_rle_crop_3950984261_0.png treat image : temp/1757338829_2454336_1382546585_dc5aa731481b25181d0f65d9d63fbe92_rle_crop_3950984262_0.png treat image : temp/1757338829_2454336_1382546585_dc5aa731481b25181d0f65d9d63fbe92_rle_crop_3950984263_0.png treat image : temp/1757338829_2454336_1382546585_dc5aa731481b25181d0f65d9d63fbe92_rle_crop_3950984264_0.png treat image : temp/1757338829_2454336_1382546585_dc5aa731481b25181d0f65d9d63fbe92_rle_crop_3950984265_0.png treat image : temp/1757338829_2454336_1382546578_70b5708e13836d6357b98ee63d2e210a_rle_crop_3950984268_0.png treat image : temp/1757338829_2454336_1382546578_70b5708e13836d6357b98ee63d2e210a_rle_crop_3950984269_0.png treat image : temp/1757338829_2454336_1382546578_70b5708e13836d6357b98ee63d2e210a_rle_crop_3950984270_0.png treat image : temp/1757338829_2454336_1382546578_70b5708e13836d6357b98ee63d2e210a_rle_crop_3950984271_0.png treat image : temp/1757338829_2454336_1382546578_70b5708e13836d6357b98ee63d2e210a_rle_crop_3950984272_0.png treat image : temp/1757338829_2454336_1382546578_70b5708e13836d6357b98ee63d2e210a_rle_crop_3950984273_0.png treat image : temp/1757338829_2454336_1382546578_70b5708e13836d6357b98ee63d2e210a_rle_crop_3950984274_0.png treat image : temp/1757338829_2454336_1382546578_70b5708e13836d6357b98ee63d2e210a_rle_crop_3950984275_0.png treat image : temp/1757338829_2454336_1382546578_70b5708e13836d6357b98ee63d2e210a_rle_crop_3950984276_0.png treat image : temp/1757338829_2454336_1382546578_70b5708e13836d6357b98ee63d2e210a_rle_crop_3950984277_0.png treat image : temp/1757338829_2454336_1382546578_70b5708e13836d6357b98ee63d2e210a_rle_crop_3950984279_0.png treat image : temp/1757338829_2454336_1382546578_70b5708e13836d6357b98ee63d2e210a_rle_crop_3950984281_0.png treat image : temp/1757338829_2454336_1382546578_70b5708e13836d6357b98ee63d2e210a_rle_crop_3950984282_0.png treat image : temp/1757338829_2454336_1382546573_59d25fbf22aa2f5470f84c9fb3c1dc6a_rle_crop_3950984283_0.png treat image : temp/1757338829_2454336_1382546573_59d25fbf22aa2f5470f84c9fb3c1dc6a_rle_crop_3950984284_0.png treat image : temp/1757338829_2454336_1382546573_59d25fbf22aa2f5470f84c9fb3c1dc6a_rle_crop_3950984285_0.png treat image : temp/1757338829_2454336_1382546573_59d25fbf22aa2f5470f84c9fb3c1dc6a_rle_crop_3950984286_0.png treat image : temp/1757338829_2454336_1382546573_59d25fbf22aa2f5470f84c9fb3c1dc6a_rle_crop_3950984287_0.png treat image : temp/1757338829_2454336_1382546573_59d25fbf22aa2f5470f84c9fb3c1dc6a_rle_crop_3950984288_0.png treat image : temp/1757338829_2454336_1382546573_59d25fbf22aa2f5470f84c9fb3c1dc6a_rle_crop_3950984289_0.png treat image : temp/1757338829_2454336_1382546573_59d25fbf22aa2f5470f84c9fb3c1dc6a_rle_crop_3950984290_0.png treat image : temp/1757338829_2454336_1382546573_59d25fbf22aa2f5470f84c9fb3c1dc6a_rle_crop_3950984291_0.png treat image : temp/1757338829_2454336_1382546573_59d25fbf22aa2f5470f84c9fb3c1dc6a_rle_crop_3950984292_0.png treat image : temp/1757338829_2454336_1382546573_59d25fbf22aa2f5470f84c9fb3c1dc6a_rle_crop_3950984293_0.png treat image : temp/1757338829_2454336_1382546573_59d25fbf22aa2f5470f84c9fb3c1dc6a_rle_crop_3950984295_0.png treat image : temp/1757338829_2454336_1382546568_be750d0aa92350f66fe42abde5253e12_rle_crop_3950984297_0.png treat image : temp/1757338829_2454336_1382546568_be750d0aa92350f66fe42abde5253e12_rle_crop_3950984298_0.png treat image : temp/1757338829_2454336_1382546568_be750d0aa92350f66fe42abde5253e12_rle_crop_3950984299_0.png treat image : temp/1757338829_2454336_1382546568_be750d0aa92350f66fe42abde5253e12_rle_crop_3950984301_0.png treat image : temp/1757338829_2454336_1382546568_be750d0aa92350f66fe42abde5253e12_rle_crop_3950984303_0.png treat image : temp/1757338829_2454336_1382546568_be750d0aa92350f66fe42abde5253e12_rle_crop_3950984304_0.png treat image : temp/1757338829_2454336_1382546568_be750d0aa92350f66fe42abde5253e12_rle_crop_3950984305_0.png treat image : temp/1757338829_2454336_1382546568_be750d0aa92350f66fe42abde5253e12_rle_crop_3950984308_0.png treat image : temp/1757338829_2454336_1382546568_be750d0aa92350f66fe42abde5253e12_rle_crop_3950984309_0.png treat image : temp/1757338829_2454336_1382546568_be750d0aa92350f66fe42abde5253e12_rle_crop_3950984310_0.png treat image : temp/1757338829_2454336_1382546568_be750d0aa92350f66fe42abde5253e12_rle_crop_3950984315_0.png treat image : temp/1757338829_2454336_1382546568_be750d0aa92350f66fe42abde5253e12_rle_crop_3950984317_0.png treat image : temp/1757338829_2454336_1382546635_c94ae2948d05eae052581c28b193ea90_rle_crop_3950984218_0.png treat image : temp/1757338829_2454336_1382546634_72e5235bed51b44598dcac9a5a675443_rle_crop_3950984229_0.png treat image : temp/1757338829_2454336_1382546634_72e5235bed51b44598dcac9a5a675443_rle_crop_3950984235_0.png treat image : temp/1757338829_2454336_1382546585_dc5aa731481b25181d0f65d9d63fbe92_rle_crop_3950984266_0.png treat image : temp/1757338829_2454336_1382546578_70b5708e13836d6357b98ee63d2e210a_rle_crop_3950984267_0.png treat image : temp/1757338829_2454336_1382546578_70b5708e13836d6357b98ee63d2e210a_rle_crop_3950984278_0.png treat image : temp/1757338829_2454336_1382546578_70b5708e13836d6357b98ee63d2e210a_rle_crop_3950984280_0.png treat image : temp/1757338829_2454336_1382546568_be750d0aa92350f66fe42abde5253e12_rle_crop_3950984300_0.png treat image : temp/1757338829_2454336_1382546568_be750d0aa92350f66fe42abde5253e12_rle_crop_3950984302_0.png treat image : temp/1757338829_2454336_1382546568_be750d0aa92350f66fe42abde5253e12_rle_crop_3950984306_0.png treat image : temp/1757338829_2454336_1382546568_be750d0aa92350f66fe42abde5253e12_rle_crop_3950984307_0.png treat image : temp/1757338829_2454336_1382546568_be750d0aa92350f66fe42abde5253e12_rle_crop_3950984313_0.png treat image : temp/1757338829_2454336_1382546568_be750d0aa92350f66fe42abde5253e12_rle_crop_3950984312_0.png treat image : temp/1757338829_2454336_1382546568_be750d0aa92350f66fe42abde5253e12_rle_crop_3950984316_0.png treat image : temp/1757338829_2454336_1382546638_6521dff3428635acaa694dd5859bfd79_rle_crop_3950984178_0.png treat image : temp/1757338829_2454336_1382546638_6521dff3428635acaa694dd5859bfd79_rle_crop_3950984190_0.png treat image : temp/1757338829_2454336_1382546636_f1bb072d993ce9030fc995139e97a34f_rle_crop_3950984205_0.png treat image : temp/1757338829_2454336_1382546636_f1bb072d993ce9030fc995139e97a34f_rle_crop_3950984206_0.png treat image : temp/1757338829_2454336_1382546592_ffa499cf887345043a4068bc17ae9bbf_rle_crop_3950984253_0.png treat image : temp/1757338829_2454336_1382546585_dc5aa731481b25181d0f65d9d63fbe92_rle_crop_3950984260_0.png treat image : temp/1757338829_2454336_1382546573_59d25fbf22aa2f5470f84c9fb3c1dc6a_rle_crop_3950984294_0.png treat image : temp/1757338829_2454336_1382546573_59d25fbf22aa2f5470f84c9fb3c1dc6a_rle_crop_3950984296_0.png treat image : temp/1757338829_2454336_1382546568_be750d0aa92350f66fe42abde5253e12_rle_crop_3950984311_0.png treat image : temp/1757338829_2454336_1382546568_be750d0aa92350f66fe42abde5253e12_rle_crop_3950984314_0.png treat image : temp/1757338829_2454336_1382546568_be750d0aa92350f66fe42abde5253e12_rle_crop_3950984318_0.png treat image : temp/1757338829_2454336_1382546568_be750d0aa92350f66fe42abde5253e12_rle_crop_3950984319_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 153 time used for this insertion : 0.01861405372619629 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 153 time used for this insertion : 0.031154870986938477 save missing photos in datou_result : time spend for datou_step_exec : 13.191834688186646 time spend to save output : 0.05504798889160156 total time spend for step 7 : 13.246882677078247 step8:velours_tree Mon Sep 8 15:46:40 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.6445572376251221 time spend to save output : 3.314018249511719e-05 total time spend for step 8 : 0.6445903778076172 step9:send_mail_cod Mon Sep 8 15:46:41 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P26644253_08-09-2025_15_46_41.pdf 26644753 imagette266447531757339201 26644754 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette266447541757339201 26644755 imagette266447551757339202 26644756 imagette266447561757339203 26644757 imagette266447571757339203 26644758 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette266447581757339203 26644759 imagette266447591757339204 26644760 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette266447601757339204 26644761 imagette266447611757339205 26644762 change filename to text .change filename to text .imagette266447621757339205 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=26644253 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/26644752,26644753,26644754,26644755,26644756,26644757,26644758,26644759,26644760,26644761,26644762?tags=environnement,flou,papier,mal_croppe,autre,pehd,pet_clair,background,carton,pet_fonce,metal args[1382546638] : ((1382546638, -6.9807800343202056, 492609224), (1382546638, 1.4523738680180132, 2107752395), '0.18612093031978738') We are sending mail with results at report@fotonower.com args[1382546636] : ((1382546636, -6.393719519678336, 492609224), (1382546636, 1.2242744415579987, 2107752395), '0.18612093031978738') We are sending mail with results at report@fotonower.com args[1382546635] : ((1382546635, -6.883324558321297, 492609224), (1382546635, 1.2276066651272364, 2107752395), '0.18612093031978738') We are sending mail with results at report@fotonower.com args[1382546634] : ((1382546634, -6.914617032278928, 492609224), (1382546634, 1.4954544075802958, 2107752395), '0.18612093031978738') We are sending mail with results at report@fotonower.com args[1382546592] : ((1382546592, -6.779157266380433, 492609224), (1382546592, 1.197174357285137, 2107752395), '0.18612093031978738') We are sending mail with results at report@fotonower.com args[1382546585] : ((1382546585, -6.922153606792228, 492609224), (1382546585, 1.2795015157237708, 2107752395), '0.18612093031978738') We are sending mail with results at report@fotonower.com args[1382546578] : ((1382546578, -6.245481515919921, 492609224), (1382546578, 1.3645178937145568, 2107752395), '0.18612093031978738') We are sending mail with results at report@fotonower.com args[1382546573] : ((1382546573, -5.825076776487553, 492609224), (1382546573, 1.023262121235996, 2107752395), '0.18612093031978738') We are sending mail with results at report@fotonower.com args[1382546568] : ((1382546568, -6.19904563121909, 492609224), (1382546568, 1.0643373971751364, 2107752395), '0.18612093031978738') We are sending mail with results at report@fotonower.com refus_total : 0.18612093031978738 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=26644253 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26644253_08-09-2025_15_46_41.pdf results_Auto_P26644253_08-09-2025_15_46_41.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26644253_08-09-2025_15_46_41.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','26644253','results_Auto_P26644253_08-09-2025_15_46_41.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26644253_08-09-2025_15_46_41.pdf','pdf','','0.84','0.18612093031978738') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/26644253

https://www.fotonower.com/image?json=false&list_photos_id=1382546638
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1382546636
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1382546635
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1382546634
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1382546592
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1382546585
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1382546578
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1382546573
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1382546568
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 18.61%
Veuillez trouver les photos des contaminants.

exemples de contaminants: papier: https://www.fotonower.com/view/26644754?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/26644758?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/26644760?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/26644762?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26644253_08-09-2025_15_46_41.pdf.

Lien vers velours :https://marlene.fotonower.com/velours/26644752,26644753,26644754,26644755,26644756,26644757,26644758,26644759,26644760,26644761,26644762?tags=environnement,flou,papier,mal_croppe,autre,pehd,pet_clair,background,carton,pet_fonce,metal.


L'équipe Fotonower 202 b'' Server: nginx Date: Mon, 08 Sep 2025 13:46:48 GMT Content-Length: 0 Connection: close X-Message-Id: vFZwDFFdQM6lBhmn1pHWuQ Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1382546638, 1382546636, 1382546635, 1382546634, 1382546592, 1382546585, 1382546578, 1382546573, 1382546568] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3678744') ('3318', '26644253', '1382546638', None, None, None, None, None, '3678744') ('3318', None, None, None, None, None, None, None, '3678744') ('3318', '26644253', '1382546636', None, None, None, None, None, '3678744') ('3318', None, None, None, None, None, None, None, '3678744') ('3318', '26644253', '1382546635', None, None, None, None, None, '3678744') ('3318', None, None, None, None, None, None, None, '3678744') ('3318', '26644253', '1382546634', None, None, None, None, None, '3678744') ('3318', None, None, None, None, None, None, None, '3678744') ('3318', '26644253', '1382546592', None, None, None, None, None, '3678744') ('3318', None, None, None, None, None, None, None, '3678744') ('3318', '26644253', '1382546585', None, None, None, None, None, '3678744') ('3318', None, None, None, None, None, None, None, '3678744') ('3318', '26644253', '1382546578', None, None, None, None, None, '3678744') ('3318', None, None, None, None, None, None, None, '3678744') ('3318', '26644253', '1382546573', None, None, None, None, None, '3678744') ('3318', None, None, None, None, None, None, None, '3678744') ('3318', '26644253', '1382546568', None, None, None, None, None, '3678744') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.01350855827331543 save_final save missing photos in datou_result : time spend for datou_step_exec : 6.947386264801025 time spend to save output : 0.013727903366088867 total time spend for step 9 : 6.961114168167114 step10:split_time_score Mon Sep 8 15:46:48 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('14', 9),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 08092025 26644253 Nombre de photos uploadées : 9 / 23040 (0%) 08092025 26644253 Nombre de photos taguées (types de déchets): 0 / 9 (0%) 08092025 26644253 Nombre de photos taguées (volume) : 0 / 9 (0%) elapsed_time : load_data_split_time_score 2.1457672119140625e-06 elapsed_time : order_list_meta_photo_and_scores 7.152557373046875e-06 ????????? elapsed_time : fill_and_build_computed_from_old_data 0.0008904933929443359 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.1978902816772461 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.03116972296409284 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26631031_08-09-2025_09_42_43.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26631031 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26631031 AND mptpi.`type`=3726 To do Qualite : 0.02563091404036857 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26639553_08-09-2025_13_21_20.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26639553 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26639553 AND mptpi.`type`=3726 To do Qualite : 0.011162972957564172 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26639556_08-09-2025_13_17_13.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26639556 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26639556 AND mptpi.`type`=3726 To do Qualite : 0.019724049200962424 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26638672_08-09-2025_12_43_06.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26638672 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26638672 AND mptpi.`type`=3726 To do Qualite : 0.07907983097029321 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26640591_08-09-2025_14_16_24.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26640591 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26640591 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26644250 order by id desc limit 1 Qualite : 0.18612093031978738 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26644253_08-09-2025_15_46_41.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26644253 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26644253 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'08092025': {'nb_upload': 9, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1382546638, 1382546636, 1382546635, 1382546634, 1382546592, 1382546585, 1382546578, 1382546573, 1382546568] Looping around the photos to save general results len do output : 1 /26644253Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3678744') ('3318', '26644253', '1382546638', None, None, None, None, None, '3678744') ('3318', None, None, None, None, None, None, None, '3678744') ('3318', '26644253', '1382546636', None, None, None, None, None, '3678744') ('3318', None, None, None, None, None, None, None, '3678744') ('3318', '26644253', '1382546635', None, None, None, None, None, '3678744') ('3318', None, None, None, None, None, None, None, '3678744') ('3318', '26644253', '1382546634', None, None, None, None, None, '3678744') ('3318', None, None, None, None, None, None, None, '3678744') ('3318', '26644253', '1382546592', None, None, None, None, None, '3678744') ('3318', None, None, None, None, None, None, None, '3678744') ('3318', '26644253', '1382546585', None, None, None, None, None, '3678744') ('3318', None, None, None, None, None, None, None, '3678744') ('3318', '26644253', '1382546578', None, None, None, None, None, '3678744') ('3318', None, None, None, None, None, None, None, '3678744') ('3318', '26644253', '1382546573', None, None, None, None, None, '3678744') ('3318', None, None, None, None, None, None, None, '3678744') ('3318', '26644253', '1382546568', None, None, None, None, None, '3678744') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.014583826065063477 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.7442381381988525 time spend to save output : 0.014801025390625 total time spend for step 10 : 1.7590391635894775 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 9 set_done_treatment 186.30user 139.81system 6:25.96elapsed 84%CPU (0avgtext+0avgdata 3974660maxresident)k 852856inputs+200632outputs (15300major+16798422minor)pagefaults 0swaps