python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3258384 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['4322522'] with mtr_portfolio_ids : ['30022771'] and first list_photo_ids : [] new path : /proc/3258384/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 11 ; length of list_pids : 11 ; length of list_args : 11 time to download the photos : 2.142524480819702 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Wed Jan 7 17:10:32 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10826 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2026-01-07 17:10:35.617571: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2026-01-07 17:10:35.650577: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493010000 Hz 2026-01-07 17:10:35.652958: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f399c000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2026-01-07 17:10:35.653004: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2026-01-07 17:10:35.657915: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2026-01-07 17:10:35.910789: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x41f7c450 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2026-01-07 17:10:35.910834: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2026-01-07 17:10:35.912000: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2026-01-07 17:10:35.912659: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2026-01-07 17:10:35.923798: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2026-01-07 17:10:35.938099: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2026-01-07 17:10:35.938980: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2026-01-07 17:10:35.946250: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2026-01-07 17:10:35.948306: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2026-01-07 17:10:35.964089: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2026-01-07 17:10:35.965841: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2026-01-07 17:10:35.966223: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2026-01-07 17:10:35.967532: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2026-01-07 17:10:35.967554: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2026-01-07 17:10:35.967565: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2026-01-07 17:10:35.969826: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10034 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2026-01-07 17:10:36.296718: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2026-01-07 17:10:36.296803: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2026-01-07 17:10:36.296823: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2026-01-07 17:10:36.296842: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2026-01-07 17:10:36.296859: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2026-01-07 17:10:36.296877: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2026-01-07 17:10:36.296894: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2026-01-07 17:10:36.296911: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2026-01-07 17:10:36.298522: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2026-01-07 17:10:36.299826: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2026-01-07 17:10:36.299863: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2026-01-07 17:10:36.299882: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2026-01-07 17:10:36.299899: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2026-01-07 17:10:36.299915: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2026-01-07 17:10:36.299932: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2026-01-07 17:10:36.299948: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2026-01-07 17:10:36.299965: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2026-01-07 17:10:36.301525: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2026-01-07 17:10:36.301556: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2026-01-07 17:10:36.301566: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2026-01-07 17:10:36.301575: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2026-01-07 17:10:36.303222: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10034 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2026-01-07 17:10:48.602398: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2026-01-07 17:10:48.850585: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 11 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 17 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 22 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 32 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 14 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 16 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 17 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 16 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 20 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 16 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 14 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 15 Detection mask done ! Trying to reset tf kernel 3258746 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5537 tf kernel not reseted sub process len(results) : 11 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 11 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10826 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] DEBUG bbox = [1206, 2796, 1560, 3216] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0019903182983398438 nb_pixel_total : 71212 time to create 1 rle with old method : 0.07322907447814941 length of segment : 352 DEBUG bbox = [282, 2934, 498, 3078] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0002868175506591797 nb_pixel_total : 6895 time to create 1 rle with old method : 0.00741267204284668 length of segment : 150 DEBUG bbox = [1968, 1434, 2160, 1722] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004673004150390625 nb_pixel_total : 27002 time to create 1 rle with old method : 0.028605222702026367 length of segment : 179 DEBUG bbox = [936, 2820, 1242, 3090] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007348060607910156 nb_pixel_total : 40462 time to create 1 rle with old method : 0.04279971122741699 length of segment : 273 DEBUG bbox = [342, 960, 444, 1152] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0002181529998779297 nb_pixel_total : 9169 time to create 1 rle with old method : 0.010323762893676758 length of segment : 99 DEBUG bbox = [1584, 2430, 1770, 2604] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003631114959716797 nb_pixel_total : 17950 time to create 1 rle with old method : 0.01919841766357422 length of segment : 168 DEBUG bbox = [1734, 1032, 1872, 1176] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00024366378784179688 nb_pixel_total : 13775 time to create 1 rle with old method : 0.014444112777709961 length of segment : 122 DEBUG bbox = [1182, 1824, 1386, 1998] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004165172576904297 nb_pixel_total : 25521 time to create 1 rle with old method : 0.026993751525878906 length of segment : 190 DEBUG bbox = [0, 1500, 564, 2286] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00410771369934082 nb_pixel_total : 114766 time to create 1 rle with old method : 0.11531209945678711 length of segment : 535 DEBUG bbox = [1824, 2292, 2148, 2646] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0013201236724853516 nb_pixel_total : 82287 time to create 1 rle with old method : 0.08682751655578613 length of segment : 316 DEBUG bbox = [768, 396, 1074, 690] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009486675262451172 nb_pixel_total : 51593 time to create 1 rle with old method : 0.055007219314575195 length of segment : 287 DEBUG bbox = [456, 1470, 642, 1692] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005276203155517578 nb_pixel_total : 22254 time to create 1 rle with old method : 0.023415565490722656 length of segment : 156 DEBUG bbox = [216, 2442, 498, 2814] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0011012554168701172 nb_pixel_total : 60895 time to create 1 rle with old method : 0.06409621238708496 length of segment : 240 DEBUG bbox = [2004, 1422, 2148, 1746] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005135536193847656 nb_pixel_total : 30980 time to create 1 rle with old method : 0.03224802017211914 length of segment : 153 DEBUG bbox = [768, 1998, 912, 2118] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00024056434631347656 nb_pixel_total : 10910 time to create 1 rle with old method : 0.011568069458007812 length of segment : 132 DEBUG bbox = [6, 6, 186, 108] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00023937225341796875 nb_pixel_total : 7331 time to create 1 rle with old method : 0.007609367370605469 length of segment : 235 DEBUG bbox = [1836, 1758, 1968, 1824] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00016307830810546875 nb_pixel_total : 5577 time to create 1 rle with old method : 0.005843639373779297 length of segment : 126 DEBUG bbox = [12, 2922, 168, 3144] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003857612609863281 nb_pixel_total : 20920 time to create 1 rle with old method : 0.02188277244567871 length of segment : 149 DEBUG bbox = [486, 792, 1260, 1662] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.008031129837036133 nb_pixel_total : 341485 time to create 1 rle with new method : 0.040338993072509766 length of segment : 998 DEBUG bbox = [528, 2712, 1062, 3090] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0023126602172851562 nb_pixel_total : 141907 time to create 1 rle with old method : 0.14609956741333008 length of segment : 560 DEBUG bbox = [1632, 3000, 1986, 3336] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001069784164428711 nb_pixel_total : 76734 time to create 1 rle with old method : 0.08186769485473633 length of segment : 321 DEBUG bbox = [330, 1914, 672, 2268] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0010731220245361328 nb_pixel_total : 63451 time to create 1 rle with old method : 0.06836557388305664 length of segment : 325 DEBUG bbox = [36, 2052, 372, 2244] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006611347198486328 nb_pixel_total : 50286 time to create 1 rle with old method : 0.051131486892700195 length of segment : 333 DEBUG bbox = [276, 180, 696, 612] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0013086795806884766 nb_pixel_total : 73602 time to create 1 rle with old method : 0.07514095306396484 length of segment : 393 DEBUG bbox = [1908, 1920, 2142, 2244] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006864070892333984 nb_pixel_total : 52025 time to create 1 rle with old method : 0.05350518226623535 length of segment : 223 DEBUG bbox = [1302, 2586, 1602, 2898] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007982254028320312 nb_pixel_total : 56345 time to create 1 rle with old method : 0.05928540229797363 length of segment : 283 DEBUG bbox = [12, 3180, 306, 3294] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003826618194580078 nb_pixel_total : 21613 time to create 1 rle with old method : 0.02263355255126953 length of segment : 284 DEBUG bbox = [1620, 468, 1836, 600] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00030541419982910156 nb_pixel_total : 17755 time to create 1 rle with old method : 0.01892542839050293 length of segment : 201 DEBUG bbox = [300, 1554, 600, 1728] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004994869232177734 nb_pixel_total : 30687 time to create 1 rle with old method : 0.0319361686706543 length of segment : 243 DEBUG bbox = [774, 2730, 990, 2946] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00046825408935546875 nb_pixel_total : 31668 time to create 1 rle with old method : 0.03254246711730957 length of segment : 212 DEBUG bbox = [198, 2652, 336, 2820] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0002434253692626953 nb_pixel_total : 15363 time to create 1 rle with old method : 0.016277790069580078 length of segment : 135 DEBUG bbox = [24, 1872, 450, 2256] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0014350414276123047 nb_pixel_total : 111881 time to create 1 rle with old method : 0.11115431785583496 length of segment : 397 DEBUG bbox = [1836, 900, 2160, 1404] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0013797283172607422 nb_pixel_total : 100526 time to create 1 rle with old method : 0.10932731628417969 length of segment : 312 DEBUG bbox = [1008, 1314, 1410, 1764] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0015664100646972656 nb_pixel_total : 107012 time to create 1 rle with old method : 0.11088776588439941 length of segment : 356 DEBUG bbox = [1722, 1860, 2142, 2292] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0015282630920410156 nb_pixel_total : 93392 time to create 1 rle with old method : 0.09562802314758301 length of segment : 395 DEBUG bbox = [0, 474, 180, 630] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003027915954589844 nb_pixel_total : 15888 time to create 1 rle with old method : 0.016246795654296875 length of segment : 170 DEBUG bbox = [240, 2184, 552, 2490] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008933544158935547 nb_pixel_total : 56684 time to create 1 rle with old method : 0.059504032135009766 length of segment : 285 DEBUG bbox = [786, 2970, 1020, 3132] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.000392913818359375 nb_pixel_total : 22947 time to create 1 rle with old method : 0.023720264434814453 length of segment : 221 DEBUG bbox = [252, 2556, 456, 2886] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.000606536865234375 nb_pixel_total : 45267 time to create 1 rle with old method : 0.04727935791015625 length of segment : 180 DEBUG bbox = [1164, 1872, 1608, 2232] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0015730857849121094 nb_pixel_total : 129696 time to create 1 rle with old method : 0.1609482765197754 length of segment : 441 DEBUG bbox = [474, 2964, 990, 3312] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0015604496002197266 nb_pixel_total : 102873 time to create 1 rle with old method : 0.10438203811645508 length of segment : 524 DEBUG bbox = [270, 990, 690, 1680] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002547740936279297 nb_pixel_total : 162764 time to create 1 rle with new method : 0.009104013442993164 length of segment : 384 DEBUG bbox = [264, 3024, 888, 3450] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0023114681243896484 nb_pixel_total : 147546 time to create 1 rle with old method : 0.15366673469543457 length of segment : 597 DEBUG bbox = [1986, 1452, 2160, 1770] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005600452423095703 nb_pixel_total : 42935 time to create 1 rle with old method : 0.043512582778930664 length of segment : 160 DEBUG bbox = [1554, 984, 1782, 1128] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00036025047302246094 nb_pixel_total : 23672 time to create 1 rle with old method : 0.024750232696533203 length of segment : 220 DEBUG bbox = [2040, 2568, 2148, 2682] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.000148773193359375 nb_pixel_total : 7779 time to create 1 rle with old method : 0.008262157440185547 length of segment : 106 DEBUG bbox = [2040, 1860, 2154, 2220] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00037741661071777344 nb_pixel_total : 31020 time to create 1 rle with old method : 0.03272581100463867 length of segment : 115 DEBUG bbox = [1440, 2490, 1554, 2778] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003154277801513672 nb_pixel_total : 22831 time to create 1 rle with old method : 0.023822307586669922 length of segment : 104 DEBUG bbox = [594, 1728, 912, 2064] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0017848014831542969 nb_pixel_total : 45433 time to create 1 rle with old method : 0.04698610305786133 length of segment : 262 DEBUG bbox = [12, 1872, 114, 2052] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004088878631591797 nb_pixel_total : 10940 time to create 1 rle with old method : 0.01175546646118164 length of segment : 84 DEBUG bbox = [1896, 1818, 2028, 1974] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0002071857452392578 nb_pixel_total : 11305 time to create 1 rle with old method : 0.012050390243530273 length of segment : 124 DEBUG bbox = [1668, 1638, 1890, 1830] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003597736358642578 nb_pixel_total : 10612 time to create 1 rle with old method : 0.011823415756225586 length of segment : 280 DEBUG bbox = [186, 2172, 630, 2508] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0026259422302246094 nb_pixel_total : 74078 time to create 1 rle with old method : 0.07908821105957031 length of segment : 385 DEBUG bbox = [18, 204, 780, 468] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.003730297088623047 nb_pixel_total : 130903 time to create 1 rle with old method : 0.13296914100646973 length of segment : 783 DEBUG bbox = [108, 2508, 558, 2880] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0031282901763916016 nb_pixel_total : 58194 time to create 1 rle with old method : 0.07692980766296387 length of segment : 754 DEBUG bbox = [972, 1374, 1212, 1524] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0011205673217773438 nb_pixel_total : 23799 time to create 1 rle with old method : 0.0281524658203125 length of segment : 209 DEBUG bbox = [528, 2514, 1278, 2868] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00605010986328125 nb_pixel_total : 143851 time to create 1 rle with old method : 0.15960001945495605 length of segment : 685 DEBUG bbox = [6, 804, 192, 978] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008044242858886719 nb_pixel_total : 23051 time to create 1 rle with old method : 0.03694438934326172 length of segment : 168 DEBUG bbox = [1608, 798, 1836, 942] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007429122924804688 nb_pixel_total : 12774 time to create 1 rle with old method : 0.017774581909179688 length of segment : 179 DEBUG bbox = [1866, 1890, 2076, 2148] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007901191711425781 nb_pixel_total : 24837 time to create 1 rle with old method : 0.027194738388061523 length of segment : 184 DEBUG bbox = [876, 2436, 1050, 2568] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005362033843994141 nb_pixel_total : 17854 time to create 1 rle with old method : 0.019206762313842773 length of segment : 169 DEBUG bbox = [1182, 1878, 1680, 2286] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0021817684173583984 nb_pixel_total : 87339 time to create 1 rle with old method : 0.09601044654846191 length of segment : 435 DEBUG bbox = [1572, 1584, 1842, 1956] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0010309219360351562 nb_pixel_total : 44592 time to create 1 rle with old method : 0.04937386512756348 length of segment : 282 DEBUG bbox = [1440, 2142, 2154, 2520] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002421140670776367 nb_pixel_total : 65390 time to create 1 rle with old method : 0.07142829895019531 length of segment : 683 DEBUG bbox = [1614, 1446, 1818, 1548] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003981590270996094 nb_pixel_total : 16147 time to create 1 rle with old method : 0.017874956130981445 length of segment : 191 DEBUG bbox = [600, 2712, 756, 2832] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00042366981506347656 nb_pixel_total : 9263 time to create 1 rle with old method : 0.010577201843261719 length of segment : 124 DEBUG bbox = [1536, 2574, 1656, 2748] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003612041473388672 nb_pixel_total : 15048 time to create 1 rle with old method : 0.015826940536499023 length of segment : 124 DEBUG bbox = [780, 2100, 894, 2268] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00032448768615722656 nb_pixel_total : 12499 time to create 1 rle with old method : 0.013774633407592773 length of segment : 107 DEBUG bbox = [1350, 690, 1638, 912] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007302761077880859 nb_pixel_total : 36182 time to create 1 rle with old method : 0.03918313980102539 length of segment : 244 DEBUG bbox = [762, 3120, 1206, 3360] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00138092041015625 nb_pixel_total : 69807 time to create 1 rle with old method : 0.07169127464294434 length of segment : 468 DEBUG bbox = [558, 858, 876, 1116] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009834766387939453 nb_pixel_total : 55707 time to create 1 rle with old method : 0.06319522857666016 length of segment : 289 DEBUG bbox = [810, 2682, 1380, 3150] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002409696578979492 nb_pixel_total : 139811 time to create 1 rle with old method : 0.14547419548034668 length of segment : 497 DEBUG bbox = [1140, 2472, 1362, 2712] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005464553833007812 nb_pixel_total : 30529 time to create 1 rle with old method : 0.03556466102600098 length of segment : 213 DEBUG bbox = [492, 48, 780, 282] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008070468902587891 nb_pixel_total : 34141 time to create 1 rle with old method : 0.03636431694030762 length of segment : 222 DEBUG bbox = [990, 1146, 1218, 1368] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006465911865234375 nb_pixel_total : 28246 time to create 1 rle with old method : 0.030335426330566406 length of segment : 190 DEBUG bbox = [240, 3096, 672, 3312] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0011713504791259766 nb_pixel_total : 33749 time to create 1 rle with old method : 0.035782814025878906 length of segment : 491 DEBUG bbox = [1410, 1740, 1758, 2076] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0014204978942871094 nb_pixel_total : 77305 time to create 1 rle with old method : 0.09093141555786133 length of segment : 296 time spent for convertir_results : 7.045669317245483 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 77 chid ids of type : 3594 Number RLEs to save : 22462 save missing photos in datou_result : time spend for datou_step_exec : 73.65670537948608 time spend to save output : 1.4246602058410645 total time spend for step 1 : 75.08136558532715 step2:crop_condition Wed Jan 7 17:11:47 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 11 ! batch 1 Loaded 77 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 31 About to insert : list_path_to_insert length 31 new photo from crops ! About to upload 31 photos upload in portfolio : 3736932 init cache_photo without model_param we have 31 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1767802317_3258384 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802323), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784227_2e317ad92ad7c85869153f613e2f2074_rle_crop_4092809126_0.png', 0, 400, 352, 0, 1767802323,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802323), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784227_2e317ad92ad7c85869153f613e2f2074_rle_crop_4092809128_0.png', 0, 277, 175, 0, 1767802323,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802323), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784227_2e317ad92ad7c85869153f613e2f2074_rle_crop_4092809129_0.png', 0, 258, 251, 0, 1767802323,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802323), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784226_5c33f42188a944215d645e5321b2da24_rle_crop_4092809131_0.png', 0, 161, 168, 0, 1767802323,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802323), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784225_5c915a68762d609b9a6435cee8508f4e_rle_crop_4092809141_0.png', 0, 85, 143, 0, 1767802323,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802323), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784225_5c915a68762d609b9a6435cee8508f4e_rle_crop_4092809142_0.png', 0, 61, 125, 0, 1767802323,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802323), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784225_5c915a68762d609b9a6435cee8508f4e_rle_crop_4092809144_0.png', 0, 807, 735, 0, 1767802323,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802323), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784224_f614b288aa0522ba629b4f42e55989a8_rle_crop_4092809147_0.png', 0, 344, 312, 0, 1767802323,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802323), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784224_f614b288aa0522ba629b4f42e55989a8_rle_crop_4092809149_0.png', 0, 363, 393, 0, 1767802323,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802323), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784224_f614b288aa0522ba629b4f42e55989a8_rle_crop_4092809151_0.png', 0, 290, 277, 0, 1767802323,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802323), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784223_6f7eea6d6d4d27e40e0150148a74a608_rle_crop_4092809157_0.png', 0, 343, 381, 0, 1767802323,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802323), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784222_5c1058e5e0a1a48d48bffabdf0b70d66_rle_crop_4092809159_0.png', 0, 426, 356, 0, 1767802323,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802323), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784222_5c1058e5e0a1a48d48bffabdf0b70d66_rle_crop_4092809164_0.png', 0, 325, 170, 0, 1767802323,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802323), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784222_5c1058e5e0a1a48d48bffabdf0b70d66_rle_crop_4092809165_0.png', 0, 321, 440, 0, 1767802323,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802323), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784221_be02adf771f3e7456e47c35328029ac7_rle_crop_4092809168_0.png', 0, 404, 597, 0, 1767802323,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802323), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784221_be02adf771f3e7456e47c35328029ac7_rle_crop_4092809169_0.png', 0, 318, 158, 0, 1767802323,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802323), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784221_be02adf771f3e7456e47c35328029ac7_rle_crop_4092809172_0.png', 0, 319, 112, 0, 1767802323,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802323), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784221_be02adf771f3e7456e47c35328029ac7_rle_crop_4092809176_0.png', 0, 145, 124, 0, 1767802323,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802323), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784221_be02adf771f3e7456e47c35328029ac7_rle_crop_4092809177_0.png', 0, 169, 207, 0, 1767802323,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802323), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784220_03b9cf32cdf8db1b9af32bf54b638a30_rle_crop_4092809178_0.png', 0, 319, 383, 0, 1767802323,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802323), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784220_03b9cf32cdf8db1b9af32bf54b638a30_rle_crop_4092809180_0.png', 0, 355, 415, 0, 1767802323,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802323), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784220_03b9cf32cdf8db1b9af32bf54b638a30_rle_crop_4092809181_0.png', 0, 138, 209, 0, 1767802323,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802323), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784219_9b579ec3bbf46cdf821296c1420493ba_rle_crop_4092809185_0.png', 0, 207, 175, 0, 1767802323,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802323), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784219_9b579ec3bbf46cdf821296c1420493ba_rle_crop_4092809186_0.png', 0, 130, 167, 0, 1767802323,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802323), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784219_9b579ec3bbf46cdf821296c1420493ba_rle_crop_4092809187_0.png', 0, 402, 354, 0, 1767802323,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802323), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784219_9b579ec3bbf46cdf821296c1420493ba_rle_crop_4092809188_0.png', 0, 338, 257, 0, 1767802323,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802323), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784219_9b579ec3bbf46cdf821296c1420493ba_rle_crop_4092809189_0.png', 0, 358, 683, 0, 1767802323,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802323), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784219_9b579ec3bbf46cdf821296c1420493ba_rle_crop_4092809190_0.png', 0, 97, 190, 0, 1767802323,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802323), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784218_dccaa2c7d0962704412f3e2ae9086c34_rle_crop_4092809193_0.png', 0, 142, 107, 0, 1767802323,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802323), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784217_331b69e59e6e58f6613168d8357dd445_rle_crop_4092809194_0.png', 0, 206, 241, 0, 1767802323,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802323), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784217_331b69e59e6e58f6613168d8357dd445_rle_crop_4092809196_0.png', 0, 258, 289, 0, 1767802323,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 31 photos in the portfolio 3736932 time of upload the photos Elapsed time : 7.627619743347168 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 12 About to insert : list_path_to_insert length 12 new photo from crops ! About to upload 12 photos upload in portfolio : 3736932 init cache_photo without model_param we have 12 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1767802329_3258384 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802331), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784227_2e317ad92ad7c85869153f613e2f2074_rle_crop_4092809127_0.png', 0, 92, 148, 0, 1767802331,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802331), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784227_2e317ad92ad7c85869153f613e2f2074_rle_crop_4092809130_0.png', 0, 163, 93, 0, 1767802331,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802331), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784225_5c915a68762d609b9a6435cee8508f4e_rle_crop_4092809136_0.png', 0, 267, 271, 0, 1767802331,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802331), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784224_f614b288aa0522ba629b4f42e55989a8_rle_crop_4092809152_0.png', 0, 106, 283, 0, 1767802331,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802331), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784223_6f7eea6d6d4d27e40e0150148a74a608_rle_crop_4092809153_0.png', 0, 118, 197, 0, 1767802331,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802331), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784223_6f7eea6d6d4d27e40e0150148a74a608_rle_crop_4092809154_0.png', 0, 165, 238, 0, 1767802331,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802331), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784223_6f7eea6d6d4d27e40e0150148a74a608_rle_crop_4092809155_0.png', 0, 212, 204, 0, 1767802331,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802331), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784222_5c1058e5e0a1a48d48bffabdf0b70d66_rle_crop_4092809163_0.png', 0, 149, 220, 0, 1767802331,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802331), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784222_5c1058e5e0a1a48d48bffabdf0b70d66_rle_crop_4092809166_0.png', 0, 332, 500, 0, 1767802331,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802331), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784220_03b9cf32cdf8db1b9af32bf54b638a30_rle_crop_4092809184_0.png', 0, 86, 179, 0, 1767802331,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802331), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784217_331b69e59e6e58f6613168d8357dd445_rle_crop_4092809200_0.png', 0, 216, 189, 0, 1767802331,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802331), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784217_331b69e59e6e58f6613168d8357dd445_rle_crop_4092809201_0.png', 0, 191, 364, 0, 1767802331,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 12 photos in the portfolio 3736932 time of upload the photos Elapsed time : 3.075112819671631 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1767802334_3258384 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802335), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784221_be02adf771f3e7456e47c35328029ac7_rle_crop_4092809171_0.png', 0, 101, 106, 0, 1767802335,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802335), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784219_9b579ec3bbf46cdf821296c1420493ba_rle_crop_4092809191_0.png', 0, 94, 124, 0, 1767802335,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802335), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784217_331b69e59e6e58f6613168d8357dd445_rle_crop_4092809202_0.png', 0, 319, 290, 0, 1767802335,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.5588879585266113 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 24 About to insert : list_path_to_insert length 24 new photo from crops ! About to upload 24 photos upload in portfolio : 3736932 init cache_photo without model_param we have 24 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1767802344_3258384 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802348), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784226_5c33f42188a944215d645e5321b2da24_rle_crop_4092809134_0.png', 0, 650, 534, 0, 1767802348,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802348), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784225_5c915a68762d609b9a6435cee8508f4e_rle_crop_4092809135_0.png', 0, 331, 313, 0, 1767802348,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802348), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784225_5c915a68762d609b9a6435cee8508f4e_rle_crop_4092809137_0.png', 0, 194, 156, 0, 1767802348,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802348), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784225_5c915a68762d609b9a6435cee8508f4e_rle_crop_4092809138_0.png', 0, 341, 219, 0, 1767802348,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802348), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784225_5c915a68762d609b9a6435cee8508f4e_rle_crop_4092809139_0.png', 0, 301, 141, 0, 1767802348,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802348), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784225_5c915a68762d609b9a6435cee8508f4e_rle_crop_4092809143_0.png', 0, 212, 148, 0, 1767802348,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802348), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784225_5c915a68762d609b9a6435cee8508f4e_rle_crop_4092809145_0.png', 0, 374, 507, 0, 1767802348,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802348), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784224_f614b288aa0522ba629b4f42e55989a8_rle_crop_4092809146_0.png', 0, 311, 310, 0, 1767802348,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802348), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784224_f614b288aa0522ba629b4f42e55989a8_rle_crop_4092809148_0.png', 0, 190, 333, 0, 1767802348,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802348), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784224_f614b288aa0522ba629b4f42e55989a8_rle_crop_4092809150_0.png', 0, 303, 216, 0, 1767802348,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802348), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784223_6f7eea6d6d4d27e40e0150148a74a608_rle_crop_4092809156_0.png', 0, 137, 135, 0, 1767802348,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802348), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784223_6f7eea6d6d4d27e40e0150148a74a608_rle_crop_4092809158_0.png', 0, 501, 307, 0, 1767802348,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802348), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784222_5c1058e5e0a1a48d48bffabdf0b70d66_rle_crop_4092809160_0.png', 0, 393, 386, 0, 1767802348,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802348), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784222_5c1058e5e0a1a48d48bffabdf0b70d66_rle_crop_4092809161_0.png', 0, 140, 168, 0, 1767802348,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802348), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784222_5c1058e5e0a1a48d48bffabdf0b70d66_rle_crop_4092809162_0.png', 0, 300, 242, 0, 1767802348,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802348), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784221_be02adf771f3e7456e47c35328029ac7_rle_crop_4092809167_0.png', 0, 602, 372, 0, 1767802348,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802348), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784221_be02adf771f3e7456e47c35328029ac7_rle_crop_4092809174_0.png', 0, 293, 256, 0, 1767802348,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802348), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784221_be02adf771f3e7456e47c35328029ac7_rle_crop_4092809175_0.png', 0, 167, 80, 0, 1767802348,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802348), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784220_03b9cf32cdf8db1b9af32bf54b638a30_rle_crop_4092809179_0.png', 0, 254, 697, 0, 1767802348,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802348), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784220_03b9cf32cdf8db1b9af32bf54b638a30_rle_crop_4092809182_0.png', 0, 328, 660, 0, 1767802348,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802348), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784220_03b9cf32cdf8db1b9af32bf54b638a30_rle_crop_4092809183_0.png', 0, 170, 167, 0, 1767802348,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802348), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784217_331b69e59e6e58f6613168d8357dd445_rle_crop_4092809195_0.png', 0, 221, 439, 0, 1767802348,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802348), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784217_331b69e59e6e58f6613168d8357dd445_rle_crop_4092809197_0.png', 0, 397, 497, 0, 1767802348,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802348), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784217_331b69e59e6e58f6613168d8357dd445_rle_crop_4092809199_0.png', 0, 205, 222, 0, 1767802348,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 24 photos in the portfolio 3736932 time of upload the photos Elapsed time : 5.483011960983276 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 6 About to insert : list_path_to_insert length 6 new photo from crops ! About to upload 6 photos upload in portfolio : 3736932 init cache_photo without model_param we have 6 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1767802351_3258384 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802352), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784226_5c33f42188a944215d645e5321b2da24_rle_crop_4092809132_0.png', 0, 140, 118, 0, 1767802352,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802352), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784225_5c915a68762d609b9a6435cee8508f4e_rle_crop_4092809140_0.png', 0, 105, 132, 0, 1767802352,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802352), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784221_be02adf771f3e7456e47c35328029ac7_rle_crop_4092809170_0.png', 0, 125, 220, 0, 1767802352,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802352), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784221_be02adf771f3e7456e47c35328029ac7_rle_crop_4092809173_0.png', 0, 268, 94, 0, 1767802352,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802352), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784218_dccaa2c7d0962704412f3e2ae9086c34_rle_crop_4092809192_0.png', 0, 154, 118, 0, 1767802352,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802352), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784217_331b69e59e6e58f6613168d8357dd445_rle_crop_4092809198_0.png', 0, 218, 213, 0, 1767802352,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 6 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.7659976482391357 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1767802355_3258384 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767802355), 0.0, 0.0, 14, '', 0, 0, '1767802230_3258384_1402784226_5c33f42188a944215d645e5321b2da24_rle_crop_4092809133_0.png', 0, 166, 189, 0, 1767802355,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.663809061050415 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1402784227, 1402784226, 1402784225, 1402784224, 1402784223, 1402784222, 1402784221, 1402784220, 1402784219, 1402784218, 1402784217] Looping around the photos to save general results len do output : 77 /1402817208Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817209Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817210Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817211Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817212Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817213Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817214Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817215Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817216Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817217Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817218Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817219Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817220Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817222Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817223Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817224Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817226Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817227Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817228Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817230Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817231Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817232Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817234Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817235Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817236Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817237Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817238Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817239Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817240Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817241Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817242Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817253Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817254Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817255Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817256Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817257Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817258Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817259Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817260Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817261Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817262Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817263Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817264Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817267Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817268Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817269Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817280Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817281Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817282Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817283Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817284Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817285Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817286Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817287Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817288Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817289Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817290Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817291Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817292Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817293Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817294Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817295Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817296Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817297Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817298Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817299Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817300Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817301Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817302Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817303Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817305Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817306Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817307Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817308Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817309Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817310Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402817311Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4322522') ('3318', '30022771', '1402784227', None, None, None, None, None, '4322522') ('3318', None, None, None, None, None, None, None, '4322522') ('3318', '30022771', '1402784226', None, None, None, None, None, '4322522') ('3318', None, None, None, None, None, None, None, '4322522') ('3318', '30022771', '1402784225', None, None, None, None, None, '4322522') ('3318', None, None, None, None, None, None, None, '4322522') ('3318', '30022771', '1402784224', None, None, None, None, None, '4322522') ('3318', None, None, None, None, None, None, None, '4322522') ('3318', '30022771', '1402784223', None, None, None, None, None, '4322522') ('3318', None, None, None, None, None, None, None, '4322522') ('3318', '30022771', '1402784222', None, None, None, None, None, '4322522') ('3318', None, None, None, None, None, None, None, '4322522') ('3318', '30022771', '1402784221', None, None, None, None, None, '4322522') ('3318', None, None, None, None, None, None, None, '4322522') ('3318', '30022771', '1402784220', None, None, None, None, None, '4322522') ('3318', None, None, None, None, None, None, None, '4322522') ('3318', '30022771', '1402784219', None, None, None, None, None, '4322522') ('3318', None, None, None, None, None, None, None, '4322522') ('3318', '30022771', '1402784218', None, None, None, None, None, '4322522') ('3318', None, None, None, None, None, None, None, '4322522') ('3318', '30022771', '1402784217', None, None, None, None, None, '4322522') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 242 time used for this insertion : 0.042778968811035156 save_final save missing photos in datou_result : time spend for datou_step_exec : 47.91951298713684 time spend to save output : 0.04569077491760254 total time spend for step 2 : 47.96520376205444 step3:rle_unique_nms_with_priority Wed Jan 7 17:12:35 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 77 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 5 nb_hashtags : 2 time to prepare the origin masks : 2.552178144454956 time for calcul the mask position with numpy : 0.48719286918640137 nb_pixel_total : 8139660 time to create 1 rle with new method : 0.7352643013000488 time for calcul the mask position with numpy : 0.023914098739624023 nb_pixel_total : 9169 time to create 1 rle with old method : 0.009938478469848633 time for calcul the mask position with numpy : 0.024135351181030273 nb_pixel_total : 40462 time to create 1 rle with old method : 0.042733192443847656 time for calcul the mask position with numpy : 0.023694753646850586 nb_pixel_total : 27002 time to create 1 rle with old method : 0.028871774673461914 time for calcul the mask position with numpy : 0.02407383918762207 nb_pixel_total : 6895 time to create 1 rle with old method : 0.007144451141357422 time for calcul the mask position with numpy : 0.023212194442749023 nb_pixel_total : 71212 time to create 1 rle with old method : 0.07330155372619629 create new chi : 1.5384676456451416 time to delete rle : 0.0209500789642334 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 4266 TO DO : save crop sub photo not yet done ! save time : 0.31383490562438965 nb_obj : 4 nb_hashtags : 4 time to prepare the origin masks : 2.382377862930298 time for calcul the mask position with numpy : 0.5654411315917969 nb_pixel_total : 8122388 time to create 1 rle with new method : 1.066108226776123 time for calcul the mask position with numpy : 0.02396368980407715 nb_pixel_total : 114766 time to create 1 rle with old method : 0.12175583839416504 time for calcul the mask position with numpy : 0.02425837516784668 nb_pixel_total : 25521 time to create 1 rle with old method : 0.027416467666625977 time for calcul the mask position with numpy : 0.024430513381958008 nb_pixel_total : 13775 time to create 1 rle with old method : 0.015059947967529297 time for calcul the mask position with numpy : 0.024953603744506836 nb_pixel_total : 17950 time to create 1 rle with old method : 0.020215988159179688 create new chi : 1.9562702178955078 time to delete rle : 0.0006279945373535156 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 4190 TO DO : save crop sub photo not yet done ! save time : 0.3164684772491455 nb_obj : 11 nb_hashtags : 4 time to prepare the origin masks : 6.027208089828491 time for calcul the mask position with numpy : 0.6063251495361328 nb_pixel_total : 7518261 time to create 1 rle with new method : 0.7360482215881348 time for calcul the mask position with numpy : 0.023566722869873047 nb_pixel_total : 141907 time to create 1 rle with old method : 0.1437692642211914 time for calcul the mask position with numpy : 0.025470495223999023 nb_pixel_total : 341485 time to create 1 rle with new method : 0.7634687423706055 time for calcul the mask position with numpy : 0.02379584312438965 nb_pixel_total : 20920 time to create 1 rle with old method : 0.02202916145324707 time for calcul the mask position with numpy : 0.023566246032714844 nb_pixel_total : 5577 time to create 1 rle with old method : 0.0059735774993896484 time for calcul the mask position with numpy : 0.023230314254760742 nb_pixel_total : 7331 time to create 1 rle with old method : 0.007673501968383789 time for calcul the mask position with numpy : 0.022315263748168945 nb_pixel_total : 10910 time to create 1 rle with old method : 0.011049509048461914 time for calcul the mask position with numpy : 0.023337602615356445 nb_pixel_total : 30980 time to create 1 rle with old method : 0.031998634338378906 time for calcul the mask position with numpy : 0.024346113204956055 nb_pixel_total : 60895 time to create 1 rle with old method : 0.061927080154418945 time for calcul the mask position with numpy : 0.02289748191833496 nb_pixel_total : 22254 time to create 1 rle with old method : 0.022578954696655273 time for calcul the mask position with numpy : 0.022747516632080078 nb_pixel_total : 51593 time to create 1 rle with old method : 0.053400278091430664 time for calcul the mask position with numpy : 0.024547338485717773 nb_pixel_total : 82287 time to create 1 rle with old method : 0.08581304550170898 create new chi : 2.8739030361175537 time to delete rle : 0.0011026859283447266 batch 1 Loaded 23 chid ids of type : 3594 ++++++++++++++++++Number RLEs to save : 8864 TO DO : save crop sub photo not yet done ! save time : 0.6198523044586182 nb_obj : 7 nb_hashtags : 3 time to prepare the origin masks : 3.1048126220703125 time for calcul the mask position with numpy : 0.6179502010345459 nb_pixel_total : 7900344 time to create 1 rle with new method : 0.9277098178863525 time for calcul the mask position with numpy : 0.023050546646118164 nb_pixel_total : 21613 time to create 1 rle with old method : 0.021394968032836914 time for calcul the mask position with numpy : 0.023522377014160156 nb_pixel_total : 56345 time to create 1 rle with old method : 0.05761885643005371 time for calcul the mask position with numpy : 0.024213075637817383 nb_pixel_total : 52025 time to create 1 rle with old method : 0.0544590950012207 time for calcul the mask position with numpy : 0.024485111236572266 nb_pixel_total : 73602 time to create 1 rle with old method : 0.07657885551452637 time for calcul the mask position with numpy : 0.02325272560119629 nb_pixel_total : 50286 time to create 1 rle with old method : 0.05231595039367676 time for calcul the mask position with numpy : 0.023990631103515625 nb_pixel_total : 63451 time to create 1 rle with old method : 0.06731390953063965 time for calcul the mask position with numpy : 0.024370908737182617 nb_pixel_total : 76734 time to create 1 rle with old method : 0.07859063148498535 create new chi : 2.1598339080810547 time to delete rle : 0.0008831024169921875 batch 1 Loaded 15 chid ids of type : 3594 ++++++++Number RLEs to save : 6484 TO DO : save crop sub photo not yet done ! save time : 0.46072959899902344 nb_obj : 6 nb_hashtags : 3 time to prepare the origin masks : 2.9282822608947754 time for calcul the mask position with numpy : 0.5985233783721924 nb_pixel_total : 7986520 time to create 1 rle with new method : 0.8150393962860107 time for calcul the mask position with numpy : 0.024576663970947266 nb_pixel_total : 100526 time to create 1 rle with old method : 0.10768556594848633 time for calcul the mask position with numpy : 0.024642229080200195 nb_pixel_total : 111881 time to create 1 rle with old method : 0.11960887908935547 time for calcul the mask position with numpy : 0.02502584457397461 nb_pixel_total : 15363 time to create 1 rle with old method : 0.016694307327270508 time for calcul the mask position with numpy : 0.02458477020263672 nb_pixel_total : 31668 time to create 1 rle with old method : 0.03390836715698242 time for calcul the mask position with numpy : 0.02496027946472168 nb_pixel_total : 30687 time to create 1 rle with old method : 0.03358626365661621 time for calcul the mask position with numpy : 0.024702787399291992 nb_pixel_total : 17755 time to create 1 rle with old method : 0.019452571868896484 create new chi : 1.9355542659759521 time to delete rle : 0.0007731914520263672 batch 1 Loaded 13 chid ids of type : 3594 ++++++Number RLEs to save : 5160 TO DO : save crop sub photo not yet done ! save time : 0.3859264850616455 nb_obj : 8 nb_hashtags : 3 time to prepare the origin masks : 3.884220600128174 time for calcul the mask position with numpy : 0.5734870433807373 nb_pixel_total : 7724702 time to create 1 rle with new method : 0.895909309387207 time for calcul the mask position with numpy : 0.024464845657348633 nb_pixel_total : 98812 time to create 1 rle with old method : 0.10688042640686035 time for calcul the mask position with numpy : 0.023204565048217773 nb_pixel_total : 129696 time to create 1 rle with old method : 0.1322040557861328 time for calcul the mask position with numpy : 0.024959325790405273 nb_pixel_total : 45267 time to create 1 rle with old method : 0.046386003494262695 time for calcul the mask position with numpy : 0.022849559783935547 nb_pixel_total : 22947 time to create 1 rle with old method : 0.023098468780517578 time for calcul the mask position with numpy : 0.0335237979888916 nb_pixel_total : 56684 time to create 1 rle with old method : 0.05767560005187988 time for calcul the mask position with numpy : 0.026415348052978516 nb_pixel_total : 15888 time to create 1 rle with old method : 0.016955852508544922 time for calcul the mask position with numpy : 0.030653953552246094 nb_pixel_total : 93392 time to create 1 rle with old method : 0.09892487525939941 time for calcul the mask position with numpy : 0.023920536041259766 nb_pixel_total : 107012 time to create 1 rle with old method : 0.11121249198913574 create new chi : 2.3140828609466553 time to delete rle : 0.0009951591491699219 batch 1 Loaded 17 chid ids of type : 3594 ++++++++Number RLEs to save : 7151 TO DO : save crop sub photo not yet done ! save time : 0.5087313652038574 nb_obj : 11 nb_hashtags : 4 time to prepare the origin masks : 4.895092487335205 time for calcul the mask position with numpy : 1.641437292098999 nb_pixel_total : 7777563 time to create 1 rle with new method : 0.8075730800628662 time for calcul the mask position with numpy : 0.023016691207885742 nb_pixel_total : 10612 time to create 1 rle with old method : 0.011131763458251953 time for calcul the mask position with numpy : 0.02508234977722168 nb_pixel_total : 11305 time to create 1 rle with old method : 0.012184619903564453 time for calcul the mask position with numpy : 0.024013996124267578 nb_pixel_total : 10940 time to create 1 rle with old method : 0.012144088745117188 time for calcul the mask position with numpy : 0.02539205551147461 nb_pixel_total : 45433 time to create 1 rle with old method : 0.048497915267944336 time for calcul the mask position with numpy : 0.0232851505279541 nb_pixel_total : 22831 time to create 1 rle with old method : 0.023857831954956055 time for calcul the mask position with numpy : 0.024187564849853516 nb_pixel_total : 31020 time to create 1 rle with old method : 0.034162044525146484 time for calcul the mask position with numpy : 0.024391651153564453 nb_pixel_total : 7779 time to create 1 rle with old method : 0.00854039192199707 time for calcul the mask position with numpy : 0.024715185165405273 nb_pixel_total : 23672 time to create 1 rle with old method : 0.04069399833679199 time for calcul the mask position with numpy : 0.025013446807861328 nb_pixel_total : 42935 time to create 1 rle with old method : 0.04728293418884277 time for calcul the mask position with numpy : 0.025548696517944336 nb_pixel_total : 147546 time to create 1 rle with old method : 0.15201091766357422 time for calcul the mask position with numpy : 0.026552915573120117 nb_pixel_total : 162764 time to create 1 rle with new method : 0.7654495239257812 create new chi : 3.9459340572357178 time to delete rle : 0.0010156631469726562 batch 1 Loaded 23 chid ids of type : 3594 ++++++++++++Number RLEs to save : 7032 TO DO : save crop sub photo not yet done ! save time : 0.5075671672821045 nb_obj : 7 nb_hashtags : 3 time to prepare the origin masks : 3.3558220863342285 time for calcul the mask position with numpy : 0.7021632194519043 nb_pixel_total : 7827750 time to create 1 rle with new method : 1.1880676746368408 time for calcul the mask position with numpy : 0.023733854293823242 nb_pixel_total : 12774 time to create 1 rle with old method : 0.014192342758178711 time for calcul the mask position with numpy : 0.025111675262451172 nb_pixel_total : 23051 time to create 1 rle with old method : 0.024568557739257812 time for calcul the mask position with numpy : 0.024801969528198242 nb_pixel_total : 143851 time to create 1 rle with old method : 0.14911890029907227 time for calcul the mask position with numpy : 0.02327871322631836 nb_pixel_total : 23799 time to create 1 rle with old method : 0.025866031646728516 time for calcul the mask position with numpy : 0.025065898895263672 nb_pixel_total : 58194 time to create 1 rle with old method : 0.060213327407836914 time for calcul the mask position with numpy : 0.024906158447265625 nb_pixel_total : 130903 time to create 1 rle with old method : 0.143693208694458 time for calcul the mask position with numpy : 0.025112628936767578 nb_pixel_total : 74078 time to create 1 rle with old method : 0.10291886329650879 create new chi : 2.6319971084594727 time to delete rle : 0.001554250717163086 batch 1 Loaded 15 chid ids of type : 3594 ++++++++++++Number RLEs to save : 8486 TO DO : save crop sub photo not yet done ! save time : 0.566321849822998 nb_obj : 7 nb_hashtags : 2 time to prepare the origin masks : 3.045736789703369 time for calcul the mask position with numpy : 0.6632182598114014 nb_pixel_total : 8028978 time to create 1 rle with new method : 0.6707861423492432 time for calcul the mask position with numpy : 0.03765106201171875 nb_pixel_total : 9263 time to create 1 rle with old method : 0.00971078872680664 time for calcul the mask position with numpy : 0.023334741592407227 nb_pixel_total : 16147 time to create 1 rle with old method : 0.01678180694580078 time for calcul the mask position with numpy : 0.024135351181030273 nb_pixel_total : 65390 time to create 1 rle with old method : 0.06862020492553711 time for calcul the mask position with numpy : 0.023224830627441406 nb_pixel_total : 44592 time to create 1 rle with old method : 0.0457150936126709 time for calcul the mask position with numpy : 0.02396702766418457 nb_pixel_total : 87339 time to create 1 rle with old method : 0.0892488956451416 time for calcul the mask position with numpy : 0.02360701560974121 nb_pixel_total : 17854 time to create 1 rle with old method : 0.018404006958007812 time for calcul the mask position with numpy : 0.023324966430664062 nb_pixel_total : 24837 time to create 1 rle with old method : 0.025315046310424805 create new chi : 1.8287804126739502 time to delete rle : 0.0008513927459716797 batch 1 Loaded 15 chid ids of type : 3594 +++++++++Number RLEs to save : 6296 TO DO : save crop sub photo not yet done ! save time : 0.46352362632751465 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 1.3242452144622803 time for calcul the mask position with numpy : 0.6519732475280762 nb_pixel_total : 8266853 time to create 1 rle with new method : 0.7957723140716553 time for calcul the mask position with numpy : 0.02280879020690918 nb_pixel_total : 12499 time to create 1 rle with old method : 0.013378381729125977 time for calcul the mask position with numpy : 0.02326679229736328 nb_pixel_total : 15048 time to create 1 rle with old method : 0.01562643051147461 create new chi : 1.561185359954834 time to delete rle : 0.000396728515625 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2622 TO DO : save crop sub photo not yet done ! save time : 0.2126471996307373 nb_obj : 9 nb_hashtags : 5 time to prepare the origin masks : 4.128124475479126 time for calcul the mask position with numpy : 0.6018311977386475 nb_pixel_total : 7788923 time to create 1 rle with new method : 0.7617220878601074 time for calcul the mask position with numpy : 0.022947311401367188 nb_pixel_total : 77305 time to create 1 rle with old method : 0.10666465759277344 time for calcul the mask position with numpy : 0.02457880973815918 nb_pixel_total : 33749 time to create 1 rle with old method : 0.03501415252685547 time for calcul the mask position with numpy : 0.02433013916015625 nb_pixel_total : 28246 time to create 1 rle with old method : 0.029374361038208008 time for calcul the mask position with numpy : 0.02294778823852539 nb_pixel_total : 34141 time to create 1 rle with old method : 0.03572225570678711 time for calcul the mask position with numpy : 0.023587465286254883 nb_pixel_total : 30529 time to create 1 rle with old method : 0.03357386589050293 time for calcul the mask position with numpy : 0.02575826644897461 nb_pixel_total : 139811 time to create 1 rle with old method : 0.1455531120300293 time for calcul the mask position with numpy : 0.02348947525024414 nb_pixel_total : 55707 time to create 1 rle with old method : 0.05933666229248047 time for calcul the mask position with numpy : 0.024375438690185547 nb_pixel_total : 69807 time to create 1 rle with old method : 0.07293534278869629 time for calcul the mask position with numpy : 0.023764610290527344 nb_pixel_total : 36182 time to create 1 rle with old method : 0.03796029090881348 create new chi : 2.1763174533843994 time to delete rle : 0.0011403560638427734 batch 1 Loaded 19 chid ids of type : 3594 ++++++++++++Number RLEs to save : 7980 TO DO : save crop sub photo not yet done ! save time : 0.5461690425872803 map_output_result : {1402784227: (0.0, 'Should be the crop_list due to order', 0), 1402784226: (0.0, 'Should be the crop_list due to order', 0), 1402784225: (0.0, 'Should be the crop_list due to order', 0), 1402784224: (0.0, 'Should be the crop_list due to order', 0), 1402784223: (0.0, 'Should be the crop_list due to order', 0), 1402784222: (0.0, 'Should be the crop_list due to order', 0), 1402784221: (0.0, 'Should be the crop_list due to order', 0), 1402784220: (0.0, 'Should be the crop_list due to order', 0), 1402784219: (0.0, 'Should be the crop_list due to order', 0), 1402784218: (0.0, 'Should be the crop_list due to order', 0), 1402784217: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1402784227, 1402784226, 1402784225, 1402784224, 1402784223, 1402784222, 1402784221, 1402784220, 1402784219, 1402784218, 1402784217] Looping around the photos to save general results len do output : 11 /1402784227.Didn't retrieve data . /1402784226.Didn't retrieve data . /1402784225.Didn't retrieve data . /1402784224.Didn't retrieve data . /1402784223.Didn't retrieve data . /1402784222.Didn't retrieve data . /1402784221.Didn't retrieve data . /1402784220.Didn't retrieve data . /1402784219.Didn't retrieve data . /1402784218.Didn't retrieve data . /1402784217.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4322522') ('3318', '30022771', '1402784227', None, None, None, None, None, '4322522') ('3318', None, None, None, None, None, None, None, '4322522') ('3318', '30022771', '1402784226', None, None, None, None, None, '4322522') ('3318', None, None, None, None, None, None, None, '4322522') ('3318', '30022771', '1402784225', None, None, None, None, None, '4322522') ('3318', None, None, None, None, None, None, None, '4322522') ('3318', '30022771', '1402784224', None, None, None, None, None, '4322522') ('3318', None, None, None, None, None, None, None, '4322522') ('3318', '30022771', '1402784223', None, None, None, None, None, '4322522') ('3318', None, None, None, None, None, None, None, '4322522') ('3318', '30022771', '1402784222', None, None, None, None, None, '4322522') ('3318', None, None, None, None, None, None, None, '4322522') ('3318', '30022771', '1402784221', None, None, None, None, None, '4322522') ('3318', None, None, None, None, None, None, None, '4322522') ('3318', '30022771', '1402784220', None, None, None, None, None, '4322522') ('3318', None, None, None, None, None, None, None, '4322522') ('3318', '30022771', '1402784219', None, None, None, None, None, '4322522') ('3318', None, None, None, None, None, None, None, '4322522') ('3318', '30022771', '1402784218', None, None, None, None, None, '4322522') ('3318', None, None, None, None, None, None, None, '4322522') ('3318', '30022771', '1402784217', None, None, None, None, None, '4322522') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 33 time used for this insertion : 0.018823862075805664 save_final save missing photos in datou_result : time spend for datou_step_exec : 68.66874861717224 time spend to save output : 0.01929640769958496 total time spend for step 3 : 68.68804502487183 step4:ventilate_hashtags_in_portfolio Wed Jan 7 17:13:43 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 30022771 get user id for portfolio 30022771 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30022771 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('background','pet_clair','carton','metal','environnement','flou','mal_croppe','papier','pet_fonce','autre','pehd')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30022771 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('background','pet_clair','carton','metal','environnement','flou','mal_croppe','papier','pet_fonce','autre','pehd')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30022771 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('background','pet_clair','carton','metal','environnement','flou','mal_croppe','papier','pet_fonce','autre','pehd')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/30023122,30023123,30023124,30023125,30023126,30023127,30023128,30023129,30023130,30023131,30023132?tags=background,pet_clair,carton,metal,environnement,flou,mal_croppe,papier,pet_fonce,autre,pehd Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1402784227, 1402784226, 1402784225, 1402784224, 1402784223, 1402784222, 1402784221, 1402784220, 1402784219, 1402784218, 1402784217] Looping around the photos to save general results len do output : 1 /30022771. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4322522') ('3318', '30022771', '1402784227', None, None, None, None, None, '4322522') ('3318', None, None, None, None, None, None, None, '4322522') ('3318', '30022771', '1402784226', None, None, None, None, None, '4322522') ('3318', None, None, None, None, None, None, None, '4322522') ('3318', '30022771', '1402784225', None, None, None, None, None, '4322522') ('3318', None, None, None, None, None, None, None, '4322522') ('3318', '30022771', '1402784224', None, None, None, None, None, '4322522') ('3318', None, None, None, None, None, None, None, '4322522') ('3318', '30022771', '1402784223', None, None, None, None, None, '4322522') ('3318', None, None, None, None, None, None, None, '4322522') ('3318', '30022771', '1402784222', None, None, None, None, None, '4322522') ('3318', None, None, None, None, None, None, None, '4322522') ('3318', '30022771', '1402784221', None, None, None, None, None, '4322522') ('3318', None, None, None, None, None, None, None, '4322522') ('3318', '30022771', '1402784220', None, None, None, None, None, '4322522') ('3318', None, None, None, None, None, None, None, '4322522') ('3318', '30022771', '1402784219', None, None, None, None, None, '4322522') ('3318', None, None, None, None, None, None, None, '4322522') ('3318', '30022771', '1402784218', None, None, None, None, None, '4322522') ('3318', None, None, None, None, None, None, None, '4322522') ('3318', '30022771', '1402784217', None, None, None, None, None, '4322522') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.0175931453704834 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.0831291675567627 time spend to save output : 0.0178680419921875 total time spend for step 4 : 2.10099720954895 step5:final Wed Jan 7 17:13:46 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1402784227: ('0.04555601588804715',), 1402784226: ('0.04555601588804715',), 1402784225: ('0.04555601588804715',), 1402784224: ('0.04555601588804715',), 1402784223: ('0.04555601588804715',), 1402784222: ('0.04555601588804715',), 1402784221: ('0.04555601588804715',), 1402784220: ('0.04555601588804715',), 1402784219: ('0.04555601588804715',), 1402784218: ('0.04555601588804715',), 1402784217: ('0.04555601588804715',)} new output for save of step final : {1402784227: ('0.04555601588804715',), 1402784226: ('0.04555601588804715',), 1402784225: ('0.04555601588804715',), 1402784224: ('0.04555601588804715',), 1402784223: ('0.04555601588804715',), 1402784222: ('0.04555601588804715',), 1402784221: ('0.04555601588804715',), 1402784220: ('0.04555601588804715',), 1402784219: ('0.04555601588804715',), 1402784218: ('0.04555601588804715',), 1402784217: ('0.04555601588804715',)} [1402784227, 1402784226, 1402784225, 1402784224, 1402784223, 1402784222, 1402784221, 1402784220, 1402784219, 1402784218, 1402784217] Looping around the photos to save general results len do output : 11 /1402784227.Didn't retrieve data . /1402784226.Didn't retrieve data . /1402784225.Didn't retrieve data . /1402784224.Didn't retrieve data . /1402784223.Didn't retrieve data . /1402784222.Didn't retrieve data . /1402784221.Didn't retrieve data . /1402784220.Didn't retrieve data . /1402784219.Didn't retrieve data . /1402784218.Didn't retrieve data . /1402784217.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4322522') ('3318', '30022771', '1402784227', None, None, None, None, None, '4322522') ('3318', None, None, None, None, None, None, None, '4322522') ('3318', '30022771', '1402784226', None, None, None, None, None, '4322522') ('3318', None, None, None, None, None, None, None, '4322522') ('3318', '30022771', '1402784225', None, None, None, None, None, '4322522') ('3318', None, None, None, None, None, None, None, '4322522') ('3318', '30022771', '1402784224', None, None, None, None, None, '4322522') ('3318', None, None, None, None, None, None, None, '4322522') ('3318', '30022771', '1402784223', None, None, None, None, None, '4322522') ('3318', None, None, None, None, None, None, None, '4322522') ('3318', '30022771', '1402784222', None, None, None, None, None, '4322522') ('3318', None, None, None, None, None, None, None, '4322522') ('3318', '30022771', '1402784221', None, None, None, None, None, '4322522') ('3318', None, None, None, None, None, None, None, '4322522') ('3318', '30022771', '1402784220', None, None, None, None, None, '4322522') ('3318', None, None, None, None, None, None, None, '4322522') ('3318', '30022771', '1402784219', None, None, None, None, None, '4322522') ('3318', None, None, None, None, None, None, None, '4322522') ('3318', '30022771', '1402784218', None, None, None, None, None, '4322522') ('3318', None, None, None, None, None, None, None, '4322522') ('3318', '30022771', '1402784217', None, None, None, None, None, '4322522') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 33 time used for this insertion : 0.01697850227355957 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.14643645286560059 time spend to save output : 0.017500877380371094 total time spend for step 5 : 0.16393733024597168 step6:blur_detection Wed Jan 7 17:13:46 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1767802230_3258384_1402784227_2e317ad92ad7c85869153f613e2f2074.jpg resize: (2160, 3840) 1402784227 -6.888182495370678 treat image : temp/1767802230_3258384_1402784226_5c33f42188a944215d645e5321b2da24.jpg resize: (2160, 3840) 1402784226 -6.907584297129179 treat image : temp/1767802230_3258384_1402784225_5c915a68762d609b9a6435cee8508f4e.jpg resize: (2160, 3840) 1402784225 -7.076627727055278 treat image : temp/1767802230_3258384_1402784224_f614b288aa0522ba629b4f42e55989a8.jpg resize: (2160, 3840) 1402784224 -6.95685522696697 treat image : temp/1767802230_3258384_1402784223_6f7eea6d6d4d27e40e0150148a74a608.jpg resize: (2160, 3840) 1402784223 -6.939017720804864 treat image : temp/1767802230_3258384_1402784222_5c1058e5e0a1a48d48bffabdf0b70d66.jpg resize: (2160, 3840) 1402784222 -7.272236952494615 treat image : temp/1767802230_3258384_1402784221_be02adf771f3e7456e47c35328029ac7.jpg resize: (2160, 3840) 1402784221 -7.033598581088589 treat image : temp/1767802230_3258384_1402784220_03b9cf32cdf8db1b9af32bf54b638a30.jpg resize: (2160, 3840) 1402784220 -6.886976855413345 treat image : temp/1767802230_3258384_1402784219_9b579ec3bbf46cdf821296c1420493ba.jpg resize: (2160, 3840) 1402784219 -7.052632824750774 treat image : temp/1767802230_3258384_1402784218_dccaa2c7d0962704412f3e2ae9086c34.jpg resize: (2160, 3840) 1402784218 -6.990917647974913 treat image : temp/1767802230_3258384_1402784217_331b69e59e6e58f6613168d8357dd445.jpg resize: (2160, 3840) 1402784217 -7.014510663223072 treat image : temp/1767802230_3258384_1402784227_2e317ad92ad7c85869153f613e2f2074_rle_crop_4092809126_0.png resize: (352, 400) 1402817208 -3.2704626587285213 treat image : temp/1767802230_3258384_1402784227_2e317ad92ad7c85869153f613e2f2074_rle_crop_4092809128_0.png resize: (175, 277) 1402817209 -4.289064787084029 treat image : temp/1767802230_3258384_1402784227_2e317ad92ad7c85869153f613e2f2074_rle_crop_4092809129_0.png resize: (251, 258) 1402817210 -3.819919604366381 treat image : temp/1767802230_3258384_1402784226_5c33f42188a944215d645e5321b2da24_rle_crop_4092809131_0.png resize: (168, 161) 1402817211 -4.760145278609622 treat image : temp/1767802230_3258384_1402784225_5c915a68762d609b9a6435cee8508f4e_rle_crop_4092809141_0.png resize: (143, 85) 1402817212 -3.528037687613798 treat image : temp/1767802230_3258384_1402784225_5c915a68762d609b9a6435cee8508f4e_rle_crop_4092809142_0.png resize: (125, 61) 1402817213 -3.004037197732442 treat image : temp/1767802230_3258384_1402784225_5c915a68762d609b9a6435cee8508f4e_rle_crop_4092809144_0.png resize: (735, 807) 1402817214 -5.079039532073125 treat image : temp/1767802230_3258384_1402784224_f614b288aa0522ba629b4f42e55989a8_rle_crop_4092809147_0.png resize: (312, 344) 1402817215 -4.626865544920776 treat image : temp/1767802230_3258384_1402784224_f614b288aa0522ba629b4f42e55989a8_rle_crop_4092809149_0.png resize: (393, 363) 1402817216 -3.521375651923164 treat image : temp/1767802230_3258384_1402784224_f614b288aa0522ba629b4f42e55989a8_rle_crop_4092809151_0.png resize: (277, 290) 1402817217 -4.954607058517092 treat image : temp/1767802230_3258384_1402784223_6f7eea6d6d4d27e40e0150148a74a608_rle_crop_4092809157_0.png resize: (381, 343) 1402817218 -4.299678411446554 treat image : temp/1767802230_3258384_1402784222_5c1058e5e0a1a48d48bffabdf0b70d66_rle_crop_4092809159_0.png resize: (356, 426) 1402817219 -5.0415608844121795 treat image : temp/1767802230_3258384_1402784222_5c1058e5e0a1a48d48bffabdf0b70d66_rle_crop_4092809164_0.png resize: (170, 325) 1402817220 -3.29897590353649 treat image : temp/1767802230_3258384_1402784222_5c1058e5e0a1a48d48bffabdf0b70d66_rle_crop_4092809165_0.png resize: (440, 321) 1402817222 -5.384323928652928 treat image : temp/1767802230_3258384_1402784221_be02adf771f3e7456e47c35328029ac7_rle_crop_4092809168_0.png resize: (597, 404) 1402817223 -5.0980165088386045 treat image : temp/1767802230_3258384_1402784221_be02adf771f3e7456e47c35328029ac7_rle_crop_4092809169_0.png resize: (158, 318) 1402817224 -4.852739099888597 treat image : temp/1767802230_3258384_1402784221_be02adf771f3e7456e47c35328029ac7_rle_crop_4092809172_0.png resize: (112, 319) 1402817226 -5.059510760445849 treat image : temp/1767802230_3258384_1402784221_be02adf771f3e7456e47c35328029ac7_rle_crop_4092809176_0.png resize: (124, 145) 1402817227 -4.590707999460182 treat image : temp/1767802230_3258384_1402784221_be02adf771f3e7456e47c35328029ac7_rle_crop_4092809177_0.png resize: (207, 169) 1402817228 -4.381072162780967 treat image : temp/1767802230_3258384_1402784220_03b9cf32cdf8db1b9af32bf54b638a30_rle_crop_4092809178_0.png resize: (383, 319) 1402817230 -3.3391820330357094 treat image : temp/1767802230_3258384_1402784220_03b9cf32cdf8db1b9af32bf54b638a30_rle_crop_4092809180_0.png resize: (415, 355) 1402817231 -3.0338652921550375 treat image : temp/1767802230_3258384_1402784220_03b9cf32cdf8db1b9af32bf54b638a30_rle_crop_4092809181_0.png resize: (209, 138) 1402817232 -3.8047323126421513 treat image : temp/1767802230_3258384_1402784219_9b579ec3bbf46cdf821296c1420493ba_rle_crop_4092809185_0.png resize: (175, 207) 1402817234 -5.010712402713822 treat image : temp/1767802230_3258384_1402784219_9b579ec3bbf46cdf821296c1420493ba_rle_crop_4092809186_0.png resize: (167, 130) 1402817235 -3.076910654997082 treat image : temp/1767802230_3258384_1402784219_9b579ec3bbf46cdf821296c1420493ba_rle_crop_4092809187_0.png resize: (354, 402) 1402817236 -4.940586497126901 treat image : temp/1767802230_3258384_1402784219_9b579ec3bbf46cdf821296c1420493ba_rle_crop_4092809188_0.png resize: (257, 338) 1402817237 -3.7060401000799095 treat image : temp/1767802230_3258384_1402784219_9b579ec3bbf46cdf821296c1420493ba_rle_crop_4092809189_0.png resize: (683, 358) 1402817238 -4.508690086948005 treat image : temp/1767802230_3258384_1402784219_9b579ec3bbf46cdf821296c1420493ba_rle_crop_4092809190_0.png resize: (190, 97) 1402817239 -2.1103392742832625 treat image : temp/1767802230_3258384_1402784218_dccaa2c7d0962704412f3e2ae9086c34_rle_crop_4092809193_0.png resize: (107, 142) 1402817240 -2.8160539553203856 treat image : temp/1767802230_3258384_1402784217_331b69e59e6e58f6613168d8357dd445_rle_crop_4092809194_0.png resize: (241, 206) 1402817241 -4.347536957549449 treat image : temp/1767802230_3258384_1402784217_331b69e59e6e58f6613168d8357dd445_rle_crop_4092809196_0.png resize: (289, 258) 1402817242 -4.867753424938548 treat image : temp/1767802230_3258384_1402784227_2e317ad92ad7c85869153f613e2f2074_rle_crop_4092809127_0.png resize: (148, 92) 1402817253 -3.229632351217185 treat image : temp/1767802230_3258384_1402784227_2e317ad92ad7c85869153f613e2f2074_rle_crop_4092809130_0.png resize: (93, 163) 1402817254 -2.4202347260282306 treat image : temp/1767802230_3258384_1402784225_5c915a68762d609b9a6435cee8508f4e_rle_crop_4092809136_0.png resize: (271, 267) 1402817255 -5.4629847302996275 treat image : temp/1767802230_3258384_1402784224_f614b288aa0522ba629b4f42e55989a8_rle_crop_4092809152_0.png resize: (283, 106) 1402817256 -3.3094446045836223 treat image : temp/1767802230_3258384_1402784223_6f7eea6d6d4d27e40e0150148a74a608_rle_crop_4092809153_0.png resize: (197, 118) 1402817257 -4.095254544647345 treat image : temp/1767802230_3258384_1402784223_6f7eea6d6d4d27e40e0150148a74a608_rle_crop_4092809154_0.png resize: (238, 165) 1402817258 -3.855449374698377 treat image : temp/1767802230_3258384_1402784223_6f7eea6d6d4d27e40e0150148a74a608_rle_crop_4092809155_0.png resize: (204, 212) 1402817259 -4.074159005875039 treat image : temp/1767802230_3258384_1402784222_5c1058e5e0a1a48d48bffabdf0b70d66_rle_crop_4092809163_0.png resize: (220, 149) 1402817260 -3.3902679379118164 treat image : temp/1767802230_3258384_1402784222_5c1058e5e0a1a48d48bffabdf0b70d66_rle_crop_4092809166_0.png resize: (500, 332) 1402817261 -4.587330228064934 treat image : temp/1767802230_3258384_1402784220_03b9cf32cdf8db1b9af32bf54b638a30_rle_crop_4092809184_0.png resize: (179, 86) 1402817262 -0.906035480040293 treat image : temp/1767802230_3258384_1402784217_331b69e59e6e58f6613168d8357dd445_rle_crop_4092809200_0.png resize: (189, 216) 1402817263 -2.5994707067525167 treat image : temp/1767802230_3258384_1402784217_331b69e59e6e58f6613168d8357dd445_rle_crop_4092809201_0.png resize: (364, 191) 1402817264 -3.3768071725091677 treat image : temp/1767802230_3258384_1402784221_be02adf771f3e7456e47c35328029ac7_rle_crop_4092809171_0.png resize: (106, 101) 1402817267 -4.832947055215828 treat image : temp/1767802230_3258384_1402784219_9b579ec3bbf46cdf821296c1420493ba_rle_crop_4092809191_0.png resize: (124, 94) 1402817268 -4.51883781982122 treat image : temp/1767802230_3258384_1402784217_331b69e59e6e58f6613168d8357dd445_rle_crop_4092809202_0.png resize: (290, 319) 1402817269 -5.968613519332955 treat image : temp/1767802230_3258384_1402784226_5c33f42188a944215d645e5321b2da24_rle_crop_4092809134_0.png resize: (534, 650) 1402817280 -2.2894996420166773 treat image : temp/1767802230_3258384_1402784225_5c915a68762d609b9a6435cee8508f4e_rle_crop_4092809135_0.png resize: (313, 331) 1402817281 -5.561970114801728 treat image : temp/1767802230_3258384_1402784225_5c915a68762d609b9a6435cee8508f4e_rle_crop_4092809137_0.png resize: (156, 194) 1402817282 -4.898942781796596 treat image : temp/1767802230_3258384_1402784225_5c915a68762d609b9a6435cee8508f4e_rle_crop_4092809138_0.png resize: (219, 341) 1402817283 -3.895020231140675 treat image : temp/1767802230_3258384_1402784225_5c915a68762d609b9a6435cee8508f4e_rle_crop_4092809139_0.png resize: (141, 301) 1402817284 -5.4800088368478335 treat image : temp/1767802230_3258384_1402784225_5c915a68762d609b9a6435cee8508f4e_rle_crop_4092809143_0.png resize: (148, 212) 1402817285 -4.286207820053445 treat image : temp/1767802230_3258384_1402784225_5c915a68762d609b9a6435cee8508f4e_rle_crop_4092809145_0.png resize: (507, 374) 1402817286 -5.5305821038714384 treat image : temp/1767802230_3258384_1402784224_f614b288aa0522ba629b4f42e55989a8_rle_crop_4092809146_0.png resize: (310, 311) 1402817287 -4.889370488490225 treat image : temp/1767802230_3258384_1402784224_f614b288aa0522ba629b4f42e55989a8_rle_crop_4092809148_0.png resize: (333, 190) 1402817288 -4.655889619563822 treat image : temp/1767802230_3258384_1402784224_f614b288aa0522ba629b4f42e55989a8_rle_crop_4092809150_0.png resize: (216, 303) 1402817289 -4.86814023019531 treat image : temp/1767802230_3258384_1402784223_6f7eea6d6d4d27e40e0150148a74a608_rle_crop_4092809156_0.png resize: (135, 137) 1402817290 -4.3211169584103875 treat image : temp/1767802230_3258384_1402784223_6f7eea6d6d4d27e40e0150148a74a608_rle_crop_4092809158_0.png resize: (307, 501) 1402817291 -4.257188256859693 treat image : temp/1767802230_3258384_1402784222_5c1058e5e0a1a48d48bffabdf0b70d66_rle_crop_4092809160_0.png resize: (386, 393) 1402817292 -6.254469952529031 treat image : temp/1767802230_3258384_1402784222_5c1058e5e0a1a48d48bffabdf0b70d66_rle_crop_4092809161_0.png resize: (168, 140) 1402817293 -4.533074612570738 treat image : temp/1767802230_3258384_1402784222_5c1058e5e0a1a48d48bffabdf0b70d66_rle_crop_4092809162_0.png resize: (242, 300) 1402817294 -4.226402852530173 treat image : temp/1767802230_3258384_1402784221_be02adf771f3e7456e47c35328029ac7_rle_crop_4092809167_0.png resize: (372, 602) 1402817295 -4.646867985106823 treat image : temp/1767802230_3258384_1402784221_be02adf771f3e7456e47c35328029ac7_rle_crop_4092809174_0.png resize: (256, 293) 1402817296 -4.416816107321787 treat image : temp/1767802230_3258384_1402784221_be02adf771f3e7456e47c35328029ac7_rle_crop_4092809175_0.png resize: (80, 167) 1402817297 -3.004822612981535 treat image : temp/1767802230_3258384_1402784220_03b9cf32cdf8db1b9af32bf54b638a30_rle_crop_4092809179_0.png resize: (697, 254) 1402817298 -5.19575845560557 treat image : temp/1767802230_3258384_1402784220_03b9cf32cdf8db1b9af32bf54b638a30_rle_crop_4092809182_0.png resize: (660, 328) 1402817299 -4.680905656400862 treat image : temp/1767802230_3258384_1402784220_03b9cf32cdf8db1b9af32bf54b638a30_rle_crop_4092809183_0.png resize: (167, 170) 1402817300 -4.913848665379376 treat image : temp/1767802230_3258384_1402784217_331b69e59e6e58f6613168d8357dd445_rle_crop_4092809195_0.png resize: (439, 221) 1402817301 -4.9618677352162965 treat image : temp/1767802230_3258384_1402784217_331b69e59e6e58f6613168d8357dd445_rle_crop_4092809197_0.png resize: (497, 397) 1402817302 -4.750148945544815 treat image : temp/1767802230_3258384_1402784217_331b69e59e6e58f6613168d8357dd445_rle_crop_4092809199_0.png resize: (222, 205) 1402817303 -5.218161843310777 treat image : temp/1767802230_3258384_1402784226_5c33f42188a944215d645e5321b2da24_rle_crop_4092809132_0.png resize: (118, 140) 1402817305 -4.7553217751496195 treat image : temp/1767802230_3258384_1402784225_5c915a68762d609b9a6435cee8508f4e_rle_crop_4092809140_0.png resize: (132, 105) 1402817306 -5.080577799089525 treat image : temp/1767802230_3258384_1402784221_be02adf771f3e7456e47c35328029ac7_rle_crop_4092809170_0.png resize: (220, 125) 1402817307 -4.700119556443669 treat image : temp/1767802230_3258384_1402784221_be02adf771f3e7456e47c35328029ac7_rle_crop_4092809173_0.png resize: (94, 268) 1402817308 -3.179456791643563 treat image : temp/1767802230_3258384_1402784218_dccaa2c7d0962704412f3e2ae9086c34_rle_crop_4092809192_0.png resize: (118, 154) 1402817309 -4.258401192764839 treat image : temp/1767802230_3258384_1402784217_331b69e59e6e58f6613168d8357dd445_rle_crop_4092809198_0.png resize: (213, 218) 1402817310 -4.803970141793443 treat image : temp/1767802230_3258384_1402784226_5c33f42188a944215d645e5321b2da24_rle_crop_4092809133_0.png resize: (189, 166) 1402817311 -5.615111188530053 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 88 time used for this insertion : 0.017607450485229492 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 88 time used for this insertion : 0.016951799392700195 save missing photos in datou_result : time spend for datou_step_exec : 41.225462675094604 time spend to save output : 0.04057645797729492 total time spend for step 6 : 41.2660391330719 step7:brightness Wed Jan 7 17:14:27 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1767802230_3258384_1402784227_2e317ad92ad7c85869153f613e2f2074.jpg treat image : temp/1767802230_3258384_1402784226_5c33f42188a944215d645e5321b2da24.jpg treat image : temp/1767802230_3258384_1402784225_5c915a68762d609b9a6435cee8508f4e.jpg treat image : temp/1767802230_3258384_1402784224_f614b288aa0522ba629b4f42e55989a8.jpg treat image : temp/1767802230_3258384_1402784223_6f7eea6d6d4d27e40e0150148a74a608.jpg treat image : temp/1767802230_3258384_1402784222_5c1058e5e0a1a48d48bffabdf0b70d66.jpg treat image : temp/1767802230_3258384_1402784221_be02adf771f3e7456e47c35328029ac7.jpg treat image : temp/1767802230_3258384_1402784220_03b9cf32cdf8db1b9af32bf54b638a30.jpg treat image : temp/1767802230_3258384_1402784219_9b579ec3bbf46cdf821296c1420493ba.jpg treat image : temp/1767802230_3258384_1402784218_dccaa2c7d0962704412f3e2ae9086c34.jpg treat image : temp/1767802230_3258384_1402784217_331b69e59e6e58f6613168d8357dd445.jpg treat image : temp/1767802230_3258384_1402784227_2e317ad92ad7c85869153f613e2f2074_rle_crop_4092809126_0.png treat image : temp/1767802230_3258384_1402784227_2e317ad92ad7c85869153f613e2f2074_rle_crop_4092809128_0.png treat image : temp/1767802230_3258384_1402784227_2e317ad92ad7c85869153f613e2f2074_rle_crop_4092809129_0.png treat image : temp/1767802230_3258384_1402784226_5c33f42188a944215d645e5321b2da24_rle_crop_4092809131_0.png treat image : temp/1767802230_3258384_1402784225_5c915a68762d609b9a6435cee8508f4e_rle_crop_4092809141_0.png treat image : temp/1767802230_3258384_1402784225_5c915a68762d609b9a6435cee8508f4e_rle_crop_4092809142_0.png treat image : temp/1767802230_3258384_1402784225_5c915a68762d609b9a6435cee8508f4e_rle_crop_4092809144_0.png treat image : temp/1767802230_3258384_1402784224_f614b288aa0522ba629b4f42e55989a8_rle_crop_4092809147_0.png treat image : temp/1767802230_3258384_1402784224_f614b288aa0522ba629b4f42e55989a8_rle_crop_4092809149_0.png treat image : temp/1767802230_3258384_1402784224_f614b288aa0522ba629b4f42e55989a8_rle_crop_4092809151_0.png treat image : temp/1767802230_3258384_1402784223_6f7eea6d6d4d27e40e0150148a74a608_rle_crop_4092809157_0.png treat image : temp/1767802230_3258384_1402784222_5c1058e5e0a1a48d48bffabdf0b70d66_rle_crop_4092809159_0.png treat image : temp/1767802230_3258384_1402784222_5c1058e5e0a1a48d48bffabdf0b70d66_rle_crop_4092809164_0.png treat image : temp/1767802230_3258384_1402784222_5c1058e5e0a1a48d48bffabdf0b70d66_rle_crop_4092809165_0.png treat image : temp/1767802230_3258384_1402784221_be02adf771f3e7456e47c35328029ac7_rle_crop_4092809168_0.png treat image : temp/1767802230_3258384_1402784221_be02adf771f3e7456e47c35328029ac7_rle_crop_4092809169_0.png treat image : temp/1767802230_3258384_1402784221_be02adf771f3e7456e47c35328029ac7_rle_crop_4092809172_0.png treat image : temp/1767802230_3258384_1402784221_be02adf771f3e7456e47c35328029ac7_rle_crop_4092809176_0.png treat image : temp/1767802230_3258384_1402784221_be02adf771f3e7456e47c35328029ac7_rle_crop_4092809177_0.png treat image : temp/1767802230_3258384_1402784220_03b9cf32cdf8db1b9af32bf54b638a30_rle_crop_4092809178_0.png treat image : temp/1767802230_3258384_1402784220_03b9cf32cdf8db1b9af32bf54b638a30_rle_crop_4092809180_0.png treat image : temp/1767802230_3258384_1402784220_03b9cf32cdf8db1b9af32bf54b638a30_rle_crop_4092809181_0.png treat image : temp/1767802230_3258384_1402784219_9b579ec3bbf46cdf821296c1420493ba_rle_crop_4092809185_0.png treat image : temp/1767802230_3258384_1402784219_9b579ec3bbf46cdf821296c1420493ba_rle_crop_4092809186_0.png treat image : temp/1767802230_3258384_1402784219_9b579ec3bbf46cdf821296c1420493ba_rle_crop_4092809187_0.png treat image : temp/1767802230_3258384_1402784219_9b579ec3bbf46cdf821296c1420493ba_rle_crop_4092809188_0.png treat image : temp/1767802230_3258384_1402784219_9b579ec3bbf46cdf821296c1420493ba_rle_crop_4092809189_0.png treat image : temp/1767802230_3258384_1402784219_9b579ec3bbf46cdf821296c1420493ba_rle_crop_4092809190_0.png treat image : temp/1767802230_3258384_1402784218_dccaa2c7d0962704412f3e2ae9086c34_rle_crop_4092809193_0.png treat image : temp/1767802230_3258384_1402784217_331b69e59e6e58f6613168d8357dd445_rle_crop_4092809194_0.png treat image : temp/1767802230_3258384_1402784217_331b69e59e6e58f6613168d8357dd445_rle_crop_4092809196_0.png treat image : temp/1767802230_3258384_1402784227_2e317ad92ad7c85869153f613e2f2074_rle_crop_4092809127_0.png treat image : temp/1767802230_3258384_1402784227_2e317ad92ad7c85869153f613e2f2074_rle_crop_4092809130_0.png treat image : temp/1767802230_3258384_1402784225_5c915a68762d609b9a6435cee8508f4e_rle_crop_4092809136_0.png treat image : temp/1767802230_3258384_1402784224_f614b288aa0522ba629b4f42e55989a8_rle_crop_4092809152_0.png treat image : temp/1767802230_3258384_1402784223_6f7eea6d6d4d27e40e0150148a74a608_rle_crop_4092809153_0.png treat image : temp/1767802230_3258384_1402784223_6f7eea6d6d4d27e40e0150148a74a608_rle_crop_4092809154_0.png treat image : temp/1767802230_3258384_1402784223_6f7eea6d6d4d27e40e0150148a74a608_rle_crop_4092809155_0.png treat image : temp/1767802230_3258384_1402784222_5c1058e5e0a1a48d48bffabdf0b70d66_rle_crop_4092809163_0.png treat image : temp/1767802230_3258384_1402784222_5c1058e5e0a1a48d48bffabdf0b70d66_rle_crop_4092809166_0.png treat image : temp/1767802230_3258384_1402784220_03b9cf32cdf8db1b9af32bf54b638a30_rle_crop_4092809184_0.png treat image : temp/1767802230_3258384_1402784217_331b69e59e6e58f6613168d8357dd445_rle_crop_4092809200_0.png treat image : temp/1767802230_3258384_1402784217_331b69e59e6e58f6613168d8357dd445_rle_crop_4092809201_0.png treat image : temp/1767802230_3258384_1402784221_be02adf771f3e7456e47c35328029ac7_rle_crop_4092809171_0.png treat image : temp/1767802230_3258384_1402784219_9b579ec3bbf46cdf821296c1420493ba_rle_crop_4092809191_0.png treat image : temp/1767802230_3258384_1402784217_331b69e59e6e58f6613168d8357dd445_rle_crop_4092809202_0.png treat image : temp/1767802230_3258384_1402784226_5c33f42188a944215d645e5321b2da24_rle_crop_4092809134_0.png treat image : temp/1767802230_3258384_1402784225_5c915a68762d609b9a6435cee8508f4e_rle_crop_4092809135_0.png treat image : temp/1767802230_3258384_1402784225_5c915a68762d609b9a6435cee8508f4e_rle_crop_4092809137_0.png treat image : temp/1767802230_3258384_1402784225_5c915a68762d609b9a6435cee8508f4e_rle_crop_4092809138_0.png treat image : temp/1767802230_3258384_1402784225_5c915a68762d609b9a6435cee8508f4e_rle_crop_4092809139_0.png treat image : temp/1767802230_3258384_1402784225_5c915a68762d609b9a6435cee8508f4e_rle_crop_4092809143_0.png treat image : temp/1767802230_3258384_1402784225_5c915a68762d609b9a6435cee8508f4e_rle_crop_4092809145_0.png treat image : temp/1767802230_3258384_1402784224_f614b288aa0522ba629b4f42e55989a8_rle_crop_4092809146_0.png treat image : temp/1767802230_3258384_1402784224_f614b288aa0522ba629b4f42e55989a8_rle_crop_4092809148_0.png treat image : temp/1767802230_3258384_1402784224_f614b288aa0522ba629b4f42e55989a8_rle_crop_4092809150_0.png treat image : temp/1767802230_3258384_1402784223_6f7eea6d6d4d27e40e0150148a74a608_rle_crop_4092809156_0.png treat image : temp/1767802230_3258384_1402784223_6f7eea6d6d4d27e40e0150148a74a608_rle_crop_4092809158_0.png treat image : temp/1767802230_3258384_1402784222_5c1058e5e0a1a48d48bffabdf0b70d66_rle_crop_4092809160_0.png treat image : temp/1767802230_3258384_1402784222_5c1058e5e0a1a48d48bffabdf0b70d66_rle_crop_4092809161_0.png treat image : temp/1767802230_3258384_1402784222_5c1058e5e0a1a48d48bffabdf0b70d66_rle_crop_4092809162_0.png treat image : temp/1767802230_3258384_1402784221_be02adf771f3e7456e47c35328029ac7_rle_crop_4092809167_0.png treat image : temp/1767802230_3258384_1402784221_be02adf771f3e7456e47c35328029ac7_rle_crop_4092809174_0.png treat image : temp/1767802230_3258384_1402784221_be02adf771f3e7456e47c35328029ac7_rle_crop_4092809175_0.png treat image : temp/1767802230_3258384_1402784220_03b9cf32cdf8db1b9af32bf54b638a30_rle_crop_4092809179_0.png treat image : temp/1767802230_3258384_1402784220_03b9cf32cdf8db1b9af32bf54b638a30_rle_crop_4092809182_0.png treat image : temp/1767802230_3258384_1402784220_03b9cf32cdf8db1b9af32bf54b638a30_rle_crop_4092809183_0.png treat image : temp/1767802230_3258384_1402784217_331b69e59e6e58f6613168d8357dd445_rle_crop_4092809195_0.png treat image : temp/1767802230_3258384_1402784217_331b69e59e6e58f6613168d8357dd445_rle_crop_4092809197_0.png treat image : temp/1767802230_3258384_1402784217_331b69e59e6e58f6613168d8357dd445_rle_crop_4092809199_0.png treat image : temp/1767802230_3258384_1402784226_5c33f42188a944215d645e5321b2da24_rle_crop_4092809132_0.png treat image : temp/1767802230_3258384_1402784225_5c915a68762d609b9a6435cee8508f4e_rle_crop_4092809140_0.png treat image : temp/1767802230_3258384_1402784221_be02adf771f3e7456e47c35328029ac7_rle_crop_4092809170_0.png treat image : temp/1767802230_3258384_1402784221_be02adf771f3e7456e47c35328029ac7_rle_crop_4092809173_0.png treat image : temp/1767802230_3258384_1402784218_dccaa2c7d0962704412f3e2ae9086c34_rle_crop_4092809192_0.png treat image : temp/1767802230_3258384_1402784217_331b69e59e6e58f6613168d8357dd445_rle_crop_4092809198_0.png treat image : temp/1767802230_3258384_1402784226_5c33f42188a944215d645e5321b2da24_rle_crop_4092809133_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 88 time used for this insertion : 0.0193784236907959 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 88 time used for this insertion : 0.020227909088134766 save missing photos in datou_result : time spend for datou_step_exec : 10.296822786331177 time spend to save output : 0.04509544372558594 total time spend for step 7 : 10.341918230056763 step8:velours_tree Wed Jan 7 17:14:37 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.08939361572265625 time spend to save output : 5.626678466796875e-05 total time spend for step 8 : 0.08944988250732422 step9:send_mail_cod Wed Jan 7 17:14:37 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P30022771_07-01-2026_17_14_37.pdf 30023122 imagette300231221767802477 30023123 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette300231231767802477 30023124 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette300231241767802479 30023125 change filename to text .change filename to text .change filename to text .imagette300231251767802480 30023127 imagette300231271767802481 30023128 imagette300231281767802481 30023129 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette300231291767802481 30023130 change filename to text .imagette300231301767802483 30023131 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette300231311767802483 30023132 imagette300231321767802483 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=30022771 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/30023122,30023123,30023124,30023125,30023126,30023127,30023128,30023129,30023130,30023131,30023132?tags=background,pet_clair,carton,metal,environnement,flou,mal_croppe,papier,pet_fonce,autre,pehd your option no_mail is active, we will not send the real mail to your client args[1402784227] : ((1402784227, -6.888182495370678, 492609224), (1402784227, -0.12536686446748815, 496442774), '0.04555601588804715') We are sending mail with results at report@fotonower.com args[1402784226] : ((1402784226, -6.907584297129179, 492609224), (1402784226, -0.1274079657582559, 496442774), '0.04555601588804715') We are sending mail with results at report@fotonower.com args[1402784225] : ((1402784225, -7.076627727055278, 492609224), (1402784225, -0.10577010327231551, 496442774), '0.04555601588804715') We are sending mail with results at report@fotonower.com args[1402784224] : ((1402784224, -6.95685522696697, 492609224), (1402784224, -0.14592362597117883, 496442774), '0.04555601588804715') We are sending mail with results at report@fotonower.com args[1402784223] : ((1402784223, -6.939017720804864, 492609224), (1402784223, -0.038889529158646303, 2107752395), '0.04555601588804715') We are sending mail with results at report@fotonower.com args[1402784222] : ((1402784222, -7.272236952494615, 492609224), (1402784222, -0.02081833358104069, 2107752395), '0.04555601588804715') We are sending mail with results at report@fotonower.com args[1402784221] : ((1402784221, -7.033598581088589, 492609224), (1402784221, -0.06453467140696925, 2107752395), '0.04555601588804715') We are sending mail with results at report@fotonower.com args[1402784220] : ((1402784220, -6.886976855413345, 492609224), (1402784220, -0.11816073479053768, 496442774), '0.04555601588804715') We are sending mail with results at report@fotonower.com args[1402784219] : ((1402784219, -7.052632824750774, 492609224), (1402784219, -0.21192484002487746, 496442774), '0.04555601588804715') We are sending mail with results at report@fotonower.com args[1402784218] : ((1402784218, -6.990917647974913, 492609224), (1402784218, -0.07377002363923497, 496442774), '0.04555601588804715') We are sending mail with results at report@fotonower.com args[1402784217] : ((1402784217, -7.014510663223072, 492609224), (1402784217, -0.11273044561509014, 496442774), '0.04555601588804715') We are sending mail with results at report@fotonower.com refus_total : 0.04555601588804715 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos_view ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=30022771 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30022771_07-01-2026_17_14_37.pdf results_Auto_P30022771_07-01-2026_17_14_37.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30022771_07-01-2026_17_14_37.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','30022771','results_Auto_P30022771_07-01-2026_17_14_37.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30022771_07-01-2026_17_14_37.pdf','pdf','','0.78','0.04555601588804715') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1402784227, 1402784226, 1402784225, 1402784224, 1402784223, 1402784222, 1402784221, 1402784220, 1402784219, 1402784218, 1402784217] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4322522') ('3318', '30022771', '1402784227', None, None, None, None, None, '4322522') ('3318', None, None, None, None, None, None, None, '4322522') ('3318', '30022771', '1402784226', None, None, None, None, None, '4322522') ('3318', None, None, None, None, None, None, None, '4322522') ('3318', '30022771', '1402784225', None, None, None, None, None, '4322522') ('3318', None, None, None, None, None, None, None, '4322522') ('3318', '30022771', '1402784224', None, None, None, None, None, '4322522') ('3318', None, None, None, None, None, None, None, '4322522') ('3318', '30022771', '1402784223', None, None, None, None, None, '4322522') ('3318', None, None, None, None, None, None, None, '4322522') ('3318', '30022771', '1402784222', None, None, None, None, None, '4322522') ('3318', None, None, None, None, None, None, None, '4322522') ('3318', '30022771', '1402784221', None, None, None, None, None, '4322522') ('3318', None, None, None, None, None, None, None, '4322522') ('3318', '30022771', '1402784220', None, None, None, None, None, '4322522') ('3318', None, None, None, None, None, None, None, '4322522') ('3318', '30022771', '1402784219', None, None, None, None, None, '4322522') ('3318', None, None, None, None, None, None, None, '4322522') ('3318', '30022771', '1402784218', None, None, None, None, None, '4322522') ('3318', None, None, None, None, None, None, None, '4322522') ('3318', '30022771', '1402784217', None, None, None, None, None, '4322522') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.015644073486328125 save_final save missing photos in datou_result : time spend for datou_step_exec : 8.398077726364136 time spend to save output : 0.015929460525512695 total time spend for step 9 : 8.414007186889648 step10:split_time_score Wed Jan 7 17:14:46 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('12', 11),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 07012026 30022771 Nombre de photos uploadées : 11 / 23040 (0%) 07012026 30022771 Nombre de photos taguées (types de déchets): 0 / 11 (0%) 07012026 30022771 Nombre de photos taguées (volume) : 0 / 11 (0%) elapsed_time : load_data_split_time_score 1.6689300537109375e-06 elapsed_time : order_list_meta_photo_and_scores 1.0967254638671875e-05 ??????????? elapsed_time : fill_and_build_computed_from_old_data 0.0007841587066650391 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.24008417129516602 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.017145123837801462 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30013137_07-01-2026_12_32_14.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30013137 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30013137 AND mptpi.`type`=3726 To do Qualite : 0.04265686431209951 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30012115_07-01-2026_10_08_27.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30012115 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30012115 AND mptpi.`type`=3726 To do Qualite : 0.036438267317143724 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30011663_07-01-2026_09_40_49.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30011663 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30011663 AND mptpi.`type`=3726 To do Qualite : 0.04555601588804715 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30022771_07-01-2026_17_14_37.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30022771 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30022771 AND mptpi.`type`=3594 To do Qualite : 0.04370853037054693 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30020405_07-01-2026_16_05_10.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30020405 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30020405 AND mptpi.`type`=3726 To do Qualite : 0.023468326791223067 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30016950_07-01-2026_14_37_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30016950 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30016950 AND mptpi.`type`=3726 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'07012026': {'nb_upload': 11, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1402784227, 1402784226, 1402784225, 1402784224, 1402784223, 1402784222, 1402784221, 1402784220, 1402784219, 1402784218, 1402784217] Looping around the photos to save general results len do output : 1 /30022771Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4322522') ('3318', '30022771', '1402784227', None, None, None, None, None, '4322522') ('3318', None, None, None, None, None, None, None, '4322522') ('3318', '30022771', '1402784226', None, None, None, None, None, '4322522') ('3318', None, None, None, None, None, None, None, '4322522') ('3318', '30022771', '1402784225', None, None, None, None, None, '4322522') ('3318', None, None, None, None, None, None, None, '4322522') ('3318', '30022771', '1402784224', None, None, None, None, None, '4322522') ('3318', None, None, None, None, None, None, None, '4322522') ('3318', '30022771', '1402784223', None, None, None, None, None, '4322522') ('3318', None, None, None, None, None, None, None, '4322522') ('3318', '30022771', '1402784222', None, None, None, None, None, '4322522') ('3318', None, None, None, None, None, None, None, '4322522') ('3318', '30022771', '1402784221', None, None, None, None, None, '4322522') ('3318', None, None, None, None, None, None, None, '4322522') ('3318', '30022771', '1402784220', None, None, None, None, None, '4322522') ('3318', None, None, None, None, None, None, None, '4322522') ('3318', '30022771', '1402784219', None, None, None, None, None, '4322522') ('3318', None, None, None, None, None, None, None, '4322522') ('3318', '30022771', '1402784218', None, None, None, None, None, '4322522') ('3318', None, None, None, None, None, None, None, '4322522') ('3318', '30022771', '1402784217', None, None, None, None, None, '4322522') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.0183866024017334 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.8949308395385742 time spend to save output : 0.01858234405517578 total time spend for step 10 : 0.91351318359375 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 11 set_done_treatment 111.33user 114.92system 4:21.37elapsed 86%CPU (0avgtext+0avgdata 4748424maxresident)k 1866432inputs+110816outputs (7061major+10504736minor)pagefaults 0swaps