python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3245387 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['4028749'] with mtr_portfolio_ids : ['28404241'] and first list_photo_ids : [] new path : /proc/3245387/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 14 ; length of list_pids : 14 ; length of list_args : 14 time to download the photos : 3.1973724365234375 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Mon Nov 10 21:40:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10998 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-11-10 21:40:33.788942: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-11-10 21:40:33.814695: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493010000 Hz 2025-11-10 21:40:33.817368: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fd29c000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-11-10 21:40:33.817423: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-11-10 21:40:33.822026: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-11-10 21:40:34.137233: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x433c8100 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-11-10 21:40:34.137282: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-11-10 21:40:34.138683: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-11-10 21:40:34.139049: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-10 21:40:34.141952: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-10 21:40:34.144527: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-11-10 21:40:34.144997: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-11-10 21:40:34.147596: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-11-10 21:40:34.148593: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-11-10 21:40:34.153445: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-11-10 21:40:34.154938: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-11-10 21:40:34.154998: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-10 21:40:34.155776: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-11-10 21:40:34.155791: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-11-10 21:40:34.155800: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-11-10 21:40:34.157121: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10193 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-11-10 21:40:34.399493: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-11-10 21:40:34.399572: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-10 21:40:34.399593: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-10 21:40:34.399611: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-11-10 21:40:34.399628: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-11-10 21:40:34.399646: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-11-10 21:40:34.399663: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-11-10 21:40:34.399680: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-11-10 21:40:34.401264: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-11-10 21:40:34.402594: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-11-10 21:40:34.402629: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-10 21:40:34.402647: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-10 21:40:34.402664: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-11-10 21:40:34.402680: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-11-10 21:40:34.402697: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-11-10 21:40:34.402713: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-11-10 21:40:34.402730: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-11-10 21:40:34.404303: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-11-10 21:40:34.404333: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-11-10 21:40:34.404343: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-11-10 21:40:34.404352: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-11-10 21:40:34.405981: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10193 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-11-10 21:40:43.889030: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-10 21:40:44.072712: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 14 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 29 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 19 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 16 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 17 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 20 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 14 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 17 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 20 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 15 Detection mask done ! Trying to reset tf kernel 3246075 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5706 tf kernel not reseted sub process len(results) : 14 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 14 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10998 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.000978231430053711 nb_pixel_total : 21854 time to create 1 rle with old method : 0.025750398635864258 length of segment : 193 time for calcul the mask position with numpy : 0.00047278404235839844 nb_pixel_total : 14525 time to create 1 rle with old method : 0.0243682861328125 length of segment : 257 time for calcul the mask position with numpy : 0.004795074462890625 nb_pixel_total : 134420 time to create 1 rle with old method : 0.17412805557250977 length of segment : 436 time for calcul the mask position with numpy : 0.0005757808685302734 nb_pixel_total : 23883 time to create 1 rle with old method : 0.028439998626708984 length of segment : 189 time for calcul the mask position with numpy : 0.0004885196685791016 nb_pixel_total : 22176 time to create 1 rle with old method : 0.02712392807006836 length of segment : 270 time for calcul the mask position with numpy : 0.0003628730773925781 nb_pixel_total : 16131 time to create 1 rle with old method : 0.018858909606933594 length of segment : 212 time for calcul the mask position with numpy : 0.00045418739318847656 nb_pixel_total : 27278 time to create 1 rle with old method : 0.031130552291870117 length of segment : 189 time for calcul the mask position with numpy : 0.0007126331329345703 nb_pixel_total : 46631 time to create 1 rle with old method : 0.05291867256164551 length of segment : 352 time for calcul the mask position with numpy : 0.0021245479583740234 nb_pixel_total : 106395 time to create 1 rle with old method : 0.11971402168273926 length of segment : 422 time for calcul the mask position with numpy : 0.01409006118774414 nb_pixel_total : 678207 time to create 1 rle with new method : 0.053734779357910156 length of segment : 825 time for calcul the mask position with numpy : 0.00043511390686035156 nb_pixel_total : 20118 time to create 1 rle with old method : 0.022495269775390625 length of segment : 147 time for calcul the mask position with numpy : 0.0013000965118408203 nb_pixel_total : 72468 time to create 1 rle with old method : 0.07773995399475098 length of segment : 445 time for calcul the mask position with numpy : 0.0017833709716796875 nb_pixel_total : 113297 time to create 1 rle with old method : 0.12080216407775879 length of segment : 444 time for calcul the mask position with numpy : 0.0002040863037109375 nb_pixel_total : 12931 time to create 1 rle with old method : 0.014286041259765625 length of segment : 204 time for calcul the mask position with numpy : 0.0009398460388183594 nb_pixel_total : 65078 time to create 1 rle with old method : 0.06911754608154297 length of segment : 480 time for calcul the mask position with numpy : 0.001069784164428711 nb_pixel_total : 75884 time to create 1 rle with old method : 0.07845520973205566 length of segment : 414 time for calcul the mask position with numpy : 0.0006420612335205078 nb_pixel_total : 53983 time to create 1 rle with old method : 0.059082746505737305 length of segment : 289 time for calcul the mask position with numpy : 0.00029754638671875 nb_pixel_total : 16766 time to create 1 rle with old method : 0.017696619033813477 length of segment : 198 time for calcul the mask position with numpy : 0.0002167224884033203 nb_pixel_total : 11351 time to create 1 rle with old method : 0.012501239776611328 length of segment : 149 time for calcul the mask position with numpy : 0.0008509159088134766 nb_pixel_total : 73530 time to create 1 rle with old method : 0.08244872093200684 length of segment : 272 time for calcul the mask position with numpy : 0.0008091926574707031 nb_pixel_total : 61773 time to create 1 rle with old method : 0.06770634651184082 length of segment : 243 time for calcul the mask position with numpy : 0.0005691051483154297 nb_pixel_total : 35312 time to create 1 rle with old method : 0.03943037986755371 length of segment : 247 time for calcul the mask position with numpy : 0.0002720355987548828 nb_pixel_total : 19840 time to create 1 rle with old method : 0.021208763122558594 length of segment : 181 time for calcul the mask position with numpy : 0.00012946128845214844 nb_pixel_total : 7417 time to create 1 rle with old method : 0.008606910705566406 length of segment : 89 time for calcul the mask position with numpy : 0.0031464099884033203 nb_pixel_total : 194021 time to create 1 rle with new method : 0.008192777633666992 length of segment : 625 time for calcul the mask position with numpy : 0.0008993148803710938 nb_pixel_total : 39472 time to create 1 rle with old method : 0.05441021919250488 length of segment : 266 time for calcul the mask position with numpy : 0.0009884834289550781 nb_pixel_total : 45021 time to create 1 rle with old method : 0.10738730430603027 length of segment : 287 time for calcul the mask position with numpy : 0.0004324913024902344 nb_pixel_total : 17726 time to create 1 rle with old method : 0.025719642639160156 length of segment : 179 time for calcul the mask position with numpy : 0.0006406307220458984 nb_pixel_total : 33461 time to create 1 rle with old method : 0.04582476615905762 length of segment : 210 time for calcul the mask position with numpy : 0.0005366802215576172 nb_pixel_total : 25943 time to create 1 rle with old method : 0.0353085994720459 length of segment : 191 time for calcul the mask position with numpy : 0.0009343624114990234 nb_pixel_total : 51561 time to create 1 rle with old method : 0.07112431526184082 length of segment : 217 time for calcul the mask position with numpy : 0.0018963813781738281 nb_pixel_total : 73281 time to create 1 rle with old method : 0.10314774513244629 length of segment : 537 time for calcul the mask position with numpy : 0.0006175041198730469 nb_pixel_total : 28821 time to create 1 rle with old method : 0.03825497627258301 length of segment : 162 time for calcul the mask position with numpy : 0.002443075180053711 nb_pixel_total : 123554 time to create 1 rle with old method : 0.1733241081237793 length of segment : 567 time for calcul the mask position with numpy : 0.001531362533569336 nb_pixel_total : 74411 time to create 1 rle with old method : 0.09337043762207031 length of segment : 221 time for calcul the mask position with numpy : 0.002814769744873047 nb_pixel_total : 79464 time to create 1 rle with old method : 0.09557533264160156 length of segment : 448 time for calcul the mask position with numpy : 0.000782012939453125 nb_pixel_total : 16136 time to create 1 rle with old method : 0.0205538272857666 length of segment : 191 time for calcul the mask position with numpy : 0.0018596649169921875 nb_pixel_total : 62371 time to create 1 rle with old method : 0.07998085021972656 length of segment : 328 time for calcul the mask position with numpy : 0.001276254653930664 nb_pixel_total : 26723 time to create 1 rle with old method : 0.03139686584472656 length of segment : 228 time for calcul the mask position with numpy : 0.0005388259887695312 nb_pixel_total : 15217 time to create 1 rle with old method : 0.01690506935119629 length of segment : 176 time for calcul the mask position with numpy : 0.0006442070007324219 nb_pixel_total : 21760 time to create 1 rle with old method : 0.02422046661376953 length of segment : 209 time for calcul the mask position with numpy : 0.00039196014404296875 nb_pixel_total : 12210 time to create 1 rle with old method : 0.01347970962524414 length of segment : 157 time for calcul the mask position with numpy : 0.00086212158203125 nb_pixel_total : 26253 time to create 1 rle with old method : 0.02888321876525879 length of segment : 167 time for calcul the mask position with numpy : 0.002376079559326172 nb_pixel_total : 112113 time to create 1 rle with old method : 0.12034296989440918 length of segment : 405 time for calcul the mask position with numpy : 0.0020678043365478516 nb_pixel_total : 87915 time to create 1 rle with old method : 0.11549878120422363 length of segment : 215 time for calcul the mask position with numpy : 0.01157379150390625 nb_pixel_total : 498634 time to create 1 rle with new method : 0.03783869743347168 length of segment : 1770 time for calcul the mask position with numpy : 0.0004684925079345703 nb_pixel_total : 12255 time to create 1 rle with old method : 0.013936281204223633 length of segment : 147 time for calcul the mask position with numpy : 0.0009543895721435547 nb_pixel_total : 39192 time to create 1 rle with old method : 0.043819427490234375 length of segment : 224 time for calcul the mask position with numpy : 0.00030803680419921875 nb_pixel_total : 13400 time to create 1 rle with old method : 0.015699386596679688 length of segment : 122 time for calcul the mask position with numpy : 0.00020265579223632812 nb_pixel_total : 8255 time to create 1 rle with old method : 0.009714365005493164 length of segment : 103 time for calcul the mask position with numpy : 0.0009341239929199219 nb_pixel_total : 41869 time to create 1 rle with old method : 0.05065155029296875 length of segment : 227 time for calcul the mask position with numpy : 0.000997781753540039 nb_pixel_total : 39671 time to create 1 rle with old method : 0.04469633102416992 length of segment : 316 time for calcul the mask position with numpy : 0.00019741058349609375 nb_pixel_total : 9687 time to create 1 rle with old method : 0.011235475540161133 length of segment : 111 time for calcul the mask position with numpy : 0.0007963180541992188 nb_pixel_total : 43110 time to create 1 rle with old method : 0.04802870750427246 length of segment : 265 time for calcul the mask position with numpy : 0.0003192424774169922 nb_pixel_total : 15430 time to create 1 rle with old method : 0.017624616622924805 length of segment : 118 time for calcul the mask position with numpy : 0.0005285739898681641 nb_pixel_total : 20662 time to create 1 rle with old method : 0.02662372589111328 length of segment : 167 time for calcul the mask position with numpy : 0.00046563148498535156 nb_pixel_total : 27631 time to create 1 rle with old method : 0.03200507164001465 length of segment : 132 time for calcul the mask position with numpy : 0.0016086101531982422 nb_pixel_total : 76308 time to create 1 rle with old method : 0.08512520790100098 length of segment : 331 time for calcul the mask position with numpy : 0.00031876564025878906 nb_pixel_total : 10460 time to create 1 rle with old method : 0.011787652969360352 length of segment : 107 time for calcul the mask position with numpy : 0.0011513233184814453 nb_pixel_total : 43725 time to create 1 rle with old method : 0.04770302772521973 length of segment : 376 time for calcul the mask position with numpy : 0.0009448528289794922 nb_pixel_total : 41062 time to create 1 rle with old method : 0.0442047119140625 length of segment : 283 time for calcul the mask position with numpy : 0.001134634017944336 nb_pixel_total : 37466 time to create 1 rle with old method : 0.04158306121826172 length of segment : 242 time for calcul the mask position with numpy : 0.002073526382446289 nb_pixel_total : 92196 time to create 1 rle with old method : 0.10334229469299316 length of segment : 463 time for calcul the mask position with numpy : 0.0026319026947021484 nb_pixel_total : 127286 time to create 1 rle with old method : 0.1399681568145752 length of segment : 402 time for calcul the mask position with numpy : 0.0006568431854248047 nb_pixel_total : 28687 time to create 1 rle with old method : 0.030697107315063477 length of segment : 237 time for calcul the mask position with numpy : 0.0008304119110107422 nb_pixel_total : 35802 time to create 1 rle with old method : 0.038651227951049805 length of segment : 217 time for calcul the mask position with numpy : 0.0004324913024902344 nb_pixel_total : 15077 time to create 1 rle with old method : 0.016490459442138672 length of segment : 121 time for calcul the mask position with numpy : 0.0011551380157470703 nb_pixel_total : 42133 time to create 1 rle with old method : 0.04763484001159668 length of segment : 279 time for calcul the mask position with numpy : 0.0012128353118896484 nb_pixel_total : 52427 time to create 1 rle with old method : 0.056531429290771484 length of segment : 309 time for calcul the mask position with numpy : 0.0015685558319091797 nb_pixel_total : 60116 time to create 1 rle with old method : 0.06557226181030273 length of segment : 320 time for calcul the mask position with numpy : 0.00048351287841796875 nb_pixel_total : 11863 time to create 1 rle with old method : 0.012966394424438477 length of segment : 137 time for calcul the mask position with numpy : 0.0008835792541503906 nb_pixel_total : 21180 time to create 1 rle with old method : 0.02340555191040039 length of segment : 264 time for calcul the mask position with numpy : 0.0011217594146728516 nb_pixel_total : 38019 time to create 1 rle with old method : 0.04243326187133789 length of segment : 254 time for calcul the mask position with numpy : 0.002010822296142578 nb_pixel_total : 67995 time to create 1 rle with old method : 0.07191967964172363 length of segment : 446 time for calcul the mask position with numpy : 0.0016510486602783203 nb_pixel_total : 66312 time to create 1 rle with old method : 0.07482337951660156 length of segment : 216 time for calcul the mask position with numpy : 0.0018649101257324219 nb_pixel_total : 72451 time to create 1 rle with old method : 0.08666419982910156 length of segment : 306 time for calcul the mask position with numpy : 0.0004963874816894531 nb_pixel_total : 15289 time to create 1 rle with old method : 0.01697063446044922 length of segment : 120 time for calcul the mask position with numpy : 0.0004911422729492188 nb_pixel_total : 15214 time to create 1 rle with old method : 0.01745915412902832 length of segment : 162 time for calcul the mask position with numpy : 0.001703023910522461 nb_pixel_total : 62566 time to create 1 rle with old method : 0.0673980712890625 length of segment : 270 time for calcul the mask position with numpy : 0.0015039443969726562 nb_pixel_total : 50063 time to create 1 rle with old method : 0.07100892066955566 length of segment : 154 time for calcul the mask position with numpy : 0.0004153251647949219 nb_pixel_total : 12691 time to create 1 rle with old method : 0.014453649520874023 length of segment : 116 time for calcul the mask position with numpy : 0.0012736320495605469 nb_pixel_total : 50889 time to create 1 rle with old method : 0.057276010513305664 length of segment : 280 time for calcul the mask position with numpy : 0.0030248165130615234 nb_pixel_total : 138846 time to create 1 rle with old method : 0.1726536750793457 length of segment : 456 time for calcul the mask position with numpy : 0.0005712509155273438 nb_pixel_total : 15771 time to create 1 rle with old method : 0.017569780349731445 length of segment : 179 time for calcul the mask position with numpy : 0.0013360977172851562 nb_pixel_total : 60154 time to create 1 rle with old method : 0.06686520576477051 length of segment : 190 time for calcul the mask position with numpy : 0.0004715919494628906 nb_pixel_total : 16894 time to create 1 rle with old method : 0.018776416778564453 length of segment : 167 time for calcul the mask position with numpy : 0.0004680156707763672 nb_pixel_total : 19012 time to create 1 rle with old method : 0.02104330062866211 length of segment : 142 time for calcul the mask position with numpy : 0.0005347728729248047 nb_pixel_total : 18009 time to create 1 rle with old method : 0.020273685455322266 length of segment : 141 time for calcul the mask position with numpy : 0.0008220672607421875 nb_pixel_total : 30239 time to create 1 rle with old method : 0.03443551063537598 length of segment : 150 time for calcul the mask position with numpy : 0.0006325244903564453 nb_pixel_total : 22536 time to create 1 rle with old method : 0.037622690200805664 length of segment : 236 time for calcul the mask position with numpy : 0.0009410381317138672 nb_pixel_total : 28528 time to create 1 rle with old method : 0.03657245635986328 length of segment : 259 time spent for convertir_results : 8.462879657745361 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 91 chid ids of type : 3594 Number RLEs to save : 25167 save missing photos in datou_result : time spend for datou_step_exec : 62.169511795043945 time spend to save output : 1.5369348526000977 total time spend for step 1 : 63.70644664764404 step2:crop_condition Mon Nov 10 21:41:34 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 14 ! batch 1 Loaded 91 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 30 About to insert : list_path_to_insert length 30 new photo from crops ! About to upload 30 photos upload in portfolio : 3736932 init cache_photo without model_param we have 30 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1762807307_3245387 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807312), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791274_0e775d67ff53001581ba49d6e2748ebe_rle_crop_4029906849_0.png', 0, 261, 193, 0, 1762807312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807312), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791274_0e775d67ff53001581ba49d6e2748ebe_rle_crop_4029906850_0.png', 0, 72, 256, 0, 1762807312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807312), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791274_0e775d67ff53001581ba49d6e2748ebe_rle_crop_4029906852_0.png', 0, 190, 189, 0, 1762807312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807312), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791274_0e775d67ff53001581ba49d6e2748ebe_rle_crop_4029906853_0.png', 0, 110, 270, 0, 1762807312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807312), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791274_0e775d67ff53001581ba49d6e2748ebe_rle_crop_4029906854_0.png', 0, 105, 212, 0, 1762807312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807312), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791274_0e775d67ff53001581ba49d6e2748ebe_rle_crop_4029906857_0.png', 0, 379, 411, 0, 1762807312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807312), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791274_0e775d67ff53001581ba49d6e2748ebe_rle_crop_4029906858_0.png', 0, 1255, 825, 0, 1762807312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807312), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791271_dcca763d7d0860ee364d2a2bcf64c271_rle_crop_4029906862_0.png', 0, 82, 202, 0, 1762807312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807312), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791271_dcca763d7d0860ee364d2a2bcf64c271_rle_crop_4029906867_0.png', 0, 108, 149, 0, 1762807312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807312), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791239_4bb3e85b3288a3c9c84149a4733ee72d_rle_crop_4029906873_0.png', 0, 494, 625, 0, 1762807312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807312), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791230_d7a7be1d71c9b257d7ac2c369fdace31_rle_crop_4029906881_0.png', 0, 213, 162, 0, 1762807312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807312), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791227_cf1f74971e36150dc74b43084ed8e981_rle_crop_4029906884_0.png', 0, 388, 338, 0, 1762807312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807312), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791227_cf1f74971e36150dc74b43084ed8e981_rle_crop_4029906888_0.png', 0, 131, 174, 0, 1762807312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807312), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791227_cf1f74971e36150dc74b43084ed8e981_rle_crop_4029906891_0.png', 0, 193, 167, 0, 1762807312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807312), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791224_68d3300d5389f4f352bb521c0f7c1158_rle_crop_4029906894_0.png', 0, 507, 1770, 0, 1762807312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807312), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791224_68d3300d5389f4f352bb521c0f7c1158_rle_crop_4029906895_0.png', 0, 113, 147, 0, 1762807312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807312), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791222_f7fca9c798b6c8417eed503a7d3583a4_rle_crop_4029906899_0.png', 0, 283, 225, 0, 1762807312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807312), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791222_f7fca9c798b6c8417eed503a7d3583a4_rle_crop_4029906900_0.png', 0, 367, 254, 0, 1762807312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807312), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791220_4946db5b19502f4d4acda2f14eef8d11_rle_crop_4029906903_0.png', 0, 156, 118, 0, 1762807312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807312), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791220_4946db5b19502f4d4acda2f14eef8d11_rle_crop_4029906904_0.png', 0, 217, 167, 0, 1762807312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807312), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791199_8f3a866756eb8b4db07c19211633fa55_rle_crop_4029906906_0.png', 0, 329, 331, 0, 1762807312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807312), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791199_8f3a866756eb8b4db07c19211633fa55_rle_crop_4029906909_0.png', 0, 236, 260, 0, 1762807312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807312), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791196_b624d45eef93f6dd2ea977f206fd3342_rle_crop_4029906916_0.png', 0, 243, 279, 0, 1762807312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807312), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791195_717c851840d356d3e2fcbbd20a305e9e_rle_crop_4029906921_0.png', 0, 268, 247, 0, 1762807312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807312), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791194_988af0dd583a78f049640b70d9b5779b_rle_crop_4029906922_0.png', 0, 234, 416, 0, 1762807312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807312), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791194_988af0dd583a78f049640b70d9b5779b_rle_crop_4029906925_0.png', 0, 182, 120, 0, 1762807312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807312), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791194_988af0dd583a78f049640b70d9b5779b_rle_crop_4029906926_0.png', 0, 110, 160, 0, 1762807312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807312), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791190_7c029bb1c545d1d76b771560e7e7afd6_rle_crop_4029906932_0.png', 0, 156, 179, 0, 1762807312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807312), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791190_7c029bb1c545d1d76b771560e7e7afd6_rle_crop_4029906936_0.png', 0, 190, 136, 0, 1762807312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807312), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791190_7c029bb1c545d1d76b771560e7e7afd6_rle_crop_4029906937_0.png', 0, 345, 150, 0, 1762807312,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 30 photos in the portfolio 3736932 time of upload the photos Elapsed time : 7.102516412734985 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 11 About to insert : list_path_to_insert length 11 new photo from crops ! About to upload 11 photos upload in portfolio : 3736932 init cache_photo without model_param we have 11 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1762807318_3245387 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807320), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791274_0e775d67ff53001581ba49d6e2748ebe_rle_crop_4029906856_0.png', 0, 167, 341, 0, 1762807320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807320), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791274_0e775d67ff53001581ba49d6e2748ebe_rle_crop_4029906859_0.png', 0, 156, 147, 0, 1762807320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807320), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791230_d7a7be1d71c9b257d7ac2c369fdace31_rle_crop_4029906883_0.png', 0, 514, 206, 0, 1762807320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807320), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791227_cf1f74971e36150dc74b43084ed8e981_rle_crop_4029906885_0.png', 0, 118, 191, 0, 1762807320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807320), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791227_cf1f74971e36150dc74b43084ed8e981_rle_crop_4029906886_0.png', 0, 312, 305, 0, 1762807320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807320), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791222_f7fca9c798b6c8417eed503a7d3583a4_rle_crop_4029906896_0.png', 0, 275, 203, 0, 1762807320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807320), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791220_4946db5b19502f4d4acda2f14eef8d11_rle_crop_4029906902_0.png', 0, 206, 259, 0, 1762807320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807320), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791196_b624d45eef93f6dd2ea977f206fd3342_rle_crop_4029906913_0.png', 0, 140, 237, 0, 1762807320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807320), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791196_b624d45eef93f6dd2ea977f206fd3342_rle_crop_4029906914_0.png', 0, 234, 208, 0, 1762807320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807320), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791195_717c851840d356d3e2fcbbd20a305e9e_rle_crop_4029906920_0.png', 0, 146, 248, 0, 1762807320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807320), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791190_7c029bb1c545d1d76b771560e7e7afd6_rle_crop_4029906938_0.png', 0, 158, 198, 0, 1762807320,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 11 photos in the portfolio 3736932 time of upload the photos Elapsed time : 3.2911570072174072 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 8 About to insert : list_path_to_insert length 8 new photo from crops ! About to upload 8 photos upload in portfolio : 3736932 init cache_photo without model_param we have 8 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1762807324_3245387 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807325), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791271_dcca763d7d0860ee364d2a2bcf64c271_rle_crop_4029906866_0.png', 0, 109, 198, 0, 1762807325,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807325), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791265_c30a1c210e79211e0a3c8b9db9aedc51_rle_crop_4029906872_0.png', 0, 111, 89, 0, 1762807325,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807325), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791227_cf1f74971e36150dc74b43084ed8e981_rle_crop_4029906889_0.png', 0, 129, 209, 0, 1762807325,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807325), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791227_cf1f74971e36150dc74b43084ed8e981_rle_crop_4029906890_0.png', 0, 105, 155, 0, 1762807325,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807325), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791222_f7fca9c798b6c8417eed503a7d3583a4_rle_crop_4029906897_0.png', 0, 132, 121, 0, 1762807325,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807325), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791195_717c851840d356d3e2fcbbd20a305e9e_rle_crop_4029906917_0.png', 0, 219, 308, 0, 1762807325,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807325), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791195_717c851840d356d3e2fcbbd20a305e9e_rle_crop_4029906919_0.png', 0, 114, 136, 0, 1762807325,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807325), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791190_7c029bb1c545d1d76b771560e7e7afd6_rle_crop_4029906935_0.png', 0, 165, 141, 0, 1762807325,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 8 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.3297383785247803 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 35 About to insert : list_path_to_insert length 35 new photo from crops ! About to upload 35 photos upload in portfolio : 3736932 init cache_photo without model_param we have 35 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1762807337_3245387 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807344), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791274_0e775d67ff53001581ba49d6e2748ebe_rle_crop_4029906851_0.png', 0, 785, 301, 0, 1762807344,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807344), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791274_0e775d67ff53001581ba49d6e2748ebe_rle_crop_4029906855_0.png', 0, 192, 188, 0, 1762807344,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807344), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791274_0e775d67ff53001581ba49d6e2748ebe_rle_crop_4029906860_0.png', 0, 216, 434, 0, 1762807344,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807344), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791274_0e775d67ff53001581ba49d6e2748ebe_rle_crop_4029906861_0.png', 0, 385, 440, 0, 1762807344,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807344), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791271_dcca763d7d0860ee364d2a2bcf64c271_rle_crop_4029906863_0.png', 0, 276, 428, 0, 1762807344,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807344), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791271_dcca763d7d0860ee364d2a2bcf64c271_rle_crop_4029906864_0.png', 0, 265, 390, 0, 1762807344,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807344), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791271_dcca763d7d0860ee364d2a2bcf64c271_rle_crop_4029906865_0.png', 0, 234, 276, 0, 1762807344,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807344), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791271_dcca763d7d0860ee364d2a2bcf64c271_rle_crop_4029906868_0.png', 0, 355, 271, 0, 1762807344,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807344), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791265_c30a1c210e79211e0a3c8b9db9aedc51_rle_crop_4029906869_0.png', 0, 331, 240, 0, 1762807344,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807344), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791265_c30a1c210e79211e0a3c8b9db9aedc51_rle_crop_4029906870_0.png', 0, 255, 230, 0, 1762807344,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807344), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791265_c30a1c210e79211e0a3c8b9db9aedc51_rle_crop_4029906871_0.png', 0, 143, 176, 0, 1762807344,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807344), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791239_4bb3e85b3288a3c9c84149a4733ee72d_rle_crop_4029906874_0.png', 0, 188, 266, 0, 1762807344,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807344), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791239_4bb3e85b3288a3c9c84149a4733ee72d_rle_crop_4029906875_0.png', 0, 230, 284, 0, 1762807344,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807344), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791239_4bb3e85b3288a3c9c84149a4733ee72d_rle_crop_4029906876_0.png', 0, 187, 164, 0, 1762807344,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807344), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791230_d7a7be1d71c9b257d7ac2c369fdace31_rle_crop_4029906879_0.png', 0, 291, 216, 0, 1762807344,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807344), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791230_d7a7be1d71c9b257d7ac2c369fdace31_rle_crop_4029906880_0.png', 0, 266, 507, 0, 1762807344,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807344), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791230_d7a7be1d71c9b257d7ac2c369fdace31_rle_crop_4029906882_0.png', 0, 385, 433, 0, 1762807344,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807344), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791227_cf1f74971e36150dc74b43084ed8e981_rle_crop_4029906887_0.png', 0, 169, 214, 0, 1762807344,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807344), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791227_cf1f74971e36150dc74b43084ed8e981_rle_crop_4029906892_0.png', 0, 395, 379, 0, 1762807344,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807344), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791224_68d3300d5389f4f352bb521c0f7c1158_rle_crop_4029906893_0.png', 0, 627, 212, 0, 1762807344,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807344), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791220_4946db5b19502f4d4acda2f14eef8d11_rle_crop_4029906905_0.png', 0, 275, 120, 0, 1762807344,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807344), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791199_8f3a866756eb8b4db07c19211633fa55_rle_crop_4029906908_0.png', 0, 192, 376, 0, 1762807344,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807344), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791199_8f3a866756eb8b4db07c19211633fa55_rle_crop_4029906910_0.png', 0, 307, 200, 0, 1762807344,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807344), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791199_8f3a866756eb8b4db07c19211633fa55_rle_crop_4029906911_0.png', 0, 274, 458, 0, 1762807344,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807344), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791199_8f3a866756eb8b4db07c19211633fa55_rle_crop_4029906912_0.png', 0, 482, 383, 0, 1762807344,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807344), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791194_988af0dd583a78f049640b70d9b5779b_rle_crop_4029906923_0.png', 0, 372, 215, 0, 1762807344,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807344), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791194_988af0dd583a78f049640b70d9b5779b_rle_crop_4029906924_0.png', 0, 332, 305, 0, 1762807344,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807344), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791194_988af0dd583a78f049640b70d9b5779b_rle_crop_4029906927_0.png', 0, 316, 265, 0, 1762807344,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807344), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791194_988af0dd583a78f049640b70d9b5779b_rle_crop_4029906928_0.png', 0, 460, 148, 0, 1762807344,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807344), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791194_988af0dd583a78f049640b70d9b5779b_rle_crop_4029906929_0.png', 0, 139, 110, 0, 1762807344,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807344), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791194_988af0dd583a78f049640b70d9b5779b_rle_crop_4029906930_0.png', 0, 232, 270, 0, 1762807344,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807344), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791194_988af0dd583a78f049640b70d9b5779b_rle_crop_4029906931_0.png', 0, 377, 456, 0, 1762807344,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807344), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791190_7c029bb1c545d1d76b771560e7e7afd6_rle_crop_4029906933_0.png', 0, 419, 183, 0, 1762807344,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807344), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791190_7c029bb1c545d1d76b771560e7e7afd6_rle_crop_4029906934_0.png', 0, 144, 163, 0, 1762807344,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807344), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791190_7c029bb1c545d1d76b771560e7e7afd6_rle_crop_4029906939_0.png', 0, 345, 181, 0, 1762807344,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 35 photos in the portfolio 3736932 time of upload the photos Elapsed time : 8.460310935974121 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 7 About to insert : list_path_to_insert length 7 new photo from crops ! About to upload 7 photos upload in portfolio : 3736932 init cache_photo without model_param we have 7 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1762807349_3245387 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807350), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791230_d7a7be1d71c9b257d7ac2c369fdace31_rle_crop_4029906877_0.png', 0, 195, 210, 0, 1762807350,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807350), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791230_d7a7be1d71c9b257d7ac2c369fdace31_rle_crop_4029906878_0.png', 0, 180, 191, 0, 1762807350,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807350), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791222_f7fca9c798b6c8417eed503a7d3583a4_rle_crop_4029906898_0.png', 0, 101, 103, 0, 1762807350,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807350), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791222_f7fca9c798b6c8417eed503a7d3583a4_rle_crop_4029906901_0.png', 0, 112, 111, 0, 1762807350,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807350), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791199_8f3a866756eb8b4db07c19211633fa55_rle_crop_4029906907_0.png', 0, 110, 107, 0, 1762807350,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807350), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791196_b624d45eef93f6dd2ea977f206fd3342_rle_crop_4029906915_0.png', 0, 174, 119, 0, 1762807350,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762807350), 0.0, 0.0, 14, '', 0, 0, '1762807227_3245387_1393791195_717c851840d356d3e2fcbbd20a305e9e_rle_crop_4029906918_0.png', 0, 234, 320, 0, 1762807350,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 7 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.13138747215271 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1393791274, 1393791271, 1393791265, 1393791239, 1393791230, 1393791227, 1393791224, 1393791222, 1393791220, 1393791199, 1393791196, 1393791195, 1393791194, 1393791190] Looping around the photos to save general results len do output : 91 /1393816609Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816610Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816611Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816612Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816613Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816614Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816615Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816616Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816617Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816618Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816619Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816620Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816621Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816622Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816623Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816624Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816625Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816626Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816627Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816628Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816629Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816630Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816631Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816632Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816633Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816634Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816635Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816636Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816637Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816638Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816641Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816643Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816644Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816645Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816647Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816648Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816649Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816650Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816652Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816653Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816654Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816665Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816666Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816667Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816668Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816669Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816670Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816671Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816672Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816679Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816680Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816681Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816682Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816683Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816684Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816685Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816686Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816687Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816688Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816689Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816690Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816691Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816692Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816693Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816694Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816695Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816696Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816697Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816698Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816699Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816700Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816701Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816702Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816703Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816704Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816705Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816706Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816707Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816708Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816709Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816710Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816711Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816712Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816713Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816718Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816719Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816720Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816721Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816722Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816723Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1393816724Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791274', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791271', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791265', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791239', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791230', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791227', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791224', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791222', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791220', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791199', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791196', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791195', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791194', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791190', None, None, None, None, None, '4028749') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 287 time used for this insertion : 0.028498411178588867 save_final save missing photos in datou_result : time spend for datou_step_exec : 56.49063277244568 time spend to save output : 0.031671762466430664 total time spend for step 2 : 56.52230453491211 step3:rle_unique_nms_with_priority Mon Nov 10 21:42:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 91 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 13 nb_hashtags : 3 time to prepare the origin masks : 3.914900779724121 time for calcul the mask position with numpy : 0.38099241256713867 nb_pixel_total : 7103107 time to create 1 rle with new method : 0.7758760452270508 time for calcul the mask position with numpy : 0.02286529541015625 nb_pixel_total : 7207 time to create 1 rle with old method : 0.008180379867553711 time for calcul the mask position with numpy : 0.024261474609375 nb_pixel_total : 72468 time to create 1 rle with old method : 0.0794830322265625 time for calcul the mask position with numpy : 0.02499699592590332 nb_pixel_total : 20118 time to create 1 rle with old method : 0.021553754806518555 time for calcul the mask position with numpy : 0.029869556427001953 nb_pixel_total : 678207 time to create 1 rle with new method : 0.7762467861175537 time for calcul the mask position with numpy : 0.02445077896118164 nb_pixel_total : 106395 time to create 1 rle with old method : 0.11088752746582031 time for calcul the mask position with numpy : 0.024512767791748047 nb_pixel_total : 46631 time to create 1 rle with old method : 0.04995608329772949 time for calcul the mask position with numpy : 0.023427248001098633 nb_pixel_total : 27278 time to create 1 rle with old method : 0.028530359268188477 time for calcul the mask position with numpy : 0.023301362991333008 nb_pixel_total : 16131 time to create 1 rle with old method : 0.01729607582092285 time for calcul the mask position with numpy : 0.024225711822509766 nb_pixel_total : 22176 time to create 1 rle with old method : 0.02411675453186035 time for calcul the mask position with numpy : 0.023819684982299805 nb_pixel_total : 23883 time to create 1 rle with old method : 0.026238441467285156 time for calcul the mask position with numpy : 0.02434062957763672 nb_pixel_total : 134420 time to create 1 rle with old method : 0.14174604415893555 time for calcul the mask position with numpy : 0.024283647537231445 nb_pixel_total : 14525 time to create 1 rle with old method : 0.015385627746582031 time for calcul the mask position with numpy : 0.02371692657470703 nb_pixel_total : 21854 time to create 1 rle with old method : 0.0226132869720459 create new chi : 2.8569066524505615 time to delete rle : 0.022274017333984375 batch 1 Loaded 27 chid ids of type : 3594 +++++++++++++Number RLEs to save : 10806 TO DO : save crop sub photo not yet done ! save time : 0.66398024559021 nb_obj : 7 nb_hashtags : 3 time to prepare the origin masks : 3.229433059692383 time for calcul the mask position with numpy : 0.6941661834716797 nb_pixel_total : 7990387 time to create 1 rle with new method : 0.7749133110046387 time for calcul the mask position with numpy : 0.027173757553100586 nb_pixel_total : 73530 time to create 1 rle with old method : 0.08529472351074219 time for calcul the mask position with numpy : 0.02415323257446289 nb_pixel_total : 11351 time to create 1 rle with old method : 0.012324810028076172 time for calcul the mask position with numpy : 0.02334904670715332 nb_pixel_total : 16766 time to create 1 rle with old method : 0.018153905868530273 time for calcul the mask position with numpy : 0.024285078048706055 nb_pixel_total : 48473 time to create 1 rle with old method : 0.05331254005432129 time for calcul the mask position with numpy : 0.025589466094970703 nb_pixel_total : 75884 time to create 1 rle with old method : 0.08218884468078613 time for calcul the mask position with numpy : 0.024509668350219727 nb_pixel_total : 65078 time to create 1 rle with old method : 0.0703885555267334 time for calcul the mask position with numpy : 0.02509021759033203 nb_pixel_total : 12931 time to create 1 rle with old method : 0.014403581619262695 create new chi : 2.030717134475708 time to delete rle : 0.0008068084716796875 batch 1 Loaded 15 chid ids of type : 3594 +++++++++Number RLEs to save : 6146 TO DO : save crop sub photo not yet done ! save time : 0.4034559726715088 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 1.8696823120117188 time for calcul the mask position with numpy : 0.4694790840148926 nb_pixel_total : 8170058 time to create 1 rle with new method : 0.4635591506958008 time for calcul the mask position with numpy : 0.027500152587890625 nb_pixel_total : 7417 time to create 1 rle with old method : 0.011030435562133789 time for calcul the mask position with numpy : 0.029443025588989258 nb_pixel_total : 19840 time to create 1 rle with old method : 0.03282332420349121 time for calcul the mask position with numpy : 0.027208805084228516 nb_pixel_total : 35312 time to create 1 rle with old method : 0.03861093521118164 time for calcul the mask position with numpy : 0.025398969650268555 nb_pixel_total : 61773 time to create 1 rle with old method : 0.0747981071472168 create new chi : 1.2469971179962158 time to delete rle : 0.0007405281066894531 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 3680 TO DO : save crop sub photo not yet done ! save time : 0.2557978630065918 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 1.8309152126312256 time for calcul the mask position with numpy : 0.5934228897094727 nb_pixel_total : 7998160 time to create 1 rle with new method : 1.1910161972045898 time for calcul the mask position with numpy : 0.024096012115478516 nb_pixel_total : 17726 time to create 1 rle with old method : 0.019078969955444336 time for calcul the mask position with numpy : 0.02448129653930664 nb_pixel_total : 45021 time to create 1 rle with old method : 0.048421621322631836 time for calcul the mask position with numpy : 0.028222322463989258 nb_pixel_total : 39472 time to create 1 rle with old method : 0.06123971939086914 time for calcul the mask position with numpy : 0.0251615047454834 nb_pixel_total : 194021 time to create 1 rle with new method : 0.6925902366638184 create new chi : 2.777679443359375 time to delete rle : 0.0007138252258300781 batch 1 Loaded 9 chid ids of type : 3594 +++++Number RLEs to save : 4874 TO DO : save crop sub photo not yet done ! save time : 0.33768558502197266 nb_obj : 7 nb_hashtags : 4 time to prepare the origin masks : 3.3354430198669434 time for calcul the mask position with numpy : 0.5700700283050537 nb_pixel_total : 7883368 time to create 1 rle with new method : 0.5718367099761963 time for calcul the mask position with numpy : 0.025420427322387695 nb_pixel_total : 74411 time to create 1 rle with old method : 0.08816814422607422 time for calcul the mask position with numpy : 0.025309085845947266 nb_pixel_total : 123554 time to create 1 rle with old method : 0.13582324981689453 time for calcul the mask position with numpy : 0.02911829948425293 nb_pixel_total : 28821 time to create 1 rle with old method : 0.035630226135253906 time for calcul the mask position with numpy : 0.026556730270385742 nb_pixel_total : 73281 time to create 1 rle with old method : 0.08409500122070312 time for calcul the mask position with numpy : 0.025244474411010742 nb_pixel_total : 51561 time to create 1 rle with old method : 0.05638766288757324 time for calcul the mask position with numpy : 0.02695775032043457 nb_pixel_total : 25943 time to create 1 rle with old method : 0.04242539405822754 time for calcul the mask position with numpy : 0.027259111404418945 nb_pixel_total : 33461 time to create 1 rle with old method : 0.03738212585449219 create new chi : 1.856215476989746 time to delete rle : 0.0011355876922607422 batch 1 Loaded 15 chid ids of type : 3594 +++++++++++Number RLEs to save : 6370 TO DO : save crop sub photo not yet done ! save time : 0.4055042266845703 nb_obj : 9 nb_hashtags : 4 time to prepare the origin masks : 3.862990140914917 time for calcul the mask position with numpy : 0.926201343536377 nb_pixel_total : 7922445 time to create 1 rle with new method : 0.6689786911010742 time for calcul the mask position with numpy : 0.023571252822875977 nb_pixel_total : 111821 time to create 1 rle with old method : 0.11888766288757324 time for calcul the mask position with numpy : 0.023654460906982422 nb_pixel_total : 26253 time to create 1 rle with old method : 0.0331113338470459 time for calcul the mask position with numpy : 0.025377273559570312 nb_pixel_total : 12210 time to create 1 rle with old method : 0.013357400894165039 time for calcul the mask position with numpy : 0.037935733795166016 nb_pixel_total : 21760 time to create 1 rle with old method : 0.02260899543762207 time for calcul the mask position with numpy : 0.0380403995513916 nb_pixel_total : 15217 time to create 1 rle with old method : 0.016423463821411133 time for calcul the mask position with numpy : 0.035608768463134766 nb_pixel_total : 26723 time to create 1 rle with old method : 0.029352188110351562 time for calcul the mask position with numpy : 0.025179386138916016 nb_pixel_total : 62371 time to create 1 rle with old method : 0.06821012496948242 time for calcul the mask position with numpy : 0.026728153228759766 nb_pixel_total : 16136 time to create 1 rle with old method : 0.017533063888549805 time for calcul the mask position with numpy : 0.024809598922729492 nb_pixel_total : 79464 time to create 1 rle with old method : 0.08457708358764648 create new chi : 2.3029632568359375 time to delete rle : 0.0009648799896240234 batch 1 Loaded 19 chid ids of type : 3594 +++++++++Number RLEs to save : 6764 TO DO : save crop sub photo not yet done ! save time : 0.4280052185058594 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 1.5147101879119873 time for calcul the mask position with numpy : 0.6038498878479004 nb_pixel_total : 7695596 time to create 1 rle with new method : 0.7674362659454346 time for calcul the mask position with numpy : 0.023565053939819336 nb_pixel_total : 12255 time to create 1 rle with old method : 0.013235807418823242 time for calcul the mask position with numpy : 0.026620149612426758 nb_pixel_total : 498634 time to create 1 rle with new method : 0.6660895347595215 time for calcul the mask position with numpy : 0.023934125900268555 nb_pixel_total : 87915 time to create 1 rle with old method : 0.09222412109375 create new chi : 2.2843549251556396 time to delete rle : 0.0009500980377197266 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 6424 TO DO : save crop sub photo not yet done ! save time : 0.407228946685791 nb_obj : 6 nb_hashtags : 4 time to prepare the origin masks : 2.5869252681732178 time for calcul the mask position with numpy : 0.4917614459991455 nb_pixel_total : 8142326 time to create 1 rle with new method : 0.5881497859954834 time for calcul the mask position with numpy : 0.022771120071411133 nb_pixel_total : 9687 time to create 1 rle with old method : 0.009961128234863281 time for calcul the mask position with numpy : 0.023102760314941406 nb_pixel_total : 39671 time to create 1 rle with old method : 0.040297746658325195 time for calcul the mask position with numpy : 0.02424001693725586 nb_pixel_total : 41869 time to create 1 rle with old method : 0.0437619686126709 time for calcul the mask position with numpy : 0.02372002601623535 nb_pixel_total : 8255 time to create 1 rle with old method : 0.008364439010620117 time for calcul the mask position with numpy : 0.023420333862304688 nb_pixel_total : 13400 time to create 1 rle with old method : 0.014027833938598633 time for calcul the mask position with numpy : 0.02265143394470215 nb_pixel_total : 39192 time to create 1 rle with old method : 0.03934335708618164 create new chi : 1.4174551963806152 time to delete rle : 0.0006165504455566406 batch 1 Loaded 13 chid ids of type : 3594 ++++++Number RLEs to save : 4366 TO DO : save crop sub photo not yet done ! save time : 0.28746914863586426 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 1.7976698875427246 time for calcul the mask position with numpy : 0.37371039390563965 nb_pixel_total : 8187567 time to create 1 rle with new method : 0.7211158275604248 time for calcul the mask position with numpy : 0.023029804229736328 nb_pixel_total : 27631 time to create 1 rle with old method : 0.02983379364013672 time for calcul the mask position with numpy : 0.022808313369750977 nb_pixel_total : 20662 time to create 1 rle with old method : 0.021988391876220703 time for calcul the mask position with numpy : 0.02409648895263672 nb_pixel_total : 15430 time to create 1 rle with old method : 0.016247987747192383 time for calcul the mask position with numpy : 0.02344965934753418 nb_pixel_total : 43110 time to create 1 rle with old method : 0.04400157928466797 create new chi : 1.3414418697357178 time to delete rle : 0.0004673004150390625 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 3524 TO DO : save crop sub photo not yet done ! save time : 0.26851892471313477 nb_obj : 7 nb_hashtags : 3 time to prepare the origin masks : 2.540438175201416 time for calcul the mask position with numpy : 0.42386698722839355 nb_pixel_total : 7865897 time to create 1 rle with new method : 0.6508088111877441 time for calcul the mask position with numpy : 0.02327871322631836 nb_pixel_total : 127286 time to create 1 rle with old method : 0.13001370429992676 time for calcul the mask position with numpy : 0.03540205955505371 nb_pixel_total : 92196 time to create 1 rle with old method : 0.0965108871459961 time for calcul the mask position with numpy : 0.038092613220214844 nb_pixel_total : 37466 time to create 1 rle with old method : 0.03886771202087402 time for calcul the mask position with numpy : 0.03688526153564453 nb_pixel_total : 41062 time to create 1 rle with old method : 0.04136967658996582 time for calcul the mask position with numpy : 0.02436089515686035 nb_pixel_total : 43725 time to create 1 rle with old method : 0.04619908332824707 time for calcul the mask position with numpy : 0.02373790740966797 nb_pixel_total : 10460 time to create 1 rle with old method : 0.011356353759765625 time for calcul the mask position with numpy : 0.023098230361938477 nb_pixel_total : 76308 time to create 1 rle with old method : 0.07682156562805176 create new chi : 1.760984182357788 time to delete rle : 0.0009555816650390625 batch 1 Loaded 15 chid ids of type : 3594 +++++++Number RLEs to save : 6568 TO DO : save crop sub photo not yet done ! save time : 0.43489789962768555 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 1.583190679550171 time for calcul the mask position with numpy : 0.4436771869659424 nb_pixel_total : 8172701 time to create 1 rle with new method : 0.8196842670440674 time for calcul the mask position with numpy : 0.02381610870361328 nb_pixel_total : 42133 time to create 1 rle with old method : 0.0452580451965332 time for calcul the mask position with numpy : 0.024471521377563477 nb_pixel_total : 15077 time to create 1 rle with old method : 0.016605138778686523 time for calcul the mask position with numpy : 0.024947643280029297 nb_pixel_total : 35802 time to create 1 rle with old method : 0.038770437240600586 time for calcul the mask position with numpy : 0.02743816375732422 nb_pixel_total : 28687 time to create 1 rle with old method : 0.031041860580444336 create new chi : 1.538076400756836 time to delete rle : 0.0005826950073242188 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 3868 TO DO : save crop sub photo not yet done ! save time : 0.2694215774536133 nb_obj : 5 nb_hashtags : 4 time to prepare the origin masks : 2.482846260070801 time for calcul the mask position with numpy : 0.5201568603515625 nb_pixel_total : 8110795 time to create 1 rle with new method : 0.7025141716003418 time for calcul the mask position with numpy : 0.024569988250732422 nb_pixel_total : 38019 time to create 1 rle with old method : 0.041674137115478516 time for calcul the mask position with numpy : 0.02389669418334961 nb_pixel_total : 21180 time to create 1 rle with old method : 0.02272343635559082 time for calcul the mask position with numpy : 0.024088382720947266 nb_pixel_total : 11863 time to create 1 rle with old method : 0.01276087760925293 time for calcul the mask position with numpy : 0.02380824089050293 nb_pixel_total : 60116 time to create 1 rle with old method : 0.06360983848571777 time for calcul the mask position with numpy : 0.023993253707885742 nb_pixel_total : 52427 time to create 1 rle with old method : 0.055502891540527344 create new chi : 1.584813117980957 time to delete rle : 0.0006792545318603516 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 4728 TO DO : save crop sub photo not yet done ! save time : 0.307114839553833 nb_obj : 10 nb_hashtags : 2 time to prepare the origin masks : 3.1722779273986816 time for calcul the mask position with numpy : 0.5170409679412842 nb_pixel_total : 7743260 time to create 1 rle with new method : 0.44817304611206055 time for calcul the mask position with numpy : 0.025087594985961914 nb_pixel_total : 138846 time to create 1 rle with old method : 0.14891648292541504 time for calcul the mask position with numpy : 0.02420186996459961 nb_pixel_total : 50889 time to create 1 rle with old method : 0.055318593978881836 time for calcul the mask position with numpy : 0.02437615394592285 nb_pixel_total : 12691 time to create 1 rle with old method : 0.013296365737915039 time for calcul the mask position with numpy : 0.024729013442993164 nb_pixel_total : 48887 time to create 1 rle with old method : 0.055394649505615234 time for calcul the mask position with numpy : 0.027926921844482422 nb_pixel_total : 62566 time to create 1 rle with old method : 0.0718529224395752 time for calcul the mask position with numpy : 0.023701906204223633 nb_pixel_total : 15214 time to create 1 rle with old method : 0.0166475772857666 time for calcul the mask position with numpy : 0.02391338348388672 nb_pixel_total : 15289 time to create 1 rle with old method : 0.016355276107788086 time for calcul the mask position with numpy : 0.024753570556640625 nb_pixel_total : 72451 time to create 1 rle with old method : 0.07661223411560059 time for calcul the mask position with numpy : 0.025852203369140625 nb_pixel_total : 66312 time to create 1 rle with old method : 0.07318711280822754 time for calcul the mask position with numpy : 0.029076814651489258 nb_pixel_total : 67995 time to create 1 rle with old method : 0.07359814643859863 create new chi : 1.865086317062378 time to delete rle : 0.0011434555053710938 batch 1 Loaded 21 chid ids of type : 3594 +++++++++++Number RLEs to save : 7129 TO DO : save crop sub photo not yet done ! save time : 0.4579129219055176 nb_obj : 8 nb_hashtags : 4 time to prepare the origin masks : 3.620765447616577 time for calcul the mask position with numpy : 0.3483433723449707 nb_pixel_total : 8083905 time to create 1 rle with new method : 0.621143102645874 time for calcul the mask position with numpy : 0.04094052314758301 nb_pixel_total : 27880 time to create 1 rle with old method : 0.030968904495239258 time for calcul the mask position with numpy : 0.026763439178466797 nb_pixel_total : 22536 time to create 1 rle with old method : 0.024695634841918945 time for calcul the mask position with numpy : 0.02421116828918457 nb_pixel_total : 30239 time to create 1 rle with old method : 0.031882524490356445 time for calcul the mask position with numpy : 0.024403095245361328 nb_pixel_total : 18009 time to create 1 rle with old method : 0.018697500228881836 time for calcul the mask position with numpy : 0.022921323776245117 nb_pixel_total : 19012 time to create 1 rle with old method : 0.020110130310058594 time for calcul the mask position with numpy : 0.024259090423583984 nb_pixel_total : 16894 time to create 1 rle with old method : 0.017682790756225586 time for calcul the mask position with numpy : 0.024248123168945312 nb_pixel_total : 60154 time to create 1 rle with old method : 0.0642862319946289 time for calcul the mask position with numpy : 0.025334835052490234 nb_pixel_total : 15771 time to create 1 rle with old method : 0.01742720603942871 create new chi : 1.4518191814422607 time to delete rle : 0.0008828639984130859 batch 1 Loaded 17 chid ids of type : 3594 ++++++++++++Number RLEs to save : 5014 TO DO : save crop sub photo not yet done ! save time : 0.3664414882659912 map_output_result : {1393791274: (0.0, 'Should be the crop_list due to order', 0), 1393791271: (0.0, 'Should be the crop_list due to order', 0), 1393791265: (0.0, 'Should be the crop_list due to order', 0), 1393791239: (0.0, 'Should be the crop_list due to order', 0), 1393791230: (0.0, 'Should be the crop_list due to order', 0), 1393791227: (0.0, 'Should be the crop_list due to order', 0), 1393791224: (0.0, 'Should be the crop_list due to order', 0), 1393791222: (0.0, 'Should be the crop_list due to order', 0), 1393791220: (0.0, 'Should be the crop_list due to order', 0), 1393791199: (0.0, 'Should be the crop_list due to order', 0), 1393791196: (0.0, 'Should be the crop_list due to order', 0), 1393791195: (0.0, 'Should be the crop_list due to order', 0), 1393791194: (0.0, 'Should be the crop_list due to order', 0), 1393791190: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1393791274, 1393791271, 1393791265, 1393791239, 1393791230, 1393791227, 1393791224, 1393791222, 1393791220, 1393791199, 1393791196, 1393791195, 1393791194, 1393791190] Looping around the photos to save general results len do output : 14 /1393791274.Didn't retrieve data . /1393791271.Didn't retrieve data . /1393791265.Didn't retrieve data . /1393791239.Didn't retrieve data . /1393791230.Didn't retrieve data . /1393791227.Didn't retrieve data . /1393791224.Didn't retrieve data . /1393791222.Didn't retrieve data . /1393791220.Didn't retrieve data . /1393791199.Didn't retrieve data . /1393791196.Didn't retrieve data . /1393791195.Didn't retrieve data . /1393791194.Didn't retrieve data . /1393791190.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791274', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791271', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791265', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791239', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791230', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791227', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791224', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791222', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791220', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791199', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791196', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791195', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791194', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791190', None, None, None, None, None, '4028749') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 42 time used for this insertion : 0.014997005462646484 save_final save missing photos in datou_result : time spend for datou_step_exec : 70.69790625572205 time spend to save output : 0.015488862991333008 total time spend for step 3 : 70.71339511871338 step4:ventilate_hashtags_in_portfolio Mon Nov 10 21:43:41 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 28404241 get user id for portfolio 28404241 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28404241 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','mal_croppe','flou','carton','autre','pehd','metal','papier','pet_fonce','pet_clair','background')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28404241 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','mal_croppe','flou','carton','autre','pehd','metal','papier','pet_fonce','pet_clair','background')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28404241 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','mal_croppe','flou','carton','autre','pehd','metal','papier','pet_fonce','pet_clair','background')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/28410737,28410738,28410740,28410741,28410742,28410743,28410744,28410745,28410746,28410747,28410748?tags=environnement,mal_croppe,flou,carton,autre,pehd,metal,papier,pet_fonce,pet_clair,background Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1393791274, 1393791271, 1393791265, 1393791239, 1393791230, 1393791227, 1393791224, 1393791222, 1393791220, 1393791199, 1393791196, 1393791195, 1393791194, 1393791190] Looping around the photos to save general results len do output : 1 /28404241. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791274', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791271', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791265', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791239', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791230', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791227', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791224', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791222', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791220', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791199', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791196', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791195', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791194', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791190', None, None, None, None, None, '4028749') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 15 time used for this insertion : 0.016562223434448242 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.666616439819336 time spend to save output : 0.016869068145751953 total time spend for step 4 : 1.683485507965088 step5:final Mon Nov 10 21:43:43 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1393791274: ('0.04350635885141094',), 1393791271: ('0.04350635885141094',), 1393791265: ('0.04350635885141094',), 1393791239: ('0.04350635885141094',), 1393791230: ('0.04350635885141094',), 1393791227: ('0.04350635885141094',), 1393791224: ('0.04350635885141094',), 1393791222: ('0.04350635885141094',), 1393791220: ('0.04350635885141094',), 1393791199: ('0.04350635885141094',), 1393791196: ('0.04350635885141094',), 1393791195: ('0.04350635885141094',), 1393791194: ('0.04350635885141094',), 1393791190: ('0.04350635885141094',)} new output for save of step final : {1393791274: ('0.04350635885141094',), 1393791271: ('0.04350635885141094',), 1393791265: ('0.04350635885141094',), 1393791239: ('0.04350635885141094',), 1393791230: ('0.04350635885141094',), 1393791227: ('0.04350635885141094',), 1393791224: ('0.04350635885141094',), 1393791222: ('0.04350635885141094',), 1393791220: ('0.04350635885141094',), 1393791199: ('0.04350635885141094',), 1393791196: ('0.04350635885141094',), 1393791195: ('0.04350635885141094',), 1393791194: ('0.04350635885141094',), 1393791190: ('0.04350635885141094',)} [1393791274, 1393791271, 1393791265, 1393791239, 1393791230, 1393791227, 1393791224, 1393791222, 1393791220, 1393791199, 1393791196, 1393791195, 1393791194, 1393791190] Looping around the photos to save general results len do output : 14 /1393791274.Didn't retrieve data . /1393791271.Didn't retrieve data . /1393791265.Didn't retrieve data . /1393791239.Didn't retrieve data . /1393791230.Didn't retrieve data . /1393791227.Didn't retrieve data . /1393791224.Didn't retrieve data . /1393791222.Didn't retrieve data . /1393791220.Didn't retrieve data . /1393791199.Didn't retrieve data . /1393791196.Didn't retrieve data . /1393791195.Didn't retrieve data . /1393791194.Didn't retrieve data . /1393791190.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791274', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791271', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791265', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791239', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791230', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791227', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791224', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791222', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791220', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791199', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791196', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791195', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791194', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791190', None, None, None, None, None, '4028749') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 42 time used for this insertion : 0.019338130950927734 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.1192328929901123 time spend to save output : 0.0200347900390625 total time spend for step 5 : 0.1392676830291748 step6:blur_detection Mon Nov 10 21:43:43 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1762807227_3245387_1393791274_0e775d67ff53001581ba49d6e2748ebe.jpg resize: (2160, 3840) 1393791274 -5.989212666485174 treat image : temp/1762807227_3245387_1393791271_dcca763d7d0860ee364d2a2bcf64c271.jpg resize: (2160, 3840) 1393791271 -7.006689048062167 treat image : temp/1762807227_3245387_1393791265_c30a1c210e79211e0a3c8b9db9aedc51.jpg resize: (2160, 3840) 1393791265 -7.144785277830802 treat image : temp/1762807227_3245387_1393791239_4bb3e85b3288a3c9c84149a4733ee72d.jpg resize: (2160, 3840) 1393791239 -6.943449144293442 treat image : temp/1762807227_3245387_1393791230_d7a7be1d71c9b257d7ac2c369fdace31.jpg resize: (2160, 3840) 1393791230 -6.93576888298988 treat image : temp/1762807227_3245387_1393791227_cf1f74971e36150dc74b43084ed8e981.jpg resize: (2160, 3840) 1393791227 -6.950943544902342 treat image : temp/1762807227_3245387_1393791224_68d3300d5389f4f352bb521c0f7c1158.jpg resize: (2160, 3840) 1393791224 -6.9904046513338525 treat image : temp/1762807227_3245387_1393791222_f7fca9c798b6c8417eed503a7d3583a4.jpg resize: (2160, 3840) 1393791222 -7.098902946621466 treat image : temp/1762807227_3245387_1393791220_4946db5b19502f4d4acda2f14eef8d11.jpg resize: (2160, 3840) 1393791220 -6.993034680306045 treat image : temp/1762807227_3245387_1393791199_8f3a866756eb8b4db07c19211633fa55.jpg resize: (2160, 3840) 1393791199 -6.785237120090042 treat image : temp/1762807227_3245387_1393791196_b624d45eef93f6dd2ea977f206fd3342.jpg resize: (2160, 3840) 1393791196 -6.911463928933262 treat image : temp/1762807227_3245387_1393791195_717c851840d356d3e2fcbbd20a305e9e.jpg resize: (2160, 3840) 1393791195 -6.369862991705433 treat image : temp/1762807227_3245387_1393791194_988af0dd583a78f049640b70d9b5779b.jpg resize: (2160, 3840) 1393791194 -6.320897542089804 treat image : temp/1762807227_3245387_1393791190_7c029bb1c545d1d76b771560e7e7afd6.jpg resize: (2160, 3840) 1393791190 -6.222869380620121 treat image : temp/1762807227_3245387_1393791274_0e775d67ff53001581ba49d6e2748ebe_rle_crop_4029906849_0.png resize: (193, 261) 1393816609 -4.493791625825302 treat image : temp/1762807227_3245387_1393791274_0e775d67ff53001581ba49d6e2748ebe_rle_crop_4029906850_0.png resize: (256, 72) 1393816610 -3.4249264579528718 treat image : temp/1762807227_3245387_1393791274_0e775d67ff53001581ba49d6e2748ebe_rle_crop_4029906852_0.png resize: (189, 190) 1393816611 -4.186185453098445 treat image : temp/1762807227_3245387_1393791274_0e775d67ff53001581ba49d6e2748ebe_rle_crop_4029906853_0.png resize: (270, 110) 1393816612 -3.8425572274242406 treat image : temp/1762807227_3245387_1393791274_0e775d67ff53001581ba49d6e2748ebe_rle_crop_4029906854_0.png resize: (212, 105) 1393816613 -3.367695379836597 treat image : temp/1762807227_3245387_1393791274_0e775d67ff53001581ba49d6e2748ebe_rle_crop_4029906857_0.png resize: (411, 379) 1393816614 -5.170521394288267 treat image : temp/1762807227_3245387_1393791274_0e775d67ff53001581ba49d6e2748ebe_rle_crop_4029906858_0.png resize: (825, 1255) 1393816615 -3.164686333808666 treat image : temp/1762807227_3245387_1393791271_dcca763d7d0860ee364d2a2bcf64c271_rle_crop_4029906862_0.png resize: (202, 82) 1393816616 -4.691293468211777 treat image : temp/1762807227_3245387_1393791271_dcca763d7d0860ee364d2a2bcf64c271_rle_crop_4029906867_0.png resize: (149, 108) 1393816617 -4.332834098282979 treat image : temp/1762807227_3245387_1393791239_4bb3e85b3288a3c9c84149a4733ee72d_rle_crop_4029906873_0.png resize: (625, 494) 1393816618 -5.423624074241189 treat image : temp/1762807227_3245387_1393791230_d7a7be1d71c9b257d7ac2c369fdace31_rle_crop_4029906881_0.png resize: (162, 213) 1393816619 -4.369443806170623 treat image : temp/1762807227_3245387_1393791227_cf1f74971e36150dc74b43084ed8e981_rle_crop_4029906884_0.png resize: (338, 388) 1393816620 -4.288815043945258 treat image : temp/1762807227_3245387_1393791227_cf1f74971e36150dc74b43084ed8e981_rle_crop_4029906888_0.png resize: (174, 131) 1393816621 -2.697188486321385 treat image : temp/1762807227_3245387_1393791227_cf1f74971e36150dc74b43084ed8e981_rle_crop_4029906891_0.png resize: (167, 193) 1393816622 -4.111902193112135 treat image : temp/1762807227_3245387_1393791224_68d3300d5389f4f352bb521c0f7c1158_rle_crop_4029906894_0.png resize: (1770, 507) 1393816623 -2.3990160143573935 treat image : temp/1762807227_3245387_1393791224_68d3300d5389f4f352bb521c0f7c1158_rle_crop_4029906895_0.png resize: (147, 113) 1393816624 -4.095952128940178 treat image : temp/1762807227_3245387_1393791222_f7fca9c798b6c8417eed503a7d3583a4_rle_crop_4029906899_0.png resize: (225, 283) 1393816625 -4.078224061072945 treat image : temp/1762807227_3245387_1393791222_f7fca9c798b6c8417eed503a7d3583a4_rle_crop_4029906900_0.png resize: (254, 367) 1393816626 -4.217340675716495 treat image : temp/1762807227_3245387_1393791220_4946db5b19502f4d4acda2f14eef8d11_rle_crop_4029906903_0.png resize: (118, 156) 1393816627 -4.217789726374453 treat image : temp/1762807227_3245387_1393791220_4946db5b19502f4d4acda2f14eef8d11_rle_crop_4029906904_0.png resize: (167, 217) 1393816628 -4.0267205459217035 treat image : temp/1762807227_3245387_1393791199_8f3a866756eb8b4db07c19211633fa55_rle_crop_4029906906_0.png resize: (331, 329) 1393816629 -4.75550406375267 treat image : temp/1762807227_3245387_1393791199_8f3a866756eb8b4db07c19211633fa55_rle_crop_4029906909_0.png resize: (260, 236) 1393816630 -4.291845949226055 treat image : temp/1762807227_3245387_1393791196_b624d45eef93f6dd2ea977f206fd3342_rle_crop_4029906916_0.png resize: (279, 243) 1393816631 -4.9271096036181765 treat image : temp/1762807227_3245387_1393791195_717c851840d356d3e2fcbbd20a305e9e_rle_crop_4029906921_0.png resize: (247, 268) 1393816632 -4.105041987764338 treat image : temp/1762807227_3245387_1393791194_988af0dd583a78f049640b70d9b5779b_rle_crop_4029906922_0.png resize: (416, 234) 1393816633 -4.528531415558108 treat image : temp/1762807227_3245387_1393791194_988af0dd583a78f049640b70d9b5779b_rle_crop_4029906925_0.png resize: (120, 182) 1393816634 -3.1021774670008044 treat image : temp/1762807227_3245387_1393791194_988af0dd583a78f049640b70d9b5779b_rle_crop_4029906926_0.png resize: (160, 110) 1393816635 -1.4154059570497572 treat image : temp/1762807227_3245387_1393791190_7c029bb1c545d1d76b771560e7e7afd6_rle_crop_4029906932_0.png resize: (179, 156) 1393816636 -4.623584920909287 treat image : temp/1762807227_3245387_1393791190_7c029bb1c545d1d76b771560e7e7afd6_rle_crop_4029906936_0.png resize: (136, 190) 1393816637 -4.391250257274777 treat image : temp/1762807227_3245387_1393791190_7c029bb1c545d1d76b771560e7e7afd6_rle_crop_4029906937_0.png resize: (150, 345) 1393816638 -4.380775088307692 treat image : temp/1762807227_3245387_1393791274_0e775d67ff53001581ba49d6e2748ebe_rle_crop_4029906856_0.png resize: (341, 167) 1393816641 -1.4999487891446748 treat image : temp/1762807227_3245387_1393791274_0e775d67ff53001581ba49d6e2748ebe_rle_crop_4029906859_0.png resize: (147, 156) 1393816643 -0.40583328651658956 treat image : temp/1762807227_3245387_1393791230_d7a7be1d71c9b257d7ac2c369fdace31_rle_crop_4029906883_0.png resize: (206, 514) 1393816644 -4.950957539677626 treat image : temp/1762807227_3245387_1393791227_cf1f74971e36150dc74b43084ed8e981_rle_crop_4029906885_0.png resize: (191, 118) 1393816645 -4.257786525700743 treat image : temp/1762807227_3245387_1393791227_cf1f74971e36150dc74b43084ed8e981_rle_crop_4029906886_0.png resize: (305, 312) 1393816647 -3.3649931777126687 treat image : temp/1762807227_3245387_1393791222_f7fca9c798b6c8417eed503a7d3583a4_rle_crop_4029906896_0.png resize: (203, 275) 1393816648 -3.653502704164858 treat image : temp/1762807227_3245387_1393791220_4946db5b19502f4d4acda2f14eef8d11_rle_crop_4029906902_0.png resize: (259, 206) 1393816649 -2.463978822826185 treat image : temp/1762807227_3245387_1393791196_b624d45eef93f6dd2ea977f206fd3342_rle_crop_4029906913_0.png resize: (237, 140) 1393816650 -3.6848717685906345 treat image : temp/1762807227_3245387_1393791196_b624d45eef93f6dd2ea977f206fd3342_rle_crop_4029906914_0.png resize: (208, 234) 1393816652 -4.68155622938201 treat image : temp/1762807227_3245387_1393791195_717c851840d356d3e2fcbbd20a305e9e_rle_crop_4029906920_0.png resize: (248, 146) 1393816653 -4.826172316385649 treat image : temp/1762807227_3245387_1393791190_7c029bb1c545d1d76b771560e7e7afd6_rle_crop_4029906938_0.png resize: (198, 158) 1393816654 -4.796545224059852 treat image : temp/1762807227_3245387_1393791271_dcca763d7d0860ee364d2a2bcf64c271_rle_crop_4029906866_0.png resize: (198, 109) 1393816665 -3.711897453299774 treat image : temp/1762807227_3245387_1393791265_c30a1c210e79211e0a3c8b9db9aedc51_rle_crop_4029906872_0.png resize: (89, 111) 1393816666 -3.6537609106533178 treat image : temp/1762807227_3245387_1393791227_cf1f74971e36150dc74b43084ed8e981_rle_crop_4029906889_0.png resize: (209, 129) 1393816667 -4.52535637065002 treat image : temp/1762807227_3245387_1393791227_cf1f74971e36150dc74b43084ed8e981_rle_crop_4029906890_0.png resize: (155, 105) 1393816668 -3.2564337931170098 treat image : temp/1762807227_3245387_1393791222_f7fca9c798b6c8417eed503a7d3583a4_rle_crop_4029906897_0.png resize: (121, 132) 1393816669 -3.941344448762873 treat image : temp/1762807227_3245387_1393791195_717c851840d356d3e2fcbbd20a305e9e_rle_crop_4029906917_0.png resize: (308, 219) 1393816670 -4.953745417694723 treat image : temp/1762807227_3245387_1393791195_717c851840d356d3e2fcbbd20a305e9e_rle_crop_4029906919_0.png resize: (136, 114) 1393816671 -4.187979174373171 treat image : temp/1762807227_3245387_1393791190_7c029bb1c545d1d76b771560e7e7afd6_rle_crop_4029906935_0.png resize: (141, 165) 1393816672 -3.9645520940659806 treat image : temp/1762807227_3245387_1393791274_0e775d67ff53001581ba49d6e2748ebe_rle_crop_4029906851_0.png resize: (301, 785) 1393816679 -4.283861819070752 treat image : temp/1762807227_3245387_1393791274_0e775d67ff53001581ba49d6e2748ebe_rle_crop_4029906855_0.png resize: (188, 192) 1393816680 -3.8937462948767743 treat image : temp/1762807227_3245387_1393791274_0e775d67ff53001581ba49d6e2748ebe_rle_crop_4029906860_0.png resize: (434, 216) 1393816681 -2.8113316430721373 treat image : temp/1762807227_3245387_1393791274_0e775d67ff53001581ba49d6e2748ebe_rle_crop_4029906861_0.png resize: (440, 385) 1393816682 -5.108182684197767 treat image : temp/1762807227_3245387_1393791271_dcca763d7d0860ee364d2a2bcf64c271_rle_crop_4029906863_0.png resize: (428, 276) 1393816683 -4.9277915583274385 treat image : temp/1762807227_3245387_1393791271_dcca763d7d0860ee364d2a2bcf64c271_rle_crop_4029906864_0.png resize: (390, 265) 1393816684 -4.489257562172305 treat image : temp/1762807227_3245387_1393791271_dcca763d7d0860ee364d2a2bcf64c271_rle_crop_4029906865_0.png resize: (276, 234) 1393816685 -5.086844024985756 treat image : temp/1762807227_3245387_1393791271_dcca763d7d0860ee364d2a2bcf64c271_rle_crop_4029906868_0.png resize: (271, 355) 1393816686 -4.613553128205061 treat image : temp/1762807227_3245387_1393791265_c30a1c210e79211e0a3c8b9db9aedc51_rle_crop_4029906869_0.png resize: (240, 331) 1393816687 -5.611525800311456 treat image : temp/1762807227_3245387_1393791265_c30a1c210e79211e0a3c8b9db9aedc51_rle_crop_4029906870_0.png resize: (230, 255) 1393816688 -4.280220005234055 treat image : temp/1762807227_3245387_1393791265_c30a1c210e79211e0a3c8b9db9aedc51_rle_crop_4029906871_0.png resize: (176, 143) 1393816689 -4.2455379276809015 treat image : temp/1762807227_3245387_1393791239_4bb3e85b3288a3c9c84149a4733ee72d_rle_crop_4029906874_0.png resize: (266, 188) 1393816690 -4.63348025128295 treat image : temp/1762807227_3245387_1393791239_4bb3e85b3288a3c9c84149a4733ee72d_rle_crop_4029906875_0.png resize: (284, 230) 1393816691 -5.344687028976207 treat image : temp/1762807227_3245387_1393791239_4bb3e85b3288a3c9c84149a4733ee72d_rle_crop_4029906876_0.png resize: (164, 187) 1393816692 -3.979733474393421 treat image : temp/1762807227_3245387_1393791230_d7a7be1d71c9b257d7ac2c369fdace31_rle_crop_4029906879_0.png resize: (216, 291) 1393816693 -5.9972138377609 treat image : temp/1762807227_3245387_1393791230_d7a7be1d71c9b257d7ac2c369fdace31_rle_crop_4029906880_0.png resize: (507, 266) 1393816694 -4.635516207202313 treat image : temp/1762807227_3245387_1393791230_d7a7be1d71c9b257d7ac2c369fdace31_rle_crop_4029906882_0.png resize: (433, 385) 1393816695 -5.112218599442173 treat image : temp/1762807227_3245387_1393791227_cf1f74971e36150dc74b43084ed8e981_rle_crop_4029906887_0.png resize: (214, 169) 1393816696 -4.208641516947816 treat image : temp/1762807227_3245387_1393791227_cf1f74971e36150dc74b43084ed8e981_rle_crop_4029906892_0.png resize: (379, 395) 1393816697 -2.2178850674808457 treat image : temp/1762807227_3245387_1393791224_68d3300d5389f4f352bb521c0f7c1158_rle_crop_4029906893_0.png resize: (212, 627) 1393816698 -4.752438035671797 treat image : temp/1762807227_3245387_1393791220_4946db5b19502f4d4acda2f14eef8d11_rle_crop_4029906905_0.png resize: (120, 275) 1393816699 -4.472395818757184 treat image : temp/1762807227_3245387_1393791199_8f3a866756eb8b4db07c19211633fa55_rle_crop_4029906908_0.png resize: (376, 192) 1393816700 -6.0105310635238265 treat image : temp/1762807227_3245387_1393791199_8f3a866756eb8b4db07c19211633fa55_rle_crop_4029906910_0.png resize: (200, 307) 1393816701 -4.9314900836675415 treat image : temp/1762807227_3245387_1393791199_8f3a866756eb8b4db07c19211633fa55_rle_crop_4029906911_0.png resize: (458, 274) 1393816702 -6.012454686407618 treat image : temp/1762807227_3245387_1393791199_8f3a866756eb8b4db07c19211633fa55_rle_crop_4029906912_0.png resize: (383, 482) 1393816703 -4.689176245600805 treat image : temp/1762807227_3245387_1393791194_988af0dd583a78f049640b70d9b5779b_rle_crop_4029906923_0.png resize: (215, 372) 1393816704 -4.185075937889359 treat image : temp/1762807227_3245387_1393791194_988af0dd583a78f049640b70d9b5779b_rle_crop_4029906924_0.png resize: (305, 332) 1393816705 -6.16249656872956 treat image : temp/1762807227_3245387_1393791194_988af0dd583a78f049640b70d9b5779b_rle_crop_4029906927_0.png resize: (265, 316) 1393816706 -4.4740829891397675 treat image : temp/1762807227_3245387_1393791194_988af0dd583a78f049640b70d9b5779b_rle_crop_4029906928_0.png resize: (148, 460) 1393816707 -4.182104993760225 treat image : temp/1762807227_3245387_1393791194_988af0dd583a78f049640b70d9b5779b_rle_crop_4029906929_0.png resize: (110, 139) 1393816708 -1.208416312880979 treat image : temp/1762807227_3245387_1393791194_988af0dd583a78f049640b70d9b5779b_rle_crop_4029906930_0.png resize: (270, 232) 1393816709 -5.196127695684401 treat image : temp/1762807227_3245387_1393791194_988af0dd583a78f049640b70d9b5779b_rle_crop_4029906931_0.png resize: (456, 377) 1393816710 -5.429864831446049 treat image : temp/1762807227_3245387_1393791190_7c029bb1c545d1d76b771560e7e7afd6_rle_crop_4029906933_0.png resize: (183, 419) 1393816711 -4.316179777291941 treat image : temp/1762807227_3245387_1393791190_7c029bb1c545d1d76b771560e7e7afd6_rle_crop_4029906934_0.png resize: (163, 144) 1393816712 -4.422779793745871 treat image : temp/1762807227_3245387_1393791190_7c029bb1c545d1d76b771560e7e7afd6_rle_crop_4029906939_0.png resize: (181, 345) 1393816713 -3.9206061707840765 treat image : temp/1762807227_3245387_1393791230_d7a7be1d71c9b257d7ac2c369fdace31_rle_crop_4029906877_0.png resize: (210, 195) 1393816718 -4.438211167382012 treat image : temp/1762807227_3245387_1393791230_d7a7be1d71c9b257d7ac2c369fdace31_rle_crop_4029906878_0.png resize: (191, 180) 1393816719 -3.5599082411181615 treat image : temp/1762807227_3245387_1393791222_f7fca9c798b6c8417eed503a7d3583a4_rle_crop_4029906898_0.png resize: (103, 101) 1393816720 -4.54080133467911 treat image : temp/1762807227_3245387_1393791222_f7fca9c798b6c8417eed503a7d3583a4_rle_crop_4029906901_0.png resize: (111, 112) 1393816721 -4.910540859942758 treat image : temp/1762807227_3245387_1393791199_8f3a866756eb8b4db07c19211633fa55_rle_crop_4029906907_0.png resize: (107, 110) 1393816722 -4.308948624156222 treat image : temp/1762807227_3245387_1393791196_b624d45eef93f6dd2ea977f206fd3342_rle_crop_4029906915_0.png resize: (119, 174) 1393816723 -4.232258676358092 treat image : temp/1762807227_3245387_1393791195_717c851840d356d3e2fcbbd20a305e9e_rle_crop_4029906918_0.png resize: (320, 234) 1393816724 -2.5705554231946257 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 105 time used for this insertion : 0.01804947853088379 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 105 time used for this insertion : 0.0294797420501709 save missing photos in datou_result : time spend for datou_step_exec : 55.11218786239624 time spend to save output : 0.05280566215515137 total time spend for step 6 : 55.16499352455139 step7:brightness Mon Nov 10 21:44:38 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1762807227_3245387_1393791274_0e775d67ff53001581ba49d6e2748ebe.jpg treat image : temp/1762807227_3245387_1393791271_dcca763d7d0860ee364d2a2bcf64c271.jpg treat image : temp/1762807227_3245387_1393791265_c30a1c210e79211e0a3c8b9db9aedc51.jpg treat image : temp/1762807227_3245387_1393791239_4bb3e85b3288a3c9c84149a4733ee72d.jpg treat image : temp/1762807227_3245387_1393791230_d7a7be1d71c9b257d7ac2c369fdace31.jpg treat image : temp/1762807227_3245387_1393791227_cf1f74971e36150dc74b43084ed8e981.jpg treat image : temp/1762807227_3245387_1393791224_68d3300d5389f4f352bb521c0f7c1158.jpg treat image : temp/1762807227_3245387_1393791222_f7fca9c798b6c8417eed503a7d3583a4.jpg treat image : temp/1762807227_3245387_1393791220_4946db5b19502f4d4acda2f14eef8d11.jpg treat image : temp/1762807227_3245387_1393791199_8f3a866756eb8b4db07c19211633fa55.jpg treat image : temp/1762807227_3245387_1393791196_b624d45eef93f6dd2ea977f206fd3342.jpg treat image : temp/1762807227_3245387_1393791195_717c851840d356d3e2fcbbd20a305e9e.jpg treat image : temp/1762807227_3245387_1393791194_988af0dd583a78f049640b70d9b5779b.jpg treat image : temp/1762807227_3245387_1393791190_7c029bb1c545d1d76b771560e7e7afd6.jpg treat image : temp/1762807227_3245387_1393791274_0e775d67ff53001581ba49d6e2748ebe_rle_crop_4029906849_0.png treat image : temp/1762807227_3245387_1393791274_0e775d67ff53001581ba49d6e2748ebe_rle_crop_4029906850_0.png treat image : temp/1762807227_3245387_1393791274_0e775d67ff53001581ba49d6e2748ebe_rle_crop_4029906852_0.png treat image : temp/1762807227_3245387_1393791274_0e775d67ff53001581ba49d6e2748ebe_rle_crop_4029906853_0.png treat image : temp/1762807227_3245387_1393791274_0e775d67ff53001581ba49d6e2748ebe_rle_crop_4029906854_0.png treat image : temp/1762807227_3245387_1393791274_0e775d67ff53001581ba49d6e2748ebe_rle_crop_4029906857_0.png treat image : temp/1762807227_3245387_1393791274_0e775d67ff53001581ba49d6e2748ebe_rle_crop_4029906858_0.png treat image : temp/1762807227_3245387_1393791271_dcca763d7d0860ee364d2a2bcf64c271_rle_crop_4029906862_0.png treat image : temp/1762807227_3245387_1393791271_dcca763d7d0860ee364d2a2bcf64c271_rle_crop_4029906867_0.png treat image : temp/1762807227_3245387_1393791239_4bb3e85b3288a3c9c84149a4733ee72d_rle_crop_4029906873_0.png treat image : temp/1762807227_3245387_1393791230_d7a7be1d71c9b257d7ac2c369fdace31_rle_crop_4029906881_0.png treat image : temp/1762807227_3245387_1393791227_cf1f74971e36150dc74b43084ed8e981_rle_crop_4029906884_0.png treat image : temp/1762807227_3245387_1393791227_cf1f74971e36150dc74b43084ed8e981_rle_crop_4029906888_0.png treat image : temp/1762807227_3245387_1393791227_cf1f74971e36150dc74b43084ed8e981_rle_crop_4029906891_0.png treat image : temp/1762807227_3245387_1393791224_68d3300d5389f4f352bb521c0f7c1158_rle_crop_4029906894_0.png treat image : temp/1762807227_3245387_1393791224_68d3300d5389f4f352bb521c0f7c1158_rle_crop_4029906895_0.png treat image : temp/1762807227_3245387_1393791222_f7fca9c798b6c8417eed503a7d3583a4_rle_crop_4029906899_0.png treat image : temp/1762807227_3245387_1393791222_f7fca9c798b6c8417eed503a7d3583a4_rle_crop_4029906900_0.png treat image : temp/1762807227_3245387_1393791220_4946db5b19502f4d4acda2f14eef8d11_rle_crop_4029906903_0.png treat image : temp/1762807227_3245387_1393791220_4946db5b19502f4d4acda2f14eef8d11_rle_crop_4029906904_0.png treat image : temp/1762807227_3245387_1393791199_8f3a866756eb8b4db07c19211633fa55_rle_crop_4029906906_0.png treat image : temp/1762807227_3245387_1393791199_8f3a866756eb8b4db07c19211633fa55_rle_crop_4029906909_0.png treat image : temp/1762807227_3245387_1393791196_b624d45eef93f6dd2ea977f206fd3342_rle_crop_4029906916_0.png treat image : temp/1762807227_3245387_1393791195_717c851840d356d3e2fcbbd20a305e9e_rle_crop_4029906921_0.png treat image : temp/1762807227_3245387_1393791194_988af0dd583a78f049640b70d9b5779b_rle_crop_4029906922_0.png treat image : temp/1762807227_3245387_1393791194_988af0dd583a78f049640b70d9b5779b_rle_crop_4029906925_0.png treat image : temp/1762807227_3245387_1393791194_988af0dd583a78f049640b70d9b5779b_rle_crop_4029906926_0.png treat image : temp/1762807227_3245387_1393791190_7c029bb1c545d1d76b771560e7e7afd6_rle_crop_4029906932_0.png treat image : temp/1762807227_3245387_1393791190_7c029bb1c545d1d76b771560e7e7afd6_rle_crop_4029906936_0.png treat image : temp/1762807227_3245387_1393791190_7c029bb1c545d1d76b771560e7e7afd6_rle_crop_4029906937_0.png treat image : temp/1762807227_3245387_1393791274_0e775d67ff53001581ba49d6e2748ebe_rle_crop_4029906856_0.png treat image : temp/1762807227_3245387_1393791274_0e775d67ff53001581ba49d6e2748ebe_rle_crop_4029906859_0.png treat image : temp/1762807227_3245387_1393791230_d7a7be1d71c9b257d7ac2c369fdace31_rle_crop_4029906883_0.png treat image : temp/1762807227_3245387_1393791227_cf1f74971e36150dc74b43084ed8e981_rle_crop_4029906885_0.png treat image : temp/1762807227_3245387_1393791227_cf1f74971e36150dc74b43084ed8e981_rle_crop_4029906886_0.png treat image : temp/1762807227_3245387_1393791222_f7fca9c798b6c8417eed503a7d3583a4_rle_crop_4029906896_0.png treat image : temp/1762807227_3245387_1393791220_4946db5b19502f4d4acda2f14eef8d11_rle_crop_4029906902_0.png treat image : temp/1762807227_3245387_1393791196_b624d45eef93f6dd2ea977f206fd3342_rle_crop_4029906913_0.png treat image : temp/1762807227_3245387_1393791196_b624d45eef93f6dd2ea977f206fd3342_rle_crop_4029906914_0.png treat image : temp/1762807227_3245387_1393791195_717c851840d356d3e2fcbbd20a305e9e_rle_crop_4029906920_0.png treat image : temp/1762807227_3245387_1393791190_7c029bb1c545d1d76b771560e7e7afd6_rle_crop_4029906938_0.png treat image : temp/1762807227_3245387_1393791271_dcca763d7d0860ee364d2a2bcf64c271_rle_crop_4029906866_0.png treat image : temp/1762807227_3245387_1393791265_c30a1c210e79211e0a3c8b9db9aedc51_rle_crop_4029906872_0.png treat image : temp/1762807227_3245387_1393791227_cf1f74971e36150dc74b43084ed8e981_rle_crop_4029906889_0.png treat image : temp/1762807227_3245387_1393791227_cf1f74971e36150dc74b43084ed8e981_rle_crop_4029906890_0.png treat image : temp/1762807227_3245387_1393791222_f7fca9c798b6c8417eed503a7d3583a4_rle_crop_4029906897_0.png treat image : temp/1762807227_3245387_1393791195_717c851840d356d3e2fcbbd20a305e9e_rle_crop_4029906917_0.png treat image : temp/1762807227_3245387_1393791195_717c851840d356d3e2fcbbd20a305e9e_rle_crop_4029906919_0.png treat image : temp/1762807227_3245387_1393791190_7c029bb1c545d1d76b771560e7e7afd6_rle_crop_4029906935_0.png treat image : temp/1762807227_3245387_1393791274_0e775d67ff53001581ba49d6e2748ebe_rle_crop_4029906851_0.png treat image : temp/1762807227_3245387_1393791274_0e775d67ff53001581ba49d6e2748ebe_rle_crop_4029906855_0.png treat image : temp/1762807227_3245387_1393791274_0e775d67ff53001581ba49d6e2748ebe_rle_crop_4029906860_0.png treat image : temp/1762807227_3245387_1393791274_0e775d67ff53001581ba49d6e2748ebe_rle_crop_4029906861_0.png treat image : temp/1762807227_3245387_1393791271_dcca763d7d0860ee364d2a2bcf64c271_rle_crop_4029906863_0.png treat image : temp/1762807227_3245387_1393791271_dcca763d7d0860ee364d2a2bcf64c271_rle_crop_4029906864_0.png treat image : temp/1762807227_3245387_1393791271_dcca763d7d0860ee364d2a2bcf64c271_rle_crop_4029906865_0.png treat image : temp/1762807227_3245387_1393791271_dcca763d7d0860ee364d2a2bcf64c271_rle_crop_4029906868_0.png treat image : temp/1762807227_3245387_1393791265_c30a1c210e79211e0a3c8b9db9aedc51_rle_crop_4029906869_0.png treat image : temp/1762807227_3245387_1393791265_c30a1c210e79211e0a3c8b9db9aedc51_rle_crop_4029906870_0.png treat image : temp/1762807227_3245387_1393791265_c30a1c210e79211e0a3c8b9db9aedc51_rle_crop_4029906871_0.png treat image : temp/1762807227_3245387_1393791239_4bb3e85b3288a3c9c84149a4733ee72d_rle_crop_4029906874_0.png treat image : temp/1762807227_3245387_1393791239_4bb3e85b3288a3c9c84149a4733ee72d_rle_crop_4029906875_0.png treat image : temp/1762807227_3245387_1393791239_4bb3e85b3288a3c9c84149a4733ee72d_rle_crop_4029906876_0.png treat image : temp/1762807227_3245387_1393791230_d7a7be1d71c9b257d7ac2c369fdace31_rle_crop_4029906879_0.png treat image : temp/1762807227_3245387_1393791230_d7a7be1d71c9b257d7ac2c369fdace31_rle_crop_4029906880_0.png treat image : temp/1762807227_3245387_1393791230_d7a7be1d71c9b257d7ac2c369fdace31_rle_crop_4029906882_0.png treat image : temp/1762807227_3245387_1393791227_cf1f74971e36150dc74b43084ed8e981_rle_crop_4029906887_0.png treat image : temp/1762807227_3245387_1393791227_cf1f74971e36150dc74b43084ed8e981_rle_crop_4029906892_0.png treat image : temp/1762807227_3245387_1393791224_68d3300d5389f4f352bb521c0f7c1158_rle_crop_4029906893_0.png treat image : temp/1762807227_3245387_1393791220_4946db5b19502f4d4acda2f14eef8d11_rle_crop_4029906905_0.png treat image : temp/1762807227_3245387_1393791199_8f3a866756eb8b4db07c19211633fa55_rle_crop_4029906908_0.png treat image : temp/1762807227_3245387_1393791199_8f3a866756eb8b4db07c19211633fa55_rle_crop_4029906910_0.png treat image : temp/1762807227_3245387_1393791199_8f3a866756eb8b4db07c19211633fa55_rle_crop_4029906911_0.png treat image : temp/1762807227_3245387_1393791199_8f3a866756eb8b4db07c19211633fa55_rle_crop_4029906912_0.png treat image : temp/1762807227_3245387_1393791194_988af0dd583a78f049640b70d9b5779b_rle_crop_4029906923_0.png treat image : temp/1762807227_3245387_1393791194_988af0dd583a78f049640b70d9b5779b_rle_crop_4029906924_0.png treat image : temp/1762807227_3245387_1393791194_988af0dd583a78f049640b70d9b5779b_rle_crop_4029906927_0.png treat image : temp/1762807227_3245387_1393791194_988af0dd583a78f049640b70d9b5779b_rle_crop_4029906928_0.png treat image : temp/1762807227_3245387_1393791194_988af0dd583a78f049640b70d9b5779b_rle_crop_4029906929_0.png treat image : temp/1762807227_3245387_1393791194_988af0dd583a78f049640b70d9b5779b_rle_crop_4029906930_0.png treat image : temp/1762807227_3245387_1393791194_988af0dd583a78f049640b70d9b5779b_rle_crop_4029906931_0.png treat image : temp/1762807227_3245387_1393791190_7c029bb1c545d1d76b771560e7e7afd6_rle_crop_4029906933_0.png treat image : temp/1762807227_3245387_1393791190_7c029bb1c545d1d76b771560e7e7afd6_rle_crop_4029906934_0.png treat image : temp/1762807227_3245387_1393791190_7c029bb1c545d1d76b771560e7e7afd6_rle_crop_4029906939_0.png treat image : temp/1762807227_3245387_1393791230_d7a7be1d71c9b257d7ac2c369fdace31_rle_crop_4029906877_0.png treat image : temp/1762807227_3245387_1393791230_d7a7be1d71c9b257d7ac2c369fdace31_rle_crop_4029906878_0.png treat image : temp/1762807227_3245387_1393791222_f7fca9c798b6c8417eed503a7d3583a4_rle_crop_4029906898_0.png treat image : temp/1762807227_3245387_1393791222_f7fca9c798b6c8417eed503a7d3583a4_rle_crop_4029906901_0.png treat image : temp/1762807227_3245387_1393791199_8f3a866756eb8b4db07c19211633fa55_rle_crop_4029906907_0.png treat image : temp/1762807227_3245387_1393791196_b624d45eef93f6dd2ea977f206fd3342_rle_crop_4029906915_0.png treat image : temp/1762807227_3245387_1393791195_717c851840d356d3e2fcbbd20a305e9e_rle_crop_4029906918_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 105 time used for this insertion : 0.020009756088256836 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 105 time used for this insertion : 0.037038564682006836 save missing photos in datou_result : time spend for datou_step_exec : 13.491750240325928 time spend to save output : 0.06270599365234375 total time spend for step 7 : 13.554456233978271 step8:velours_tree Mon Nov 10 21:44:52 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.08355093002319336 time spend to save output : 5.2928924560546875e-05 total time spend for step 8 : 0.0836038589477539 step9:send_mail_cod Mon Nov 10 21:44:52 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P28404241_10-11-2025_21_44_52.pdf 28410738 imagette284107381762807492 28410740 imagette284107401762807492 28410741 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette284107411762807492 28410742 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette284107421762807493 28410743 imagette284107431762807494 28410744 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette284107441762807494 28410745 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette284107451762807494 28410746 imagette284107461762807496 28410747 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette284107471762807496 28410748 imagette284107481762807498 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=28404241 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/28410737,28410738,28410740,28410741,28410742,28410743,28410744,28410745,28410746,28410747,28410748?tags=environnement,mal_croppe,flou,carton,autre,pehd,metal,papier,pet_fonce,pet_clair,background args[1393791274] : ((1393791274, -5.989212666485174, 492609224), (1393791274, -0.5613785087747928, 501862349), '0.04350635885141094') We are sending mail with results at report@fotonower.com args[1393791271] : ((1393791271, -7.006689048062167, 492609224), (1393791271, -0.21226039683328524, 496442774), '0.04350635885141094') We are sending mail with results at report@fotonower.com args[1393791265] : ((1393791265, -7.144785277830802, 492609224), (1393791265, -0.19752247731249328, 496442774), '0.04350635885141094') We are sending mail with results at report@fotonower.com args[1393791239] : ((1393791239, -6.943449144293442, 492609224), (1393791239, -0.36813968563038385, 496442774), '0.04350635885141094') We are sending mail with results at report@fotonower.com args[1393791230] : ((1393791230, -6.93576888298988, 492609224), (1393791230, -0.2880927752082855, 496442774), '0.04350635885141094') We are sending mail with results at report@fotonower.com args[1393791227] : ((1393791227, -6.950943544902342, 492609224), (1393791227, -0.2460378435784245, 496442774), '0.04350635885141094') We are sending mail with results at report@fotonower.com args[1393791224] : ((1393791224, -6.9904046513338525, 492609224), (1393791224, -0.25514109704359306, 496442774), '0.04350635885141094') We are sending mail with results at report@fotonower.com args[1393791222] : ((1393791222, -7.098902946621466, 492609224), (1393791222, -0.29853530351084545, 496442774), '0.04350635885141094') We are sending mail with results at report@fotonower.com args[1393791220] : ((1393791220, -6.993034680306045, 492609224), (1393791220, -0.40802350634581536, 496442774), '0.04350635885141094') We are sending mail with results at report@fotonower.com args[1393791199] : ((1393791199, -6.785237120090042, 492609224), (1393791199, -0.49650726726695116, 501862349), '0.04350635885141094') We are sending mail with results at report@fotonower.com args[1393791196] : ((1393791196, -6.911463928933262, 492609224), (1393791196, -0.4182763064945389, 496442774), '0.04350635885141094') We are sending mail with results at report@fotonower.com args[1393791195] : ((1393791195, -6.369862991705433, 492609224), (1393791195, -0.4615397394649435, 496442774), '0.04350635885141094') We are sending mail with results at report@fotonower.com args[1393791194] : ((1393791194, -6.320897542089804, 492609224), (1393791194, -0.4976731811955337, 501862349), '0.04350635885141094') We are sending mail with results at report@fotonower.com args[1393791190] : ((1393791190, -6.222869380620121, 492609224), (1393791190, -1.1275003945902768, 501862349), '0.04350635885141094') We are sending mail with results at report@fotonower.com refus_total : 0.04350635885141094 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos_view ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=28404241 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28404241_10-11-2025_21_44_52.pdf results_Auto_P28404241_10-11-2025_21_44_52.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28404241_10-11-2025_21_44_52.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','28404241','results_Auto_P28404241_10-11-2025_21_44_52.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28404241_10-11-2025_21_44_52.pdf','pdf','','0.81','0.04350635885141094') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/28404241

https://www.fotonower.com/image?json=false&list_photos_id=1393791274
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393791271
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393791265
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393791239
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393791230
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393791227
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393791224
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393791222
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393791220
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393791199
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393791196
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393791195
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393791194
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1393791190
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 4.35%
Veuillez trouver les photos des contaminants.

exemples de contaminants: carton: https://www.fotonower.com/view/28410741?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/28410742?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/28410744?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/28410745?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/28410747?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28404241_10-11-2025_21_44_52.pdf.

Lien vers velours :https://marlene.fotonower.com/velours/28410737,28410738,28410740,28410741,28410742,28410743,28410744,28410745,28410746,28410747,28410748?tags=environnement,mal_croppe,flou,carton,autre,pehd,metal,papier,pet_fonce,pet_clair,background.


L'équipe Fotonower 202 b'' Date: Mon, 10 Nov 2025 20:45:02 GMT Content-Length: 0 Connection: close Server: nginx X-Message-Id: BfEwT2ueRmqTruYXWeGpXw Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1393791274, 1393791271, 1393791265, 1393791239, 1393791230, 1393791227, 1393791224, 1393791222, 1393791220, 1393791199, 1393791196, 1393791195, 1393791194, 1393791190] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791274', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791271', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791265', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791239', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791230', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791227', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791224', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791222', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791220', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791199', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791196', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791195', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791194', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791190', None, None, None, None, None, '4028749') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 14 time used for this insertion : 0.018232107162475586 save_final save missing photos in datou_result : time spend for datou_step_exec : 9.44760513305664 time spend to save output : 0.01851177215576172 total time spend for step 9 : 9.466116905212402 step10:split_time_score Mon Nov 10 21:45:02 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('18', 14),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 10112025 28404241 Nombre de photos uploadées : 14 / 23040 (0%) 10112025 28404241 Nombre de photos taguées (types de déchets): 0 / 14 (0%) 10112025 28404241 Nombre de photos taguées (volume) : 0 / 14 (0%) elapsed_time : load_data_split_time_score 1.9073486328125e-06 elapsed_time : order_list_meta_photo_and_scores 5.4836273193359375e-06 ?????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0007188320159912109 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.2113962173461914 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.015594129381120855 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28408328_10-11-2025_20_38_50.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28408328 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28408328 AND mptpi.`type`=3726 To do Qualite : 0.02363916192898457 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28377782_10-11-2025_08_08_10.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28377782 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28377782 AND mptpi.`type`=3726 To do Qualite : 0.0369825378023389 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28377784_10-11-2025_08_05_19.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28377784 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28377784 AND mptpi.`type`=3726 To do Qualite : 0.015906579873558223 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28386389_10-11-2025_11_41_29.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28386389 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28386389 AND mptpi.`type`=3726 To do Qualite : 0.07163117083011836 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28389438_10-11-2025_13_15_01.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28389438 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28389438 AND mptpi.`type`=3594 To do Qualite : 0.027669456356263278 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28389443_10-11-2025_13_05_12.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28389443 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28389443 AND mptpi.`type`=3726 To do Qualite : 0.026303354095645555 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28395048_10-11-2025_15_44_08.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28395048 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28395048 AND mptpi.`type`=3726 To do Qualite : 0.010635503814521767 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28398901_10-11-2025_17_11_49.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28398901 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28398901 AND mptpi.`type`=3726 To do Qualite : 0.04350635885141094 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28404241_10-11-2025_21_44_52.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28404241 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28404241 AND mptpi.`type`=3594 To do Qualite : 0.07097222098765495 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28406776_10-11-2025_20_08_39.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28406776 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28406776 AND mptpi.`type`=3726 To do Qualite : 0.08423818140159646 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28408340_10-11-2025_20_41_27.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28408340 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28408340 AND mptpi.`type`=3726 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'10112025': {'nb_upload': 14, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1393791274, 1393791271, 1393791265, 1393791239, 1393791230, 1393791227, 1393791224, 1393791222, 1393791220, 1393791199, 1393791196, 1393791195, 1393791194, 1393791190] Looping around the photos to save general results len do output : 1 /28404241Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791274', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791271', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791265', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791239', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791230', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791227', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791224', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791222', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791220', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791199', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791196', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791195', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791194', None, None, None, None, None, '4028749') ('3318', None, None, None, None, None, None, None, '4028749') ('3318', '28404241', '1393791190', None, None, None, None, None, '4028749') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 15 time used for this insertion : 0.014768600463867188 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.04457688331604 time spend to save output : 0.014998435974121094 total time spend for step 10 : 1.0595753192901611 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 14 set_done_treatment 135.60user 106.90system 4:37.85elapsed 87%CPU (0avgtext+0avgdata 5072916maxresident)k 508824inputs+121584outputs (44major+12505573minor)pagefaults 0swaps