python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1110547 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['4058354'] with mtr_portfolio_ids : ['28609449'] and first list_photo_ids : [] new path : /proc/1110547/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 12 ; length of list_pids : 12 ; length of list_args : 12 time to download the photos : 2.720550298690796 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Mon Nov 17 14:40:32 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10998 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-11-17 14:40:34.859527: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-11-17 14:40:34.886503: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493010000 Hz 2025-11-17 14:40:34.888470: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f2fc0000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-11-17 14:40:34.888514: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-11-17 14:40:34.892106: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-11-17 14:40:35.026188: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x33bb6e60 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-11-17 14:40:35.026228: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-11-17 14:40:35.027639: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-11-17 14:40:35.028008: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-17 14:40:35.030820: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-17 14:40:35.033370: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-11-17 14:40:35.033833: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-11-17 14:40:35.036385: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-11-17 14:40:35.037376: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-11-17 14:40:35.041300: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-11-17 14:40:35.042682: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-11-17 14:40:35.042756: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-17 14:40:35.043570: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-11-17 14:40:35.043587: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-11-17 14:40:35.043596: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-11-17 14:40:35.044983: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10049 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-11-17 14:40:35.333208: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-11-17 14:40:35.333281: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-17 14:40:35.333297: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-17 14:40:35.333311: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-11-17 14:40:35.333325: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-11-17 14:40:35.333338: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-11-17 14:40:35.333351: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-11-17 14:40:35.333365: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-11-17 14:40:35.334668: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-11-17 14:40:35.335796: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-11-17 14:40:35.335824: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-17 14:40:35.335839: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-17 14:40:35.335853: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-11-17 14:40:35.335867: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-11-17 14:40:35.335880: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-11-17 14:40:35.335894: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-11-17 14:40:35.335908: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-11-17 14:40:35.337160: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-11-17 14:40:35.337186: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-11-17 14:40:35.337194: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-11-17 14:40:35.337202: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-11-17 14:40:35.338545: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10049 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-11-17 14:40:45.798053: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-17 14:40:45.996959: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 12 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 19 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 15 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 27 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 16 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 26 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 24 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 17 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 36 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 23 Detection mask done ! Trying to reset tf kernel 1111186 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1929 tf kernel not reseted sub process len(results) : 12 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 12 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10998 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0023081302642822266 nb_pixel_total : 95949 time to create 1 rle with old method : 0.10700559616088867 length of segment : 260 time for calcul the mask position with numpy : 0.003934144973754883 nb_pixel_total : 171634 time to create 1 rle with new method : 0.011058568954467773 length of segment : 593 time for calcul the mask position with numpy : 0.0008671283721923828 nb_pixel_total : 46777 time to create 1 rle with old method : 0.051995038986206055 length of segment : 276 time for calcul the mask position with numpy : 0.0004050731658935547 nb_pixel_total : 27108 time to create 1 rle with old method : 0.030521154403686523 length of segment : 388 time for calcul the mask position with numpy : 0.0023469924926757812 nb_pixel_total : 173182 time to create 1 rle with new method : 0.00959467887878418 length of segment : 312 time for calcul the mask position with numpy : 0.0010235309600830078 nb_pixel_total : 81463 time to create 1 rle with old method : 0.09044575691223145 length of segment : 302 time for calcul the mask position with numpy : 0.00020170211791992188 nb_pixel_total : 10149 time to create 1 rle with old method : 0.012426614761352539 length of segment : 84 time for calcul the mask position with numpy : 0.0008168220520019531 nb_pixel_total : 27640 time to create 1 rle with old method : 0.03232431411743164 length of segment : 248 time for calcul the mask position with numpy : 0.0005733966827392578 nb_pixel_total : 38298 time to create 1 rle with old method : 0.042706966400146484 length of segment : 311 time for calcul the mask position with numpy : 0.0029375553131103516 nb_pixel_total : 149804 time to create 1 rle with old method : 0.16953802108764648 length of segment : 593 time for calcul the mask position with numpy : 0.0010724067687988281 nb_pixel_total : 72729 time to create 1 rle with old method : 0.07768607139587402 length of segment : 443 time for calcul the mask position with numpy : 0.003239154815673828 nb_pixel_total : 165526 time to create 1 rle with new method : 0.01696181297302246 length of segment : 1002 time for calcul the mask position with numpy : 0.0006062984466552734 nb_pixel_total : 21542 time to create 1 rle with old method : 0.028520584106445312 length of segment : 231 time for calcul the mask position with numpy : 0.00038123130798339844 nb_pixel_total : 18352 time to create 1 rle with old method : 0.02004861831665039 length of segment : 174 time for calcul the mask position with numpy : 0.0005517005920410156 nb_pixel_total : 32108 time to create 1 rle with old method : 0.036209821701049805 length of segment : 248 time for calcul the mask position with numpy : 0.0010294914245605469 nb_pixel_total : 63390 time to create 1 rle with old method : 0.0707085132598877 length of segment : 195 time for calcul the mask position with numpy : 0.0002460479736328125 nb_pixel_total : 14269 time to create 1 rle with old method : 0.015779733657836914 length of segment : 116 time for calcul the mask position with numpy : 0.0005927085876464844 nb_pixel_total : 36573 time to create 1 rle with old method : 0.041956424713134766 length of segment : 204 time for calcul the mask position with numpy : 0.0002598762512207031 nb_pixel_total : 6293 time to create 1 rle with old method : 0.01173853874206543 length of segment : 77 time for calcul the mask position with numpy : 0.001852273941040039 nb_pixel_total : 69495 time to create 1 rle with old method : 0.08367514610290527 length of segment : 503 time for calcul the mask position with numpy : 0.003773927688598633 nb_pixel_total : 181809 time to create 1 rle with new method : 0.01334524154663086 length of segment : 570 time for calcul the mask position with numpy : 0.0021140575408935547 nb_pixel_total : 129551 time to create 1 rle with old method : 0.13812589645385742 length of segment : 402 time for calcul the mask position with numpy : 0.0005216598510742188 nb_pixel_total : 33678 time to create 1 rle with old method : 0.03691220283508301 length of segment : 136 time for calcul the mask position with numpy : 0.0009176731109619141 nb_pixel_total : 63852 time to create 1 rle with old method : 0.07009387016296387 length of segment : 256 time for calcul the mask position with numpy : 0.0002713203430175781 nb_pixel_total : 7973 time to create 1 rle with old method : 0.008963823318481445 length of segment : 141 time for calcul the mask position with numpy : 0.0016200542449951172 nb_pixel_total : 103616 time to create 1 rle with old method : 0.11207938194274902 length of segment : 390 time for calcul the mask position with numpy : 0.00028061866760253906 nb_pixel_total : 10732 time to create 1 rle with old method : 0.015827178955078125 length of segment : 171 time for calcul the mask position with numpy : 0.0005786418914794922 nb_pixel_total : 26278 time to create 1 rle with old method : 0.02828359603881836 length of segment : 262 time for calcul the mask position with numpy : 0.0006017684936523438 nb_pixel_total : 31424 time to create 1 rle with old method : 0.033907175064086914 length of segment : 245 time for calcul the mask position with numpy : 0.0017561912536621094 nb_pixel_total : 104026 time to create 1 rle with old method : 0.11270666122436523 length of segment : 471 time for calcul the mask position with numpy : 0.0022644996643066406 nb_pixel_total : 160407 time to create 1 rle with new method : 0.008911371231079102 length of segment : 519 time for calcul the mask position with numpy : 0.0006656646728515625 nb_pixel_total : 37577 time to create 1 rle with old method : 0.04865431785583496 length of segment : 266 time for calcul the mask position with numpy : 0.0008058547973632812 nb_pixel_total : 35834 time to create 1 rle with old method : 0.05291628837585449 length of segment : 282 time for calcul the mask position with numpy : 0.0010120868682861328 nb_pixel_total : 54352 time to create 1 rle with old method : 0.0745694637298584 length of segment : 300 time for calcul the mask position with numpy : 0.0005941390991210938 nb_pixel_total : 32355 time to create 1 rle with old method : 0.04359912872314453 length of segment : 194 time for calcul the mask position with numpy : 0.0007693767547607422 nb_pixel_total : 36681 time to create 1 rle with old method : 0.047249555587768555 length of segment : 301 time for calcul the mask position with numpy : 0.000858306884765625 nb_pixel_total : 26611 time to create 1 rle with old method : 0.03599071502685547 length of segment : 350 time for calcul the mask position with numpy : 0.000614166259765625 nb_pixel_total : 38576 time to create 1 rle with old method : 0.06851625442504883 length of segment : 205 time for calcul the mask position with numpy : 0.00021719932556152344 nb_pixel_total : 8646 time to create 1 rle with old method : 0.012281417846679688 length of segment : 102 time for calcul the mask position with numpy : 0.00194549560546875 nb_pixel_total : 121343 time to create 1 rle with old method : 0.16092658042907715 length of segment : 343 time for calcul the mask position with numpy : 0.00016689300537109375 nb_pixel_total : 9624 time to create 1 rle with old method : 0.011143684387207031 length of segment : 96 time for calcul the mask position with numpy : 0.0008034706115722656 nb_pixel_total : 22769 time to create 1 rle with old method : 0.02564239501953125 length of segment : 217 time for calcul the mask position with numpy : 0.002126932144165039 nb_pixel_total : 59315 time to create 1 rle with old method : 0.0661170482635498 length of segment : 349 time for calcul the mask position with numpy : 0.0010743141174316406 nb_pixel_total : 27664 time to create 1 rle with old method : 0.03697824478149414 length of segment : 193 time for calcul the mask position with numpy : 0.00025653839111328125 nb_pixel_total : 11806 time to create 1 rle with old method : 0.013921976089477539 length of segment : 148 time for calcul the mask position with numpy : 0.0020592212677001953 nb_pixel_total : 80523 time to create 1 rle with old method : 0.09190249443054199 length of segment : 264 time for calcul the mask position with numpy : 0.0010406970977783203 nb_pixel_total : 40434 time to create 1 rle with old method : 0.050563812255859375 length of segment : 267 time for calcul the mask position with numpy : 0.0015077590942382812 nb_pixel_total : 43004 time to create 1 rle with old method : 0.04931521415710449 length of segment : 246 time for calcul the mask position with numpy : 0.0009462833404541016 nb_pixel_total : 21201 time to create 1 rle with old method : 0.024944543838500977 length of segment : 166 time for calcul the mask position with numpy : 0.0023076534271240234 nb_pixel_total : 84039 time to create 1 rle with old method : 0.11009669303894043 length of segment : 315 time for calcul the mask position with numpy : 0.0040814876556396484 nb_pixel_total : 114282 time to create 1 rle with old method : 0.12653875350952148 length of segment : 398 time for calcul the mask position with numpy : 0.0009655952453613281 nb_pixel_total : 20506 time to create 1 rle with old method : 0.023121118545532227 length of segment : 273 time for calcul the mask position with numpy : 0.0011188983917236328 nb_pixel_total : 31280 time to create 1 rle with old method : 0.03496694564819336 length of segment : 301 time for calcul the mask position with numpy : 0.002948284149169922 nb_pixel_total : 36305 time to create 1 rle with old method : 0.04044795036315918 length of segment : 327 time for calcul the mask position with numpy : 0.0020263195037841797 nb_pixel_total : 64900 time to create 1 rle with old method : 0.07108712196350098 length of segment : 230 time for calcul the mask position with numpy : 0.0015339851379394531 nb_pixel_total : 33275 time to create 1 rle with old method : 0.041536569595336914 length of segment : 360 time for calcul the mask position with numpy : 0.0005564689636230469 nb_pixel_total : 20358 time to create 1 rle with old method : 0.023491621017456055 length of segment : 165 time for calcul the mask position with numpy : 0.0026488304138183594 nb_pixel_total : 85833 time to create 1 rle with old method : 0.0944509506225586 length of segment : 352 time for calcul the mask position with numpy : 0.0008974075317382812 nb_pixel_total : 31587 time to create 1 rle with old method : 0.036324262619018555 length of segment : 182 time for calcul the mask position with numpy : 0.0011336803436279297 nb_pixel_total : 44871 time to create 1 rle with old method : 0.050238609313964844 length of segment : 285 time for calcul the mask position with numpy : 0.004358053207397461 nb_pixel_total : 138229 time to create 1 rle with old method : 0.15501117706298828 length of segment : 673 time for calcul the mask position with numpy : 0.004072904586791992 nb_pixel_total : 190049 time to create 1 rle with new method : 0.009342670440673828 length of segment : 523 time for calcul the mask position with numpy : 0.0015001296997070312 nb_pixel_total : 73577 time to create 1 rle with old method : 0.08383965492248535 length of segment : 363 time for calcul the mask position with numpy : 0.016315221786499023 nb_pixel_total : 389576 time to create 1 rle with new method : 0.03436398506164551 length of segment : 1042 time for calcul the mask position with numpy : 0.0007100105285644531 nb_pixel_total : 26622 time to create 1 rle with old method : 0.030610084533691406 length of segment : 175 time for calcul the mask position with numpy : 0.0012888908386230469 nb_pixel_total : 48972 time to create 1 rle with old method : 0.05657625198364258 length of segment : 250 time for calcul the mask position with numpy : 0.0009243488311767578 nb_pixel_total : 32949 time to create 1 rle with old method : 0.037824392318725586 length of segment : 184 time for calcul the mask position with numpy : 0.0029387474060058594 nb_pixel_total : 174170 time to create 1 rle with new method : 0.0037221908569335938 length of segment : 311 time for calcul the mask position with numpy : 0.0016086101531982422 nb_pixel_total : 64422 time to create 1 rle with old method : 0.0741431713104248 length of segment : 270 time for calcul the mask position with numpy : 0.001157999038696289 nb_pixel_total : 43245 time to create 1 rle with old method : 0.050073862075805664 length of segment : 322 time for calcul the mask position with numpy : 0.0007150173187255859 nb_pixel_total : 27825 time to create 1 rle with old method : 0.03411579132080078 length of segment : 138 time for calcul the mask position with numpy : 0.0007195472717285156 nb_pixel_total : 22900 time to create 1 rle with old method : 0.02671074867248535 length of segment : 215 time for calcul the mask position with numpy : 0.0032372474670410156 nb_pixel_total : 132098 time to create 1 rle with old method : 0.148298978805542 length of segment : 398 time for calcul the mask position with numpy : 0.0008490085601806641 nb_pixel_total : 27185 time to create 1 rle with old method : 0.0443110466003418 length of segment : 180 time for calcul the mask position with numpy : 0.003087282180786133 nb_pixel_total : 126548 time to create 1 rle with old method : 0.1383373737335205 length of segment : 443 time for calcul the mask position with numpy : 0.0014827251434326172 nb_pixel_total : 39738 time to create 1 rle with old method : 0.04482531547546387 length of segment : 217 time for calcul the mask position with numpy : 0.0013413429260253906 nb_pixel_total : 27757 time to create 1 rle with old method : 0.04013800621032715 length of segment : 173 time for calcul the mask position with numpy : 0.01099848747253418 nb_pixel_total : 254040 time to create 1 rle with new method : 0.02733325958251953 length of segment : 1159 time for calcul the mask position with numpy : 0.0015285015106201172 nb_pixel_total : 31782 time to create 1 rle with old method : 0.03567767143249512 length of segment : 320 time for calcul the mask position with numpy : 0.001363515853881836 nb_pixel_total : 42793 time to create 1 rle with old method : 0.04776144027709961 length of segment : 244 time for calcul the mask position with numpy : 0.0013914108276367188 nb_pixel_total : 29802 time to create 1 rle with old method : 0.03369140625 length of segment : 286 time for calcul the mask position with numpy : 0.0007336139678955078 nb_pixel_total : 15852 time to create 1 rle with old method : 0.018614530563354492 length of segment : 111 time for calcul the mask position with numpy : 0.0018508434295654297 nb_pixel_total : 26337 time to create 1 rle with old method : 0.030426740646362305 length of segment : 351 time for calcul the mask position with numpy : 0.0003986358642578125 nb_pixel_total : 10752 time to create 1 rle with old method : 0.012350082397460938 length of segment : 91 time for calcul the mask position with numpy : 0.006865262985229492 nb_pixel_total : 196945 time to create 1 rle with new method : 0.01238393783569336 length of segment : 653 time for calcul the mask position with numpy : 0.0010113716125488281 nb_pixel_total : 21811 time to create 1 rle with old method : 0.025022268295288086 length of segment : 245 time for calcul the mask position with numpy : 0.0006048679351806641 nb_pixel_total : 11883 time to create 1 rle with old method : 0.01427006721496582 length of segment : 131 time for calcul the mask position with numpy : 0.003427743911743164 nb_pixel_total : 159857 time to create 1 rle with new method : 0.007908344268798828 length of segment : 563 time for calcul the mask position with numpy : 0.0011837482452392578 nb_pixel_total : 36283 time to create 1 rle with old method : 0.050234079360961914 length of segment : 431 time for calcul the mask position with numpy : 0.0007753372192382812 nb_pixel_total : 23486 time to create 1 rle with old method : 0.028216123580932617 length of segment : 258 time for calcul the mask position with numpy : 0.003042936325073242 nb_pixel_total : 171500 time to create 1 rle with new method : 0.008516311645507812 length of segment : 525 time for calcul the mask position with numpy : 0.0003833770751953125 nb_pixel_total : 10558 time to create 1 rle with old method : 0.01436471939086914 length of segment : 131 time for calcul the mask position with numpy : 0.0011894702911376953 nb_pixel_total : 42731 time to create 1 rle with old method : 0.058040618896484375 length of segment : 216 time for calcul the mask position with numpy : 0.0028836727142333984 nb_pixel_total : 100941 time to create 1 rle with old method : 0.1197967529296875 length of segment : 403 time for calcul the mask position with numpy : 0.0006856918334960938 nb_pixel_total : 24762 time to create 1 rle with old method : 0.03030562400817871 length of segment : 170 time for calcul the mask position with numpy : 0.0005745887756347656 nb_pixel_total : 13282 time to create 1 rle with old method : 0.01619124412536621 length of segment : 121 time for calcul the mask position with numpy : 0.0009772777557373047 nb_pixel_total : 34913 time to create 1 rle with old method : 0.040793418884277344 length of segment : 272 time for calcul the mask position with numpy : 0.0006213188171386719 nb_pixel_total : 19468 time to create 1 rle with old method : 0.023818492889404297 length of segment : 141 time for calcul the mask position with numpy : 0.0014162063598632812 nb_pixel_total : 49166 time to create 1 rle with old method : 0.05492424964904785 length of segment : 240 time for calcul the mask position with numpy : 0.000751495361328125 nb_pixel_total : 40717 time to create 1 rle with old method : 0.05102229118347168 length of segment : 245 time spent for convertir_results : 10.047773599624634 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 100 chid ids of type : 3594 Number RLEs to save : 30784 save missing photos in datou_result : time spend for datou_step_exec : 68.98740935325623 time spend to save output : 1.8369297981262207 total time spend for step 1 : 70.82433915138245 step2:crop_condition Mon Nov 17 14:41:43 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 12 ! batch 1 Loaded 100 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 54 About to insert : list_path_to_insert length 54 new photo from crops ! About to upload 54 photos upload in portfolio : 3736932 init cache_photo without model_param we have 54 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1763386919_1110547 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386929), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394872024_1c509bf1ebe6f093935b722d0ad0d6b7_rle_crop_4036418985_0.png', 0, 399, 276, 0, 1763386929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386929), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394872024_1c509bf1ebe6f093935b722d0ad0d6b7_rle_crop_4036418986_0.png', 0, 89, 377, 0, 1763386929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386929), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394872024_1c509bf1ebe6f093935b722d0ad0d6b7_rle_crop_4036418989_0.png', 0, 186, 82, 0, 1763386929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386929), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394872024_1c509bf1ebe6f093935b722d0ad0d6b7_rle_crop_4036418990_0.png', 0, 268, 248, 0, 1763386929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386929), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871989_5f2a5e8d89ec70b673561fdb5262716b_rle_crop_4036418992_0.png', 0, 693, 487, 0, 1763386929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386929), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871989_5f2a5e8d89ec70b673561fdb5262716b_rle_crop_4036418993_0.png', 0, 235, 421, 0, 1763386929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386929), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871989_5f2a5e8d89ec70b673561fdb5262716b_rle_crop_4036418995_0.png', 0, 287, 231, 0, 1763386929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386929), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871989_5f2a5e8d89ec70b673561fdb5262716b_rle_crop_4036418996_0.png', 0, 162, 174, 0, 1763386929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386929), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871989_5f2a5e8d89ec70b673561fdb5262716b_rle_crop_4036419000_0.png', 0, 242, 203, 0, 1763386929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386929), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871953_829d9909d2c4f5697359241f38644e7b_rle_crop_4036419001_0.png', 0, 107, 77, 0, 1763386929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386929), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871953_829d9909d2c4f5697359241f38644e7b_rle_crop_4036419002_0.png', 0, 161, 503, 0, 1763386929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386929), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871953_829d9909d2c4f5697359241f38644e7b_rle_crop_4036419003_0.png', 0, 471, 569, 0, 1763386929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386929), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871953_829d9909d2c4f5697359241f38644e7b_rle_crop_4036419004_0.png', 0, 427, 377, 0, 1763386929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386929), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871953_829d9909d2c4f5697359241f38644e7b_rle_crop_4036419006_0.png', 0, 407, 204, 0, 1763386929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386929), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871953_829d9909d2c4f5697359241f38644e7b_rle_crop_4036419007_0.png', 0, 155, 82, 0, 1763386929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386929), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871953_829d9909d2c4f5697359241f38644e7b_rle_crop_4036419009_0.png', 0, 140, 118, 0, 1763386929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386929), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871953_829d9909d2c4f5697359241f38644e7b_rle_crop_4036419010_0.png', 0, 175, 257, 0, 1763386929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386929), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871953_829d9909d2c4f5697359241f38644e7b_rle_crop_4036419011_0.png', 0, 261, 245, 0, 1763386929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386929), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871953_829d9909d2c4f5697359241f38644e7b_rle_crop_4036419012_0.png', 0, 478, 375, 0, 1763386929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386929), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871919_9e1b248cd80c2a7b5d0726099d39d0cd_rle_crop_4036419013_0.png', 0, 466, 514, 0, 1763386929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386929), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871919_9e1b248cd80c2a7b5d0726099d39d0cd_rle_crop_4036419018_0.png', 0, 322, 249, 0, 1763386929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386929), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871881_2f07c7e07ac15328f346138705c8f261_rle_crop_4036419022_0.png', 0, 533, 331, 0, 1763386929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386929), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871823_7af85144ec66701ba8bf692f190d49e3_rle_crop_4036419024_0.png', 0, 146, 217, 0, 1763386929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386929), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871823_7af85144ec66701ba8bf692f190d49e3_rle_crop_4036419025_0.png', 0, 319, 308, 0, 1763386929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386929), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871823_7af85144ec66701ba8bf692f190d49e3_rle_crop_4036419027_0.png', 0, 113, 148, 0, 1763386929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386929), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871823_7af85144ec66701ba8bf692f190d49e3_rle_crop_4036419029_0.png', 0, 167, 260, 0, 1763386929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386929), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871823_7af85144ec66701ba8bf692f190d49e3_rle_crop_4036419030_0.png', 0, 278, 230, 0, 1763386929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386929), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871819_10a843a571fa00037655580c11987de8_rle_crop_4036419034_0.png', 0, 127, 272, 0, 1763386929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386929), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871819_10a843a571fa00037655580c11987de8_rle_crop_4036419035_0.png', 0, 190, 301, 0, 1763386929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386929), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871819_10a843a571fa00037655580c11987de8_rle_crop_4036419036_0.png', 0, 213, 295, 0, 1763386929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386929), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871819_10a843a571fa00037655580c11987de8_rle_crop_4036419038_0.png', 0, 131, 360, 0, 1763386929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386929), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871815_0b0dddbd11fc99c619ac316b00bbba99_rle_crop_4036419041_0.png', 0, 268, 167, 0, 1763386929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386929), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871815_0b0dddbd11fc99c619ac316b00bbba99_rle_crop_4036419044_0.png', 0, 566, 517, 0, 1763386929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386929), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871815_0b0dddbd11fc99c619ac316b00bbba99_rle_crop_4036419047_0.png', 0, 225, 162, 0, 1763386929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386929), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871811_9976f91e13a9f9c7e7fac1e0c4ea49a3_rle_crop_4036419053_0.png', 0, 312, 106, 0, 1763386929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386929), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871811_9976f91e13a9f9c7e7fac1e0c4ea49a3_rle_crop_4036419054_0.png', 0, 191, 174, 0, 1763386929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386929), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871811_9976f91e13a9f9c7e7fac1e0c4ea49a3_rle_crop_4036419056_0.png', 0, 220, 169, 0, 1763386929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386929), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871811_9976f91e13a9f9c7e7fac1e0c4ea49a3_rle_crop_4036419057_0.png', 0, 449, 443, 0, 1763386929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386929), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871807_3833afbe7daae65a957b97ae775007db_rle_crop_4036419058_0.png', 0, 274, 213, 0, 1763386929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386929), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871807_3833afbe7daae65a957b97ae775007db_rle_crop_4036419059_0.png', 0, 248, 173, 0, 1763386929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386929), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871807_3833afbe7daae65a957b97ae775007db_rle_crop_4036419060_0.png', 0, 900, 563, 0, 1763386929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386929), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871807_3833afbe7daae65a957b97ae775007db_rle_crop_4036419061_0.png', 0, 232, 315, 0, 1763386929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386929), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871807_3833afbe7daae65a957b97ae775007db_rle_crop_4036419063_0.png', 0, 226, 296, 0, 1763386929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386929), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871807_3833afbe7daae65a957b97ae775007db_rle_crop_4036419065_0.png', 0, 232, 351, 0, 1763386929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386929), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871807_3833afbe7daae65a957b97ae775007db_rle_crop_4036419066_0.png', 0, 148, 91, 0, 1763386929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386929), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871807_3833afbe7daae65a957b97ae775007db_rle_crop_4036419067_0.png', 0, 550, 626, 0, 1763386929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386929), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871807_3833afbe7daae65a957b97ae775007db_rle_crop_4036419069_0.png', 0, 127, 130, 0, 1763386929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386929), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871805_6378ae73bff23ad3f026cc8b098d5a93_rle_crop_4036419071_0.png', 0, 260, 248, 0, 1763386929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386929), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871805_6378ae73bff23ad3f026cc8b098d5a93_rle_crop_4036419072_0.png', 0, 161, 214, 0, 1763386929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386929), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871805_6378ae73bff23ad3f026cc8b098d5a93_rle_crop_4036419073_0.png', 0, 536, 518, 0, 1763386929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386929), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871768_6faa535e8d1bb8d8bfbef6b0314deb5f_rle_crop_4036419076_0.png', 0, 341, 391, 0, 1763386929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386929), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871768_6faa535e8d1bb8d8bfbef6b0314deb5f_rle_crop_4036419078_0.png', 0, 192, 121, 0, 1763386929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386929), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871768_6faa535e8d1bb8d8bfbef6b0314deb5f_rle_crop_4036419079_0.png', 0, 167, 271, 0, 1763386929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386929), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871768_6faa535e8d1bb8d8bfbef6b0314deb5f_rle_crop_4036419080_0.png', 0, 171, 137, 0, 1763386929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 54 photos in the portfolio 3736932 time of upload the photos Elapsed time : 12.318164587020874 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 8 About to insert : list_path_to_insert length 8 new photo from crops ! About to upload 8 photos upload in portfolio : 3736932 init cache_photo without model_param we have 8 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1763386935_1110547 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386936), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871919_9e1b248cd80c2a7b5d0726099d39d0cd_rle_crop_4036419015_0.png', 0, 287, 218, 0, 1763386936,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386936), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871919_9e1b248cd80c2a7b5d0726099d39d0cd_rle_crop_4036419017_0.png', 0, 253, 193, 0, 1763386936,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386936), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871823_7af85144ec66701ba8bf692f190d49e3_rle_crop_4036419026_0.png', 0, 213, 192, 0, 1763386936,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386936), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871823_7af85144ec66701ba8bf692f190d49e3_rle_crop_4036419028_0.png', 0, 427, 254, 0, 1763386936,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386936), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871811_9976f91e13a9f9c7e7fac1e0c4ea49a3_rle_crop_4036419049_0.png', 0, 278, 184, 0, 1763386936,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386936), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871807_3833afbe7daae65a957b97ae775007db_rle_crop_4036419064_0.png', 0, 220, 106, 0, 1763386936,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386936), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871807_3833afbe7daae65a957b97ae775007db_rle_crop_4036419068_0.png', 0, 125, 245, 0, 1763386936,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386936), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871805_6378ae73bff23ad3f026cc8b098d5a93_rle_crop_4036419075_0.png', 0, 256, 212, 0, 1763386936,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 8 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.081202983856201 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 5 About to insert : list_path_to_insert length 5 new photo from crops ! About to upload 5 photos upload in portfolio : 3736932 init cache_photo without model_param we have 5 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1763386939_1110547 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386940), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871989_5f2a5e8d89ec70b673561fdb5262716b_rle_crop_4036418997_0.png', 0, 163, 248, 0, 1763386940,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386940), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871919_9e1b248cd80c2a7b5d0726099d39d0cd_rle_crop_4036419014_0.png', 0, 172, 263, 0, 1763386940,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386940), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871819_10a843a571fa00037655580c11987de8_rle_crop_4036419039_0.png', 0, 165, 165, 0, 1763386940,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386940), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871805_6378ae73bff23ad3f026cc8b098d5a93_rle_crop_4036419074_0.png', 0, 106, 131, 0, 1763386940,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386940), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871768_6faa535e8d1bb8d8bfbef6b0314deb5f_rle_crop_4036419077_0.png', 0, 231, 170, 0, 1763386940,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 5 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.7257697582244873 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 27 About to insert : list_path_to_insert length 27 new photo from crops ! About to upload 27 photos upload in portfolio : 3736932 init cache_photo without model_param we have 27 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1763386954_1110547 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386960), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394872024_1c509bf1ebe6f093935b722d0ad0d6b7_rle_crop_4036418983_0.png', 0, 629, 210, 0, 1763386960,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386960), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394872024_1c509bf1ebe6f093935b722d0ad0d6b7_rle_crop_4036418984_0.png', 0, 675, 434, 0, 1763386960,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386960), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394872024_1c509bf1ebe6f093935b722d0ad0d6b7_rle_crop_4036418987_0.png', 0, 767, 297, 0, 1763386960,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386960), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871989_5f2a5e8d89ec70b673561fdb5262716b_rle_crop_4036418994_0.png', 0, 603, 624, 0, 1763386960,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386960), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871989_5f2a5e8d89ec70b673561fdb5262716b_rle_crop_4036418999_0.png', 0, 167, 116, 0, 1763386960,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386960), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871953_829d9909d2c4f5697359241f38644e7b_rle_crop_4036419005_0.png', 0, 308, 131, 0, 1763386960,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386960), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871953_829d9909d2c4f5697359241f38644e7b_rle_crop_4036419008_0.png', 0, 338, 385, 0, 1763386960,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386960), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871919_9e1b248cd80c2a7b5d0726099d39d0cd_rle_crop_4036419016_0.png', 0, 292, 283, 0, 1763386960,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386960), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871919_9e1b248cd80c2a7b5d0726099d39d0cd_rle_crop_4036419019_0.png', 0, 301, 300, 0, 1763386960,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386960), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871881_2f07c7e07ac15328f346138705c8f261_rle_crop_4036419021_0.png', 0, 118, 102, 0, 1763386960,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386960), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871881_2f07c7e07ac15328f346138705c8f261_rle_crop_4036419023_0.png', 0, 123, 96, 0, 1763386960,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386960), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871823_7af85144ec66701ba8bf692f190d49e3_rle_crop_4036419031_0.png', 0, 223, 162, 0, 1763386960,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386960), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871823_7af85144ec66701ba8bf692f190d49e3_rle_crop_4036419032_0.png', 0, 338, 314, 0, 1763386960,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386960), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871819_10a843a571fa00037655580c11987de8_rle_crop_4036419033_0.png', 0, 398, 385, 0, 1763386960,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386960), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871819_10a843a571fa00037655580c11987de8_rle_crop_4036419037_0.png', 0, 336, 230, 0, 1763386960,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386960), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871815_0b0dddbd11fc99c619ac316b00bbba99_rle_crop_4036419042_0.png', 0, 224, 284, 0, 1763386960,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386960), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871815_0b0dddbd11fc99c619ac316b00bbba99_rle_crop_4036419043_0.png', 0, 392, 671, 0, 1763386960,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386960), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871815_0b0dddbd11fc99c619ac316b00bbba99_rle_crop_4036419045_0.png', 0, 351, 358, 0, 1763386960,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386960), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871815_0b0dddbd11fc99c619ac316b00bbba99_rle_crop_4036419046_0.png', 0, 735, 778, 0, 1763386960,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386960), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871815_0b0dddbd11fc99c619ac316b00bbba99_rle_crop_4036419048_0.png', 0, 237, 249, 0, 1763386960,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386960), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871811_9976f91e13a9f9c7e7fac1e0c4ea49a3_rle_crop_4036419050_0.png', 0, 623, 307, 0, 1763386960,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386960), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871811_9976f91e13a9f9c7e7fac1e0c4ea49a3_rle_crop_4036419051_0.png', 0, 359, 234, 0, 1763386960,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386960), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871811_9976f91e13a9f9c7e7fac1e0c4ea49a3_rle_crop_4036419052_0.png', 0, 188, 300, 0, 1763386960,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386960), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871811_9976f91e13a9f9c7e7fac1e0c4ea49a3_rle_crop_4036419055_0.png', 0, 485, 398, 0, 1763386960,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386960), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871807_3833afbe7daae65a957b97ae775007db_rle_crop_4036419062_0.png', 0, 221, 230, 0, 1763386960,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386960), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871805_6378ae73bff23ad3f026cc8b098d5a93_rle_crop_4036419070_0.png', 0, 423, 560, 0, 1763386960,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386960), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871768_6faa535e8d1bb8d8bfbef6b0314deb5f_rle_crop_4036419081_0.png', 0, 284, 240, 0, 1763386960,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 27 photos in the portfolio 3736932 time of upload the photos Elapsed time : 7.303745746612549 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1763386964_1110547 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386964), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394872024_1c509bf1ebe6f093935b722d0ad0d6b7_rle_crop_4036418988_0.png', 0, 327, 302, 0, 1763386964,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386964), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871881_2f07c7e07ac15328f346138705c8f261_rle_crop_4036419020_0.png', 0, 267, 176, 0, 1763386964,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386964), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871768_6faa535e8d1bb8d8bfbef6b0314deb5f_rle_crop_4036419082_0.png', 0, 196, 241, 0, 1763386964,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.00350022315979 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1763386966_1110547 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386966), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871989_5f2a5e8d89ec70b673561fdb5262716b_rle_crop_4036418998_0.png', 0, 465, 190, 0, 1763386966,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.6200301647186279 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1763386969_1110547 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386969), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394872024_1c509bf1ebe6f093935b722d0ad0d6b7_rle_crop_4036418991_0.png', 0, 156, 311, 0, 1763386969,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763386969), 0.0, 0.0, 14, '', 0, 0, '1763386829_1110547_1394871819_10a843a571fa00037655580c11987de8_rle_crop_4036419040_0.png', 0, 404, 344, 0, 1763386969,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.7083010673522949 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1394872024, 1394871989, 1394871953, 1394871919, 1394871881, 1394871823, 1394871819, 1394871815, 1394871811, 1394871807, 1394871805, 1394871768] Looping around the photos to save general results len do output : 100 /1394878140Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878141Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878142Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878143Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878144Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878145Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878146Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878147Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878148Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878149Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878150Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878151Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878152Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878153Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878154Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878155Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878156Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878157Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878158Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878159Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878160Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878161Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878162Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878163Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878164Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878165Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878166Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878167Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878168Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878169Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878170Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878171Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878172Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878173Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878174Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878175Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878176Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878177Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878178Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878179Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878180Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878181Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878182Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878183Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878184Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878185Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878186Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878187Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878188Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878189Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878190Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878191Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878192Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878193Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878196Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878197Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878198Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878199Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878200Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878201Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878202Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878203Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878231Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878232Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878233Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878234Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878235Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878271Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878272Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878273Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878274Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878275Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878276Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878277Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878278Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878279Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878280Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878281Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878282Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878283Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878284Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878285Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878286Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878287Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878288Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878289Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878290Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878291Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878292Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878293Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878294Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878295Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878296Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878297Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878299Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878300Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878301Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878302Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878306Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394878308Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4058354') ('3318', '28609449', '1394872024', None, None, None, None, None, '4058354') ('3318', None, None, None, None, None, None, None, '4058354') ('3318', '28609449', '1394871989', None, None, None, None, None, '4058354') ('3318', None, None, None, None, None, None, None, '4058354') ('3318', '28609449', '1394871953', None, None, None, None, None, '4058354') ('3318', None, None, None, None, None, None, None, '4058354') ('3318', '28609449', '1394871919', None, None, None, None, None, '4058354') ('3318', None, None, None, None, None, None, None, '4058354') ('3318', '28609449', '1394871881', None, None, None, None, None, '4058354') ('3318', None, None, None, None, None, None, None, '4058354') ('3318', '28609449', '1394871823', None, None, None, None, None, '4058354') ('3318', None, None, None, None, None, None, None, '4058354') ('3318', '28609449', '1394871819', None, None, None, None, None, '4058354') ('3318', None, None, None, None, None, None, None, '4058354') ('3318', '28609449', '1394871815', None, None, None, None, None, '4058354') ('3318', None, None, None, None, None, None, None, '4058354') ('3318', '28609449', '1394871811', None, None, None, None, None, '4058354') ('3318', None, None, None, None, None, None, None, '4058354') ('3318', '28609449', '1394871807', None, None, None, None, None, '4058354') ('3318', None, None, None, None, None, None, None, '4058354') ('3318', '28609449', '1394871805', None, None, None, None, None, '4058354') ('3318', None, None, None, None, None, None, None, '4058354') ('3318', '28609449', '1394871768', None, None, None, None, None, '4058354') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 312 time used for this insertion : 0.030106306076049805 save_final save missing photos in datou_result : time spend for datou_step_exec : 66.73775720596313 time spend to save output : 0.03389787673950195 total time spend for step 2 : 66.77165508270264 step3:rle_unique_nms_with_priority Mon Nov 17 14:42:49 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 100 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 9 nb_hashtags : 4 time to prepare the origin masks : 3.477041244506836 time for calcul the mask position with numpy : 0.5131211280822754 nb_pixel_total : 7622200 time to create 1 rle with new method : 0.8121402263641357 time for calcul the mask position with numpy : 0.023690462112426758 nb_pixel_total : 38298 time to create 1 rle with old method : 0.03970599174499512 time for calcul the mask position with numpy : 0.022803306579589844 nb_pixel_total : 27640 time to create 1 rle with old method : 0.028901100158691406 time for calcul the mask position with numpy : 0.02368950843811035 nb_pixel_total : 10149 time to create 1 rle with old method : 0.010977029800415039 time for calcul the mask position with numpy : 0.02419590950012207 nb_pixel_total : 81463 time to create 1 rle with old method : 0.08611321449279785 time for calcul the mask position with numpy : 0.02514028549194336 nb_pixel_total : 173182 time to create 1 rle with new method : 0.6130766868591309 time for calcul the mask position with numpy : 0.024570465087890625 nb_pixel_total : 27108 time to create 1 rle with old method : 0.029135704040527344 time for calcul the mask position with numpy : 0.024002552032470703 nb_pixel_total : 46777 time to create 1 rle with old method : 0.0497279167175293 time for calcul the mask position with numpy : 0.024634361267089844 nb_pixel_total : 171634 time to create 1 rle with new method : 0.5781662464141846 time for calcul the mask position with numpy : 0.024675369262695312 nb_pixel_total : 95949 time to create 1 rle with old method : 0.10281157493591309 create new chi : 3.1626718044281006 time to delete rle : 0.014555215835571289 batch 1 Loaded 19 chid ids of type : 3594 ++++++++++++Number RLEs to save : 7708 TO DO : save crop sub photo not yet done ! save time : 0.4997549057006836 nb_obj : 9 nb_hashtags : 4 time to prepare the origin masks : 3.355877161026001 time for calcul the mask position with numpy : 0.7243285179138184 nb_pixel_total : 7720123 time to create 1 rle with new method : 0.8370640277862549 time for calcul the mask position with numpy : 0.024267911911010742 nb_pixel_total : 36573 time to create 1 rle with old method : 0.039519309997558594 time for calcul the mask position with numpy : 0.023895263671875 nb_pixel_total : 14269 time to create 1 rle with old method : 0.0158689022064209 time for calcul the mask position with numpy : 0.024355411529541016 nb_pixel_total : 63390 time to create 1 rle with old method : 0.06849527359008789 time for calcul the mask position with numpy : 0.025035619735717773 nb_pixel_total : 32108 time to create 1 rle with old method : 0.03494977951049805 time for calcul the mask position with numpy : 0.024861574172973633 nb_pixel_total : 18352 time to create 1 rle with old method : 0.019896745681762695 time for calcul the mask position with numpy : 0.024147987365722656 nb_pixel_total : 21526 time to create 1 rle with old method : 0.02334904670715332 time for calcul the mask position with numpy : 0.025219202041625977 nb_pixel_total : 165526 time to create 1 rle with new method : 0.7008345127105713 time for calcul the mask position with numpy : 0.02423882484436035 nb_pixel_total : 72729 time to create 1 rle with old method : 0.0778968334197998 time for calcul the mask position with numpy : 0.024260759353637695 nb_pixel_total : 149804 time to create 1 rle with old method : 0.1608130931854248 create new chi : 2.988426446914673 time to delete rle : 0.001222848892211914 batch 1 Loaded 19 chid ids of type : 3594 ++++++++++++Number RLEs to save : 8568 TO DO : save crop sub photo not yet done ! save time : 0.5291023254394531 nb_obj : 12 nb_hashtags : 2 time to prepare the origin masks : 3.5979502201080322 time for calcul the mask position with numpy : 0.5358364582061768 nb_pixel_total : 7525673 time to create 1 rle with new method : 0.7297520637512207 time for calcul the mask position with numpy : 0.02307581901550293 nb_pixel_total : 104026 time to create 1 rle with old method : 0.11307740211486816 time for calcul the mask position with numpy : 0.024043798446655273 nb_pixel_total : 31424 time to create 1 rle with old method : 0.03393912315368652 time for calcul the mask position with numpy : 0.023114681243896484 nb_pixel_total : 26278 time to create 1 rle with old method : 0.028086185455322266 time for calcul the mask position with numpy : 0.023772001266479492 nb_pixel_total : 10732 time to create 1 rle with old method : 0.011358261108398438 time for calcul the mask position with numpy : 0.024211406707763672 nb_pixel_total : 103616 time to create 1 rle with old method : 0.11071658134460449 time for calcul the mask position with numpy : 0.023374319076538086 nb_pixel_total : 7973 time to create 1 rle with old method : 0.008455991744995117 time for calcul the mask position with numpy : 0.024345874786376953 nb_pixel_total : 63852 time to create 1 rle with old method : 0.06868314743041992 time for calcul the mask position with numpy : 0.023819446563720703 nb_pixel_total : 33678 time to create 1 rle with old method : 0.036154985427856445 time for calcul the mask position with numpy : 0.025304079055786133 nb_pixel_total : 129551 time to create 1 rle with old method : 0.13951659202575684 time for calcul the mask position with numpy : 0.024239063262939453 nb_pixel_total : 181809 time to create 1 rle with new method : 0.7012035846710205 time for calcul the mask position with numpy : 0.04051375389099121 nb_pixel_total : 69495 time to create 1 rle with old method : 0.0793755054473877 time for calcul the mask position with numpy : 0.040403127670288086 nb_pixel_total : 6293 time to create 1 rle with old method : 0.007074594497680664 create new chi : 2.9898757934570312 time to delete rle : 0.0014410018920898438 batch 1 Loaded 25 chid ids of type : 3594 +++++++++++++++++++Number RLEs to save : 9408 TO DO : save crop sub photo not yet done ! save time : 0.5876052379608154 nb_obj : 7 nb_hashtags : 4 time to prepare the origin masks : 2.7884902954101562 time for calcul the mask position with numpy : 0.7135937213897705 nb_pixel_total : 7910583 time to create 1 rle with new method : 0.7012133598327637 time for calcul the mask position with numpy : 0.04023098945617676 nb_pixel_total : 26611 time to create 1 rle with old method : 0.02940535545349121 time for calcul the mask position with numpy : 0.039412498474121094 nb_pixel_total : 36681 time to create 1 rle with old method : 0.03992199897766113 time for calcul the mask position with numpy : 0.03395795822143555 nb_pixel_total : 32355 time to create 1 rle with old method : 0.03449559211730957 time for calcul the mask position with numpy : 0.02372455596923828 nb_pixel_total : 54352 time to create 1 rle with old method : 0.05904340744018555 time for calcul the mask position with numpy : 0.025560617446899414 nb_pixel_total : 35834 time to create 1 rle with old method : 0.03890275955200195 time for calcul the mask position with numpy : 0.03860068321228027 nb_pixel_total : 37577 time to create 1 rle with old method : 0.03949427604675293 time for calcul the mask position with numpy : 0.03973078727722168 nb_pixel_total : 160407 time to create 1 rle with new method : 0.7456953525543213 create new chi : 2.709714412689209 time to delete rle : 0.0010471343994140625 batch 1 Loaded 15 chid ids of type : 3594 ++++++++Number RLEs to save : 6584 TO DO : save crop sub photo not yet done ! save time : 0.42761993408203125 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 1.5803241729736328 time for calcul the mask position with numpy : 0.9274249076843262 nb_pixel_total : 8116211 time to create 1 rle with new method : 0.5551354885101318 time for calcul the mask position with numpy : 0.024329423904418945 nb_pixel_total : 9624 time to create 1 rle with old method : 0.010396003723144531 time for calcul the mask position with numpy : 0.024991512298583984 nb_pixel_total : 121343 time to create 1 rle with old method : 0.1309349536895752 time for calcul the mask position with numpy : 0.024903535842895508 nb_pixel_total : 8646 time to create 1 rle with old method : 0.009805679321289062 time for calcul the mask position with numpy : 0.025459766387939453 nb_pixel_total : 38576 time to create 1 rle with old method : 0.04143118858337402 create new chi : 1.8183434009552002 time to delete rle : 0.0007073879241943359 batch 1 Loaded 9 chid ids of type : 3594 ++++++Number RLEs to save : 3652 TO DO : save crop sub photo not yet done ! save time : 0.2528254985809326 nb_obj : 9 nb_hashtags : 3 time to prepare the origin masks : 3.189059257507324 time for calcul the mask position with numpy : 0.4284210205078125 nb_pixel_total : 7903646 time to create 1 rle with new method : 1.256007432937622 time for calcul the mask position with numpy : 0.03575539588928223 nb_pixel_total : 84039 time to create 1 rle with old method : 0.11226749420166016 time for calcul the mask position with numpy : 0.027843952178955078 nb_pixel_total : 21201 time to create 1 rle with old method : 0.03217124938964844 time for calcul the mask position with numpy : 0.03019881248474121 nb_pixel_total : 43004 time to create 1 rle with old method : 0.047165632247924805 time for calcul the mask position with numpy : 0.025629043579101562 nb_pixel_total : 40434 time to create 1 rle with old method : 0.04363870620727539 time for calcul the mask position with numpy : 0.025068283081054688 nb_pixel_total : 80523 time to create 1 rle with old method : 0.08800840377807617 time for calcul the mask position with numpy : 0.02540135383605957 nb_pixel_total : 11805 time to create 1 rle with old method : 0.01295614242553711 time for calcul the mask position with numpy : 0.024822235107421875 nb_pixel_total : 27664 time to create 1 rle with old method : 0.03055715560913086 time for calcul the mask position with numpy : 0.02679896354675293 nb_pixel_total : 59315 time to create 1 rle with old method : 0.06410908699035645 time for calcul the mask position with numpy : 0.02537059783935547 nb_pixel_total : 22769 time to create 1 rle with old method : 0.02459716796875 create new chi : 2.430089235305786 time to delete rle : 0.0010836124420166016 batch 1 Loaded 19 chid ids of type : 3594 ++++++++++++Number RLEs to save : 6488 TO DO : save crop sub photo not yet done ! save time : 0.4174838066101074 nb_obj : 8 nb_hashtags : 4 time to prepare the origin masks : 3.293177604675293 time for calcul the mask position with numpy : 0.5268847942352295 nb_pixel_total : 7887661 time to create 1 rle with new method : 0.8377964496612549 time for calcul the mask position with numpy : 0.02506089210510254 nb_pixel_total : 85833 time to create 1 rle with old method : 0.09558606147766113 time for calcul the mask position with numpy : 0.025211334228515625 nb_pixel_total : 20358 time to create 1 rle with old method : 0.022686004638671875 time for calcul the mask position with numpy : 0.02402329444885254 nb_pixel_total : 33275 time to create 1 rle with old method : 0.03688859939575195 time for calcul the mask position with numpy : 0.024316787719726562 nb_pixel_total : 64900 time to create 1 rle with old method : 0.07328534126281738 time for calcul the mask position with numpy : 0.02879929542541504 nb_pixel_total : 36305 time to create 1 rle with old method : 0.04055976867675781 time for calcul the mask position with numpy : 0.02730703353881836 nb_pixel_total : 31280 time to create 1 rle with old method : 0.03474736213684082 time for calcul the mask position with numpy : 0.025331735610961914 nb_pixel_total : 20506 time to create 1 rle with old method : 0.022364139556884766 time for calcul the mask position with numpy : 0.024957895278930664 nb_pixel_total : 114282 time to create 1 rle with old method : 0.12226128578186035 create new chi : 2.06270432472229 time to delete rle : 0.0010635852813720703 batch 1 Loaded 17 chid ids of type : 3594 +++++++++Number RLEs to save : 6972 TO DO : save crop sub photo not yet done ! save time : 0.4446744918823242 nb_obj : 8 nb_hashtags : 2 time to prepare the origin masks : 2.6216397285461426 time for calcul the mask position with numpy : 0.5058012008666992 nb_pixel_total : 7366598 time to create 1 rle with new method : 0.7661325931549072 time for calcul the mask position with numpy : 0.023443937301635742 nb_pixel_total : 48972 time to create 1 rle with old method : 0.05160665512084961 time for calcul the mask position with numpy : 0.03911256790161133 nb_pixel_total : 10941 time to create 1 rle with old method : 0.012343406677246094 time for calcul the mask position with numpy : 0.04064464569091797 nb_pixel_total : 389576 time to create 1 rle with new method : 0.4017500877380371 time for calcul the mask position with numpy : 0.032479047775268555 nb_pixel_total : 73577 time to create 1 rle with old method : 0.08246278762817383 time for calcul the mask position with numpy : 0.025559186935424805 nb_pixel_total : 190049 time to create 1 rle with new method : 0.6513540744781494 time for calcul the mask position with numpy : 0.02589702606201172 nb_pixel_total : 138229 time to create 1 rle with old method : 0.15982460975646973 time for calcul the mask position with numpy : 0.02617788314819336 nb_pixel_total : 44871 time to create 1 rle with old method : 0.052899837493896484 time for calcul the mask position with numpy : 0.024509429931640625 nb_pixel_total : 31587 time to create 1 rle with old method : 0.03462719917297363 create new chi : 3.0566420555114746 time to delete rle : 0.001367807388305664 batch 1 Loaded 17 chid ids of type : 3594 +++++++++Number RLEs to save : 8939 TO DO : save crop sub photo not yet done ! save time : 0.5346207618713379 nb_obj : 9 nb_hashtags : 3 time to prepare the origin masks : 2.896131992340088 time for calcul the mask position with numpy : 0.4030311107635498 nb_pixel_total : 7643058 time to create 1 rle with new method : 0.8377194404602051 time for calcul the mask position with numpy : 0.023543596267700195 nb_pixel_total : 126548 time to create 1 rle with old method : 0.13779520988464355 time for calcul the mask position with numpy : 0.023557424545288086 nb_pixel_total : 27185 time to create 1 rle with old method : 0.029907941818237305 time for calcul the mask position with numpy : 0.02407097816467285 nb_pixel_total : 132098 time to create 1 rle with old method : 0.14235520362854004 time for calcul the mask position with numpy : 0.02484130859375 nb_pixel_total : 22900 time to create 1 rle with old method : 0.024805068969726562 time for calcul the mask position with numpy : 0.023700475692749023 nb_pixel_total : 27825 time to create 1 rle with old method : 0.03018808364868164 time for calcul the mask position with numpy : 0.02339911460876465 nb_pixel_total : 43245 time to create 1 rle with old method : 0.04743337631225586 time for calcul the mask position with numpy : 0.028232812881469727 nb_pixel_total : 64422 time to create 1 rle with old method : 0.07010960578918457 time for calcul the mask position with numpy : 0.025115966796875 nb_pixel_total : 174170 time to create 1 rle with new method : 0.6242198944091797 time for calcul the mask position with numpy : 0.023691177368164062 nb_pixel_total : 32949 time to create 1 rle with old method : 0.03563427925109863 create new chi : 2.669269561767578 time to delete rle : 0.0010442733764648438 batch 1 Loaded 19 chid ids of type : 3594 ++++++++++Number RLEs to save : 7082 TO DO : save crop sub photo not yet done ! save time : 0.45636963844299316 nb_obj : 12 nb_hashtags : 3 time to prepare the origin masks : 3.927135467529297 time for calcul the mask position with numpy : 0.5918335914611816 nb_pixel_total : 7585323 time to create 1 rle with new method : 0.7446904182434082 time for calcul the mask position with numpy : 0.022992849349975586 nb_pixel_total : 11649 time to create 1 rle with old method : 0.012619495391845703 time for calcul the mask position with numpy : 0.02565622329711914 nb_pixel_total : 21811 time to create 1 rle with old method : 0.023999929428100586 time for calcul the mask position with numpy : 0.024782657623291016 nb_pixel_total : 196945 time to create 1 rle with new method : 0.6269195079803467 time for calcul the mask position with numpy : 0.02454972267150879 nb_pixel_total : 10752 time to create 1 rle with old method : 0.011861562728881836 time for calcul the mask position with numpy : 0.024759292602539062 nb_pixel_total : 26337 time to create 1 rle with old method : 0.029393911361694336 time for calcul the mask position with numpy : 0.024500370025634766 nb_pixel_total : 15852 time to create 1 rle with old method : 0.01729416847229004 time for calcul the mask position with numpy : 0.025274276733398438 nb_pixel_total : 29621 time to create 1 rle with old method : 0.0320887565612793 time for calcul the mask position with numpy : 0.024173974990844727 nb_pixel_total : 42793 time to create 1 rle with old method : 0.04663228988647461 time for calcul the mask position with numpy : 0.024382829666137695 nb_pixel_total : 31782 time to create 1 rle with old method : 0.03475832939147949 time for calcul the mask position with numpy : 0.025381803512573242 nb_pixel_total : 254040 time to create 1 rle with new method : 0.5302813053131104 time for calcul the mask position with numpy : 0.024454355239868164 nb_pixel_total : 27757 time to create 1 rle with old method : 0.030501365661621094 time for calcul the mask position with numpy : 0.025133848190307617 nb_pixel_total : 39738 time to create 1 rle with old method : 0.043813467025756836 create new chi : 3.1648411750793457 time to delete rle : 0.0016281604766845703 batch 1 Loaded 25 chid ids of type : 3594 +++++++++++++++++++Number RLEs to save : 10039 TO DO : save crop sub photo not yet done ! save time : 0.6304683685302734 nb_obj : 6 nb_hashtags : 4 time to prepare the origin masks : 2.2435076236724854 time for calcul the mask position with numpy : 0.621042013168335 nb_pixel_total : 7998603 time to create 1 rle with new method : 0.6154000759124756 time for calcul the mask position with numpy : 0.02276611328125 nb_pixel_total : 42731 time to create 1 rle with old method : 0.0448918342590332 time for calcul the mask position with numpy : 0.023308515548706055 nb_pixel_total : 10558 time to create 1 rle with old method : 0.011676788330078125 time for calcul the mask position with numpy : 0.02297067642211914 nb_pixel_total : 22882 time to create 1 rle with old method : 0.023937225341796875 time for calcul the mask position with numpy : 0.022840023040771484 nb_pixel_total : 23486 time to create 1 rle with old method : 0.024924278259277344 time for calcul the mask position with numpy : 0.024552106857299805 nb_pixel_total : 36283 time to create 1 rle with old method : 0.03843879699707031 time for calcul the mask position with numpy : 0.02539658546447754 nb_pixel_total : 159857 time to create 1 rle with new method : 0.6139857769012451 create new chi : 2.203044891357422 time to delete rle : 0.0008714199066162109 batch 1 Loaded 13 chid ids of type : 3594 ++++++Number RLEs to save : 5826 TO DO : save crop sub photo not yet done ! save time : 0.37700676918029785 nb_obj : 7 nb_hashtags : 4 time to prepare the origin masks : 2.6560003757476807 time for calcul the mask position with numpy : 0.5543715953826904 nb_pixel_total : 8011151 time to create 1 rle with new method : 0.7496645450592041 time for calcul the mask position with numpy : 0.03461027145385742 nb_pixel_total : 40717 time to create 1 rle with old method : 0.04366898536682129 time for calcul the mask position with numpy : 0.024372577667236328 nb_pixel_total : 49166 time to create 1 rle with old method : 0.05267930030822754 time for calcul the mask position with numpy : 0.02251291275024414 nb_pixel_total : 19468 time to create 1 rle with old method : 0.020590543746948242 time for calcul the mask position with numpy : 0.02362656593322754 nb_pixel_total : 34913 time to create 1 rle with old method : 0.0368192195892334 time for calcul the mask position with numpy : 0.023422718048095703 nb_pixel_total : 13282 time to create 1 rle with old method : 0.014174699783325195 time for calcul the mask position with numpy : 0.023000478744506836 nb_pixel_total : 24762 time to create 1 rle with old method : 0.026241302490234375 time for calcul the mask position with numpy : 0.023541688919067383 nb_pixel_total : 100941 time to create 1 rle with old method : 0.10742592811584473 create new chi : 1.8223392963409424 time to delete rle : 0.0008046627044677734 batch 1 Loaded 15 chid ids of type : 3594 +++++++Number RLEs to save : 5344 TO DO : save crop sub photo not yet done ! save time : 0.3822762966156006 map_output_result : {1394872024: (0.0, 'Should be the crop_list due to order', 0), 1394871989: (0.0, 'Should be the crop_list due to order', 0), 1394871953: (0.0, 'Should be the crop_list due to order', 0), 1394871919: (0.0, 'Should be the crop_list due to order', 0), 1394871881: (0.0, 'Should be the crop_list due to order', 0), 1394871823: (0.0, 'Should be the crop_list due to order', 0), 1394871819: (0.0, 'Should be the crop_list due to order', 0), 1394871815: (0.0, 'Should be the crop_list due to order', 0), 1394871811: (0.0, 'Should be the crop_list due to order', 0), 1394871807: (0.0, 'Should be the crop_list due to order', 0), 1394871805: (0.0, 'Should be the crop_list due to order', 0), 1394871768: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1394872024, 1394871989, 1394871953, 1394871919, 1394871881, 1394871823, 1394871819, 1394871815, 1394871811, 1394871807, 1394871805, 1394871768] Looping around the photos to save general results len do output : 12 /1394872024.Didn't retrieve data . /1394871989.Didn't retrieve data . /1394871953.Didn't retrieve data . /1394871919.Didn't retrieve data . /1394871881.Didn't retrieve data . /1394871823.Didn't retrieve data . /1394871819.Didn't retrieve data . /1394871815.Didn't retrieve data . /1394871811.Didn't retrieve data . /1394871807.Didn't retrieve data . /1394871805.Didn't retrieve data . /1394871768.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4058354') ('3318', '28609449', '1394872024', None, None, None, None, None, '4058354') ('3318', None, None, None, None, None, None, None, '4058354') ('3318', '28609449', '1394871989', None, None, None, None, None, '4058354') ('3318', None, None, None, None, None, None, None, '4058354') ('3318', '28609449', '1394871953', None, None, None, None, None, '4058354') ('3318', None, None, None, None, None, None, None, '4058354') ('3318', '28609449', '1394871919', None, None, None, None, None, '4058354') ('3318', None, None, None, None, None, None, None, '4058354') ('3318', '28609449', '1394871881', None, None, None, None, None, '4058354') ('3318', None, None, None, None, None, None, None, '4058354') ('3318', '28609449', '1394871823', None, None, None, None, None, '4058354') ('3318', None, None, None, None, None, None, None, '4058354') ('3318', '28609449', '1394871819', None, None, None, None, None, '4058354') ('3318', None, None, None, None, None, None, None, '4058354') ('3318', '28609449', '1394871815', None, None, None, None, None, '4058354') ('3318', None, None, None, None, None, None, None, '4058354') ('3318', '28609449', '1394871811', None, None, None, None, None, '4058354') ('3318', None, None, None, None, None, None, None, '4058354') ('3318', '28609449', '1394871807', None, None, None, None, None, '4058354') ('3318', None, None, None, None, None, None, None, '4058354') ('3318', '28609449', '1394871805', None, None, None, None, None, '4058354') ('3318', None, None, None, None, None, None, None, '4058354') ('3318', '28609449', '1394871768', None, None, None, None, None, '4058354') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 36 time used for this insertion : 0.016757965087890625 save_final save missing photos in datou_result : time spend for datou_step_exec : 73.83555793762207 time spend to save output : 0.017266511917114258 total time spend for step 3 : 73.85282444953918 step4:ventilate_hashtags_in_portfolio Mon Nov 17 14:44:03 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 28609449 get user id for portfolio 28609449 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28609449 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pehd','environnement','carton','pet_clair','metal','flou','background','papier','autre','mal_croppe','pet_fonce')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28609449 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pehd','environnement','carton','pet_clair','metal','flou','background','papier','autre','mal_croppe','pet_fonce')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28609449 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pehd','environnement','carton','pet_clair','metal','flou','background','papier','autre','mal_croppe','pet_fonce')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/28609845,28609846,28609847,28609848,28609849,28609850,28609851,28609852,28609853,28609854,28609855?tags=pehd,environnement,carton,pet_clair,metal,flou,background,papier,autre,mal_croppe,pet_fonce Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1394872024, 1394871989, 1394871953, 1394871919, 1394871881, 1394871823, 1394871819, 1394871815, 1394871811, 1394871807, 1394871805, 1394871768] Looping around the photos to save general results len do output : 1 /28609449. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4058354') ('3318', '28609449', '1394872024', None, None, None, None, None, '4058354') ('3318', None, None, None, None, None, None, None, '4058354') ('3318', '28609449', '1394871989', None, None, None, None, None, '4058354') ('3318', None, None, None, None, None, None, None, '4058354') ('3318', '28609449', '1394871953', None, None, None, None, None, '4058354') ('3318', None, None, None, None, None, None, None, '4058354') ('3318', '28609449', '1394871919', None, None, None, None, None, '4058354') ('3318', None, None, None, None, None, None, None, '4058354') ('3318', '28609449', '1394871881', None, None, None, None, None, '4058354') ('3318', None, None, None, None, None, None, None, '4058354') ('3318', '28609449', '1394871823', None, None, None, None, None, '4058354') ('3318', None, None, None, None, None, None, None, '4058354') ('3318', '28609449', '1394871819', None, None, None, None, None, '4058354') ('3318', None, None, None, None, None, None, None, '4058354') ('3318', '28609449', '1394871815', None, None, None, None, None, '4058354') ('3318', None, None, None, None, None, None, None, '4058354') ('3318', '28609449', '1394871811', None, None, None, None, None, '4058354') ('3318', None, None, None, None, None, None, None, '4058354') ('3318', '28609449', '1394871807', None, None, None, None, None, '4058354') ('3318', None, None, None, None, None, None, None, '4058354') ('3318', '28609449', '1394871805', None, None, None, None, None, '4058354') ('3318', None, None, None, None, None, None, None, '4058354') ('3318', '28609449', '1394871768', None, None, None, None, None, '4058354') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 13 time used for this insertion : 0.01593470573425293 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.7609443664550781 time spend to save output : 0.016199827194213867 total time spend for step 4 : 1.777144193649292 step5:final Mon Nov 17 14:44:05 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1394872024: ('0.06271269370498972',), 1394871989: ('0.06271269370498972',), 1394871953: ('0.06271269370498972',), 1394871919: ('0.06271269370498972',), 1394871881: ('0.06271269370498972',), 1394871823: ('0.06271269370498972',), 1394871819: ('0.06271269370498972',), 1394871815: ('0.06271269370498972',), 1394871811: ('0.06271269370498972',), 1394871807: ('0.06271269370498972',), 1394871805: ('0.06271269370498972',), 1394871768: ('0.06271269370498972',)} new output for save of step final : {1394872024: ('0.06271269370498972',), 1394871989: ('0.06271269370498972',), 1394871953: ('0.06271269370498972',), 1394871919: ('0.06271269370498972',), 1394871881: ('0.06271269370498972',), 1394871823: ('0.06271269370498972',), 1394871819: ('0.06271269370498972',), 1394871815: ('0.06271269370498972',), 1394871811: ('0.06271269370498972',), 1394871807: ('0.06271269370498972',), 1394871805: ('0.06271269370498972',), 1394871768: ('0.06271269370498972',)} [1394872024, 1394871989, 1394871953, 1394871919, 1394871881, 1394871823, 1394871819, 1394871815, 1394871811, 1394871807, 1394871805, 1394871768] Looping around the photos to save general results len do output : 12 /1394872024.Didn't retrieve data . /1394871989.Didn't retrieve data . /1394871953.Didn't retrieve data . /1394871919.Didn't retrieve data . /1394871881.Didn't retrieve data . /1394871823.Didn't retrieve data . /1394871819.Didn't retrieve data . /1394871815.Didn't retrieve data . /1394871811.Didn't retrieve data . /1394871807.Didn't retrieve data . /1394871805.Didn't retrieve data . /1394871768.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4058354') ('3318', '28609449', '1394872024', None, None, None, None, None, '4058354') ('3318', None, None, None, None, None, None, None, '4058354') ('3318', '28609449', '1394871989', None, None, None, None, None, '4058354') ('3318', None, None, None, None, None, None, None, '4058354') ('3318', '28609449', '1394871953', None, None, None, None, None, '4058354') ('3318', None, None, None, None, None, None, None, '4058354') ('3318', '28609449', '1394871919', None, None, None, None, None, '4058354') ('3318', None, None, None, None, None, None, None, '4058354') ('3318', '28609449', '1394871881', None, None, None, None, None, '4058354') ('3318', None, None, None, None, None, None, None, '4058354') ('3318', '28609449', '1394871823', None, None, None, None, None, '4058354') ('3318', None, None, None, None, None, None, None, '4058354') ('3318', '28609449', '1394871819', None, None, None, None, None, '4058354') ('3318', None, None, None, None, None, None, None, '4058354') ('3318', '28609449', '1394871815', None, None, None, None, None, '4058354') ('3318', None, None, None, None, None, None, None, '4058354') ('3318', '28609449', '1394871811', None, None, None, None, None, '4058354') ('3318', None, None, None, None, None, None, None, '4058354') ('3318', '28609449', '1394871807', None, None, None, None, None, '4058354') ('3318', None, None, None, None, None, None, None, '4058354') ('3318', '28609449', '1394871805', None, None, None, None, None, '4058354') ('3318', None, None, None, None, None, None, None, '4058354') ('3318', '28609449', '1394871768', None, None, None, None, None, '4058354') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 36 time used for this insertion : 0.017531156539916992 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.13844537734985352 time spend to save output : 0.018117427825927734 total time spend for step 5 : 0.15656280517578125 step6:blur_detection Mon Nov 17 14:44:05 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1763386829_1110547_1394872024_1c509bf1ebe6f093935b722d0ad0d6b7.jpg resize: (2160, 3840) 1394872024 -6.132128806503208 treat image : temp/1763386829_1110547_1394871989_5f2a5e8d89ec70b673561fdb5262716b.jpg resize: (2160, 3840) 1394871989 -7.005873942535524 treat image : temp/1763386829_1110547_1394871953_829d9909d2c4f5697359241f38644e7b.jpg resize: (2160, 3840) 1394871953 -7.22821252516008 treat image : temp/1763386829_1110547_1394871919_9e1b248cd80c2a7b5d0726099d39d0cd.jpg resize: (2160, 3840) 1394871919 -6.98797270157772 treat image : temp/1763386829_1110547_1394871881_2f07c7e07ac15328f346138705c8f261.jpg resize: (2160, 3840) 1394871881 -7.06761080913555 treat image : temp/1763386829_1110547_1394871823_7af85144ec66701ba8bf692f190d49e3.jpg resize: (2160, 3840) 1394871823 -6.997738839871621 treat image : temp/1763386829_1110547_1394871819_10a843a571fa00037655580c11987de8.jpg resize: (2160, 3840) 1394871819 -7.0133068936851695 treat image : temp/1763386829_1110547_1394871815_0b0dddbd11fc99c619ac316b00bbba99.jpg resize: (2160, 3840) 1394871815 -7.042578762156026 treat image : temp/1763386829_1110547_1394871811_9976f91e13a9f9c7e7fac1e0c4ea49a3.jpg resize: (2160, 3840) 1394871811 -6.980094381286784 treat image : temp/1763386829_1110547_1394871807_3833afbe7daae65a957b97ae775007db.jpg resize: (2160, 3840) 1394871807 -7.080684476982075 treat image : temp/1763386829_1110547_1394871805_6378ae73bff23ad3f026cc8b098d5a93.jpg resize: (2160, 3840) 1394871805 -7.146079096026036 treat image : temp/1763386829_1110547_1394871768_6faa535e8d1bb8d8bfbef6b0314deb5f.jpg resize: (2160, 3840) 1394871768 -6.481193109291296 treat image : temp/1763386829_1110547_1394872024_1c509bf1ebe6f093935b722d0ad0d6b7_rle_crop_4036418985_0.png resize: (276, 399) 1394878140 -3.4575648218867503 treat image : temp/1763386829_1110547_1394872024_1c509bf1ebe6f093935b722d0ad0d6b7_rle_crop_4036418986_0.png resize: (377, 89) 1394878141 -3.720499725945735 treat image : temp/1763386829_1110547_1394872024_1c509bf1ebe6f093935b722d0ad0d6b7_rle_crop_4036418989_0.png resize: (82, 186) 1394878142 -3.801250187355562 treat image : temp/1763386829_1110547_1394872024_1c509bf1ebe6f093935b722d0ad0d6b7_rle_crop_4036418990_0.png resize: (248, 268) 1394878143 -3.943508727532601 treat image : temp/1763386829_1110547_1394871989_5f2a5e8d89ec70b673561fdb5262716b_rle_crop_4036418992_0.png resize: (487, 693) 1394878144 -4.009194804323022 treat image : temp/1763386829_1110547_1394871989_5f2a5e8d89ec70b673561fdb5262716b_rle_crop_4036418993_0.png resize: (421, 235) 1394878145 -4.534398493771405 treat image : temp/1763386829_1110547_1394871989_5f2a5e8d89ec70b673561fdb5262716b_rle_crop_4036418995_0.png resize: (231, 287) 1394878146 -2.478951807742237 treat image : temp/1763386829_1110547_1394871989_5f2a5e8d89ec70b673561fdb5262716b_rle_crop_4036418996_0.png resize: (174, 162) 1394878147 -3.362249084084221 treat image : temp/1763386829_1110547_1394871989_5f2a5e8d89ec70b673561fdb5262716b_rle_crop_4036419000_0.png resize: (203, 242) 1394878148 -3.8873280133387564 treat image : temp/1763386829_1110547_1394871953_829d9909d2c4f5697359241f38644e7b_rle_crop_4036419001_0.png resize: (77, 107) 1394878149 -1.8294625993345963 treat image : temp/1763386829_1110547_1394871953_829d9909d2c4f5697359241f38644e7b_rle_crop_4036419002_0.png resize: (503, 161) 1394878150 -4.613607273808539 treat image : temp/1763386829_1110547_1394871953_829d9909d2c4f5697359241f38644e7b_rle_crop_4036419003_0.png resize: (569, 471) 1394878151 -5.12040890589647 treat image : temp/1763386829_1110547_1394871953_829d9909d2c4f5697359241f38644e7b_rle_crop_4036419004_0.png resize: (377, 427) 1394878152 -4.708421161356095 treat image : temp/1763386829_1110547_1394871953_829d9909d2c4f5697359241f38644e7b_rle_crop_4036419006_0.png resize: (204, 407) 1394878153 -5.263155285406781 treat image : temp/1763386829_1110547_1394871953_829d9909d2c4f5697359241f38644e7b_rle_crop_4036419007_0.png resize: (82, 155) 1394878154 -4.191593099121971 treat image : temp/1763386829_1110547_1394871953_829d9909d2c4f5697359241f38644e7b_rle_crop_4036419009_0.png resize: (118, 140) 1394878155 -4.531024587617314 treat image : temp/1763386829_1110547_1394871953_829d9909d2c4f5697359241f38644e7b_rle_crop_4036419010_0.png resize: (257, 175) 1394878156 -3.6838555712960863 treat image : temp/1763386829_1110547_1394871953_829d9909d2c4f5697359241f38644e7b_rle_crop_4036419011_0.png resize: (245, 261) 1394878157 -2.9818473349311465 treat image : temp/1763386829_1110547_1394871953_829d9909d2c4f5697359241f38644e7b_rle_crop_4036419012_0.png resize: (375, 478) 1394878158 -5.1618588873464715 treat image : temp/1763386829_1110547_1394871919_9e1b248cd80c2a7b5d0726099d39d0cd_rle_crop_4036419013_0.png resize: (514, 466) 1394878159 -2.7141176240004574 treat image : temp/1763386829_1110547_1394871919_9e1b248cd80c2a7b5d0726099d39d0cd_rle_crop_4036419018_0.png resize: (249, 322) 1394878160 -4.63806116975281 treat image : temp/1763386829_1110547_1394871881_2f07c7e07ac15328f346138705c8f261_rle_crop_4036419022_0.png resize: (331, 533) 1394878161 -4.549871668569203 treat image : temp/1763386829_1110547_1394871823_7af85144ec66701ba8bf692f190d49e3_rle_crop_4036419024_0.png resize: (217, 146) 1394878162 -3.988530410596145 treat image : temp/1763386829_1110547_1394871823_7af85144ec66701ba8bf692f190d49e3_rle_crop_4036419025_0.png resize: (308, 319) 1394878163 -5.092842127076164 treat image : temp/1763386829_1110547_1394871823_7af85144ec66701ba8bf692f190d49e3_rle_crop_4036419027_0.png resize: (148, 113) 1394878164 -5.05634498353433 treat image : temp/1763386829_1110547_1394871823_7af85144ec66701ba8bf692f190d49e3_rle_crop_4036419029_0.png resize: (260, 167) 1394878165 -3.5183296587818984 treat image : temp/1763386829_1110547_1394871823_7af85144ec66701ba8bf692f190d49e3_rle_crop_4036419030_0.png resize: (230, 278) 1394878166 -4.650346246194926 treat image : temp/1763386829_1110547_1394871819_10a843a571fa00037655580c11987de8_rle_crop_4036419034_0.png resize: (272, 127) 1394878167 -3.955194573458517 treat image : temp/1763386829_1110547_1394871819_10a843a571fa00037655580c11987de8_rle_crop_4036419035_0.png resize: (301, 190) 1394878168 -4.612160594325166 treat image : temp/1763386829_1110547_1394871819_10a843a571fa00037655580c11987de8_rle_crop_4036419036_0.png resize: (295, 213) 1394878169 -2.9625638418559785 treat image : temp/1763386829_1110547_1394871819_10a843a571fa00037655580c11987de8_rle_crop_4036419038_0.png resize: (360, 131) 1394878170 -3.618610978852079 treat image : temp/1763386829_1110547_1394871815_0b0dddbd11fc99c619ac316b00bbba99_rle_crop_4036419041_0.png resize: (167, 268) 1394878171 -4.8860124555786255 treat image : temp/1763386829_1110547_1394871815_0b0dddbd11fc99c619ac316b00bbba99_rle_crop_4036419044_0.png resize: (517, 566) 1394878172 -3.212987990599815 treat image : temp/1763386829_1110547_1394871815_0b0dddbd11fc99c619ac316b00bbba99_rle_crop_4036419047_0.png resize: (162, 225) 1394878173 -3.387345448311004 treat image : temp/1763386829_1110547_1394871811_9976f91e13a9f9c7e7fac1e0c4ea49a3_rle_crop_4036419053_0.png resize: (106, 312) 1394878174 -4.336197398270856 treat image : temp/1763386829_1110547_1394871811_9976f91e13a9f9c7e7fac1e0c4ea49a3_rle_crop_4036419054_0.png resize: (174, 191) 1394878175 -4.449651561817264 treat image : temp/1763386829_1110547_1394871811_9976f91e13a9f9c7e7fac1e0c4ea49a3_rle_crop_4036419056_0.png resize: (169, 220) 1394878176 -4.150820996764219 treat image : temp/1763386829_1110547_1394871811_9976f91e13a9f9c7e7fac1e0c4ea49a3_rle_crop_4036419057_0.png resize: (443, 449) 1394878177 -5.282085336592277 treat image : temp/1763386829_1110547_1394871807_3833afbe7daae65a957b97ae775007db_rle_crop_4036419058_0.png resize: (213, 274) 1394878178 -4.9062186394149245 treat image : temp/1763386829_1110547_1394871807_3833afbe7daae65a957b97ae775007db_rle_crop_4036419059_0.png resize: (173, 248) 1394878179 -3.4865465597590335 treat image : temp/1763386829_1110547_1394871807_3833afbe7daae65a957b97ae775007db_rle_crop_4036419060_0.png resize: (563, 900) 1394878180 -4.782811441218141 treat image : temp/1763386829_1110547_1394871807_3833afbe7daae65a957b97ae775007db_rle_crop_4036419061_0.png resize: (315, 232) 1394878181 -3.926040074693844 treat image : temp/1763386829_1110547_1394871807_3833afbe7daae65a957b97ae775007db_rle_crop_4036419063_0.png resize: (296, 226) 1394878182 -4.463682089302272 treat image : temp/1763386829_1110547_1394871807_3833afbe7daae65a957b97ae775007db_rle_crop_4036419065_0.png resize: (351, 232) 1394878183 -4.206988659713183 treat image : temp/1763386829_1110547_1394871807_3833afbe7daae65a957b97ae775007db_rle_crop_4036419066_0.png resize: (91, 148) 1394878184 -3.97777134825575 treat image : temp/1763386829_1110547_1394871807_3833afbe7daae65a957b97ae775007db_rle_crop_4036419067_0.png resize: (626, 550) 1394878185 -3.404817762754678 treat image : temp/1763386829_1110547_1394871807_3833afbe7daae65a957b97ae775007db_rle_crop_4036419069_0.png resize: (130, 127) 1394878186 -3.8337137170704203 treat image : temp/1763386829_1110547_1394871805_6378ae73bff23ad3f026cc8b098d5a93_rle_crop_4036419071_0.png resize: (248, 260) 1394878187 -4.97135628257268 treat image : temp/1763386829_1110547_1394871805_6378ae73bff23ad3f026cc8b098d5a93_rle_crop_4036419072_0.png resize: (214, 161) 1394878188 -4.475950825752916 treat image : temp/1763386829_1110547_1394871805_6378ae73bff23ad3f026cc8b098d5a93_rle_crop_4036419073_0.png resize: (518, 536) 1394878189 -5.973813750433844 treat image : temp/1763386829_1110547_1394871768_6faa535e8d1bb8d8bfbef6b0314deb5f_rle_crop_4036419076_0.png resize: (391, 341) 1394878190 -4.81640588392732 treat image : temp/1763386829_1110547_1394871768_6faa535e8d1bb8d8bfbef6b0314deb5f_rle_crop_4036419078_0.png resize: (121, 192) 1394878191 -3.7591543494402937 treat image : temp/1763386829_1110547_1394871768_6faa535e8d1bb8d8bfbef6b0314deb5f_rle_crop_4036419079_0.png resize: (271, 167) 1394878192 -3.6144078356211744 treat image : temp/1763386829_1110547_1394871768_6faa535e8d1bb8d8bfbef6b0314deb5f_rle_crop_4036419080_0.png resize: (137, 171) 1394878193 -3.581369669989853 treat image : temp/1763386829_1110547_1394871919_9e1b248cd80c2a7b5d0726099d39d0cd_rle_crop_4036419015_0.png resize: (218, 287) 1394878196 -4.362511756957035 treat image : temp/1763386829_1110547_1394871919_9e1b248cd80c2a7b5d0726099d39d0cd_rle_crop_4036419017_0.png resize: (193, 253) 1394878197 -4.2435914309190075 treat image : temp/1763386829_1110547_1394871823_7af85144ec66701ba8bf692f190d49e3_rle_crop_4036419026_0.png resize: (192, 213) 1394878198 -4.2045654671765025 treat image : temp/1763386829_1110547_1394871823_7af85144ec66701ba8bf692f190d49e3_rle_crop_4036419028_0.png resize: (254, 427) 1394878199 -3.2334930814033234 treat image : temp/1763386829_1110547_1394871811_9976f91e13a9f9c7e7fac1e0c4ea49a3_rle_crop_4036419049_0.png resize: (184, 278) 1394878200 -3.210811302376664 treat image : temp/1763386829_1110547_1394871807_3833afbe7daae65a957b97ae775007db_rle_crop_4036419064_0.png resize: (106, 220) 1394878201 -2.971847053728361 treat image : temp/1763386829_1110547_1394871807_3833afbe7daae65a957b97ae775007db_rle_crop_4036419068_0.png resize: (245, 125) 1394878202 -4.658793969492464 treat image : temp/1763386829_1110547_1394871805_6378ae73bff23ad3f026cc8b098d5a93_rle_crop_4036419075_0.png resize: (212, 256) 1394878203 -4.253282294344451 treat image : temp/1763386829_1110547_1394871989_5f2a5e8d89ec70b673561fdb5262716b_rle_crop_4036418997_0.png resize: (248, 163) 1394878231 -4.255186589462981 treat image : temp/1763386829_1110547_1394871919_9e1b248cd80c2a7b5d0726099d39d0cd_rle_crop_4036419014_0.png resize: (263, 172) 1394878232 -5.035050480906225 treat image : temp/1763386829_1110547_1394871819_10a843a571fa00037655580c11987de8_rle_crop_4036419039_0.png resize: (165, 165) 1394878233 -4.626193500187015 treat image : temp/1763386829_1110547_1394871805_6378ae73bff23ad3f026cc8b098d5a93_rle_crop_4036419074_0.png resize: (131, 106) 1394878234 -4.715224926395424 treat image : temp/1763386829_1110547_1394871768_6faa535e8d1bb8d8bfbef6b0314deb5f_rle_crop_4036419077_0.png resize: (170, 231) 1394878235 -4.1640765886156785 treat image : temp/1763386829_1110547_1394872024_1c509bf1ebe6f093935b722d0ad0d6b7_rle_crop_4036418983_0.png resize: (210, 629) 1394878271 -3.994311134902746 treat image : temp/1763386829_1110547_1394872024_1c509bf1ebe6f093935b722d0ad0d6b7_rle_crop_4036418984_0.png resize: (434, 675) 1394878272 -4.647379271279513 treat image : temp/1763386829_1110547_1394872024_1c509bf1ebe6f093935b722d0ad0d6b7_rle_crop_4036418987_0.png resize: (297, 767) 1394878273 -2.3443427995957844 treat image : temp/1763386829_1110547_1394871989_5f2a5e8d89ec70b673561fdb5262716b_rle_crop_4036418994_0.png resize: (624, 603) 1394878274 -4.903795437541078 treat image : temp/1763386829_1110547_1394871989_5f2a5e8d89ec70b673561fdb5262716b_rle_crop_4036418999_0.png resize: (116, 167) 1394878275 -3.6956909637462383 treat image : temp/1763386829_1110547_1394871953_829d9909d2c4f5697359241f38644e7b_rle_crop_4036419005_0.png resize: (131, 308) 1394878276 -3.7295496005730207 treat image : temp/1763386829_1110547_1394871953_829d9909d2c4f5697359241f38644e7b_rle_crop_4036419008_0.png resize: (385, 338) 1394878277 -6.262540028481457 treat image : temp/1763386829_1110547_1394871919_9e1b248cd80c2a7b5d0726099d39d0cd_rle_crop_4036419016_0.png resize: (283, 292) 1394878278 -5.094319321671778 treat image : temp/1763386829_1110547_1394871919_9e1b248cd80c2a7b5d0726099d39d0cd_rle_crop_4036419019_0.png resize: (300, 301) 1394878279 -4.366300766505862 treat image : temp/1763386829_1110547_1394871881_2f07c7e07ac15328f346138705c8f261_rle_crop_4036419021_0.png resize: (102, 118) 1394878280 -3.470849633524315 treat image : temp/1763386829_1110547_1394871881_2f07c7e07ac15328f346138705c8f261_rle_crop_4036419023_0.png resize: (96, 123) 1394878281 -4.178859976220025 treat image : temp/1763386829_1110547_1394871823_7af85144ec66701ba8bf692f190d49e3_rle_crop_4036419031_0.png resize: (162, 223) 1394878282 -4.755191578960286 treat image : temp/1763386829_1110547_1394871823_7af85144ec66701ba8bf692f190d49e3_rle_crop_4036419032_0.png resize: (314, 338) 1394878283 -5.438713257984658 treat image : temp/1763386829_1110547_1394871819_10a843a571fa00037655580c11987de8_rle_crop_4036419033_0.png resize: (385, 398) 1394878284 -4.452557371373376 treat image : temp/1763386829_1110547_1394871819_10a843a571fa00037655580c11987de8_rle_crop_4036419037_0.png resize: (230, 336) 1394878285 -3.8323472680031307 treat image : temp/1763386829_1110547_1394871815_0b0dddbd11fc99c619ac316b00bbba99_rle_crop_4036419042_0.png resize: (284, 224) 1394878286 -4.668287458651188 treat image : temp/1763386829_1110547_1394871815_0b0dddbd11fc99c619ac316b00bbba99_rle_crop_4036419043_0.png resize: (671, 392) 1394878287 -4.631182461140444 treat image : temp/1763386829_1110547_1394871815_0b0dddbd11fc99c619ac316b00bbba99_rle_crop_4036419045_0.png resize: (358, 351) 1394878288 -5.028346301121248 treat image : temp/1763386829_1110547_1394871815_0b0dddbd11fc99c619ac316b00bbba99_rle_crop_4036419046_0.png resize: (778, 735) 1394878289 -3.6785221964037045 treat image : temp/1763386829_1110547_1394871815_0b0dddbd11fc99c619ac316b00bbba99_rle_crop_4036419048_0.png resize: (249, 237) 1394878290 -5.518852100362879 treat image : temp/1763386829_1110547_1394871811_9976f91e13a9f9c7e7fac1e0c4ea49a3_rle_crop_4036419050_0.png resize: (307, 623) 1394878291 -5.07820854704864 treat image : temp/1763386829_1110547_1394871811_9976f91e13a9f9c7e7fac1e0c4ea49a3_rle_crop_4036419051_0.png resize: (234, 359) 1394878292 -3.6149449617313936 treat image : temp/1763386829_1110547_1394871811_9976f91e13a9f9c7e7fac1e0c4ea49a3_rle_crop_4036419052_0.png resize: (300, 188) 1394878293 -4.4861635927719075 treat image : temp/1763386829_1110547_1394871811_9976f91e13a9f9c7e7fac1e0c4ea49a3_rle_crop_4036419055_0.png resize: (398, 485) 1394878294 -5.558571846144561 treat image : temp/1763386829_1110547_1394871807_3833afbe7daae65a957b97ae775007db_rle_crop_4036419062_0.png resize: (230, 221) 1394878295 -4.179497454908041 treat image : temp/1763386829_1110547_1394871805_6378ae73bff23ad3f026cc8b098d5a93_rle_crop_4036419070_0.png resize: (560, 423) 1394878296 -6.1493150062744775 treat image : temp/1763386829_1110547_1394871768_6faa535e8d1bb8d8bfbef6b0314deb5f_rle_crop_4036419081_0.png resize: (240, 284) 1394878297 -5.460966831307093 treat image : temp/1763386829_1110547_1394872024_1c509bf1ebe6f093935b722d0ad0d6b7_rle_crop_4036418988_0.png resize: (302, 327) 1394878299 -3.167055749963866 treat image : temp/1763386829_1110547_1394871881_2f07c7e07ac15328f346138705c8f261_rle_crop_4036419020_0.png resize: (176, 267) 1394878300 -3.2708417381992994 treat image : temp/1763386829_1110547_1394871768_6faa535e8d1bb8d8bfbef6b0314deb5f_rle_crop_4036419082_0.png resize: (241, 196) 1394878301 -4.824905559892336 treat image : temp/1763386829_1110547_1394871989_5f2a5e8d89ec70b673561fdb5262716b_rle_crop_4036418998_0.png resize: (190, 465) 1394878302 -3.7799706523987595 treat image : temp/1763386829_1110547_1394872024_1c509bf1ebe6f093935b722d0ad0d6b7_rle_crop_4036418991_0.png resize: (311, 156) 1394878306 -3.6865147994198604 treat image : temp/1763386829_1110547_1394871819_10a843a571fa00037655580c11987de8_rle_crop_4036419040_0.png resize: (344, 404) 1394878308 -5.875310745464983 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 112 time used for this insertion : 0.019067764282226562 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 112 time used for this insertion : 0.03594803810119629 save missing photos in datou_result : time spend for datou_step_exec : 46.531073808670044 time spend to save output : 0.06033182144165039 total time spend for step 6 : 46.591405630111694 step7:brightness Mon Nov 17 14:44:52 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1763386829_1110547_1394872024_1c509bf1ebe6f093935b722d0ad0d6b7.jpg treat image : temp/1763386829_1110547_1394871989_5f2a5e8d89ec70b673561fdb5262716b.jpg treat image : temp/1763386829_1110547_1394871953_829d9909d2c4f5697359241f38644e7b.jpg treat image : temp/1763386829_1110547_1394871919_9e1b248cd80c2a7b5d0726099d39d0cd.jpg treat image : temp/1763386829_1110547_1394871881_2f07c7e07ac15328f346138705c8f261.jpg treat image : temp/1763386829_1110547_1394871823_7af85144ec66701ba8bf692f190d49e3.jpg treat image : temp/1763386829_1110547_1394871819_10a843a571fa00037655580c11987de8.jpg treat image : temp/1763386829_1110547_1394871815_0b0dddbd11fc99c619ac316b00bbba99.jpg treat image : temp/1763386829_1110547_1394871811_9976f91e13a9f9c7e7fac1e0c4ea49a3.jpg treat image : temp/1763386829_1110547_1394871807_3833afbe7daae65a957b97ae775007db.jpg treat image : temp/1763386829_1110547_1394871805_6378ae73bff23ad3f026cc8b098d5a93.jpg treat image : temp/1763386829_1110547_1394871768_6faa535e8d1bb8d8bfbef6b0314deb5f.jpg treat image : temp/1763386829_1110547_1394872024_1c509bf1ebe6f093935b722d0ad0d6b7_rle_crop_4036418985_0.png treat image : temp/1763386829_1110547_1394872024_1c509bf1ebe6f093935b722d0ad0d6b7_rle_crop_4036418986_0.png treat image : temp/1763386829_1110547_1394872024_1c509bf1ebe6f093935b722d0ad0d6b7_rle_crop_4036418989_0.png treat image : temp/1763386829_1110547_1394872024_1c509bf1ebe6f093935b722d0ad0d6b7_rle_crop_4036418990_0.png treat image : temp/1763386829_1110547_1394871989_5f2a5e8d89ec70b673561fdb5262716b_rle_crop_4036418992_0.png treat image : temp/1763386829_1110547_1394871989_5f2a5e8d89ec70b673561fdb5262716b_rle_crop_4036418993_0.png treat image : temp/1763386829_1110547_1394871989_5f2a5e8d89ec70b673561fdb5262716b_rle_crop_4036418995_0.png treat image : temp/1763386829_1110547_1394871989_5f2a5e8d89ec70b673561fdb5262716b_rle_crop_4036418996_0.png treat image : temp/1763386829_1110547_1394871989_5f2a5e8d89ec70b673561fdb5262716b_rle_crop_4036419000_0.png treat image : temp/1763386829_1110547_1394871953_829d9909d2c4f5697359241f38644e7b_rle_crop_4036419001_0.png treat image : temp/1763386829_1110547_1394871953_829d9909d2c4f5697359241f38644e7b_rle_crop_4036419002_0.png treat image : temp/1763386829_1110547_1394871953_829d9909d2c4f5697359241f38644e7b_rle_crop_4036419003_0.png treat image : temp/1763386829_1110547_1394871953_829d9909d2c4f5697359241f38644e7b_rle_crop_4036419004_0.png treat image : temp/1763386829_1110547_1394871953_829d9909d2c4f5697359241f38644e7b_rle_crop_4036419006_0.png treat image : temp/1763386829_1110547_1394871953_829d9909d2c4f5697359241f38644e7b_rle_crop_4036419007_0.png treat image : temp/1763386829_1110547_1394871953_829d9909d2c4f5697359241f38644e7b_rle_crop_4036419009_0.png treat image : temp/1763386829_1110547_1394871953_829d9909d2c4f5697359241f38644e7b_rle_crop_4036419010_0.png treat image : temp/1763386829_1110547_1394871953_829d9909d2c4f5697359241f38644e7b_rle_crop_4036419011_0.png treat image : temp/1763386829_1110547_1394871953_829d9909d2c4f5697359241f38644e7b_rle_crop_4036419012_0.png treat image : temp/1763386829_1110547_1394871919_9e1b248cd80c2a7b5d0726099d39d0cd_rle_crop_4036419013_0.png treat image : temp/1763386829_1110547_1394871919_9e1b248cd80c2a7b5d0726099d39d0cd_rle_crop_4036419018_0.png treat image : temp/1763386829_1110547_1394871881_2f07c7e07ac15328f346138705c8f261_rle_crop_4036419022_0.png treat image : temp/1763386829_1110547_1394871823_7af85144ec66701ba8bf692f190d49e3_rle_crop_4036419024_0.png treat image : temp/1763386829_1110547_1394871823_7af85144ec66701ba8bf692f190d49e3_rle_crop_4036419025_0.png treat image : temp/1763386829_1110547_1394871823_7af85144ec66701ba8bf692f190d49e3_rle_crop_4036419027_0.png treat image : temp/1763386829_1110547_1394871823_7af85144ec66701ba8bf692f190d49e3_rle_crop_4036419029_0.png treat image : temp/1763386829_1110547_1394871823_7af85144ec66701ba8bf692f190d49e3_rle_crop_4036419030_0.png treat image : temp/1763386829_1110547_1394871819_10a843a571fa00037655580c11987de8_rle_crop_4036419034_0.png treat image : temp/1763386829_1110547_1394871819_10a843a571fa00037655580c11987de8_rle_crop_4036419035_0.png treat image : temp/1763386829_1110547_1394871819_10a843a571fa00037655580c11987de8_rle_crop_4036419036_0.png treat image : temp/1763386829_1110547_1394871819_10a843a571fa00037655580c11987de8_rle_crop_4036419038_0.png treat image : temp/1763386829_1110547_1394871815_0b0dddbd11fc99c619ac316b00bbba99_rle_crop_4036419041_0.png treat image : temp/1763386829_1110547_1394871815_0b0dddbd11fc99c619ac316b00bbba99_rle_crop_4036419044_0.png treat image : temp/1763386829_1110547_1394871815_0b0dddbd11fc99c619ac316b00bbba99_rle_crop_4036419047_0.png treat image : temp/1763386829_1110547_1394871811_9976f91e13a9f9c7e7fac1e0c4ea49a3_rle_crop_4036419053_0.png treat image : temp/1763386829_1110547_1394871811_9976f91e13a9f9c7e7fac1e0c4ea49a3_rle_crop_4036419054_0.png treat image : temp/1763386829_1110547_1394871811_9976f91e13a9f9c7e7fac1e0c4ea49a3_rle_crop_4036419056_0.png treat image : temp/1763386829_1110547_1394871811_9976f91e13a9f9c7e7fac1e0c4ea49a3_rle_crop_4036419057_0.png treat image : temp/1763386829_1110547_1394871807_3833afbe7daae65a957b97ae775007db_rle_crop_4036419058_0.png treat image : temp/1763386829_1110547_1394871807_3833afbe7daae65a957b97ae775007db_rle_crop_4036419059_0.png treat image : temp/1763386829_1110547_1394871807_3833afbe7daae65a957b97ae775007db_rle_crop_4036419060_0.png treat image : temp/1763386829_1110547_1394871807_3833afbe7daae65a957b97ae775007db_rle_crop_4036419061_0.png treat image : temp/1763386829_1110547_1394871807_3833afbe7daae65a957b97ae775007db_rle_crop_4036419063_0.png treat image : temp/1763386829_1110547_1394871807_3833afbe7daae65a957b97ae775007db_rle_crop_4036419065_0.png treat image : temp/1763386829_1110547_1394871807_3833afbe7daae65a957b97ae775007db_rle_crop_4036419066_0.png treat image : temp/1763386829_1110547_1394871807_3833afbe7daae65a957b97ae775007db_rle_crop_4036419067_0.png treat image : temp/1763386829_1110547_1394871807_3833afbe7daae65a957b97ae775007db_rle_crop_4036419069_0.png treat image : temp/1763386829_1110547_1394871805_6378ae73bff23ad3f026cc8b098d5a93_rle_crop_4036419071_0.png treat image : temp/1763386829_1110547_1394871805_6378ae73bff23ad3f026cc8b098d5a93_rle_crop_4036419072_0.png treat image : temp/1763386829_1110547_1394871805_6378ae73bff23ad3f026cc8b098d5a93_rle_crop_4036419073_0.png treat image : temp/1763386829_1110547_1394871768_6faa535e8d1bb8d8bfbef6b0314deb5f_rle_crop_4036419076_0.png treat image : temp/1763386829_1110547_1394871768_6faa535e8d1bb8d8bfbef6b0314deb5f_rle_crop_4036419078_0.png treat image : temp/1763386829_1110547_1394871768_6faa535e8d1bb8d8bfbef6b0314deb5f_rle_crop_4036419079_0.png treat image : temp/1763386829_1110547_1394871768_6faa535e8d1bb8d8bfbef6b0314deb5f_rle_crop_4036419080_0.png treat image : temp/1763386829_1110547_1394871919_9e1b248cd80c2a7b5d0726099d39d0cd_rle_crop_4036419015_0.png treat image : temp/1763386829_1110547_1394871919_9e1b248cd80c2a7b5d0726099d39d0cd_rle_crop_4036419017_0.png treat image : temp/1763386829_1110547_1394871823_7af85144ec66701ba8bf692f190d49e3_rle_crop_4036419026_0.png treat image : temp/1763386829_1110547_1394871823_7af85144ec66701ba8bf692f190d49e3_rle_crop_4036419028_0.png treat image : temp/1763386829_1110547_1394871811_9976f91e13a9f9c7e7fac1e0c4ea49a3_rle_crop_4036419049_0.png treat image : temp/1763386829_1110547_1394871807_3833afbe7daae65a957b97ae775007db_rle_crop_4036419064_0.png treat image : temp/1763386829_1110547_1394871807_3833afbe7daae65a957b97ae775007db_rle_crop_4036419068_0.png treat image : temp/1763386829_1110547_1394871805_6378ae73bff23ad3f026cc8b098d5a93_rle_crop_4036419075_0.png treat image : temp/1763386829_1110547_1394871989_5f2a5e8d89ec70b673561fdb5262716b_rle_crop_4036418997_0.png treat image : temp/1763386829_1110547_1394871919_9e1b248cd80c2a7b5d0726099d39d0cd_rle_crop_4036419014_0.png treat image : temp/1763386829_1110547_1394871819_10a843a571fa00037655580c11987de8_rle_crop_4036419039_0.png treat image : temp/1763386829_1110547_1394871805_6378ae73bff23ad3f026cc8b098d5a93_rle_crop_4036419074_0.png treat image : temp/1763386829_1110547_1394871768_6faa535e8d1bb8d8bfbef6b0314deb5f_rle_crop_4036419077_0.png treat image : temp/1763386829_1110547_1394872024_1c509bf1ebe6f093935b722d0ad0d6b7_rle_crop_4036418983_0.png treat image : temp/1763386829_1110547_1394872024_1c509bf1ebe6f093935b722d0ad0d6b7_rle_crop_4036418984_0.png treat image : temp/1763386829_1110547_1394872024_1c509bf1ebe6f093935b722d0ad0d6b7_rle_crop_4036418987_0.png treat image : temp/1763386829_1110547_1394871989_5f2a5e8d89ec70b673561fdb5262716b_rle_crop_4036418994_0.png treat image : temp/1763386829_1110547_1394871989_5f2a5e8d89ec70b673561fdb5262716b_rle_crop_4036418999_0.png treat image : temp/1763386829_1110547_1394871953_829d9909d2c4f5697359241f38644e7b_rle_crop_4036419005_0.png treat image : temp/1763386829_1110547_1394871953_829d9909d2c4f5697359241f38644e7b_rle_crop_4036419008_0.png treat image : temp/1763386829_1110547_1394871919_9e1b248cd80c2a7b5d0726099d39d0cd_rle_crop_4036419016_0.png treat image : temp/1763386829_1110547_1394871919_9e1b248cd80c2a7b5d0726099d39d0cd_rle_crop_4036419019_0.png treat image : temp/1763386829_1110547_1394871881_2f07c7e07ac15328f346138705c8f261_rle_crop_4036419021_0.png treat image : temp/1763386829_1110547_1394871881_2f07c7e07ac15328f346138705c8f261_rle_crop_4036419023_0.png treat image : temp/1763386829_1110547_1394871823_7af85144ec66701ba8bf692f190d49e3_rle_crop_4036419031_0.png treat image : temp/1763386829_1110547_1394871823_7af85144ec66701ba8bf692f190d49e3_rle_crop_4036419032_0.png treat image : temp/1763386829_1110547_1394871819_10a843a571fa00037655580c11987de8_rle_crop_4036419033_0.png treat image : temp/1763386829_1110547_1394871819_10a843a571fa00037655580c11987de8_rle_crop_4036419037_0.png treat image : temp/1763386829_1110547_1394871815_0b0dddbd11fc99c619ac316b00bbba99_rle_crop_4036419042_0.png treat image : temp/1763386829_1110547_1394871815_0b0dddbd11fc99c619ac316b00bbba99_rle_crop_4036419043_0.png treat image : temp/1763386829_1110547_1394871815_0b0dddbd11fc99c619ac316b00bbba99_rle_crop_4036419045_0.png treat image : temp/1763386829_1110547_1394871815_0b0dddbd11fc99c619ac316b00bbba99_rle_crop_4036419046_0.png treat image : temp/1763386829_1110547_1394871815_0b0dddbd11fc99c619ac316b00bbba99_rle_crop_4036419048_0.png treat image : temp/1763386829_1110547_1394871811_9976f91e13a9f9c7e7fac1e0c4ea49a3_rle_crop_4036419050_0.png treat image : temp/1763386829_1110547_1394871811_9976f91e13a9f9c7e7fac1e0c4ea49a3_rle_crop_4036419051_0.png treat image : temp/1763386829_1110547_1394871811_9976f91e13a9f9c7e7fac1e0c4ea49a3_rle_crop_4036419052_0.png treat image : temp/1763386829_1110547_1394871811_9976f91e13a9f9c7e7fac1e0c4ea49a3_rle_crop_4036419055_0.png treat image : temp/1763386829_1110547_1394871807_3833afbe7daae65a957b97ae775007db_rle_crop_4036419062_0.png treat image : temp/1763386829_1110547_1394871805_6378ae73bff23ad3f026cc8b098d5a93_rle_crop_4036419070_0.png treat image : temp/1763386829_1110547_1394871768_6faa535e8d1bb8d8bfbef6b0314deb5f_rle_crop_4036419081_0.png treat image : temp/1763386829_1110547_1394872024_1c509bf1ebe6f093935b722d0ad0d6b7_rle_crop_4036418988_0.png treat image : temp/1763386829_1110547_1394871881_2f07c7e07ac15328f346138705c8f261_rle_crop_4036419020_0.png treat image : temp/1763386829_1110547_1394871768_6faa535e8d1bb8d8bfbef6b0314deb5f_rle_crop_4036419082_0.png treat image : temp/1763386829_1110547_1394871989_5f2a5e8d89ec70b673561fdb5262716b_rle_crop_4036418998_0.png treat image : temp/1763386829_1110547_1394872024_1c509bf1ebe6f093935b722d0ad0d6b7_rle_crop_4036418991_0.png treat image : temp/1763386829_1110547_1394871819_10a843a571fa00037655580c11987de8_rle_crop_4036419040_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 112 time used for this insertion : 0.017770767211914062 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 112 time used for this insertion : 0.029461383819580078 save missing photos in datou_result : time spend for datou_step_exec : 12.218907833099365 time spend to save output : 0.052533626556396484 total time spend for step 7 : 12.271441459655762 step8:velours_tree Mon Nov 17 14:45:04 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.1796400547027588 time spend to save output : 5.269050598144531e-05 total time spend for step 8 : 0.17969274520874023 step9:send_mail_cod Mon Nov 17 14:45:04 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P28609449_17-11-2025_14_45_04.pdf 28609845 change filename to text .imagette286098451763387104 28609847 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette286098471763387104 28609848 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette286098481763387105 28609849 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette286098491763387107 28609850 imagette286098501763387107 28609851 imagette286098511763387107 28609852 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette286098521763387107 28609853 change filename to text .change filename to text .change filename to text .imagette286098531763387109 28609854 imagette286098541763387110 28609855 change filename to text .change filename to text .imagette286098551763387110 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=28609449 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/28609845,28609846,28609847,28609848,28609849,28609850,28609851,28609852,28609853,28609854,28609855?tags=pehd,environnement,carton,pet_clair,metal,flou,background,papier,autre,mal_croppe,pet_fonce args[1394872024] : ((1394872024, -6.132128806503208, 492609224), (1394872024, -0.35497954486811467, 496442774), '0.06271269370498972') We are sending mail with results at report@fotonower.com args[1394871989] : ((1394871989, -7.005873942535524, 492609224), (1394871989, 0.08155474494941974, 2107752395), '0.06271269370498972') We are sending mail with results at report@fotonower.com args[1394871953] : ((1394871953, -7.22821252516008, 492609224), (1394871953, 0.05135510498087468, 2107752395), '0.06271269370498972') We are sending mail with results at report@fotonower.com args[1394871919] : ((1394871919, -6.98797270157772, 492609224), (1394871919, 0.012710698740605151, 2107752395), '0.06271269370498972') We are sending mail with results at report@fotonower.com args[1394871881] : ((1394871881, -7.06761080913555, 492609224), (1394871881, -0.03718331478881872, 2107752395), '0.06271269370498972') We are sending mail with results at report@fotonower.com args[1394871823] : ((1394871823, -6.997738839871621, 492609224), (1394871823, -0.05142651425384372, 2107752395), '0.06271269370498972') We are sending mail with results at report@fotonower.com args[1394871819] : ((1394871819, -7.0133068936851695, 492609224), (1394871819, -0.013950925285647817, 2107752395), '0.06271269370498972') We are sending mail with results at report@fotonower.com args[1394871815] : ((1394871815, -7.042578762156026, 492609224), (1394871815, -0.016222889617899673, 2107752395), '0.06271269370498972') We are sending mail with results at report@fotonower.com args[1394871811] : ((1394871811, -6.980094381286784, 492609224), (1394871811, 0.0629176427433142, 2107752395), '0.06271269370498972') We are sending mail with results at report@fotonower.com args[1394871807] : ((1394871807, -7.080684476982075, 492609224), (1394871807, 0.2134308981974665, 2107752395), '0.06271269370498972') We are sending mail with results at report@fotonower.com args[1394871805] : ((1394871805, -7.146079096026036, 492609224), (1394871805, 0.1955127170929645, 2107752395), '0.06271269370498972') We are sending mail with results at report@fotonower.com args[1394871768] : ((1394871768, -6.481193109291296, 492609224), (1394871768, -0.4014050563120317, 496442774), '0.06271269370498972') We are sending mail with results at report@fotonower.com refus_total : 0.06271269370498972 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos_view ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=28609449 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28609449_17-11-2025_14_45_04.pdf results_Auto_P28609449_17-11-2025_14_45_04.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28609449_17-11-2025_14_45_04.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','28609449','results_Auto_P28609449_17-11-2025_14_45_04.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28609449_17-11-2025_14_45_04.pdf','pdf','','0.88','0.06271269370498972') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/28609449

https://www.fotonower.com/image?json=false&list_photos_id=1394872024
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1394871989
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1394871953
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1394871919
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1394871881
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1394871823
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1394871819
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1394871815
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1394871811
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1394871807
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1394871805
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1394871768
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 6.27%
Veuillez trouver les photos des contaminants.

exemples de contaminants: pehd: https://www.fotonower.com/view/28609845?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/28609847?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/28609848?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/28609849?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/28609852?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/28609853?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/28609855?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28609449_17-11-2025_14_45_04.pdf.

Lien vers velours :https://marlene.fotonower.com/velours/28609845,28609846,28609847,28609848,28609849,28609850,28609851,28609852,28609853,28609854,28609855?tags=pehd,environnement,carton,pet_clair,metal,flou,background,papier,autre,mal_croppe,pet_fonce.


L'équipe Fotonower 202 b'' Date: Mon, 17 Nov 2025 13:45:13 GMT Content-Length: 0 Connection: close Server: nginx X-Message-Id: hQWFY32LT0elSRI_hUfdXQ Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1394872024, 1394871989, 1394871953, 1394871919, 1394871881, 1394871823, 1394871819, 1394871815, 1394871811, 1394871807, 1394871805, 1394871768] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4058354') ('3318', '28609449', '1394872024', None, None, None, None, None, '4058354') ('3318', None, None, None, None, None, None, None, '4058354') ('3318', '28609449', '1394871989', None, None, None, None, None, '4058354') ('3318', None, None, None, None, None, None, None, '4058354') ('3318', '28609449', '1394871953', None, None, None, None, None, '4058354') ('3318', None, None, None, None, None, None, None, '4058354') ('3318', '28609449', '1394871919', None, None, None, None, None, '4058354') ('3318', None, None, None, None, None, None, None, '4058354') ('3318', '28609449', '1394871881', None, None, None, None, None, '4058354') ('3318', None, None, None, None, None, None, None, '4058354') ('3318', '28609449', '1394871823', None, None, None, None, None, '4058354') ('3318', None, None, None, None, None, None, None, '4058354') ('3318', '28609449', '1394871819', None, None, None, None, None, '4058354') ('3318', None, None, None, None, None, None, None, '4058354') ('3318', '28609449', '1394871815', None, None, None, None, None, '4058354') ('3318', None, None, None, None, None, None, None, '4058354') ('3318', '28609449', '1394871811', None, None, None, None, None, '4058354') ('3318', None, None, None, None, None, None, None, '4058354') ('3318', '28609449', '1394871807', None, None, None, None, None, '4058354') ('3318', None, None, None, None, None, None, None, '4058354') ('3318', '28609449', '1394871805', None, None, None, None, None, '4058354') ('3318', None, None, None, None, None, None, None, '4058354') ('3318', '28609449', '1394871768', None, None, None, None, None, '4058354') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.02425980567932129 save_final save missing photos in datou_result : time spend for datou_step_exec : 9.217726469039917 time spend to save output : 0.024480342864990234 total time spend for step 9 : 9.242206811904907 step10:split_time_score Mon Nov 17 14:45:13 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('13', 2), ('14', 10)) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 17112025 28609449 Nombre de photos uploadées : 12 / 23040 (0%) 17112025 28609449 Nombre de photos taguées (types de déchets): 0 / 12 (0%) 17112025 28609449 Nombre de photos taguées (volume) : 0 / 12 (0%) elapsed_time : load_data_split_time_score 2.86102294921875e-06 elapsed_time : order_list_meta_photo_and_scores 7.867813110351562e-06 ???????????? elapsed_time : fill_and_build_computed_from_old_data 0.0006520748138427734 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.2206113338470459 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.024263243577165507 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28602005_17-11-2025_11_14_15.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28602005 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28602005 AND mptpi.`type`=3726 To do Qualite : 0.08495215647505143 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28598196_17-11-2025_09_43_18.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28598196 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28598196 AND mptpi.`type`=3594 To do Qualite : 0.016410011398527536 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28605874_17-11-2025_12_38_46.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28605874 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28605874 AND mptpi.`type`=3726 To do Qualite : 0.07625585401663237 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28608156_17-11-2025_14_14_19.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28608156 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28608156 AND mptpi.`type`=3594 To do Qualite : 0.06271269370498972 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28609449_17-11-2025_14_45_04.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28609449 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28609449 AND mptpi.`type`=3594 To do Qualite : 0.021889538143323943 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28609453_17-11-2025_14_38_14.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28609453 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28609453 AND mptpi.`type`=3726 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'17112025': {'nb_upload': 12, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1394872024, 1394871989, 1394871953, 1394871919, 1394871881, 1394871823, 1394871819, 1394871815, 1394871811, 1394871807, 1394871805, 1394871768] Looping around the photos to save general results len do output : 1 /28609449Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4058354') ('3318', '28609449', '1394872024', None, None, None, None, None, '4058354') ('3318', None, None, None, None, None, None, None, '4058354') ('3318', '28609449', '1394871989', None, None, None, None, None, '4058354') ('3318', None, None, None, None, None, None, None, '4058354') ('3318', '28609449', '1394871953', None, None, None, None, None, '4058354') ('3318', None, None, None, None, None, None, None, '4058354') ('3318', '28609449', '1394871919', None, None, None, None, None, '4058354') ('3318', None, None, None, None, None, None, None, '4058354') ('3318', '28609449', '1394871881', None, None, None, None, None, '4058354') ('3318', None, None, None, None, None, None, None, '4058354') ('3318', '28609449', '1394871823', None, None, None, None, None, '4058354') ('3318', None, None, None, None, None, None, None, '4058354') ('3318', '28609449', '1394871819', None, None, None, None, None, '4058354') ('3318', None, None, None, None, None, None, None, '4058354') ('3318', '28609449', '1394871815', None, None, None, None, None, '4058354') ('3318', None, None, None, None, None, None, None, '4058354') ('3318', '28609449', '1394871811', None, None, None, None, None, '4058354') ('3318', None, None, None, None, None, None, None, '4058354') ('3318', '28609449', '1394871807', None, None, None, None, None, '4058354') ('3318', None, None, None, None, None, None, None, '4058354') ('3318', '28609449', '1394871805', None, None, None, None, None, '4058354') ('3318', None, None, None, None, None, None, None, '4058354') ('3318', '28609449', '1394871768', None, None, None, None, None, '4058354') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 13 time used for this insertion : 0.01846766471862793 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.848200798034668 time spend to save output : 0.01870560646057129 total time spend for step 10 : 0.8669064044952393 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 12 set_done_treatment 138.86user 112.09system 4:48.56elapsed 86%CPU (0avgtext+0avgdata 4936060maxresident)k 743552inputs+143152outputs (11654major+13760554minor)pagefaults 0swaps