python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 4136436 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3669705'] with mtr_portfolio_ids : ['26574891'] and first list_photo_ids : [] new path : /proc/4136436/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 32 ; length of list_pids : 32 ; length of list_args : 32 time to download the photos : 4.207200050354004 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Fri Sep 5 12:10:34 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10375 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-09-05 12:10:37.280029: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-09-05 12:10:37.288159: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3492910000 Hz 2025-09-05 12:10:37.289694: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fb23c000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-09-05 12:10:37.289746: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-09-05 12:10:37.292786: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-09-05 12:10:37.489926: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x13318a80 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-09-05 12:10:37.489979: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-09-05 12:10:37.491416: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-05 12:10:37.491831: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-05 12:10:37.494942: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-05 12:10:37.497855: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-05 12:10:37.498250: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-05 12:10:37.500908: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-05 12:10:37.502232: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-05 12:10:37.507574: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-05 12:10:37.509389: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-05 12:10:37.509466: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-05 12:10:37.510211: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-05 12:10:37.510227: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-05 12:10:37.510235: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-05 12:10:37.511899: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9466 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-09-05 12:10:37.859296: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-05 12:10:37.859414: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-05 12:10:37.859441: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-05 12:10:37.859466: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-05 12:10:37.859490: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-05 12:10:37.859513: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-05 12:10:37.859537: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-05 12:10:37.859560: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-05 12:10:37.861287: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-05 12:10:37.862988: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-05 12:10:37.863060: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-05 12:10:37.863089: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-05 12:10:37.863115: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-05 12:10:37.863142: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-05 12:10:37.863167: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-05 12:10:37.863193: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-05 12:10:37.863219: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-05 12:10:37.864934: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-05 12:10:37.864979: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-05 12:10:37.864993: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-05 12:10:37.865005: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-05 12:10:37.866786: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9466 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-09-05 12:10:48.684995: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-05 12:10:49.017054: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 32 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 33.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 33.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 31.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 15 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 33.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 14 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 31.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 22.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 14 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 19 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 22.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 15.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 32.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 15.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 14 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 41.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 8.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 32.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 10.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 34.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 18 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 17.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 17 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 40.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 35.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 32.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 35.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 22.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 33.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 34.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 35.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 11 Detection mask done ! Trying to reset tf kernel 4137104 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 112 tf kernel not reseted sub process len(results) : 32 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 32 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5401 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0005850791931152344 nb_pixel_total : 11092 time to create 1 rle with old method : 0.014823198318481445 length of segment : 118 time for calcul the mask position with numpy : 0.00047087669372558594 nb_pixel_total : 12178 time to create 1 rle with old method : 0.01416635513305664 length of segment : 136 time for calcul the mask position with numpy : 0.00024890899658203125 nb_pixel_total : 8276 time to create 1 rle with old method : 0.009458303451538086 length of segment : 114 time for calcul the mask position with numpy : 0.00025725364685058594 nb_pixel_total : 6715 time to create 1 rle with old method : 0.0077059268951416016 length of segment : 155 time for calcul the mask position with numpy : 0.0002696514129638672 nb_pixel_total : 10870 time to create 1 rle with old method : 0.013292551040649414 length of segment : 114 time for calcul the mask position with numpy : 0.0003845691680908203 nb_pixel_total : 11668 time to create 1 rle with old method : 0.01364445686340332 length of segment : 126 time for calcul the mask position with numpy : 0.0005397796630859375 nb_pixel_total : 14347 time to create 1 rle with old method : 0.017850637435913086 length of segment : 152 time for calcul the mask position with numpy : 0.0002300739288330078 nb_pixel_total : 6919 time to create 1 rle with old method : 0.008181333541870117 length of segment : 70 time for calcul the mask position with numpy : 0.00026297569274902344 nb_pixel_total : 6777 time to create 1 rle with old method : 0.007980108261108398 length of segment : 81 time for calcul the mask position with numpy : 0.0003712177276611328 nb_pixel_total : 7710 time to create 1 rle with old method : 0.008895635604858398 length of segment : 91 time for calcul the mask position with numpy : 0.0001823902130126953 nb_pixel_total : 7706 time to create 1 rle with old method : 0.009241580963134766 length of segment : 63 time for calcul the mask position with numpy : 0.00026679039001464844 nb_pixel_total : 7096 time to create 1 rle with old method : 0.011783838272094727 length of segment : 97 time for calcul the mask position with numpy : 0.014897346496582031 nb_pixel_total : 659074 time to create 1 rle with new method : 0.08282661437988281 length of segment : 986 time for calcul the mask position with numpy : 0.0005075931549072266 nb_pixel_total : 12316 time to create 1 rle with old method : 0.014039754867553711 length of segment : 212 time for calcul the mask position with numpy : 0.000225067138671875 nb_pixel_total : 6412 time to create 1 rle with old method : 0.007908821105957031 length of segment : 85 time for calcul the mask position with numpy : 0.0005424022674560547 nb_pixel_total : 27597 time to create 1 rle with old method : 0.032717227935791016 length of segment : 220 time for calcul the mask position with numpy : 0.0012011528015136719 nb_pixel_total : 43424 time to create 1 rle with old method : 0.049669504165649414 length of segment : 226 time for calcul the mask position with numpy : 0.003771543502807617 nb_pixel_total : 96732 time to create 1 rle with old method : 0.11055254936218262 length of segment : 545 time for calcul the mask position with numpy : 0.00028133392333984375 nb_pixel_total : 9378 time to create 1 rle with old method : 0.011185646057128906 length of segment : 118 time for calcul the mask position with numpy : 0.0003466606140136719 nb_pixel_total : 15452 time to create 1 rle with old method : 0.0181732177734375 length of segment : 160 time for calcul the mask position with numpy : 0.0002288818359375 nb_pixel_total : 4113 time to create 1 rle with old method : 0.00495457649230957 length of segment : 71 time for calcul the mask position with numpy : 0.0002720355987548828 nb_pixel_total : 15668 time to create 1 rle with old method : 0.017766237258911133 length of segment : 157 time for calcul the mask position with numpy : 0.00019049644470214844 nb_pixel_total : 9685 time to create 1 rle with old method : 0.011468648910522461 length of segment : 131 time for calcul the mask position with numpy : 0.0002467632293701172 nb_pixel_total : 3946 time to create 1 rle with old method : 0.004697084426879883 length of segment : 103 time for calcul the mask position with numpy : 0.000244140625 nb_pixel_total : 5553 time to create 1 rle with old method : 0.006682157516479492 length of segment : 132 time for calcul the mask position with numpy : 0.00028395652770996094 nb_pixel_total : 7299 time to create 1 rle with old method : 0.008797407150268555 length of segment : 80 time for calcul the mask position with numpy : 0.0008449554443359375 nb_pixel_total : 29769 time to create 1 rle with old method : 0.03530454635620117 length of segment : 149 time for calcul the mask position with numpy : 0.0001723766326904297 nb_pixel_total : 2298 time to create 1 rle with old method : 0.0027871131896972656 length of segment : 74 time for calcul the mask position with numpy : 0.00022554397583007812 nb_pixel_total : 6927 time to create 1 rle with old method : 0.008255481719970703 length of segment : 100 time for calcul the mask position with numpy : 0.0005545616149902344 nb_pixel_total : 16119 time to create 1 rle with old method : 0.01873493194580078 length of segment : 150 time for calcul the mask position with numpy : 0.00034427642822265625 nb_pixel_total : 7207 time to create 1 rle with old method : 0.008891820907592773 length of segment : 103 time for calcul the mask position with numpy : 0.0001842975616455078 nb_pixel_total : 4811 time to create 1 rle with old method : 0.0058519840240478516 length of segment : 91 time for calcul the mask position with numpy : 0.0001735687255859375 nb_pixel_total : 5565 time to create 1 rle with old method : 0.006608724594116211 length of segment : 73 time for calcul the mask position with numpy : 0.00043201446533203125 nb_pixel_total : 13470 time to create 1 rle with old method : 0.01571965217590332 length of segment : 118 time for calcul the mask position with numpy : 0.0005183219909667969 nb_pixel_total : 12476 time to create 1 rle with old method : 0.014683723449707031 length of segment : 147 time for calcul the mask position with numpy : 0.0005924701690673828 nb_pixel_total : 17321 time to create 1 rle with old method : 0.019883394241333008 length of segment : 201 time for calcul the mask position with numpy : 0.00033211708068847656 nb_pixel_total : 5530 time to create 1 rle with old method : 0.006998300552368164 length of segment : 86 time for calcul the mask position with numpy : 0.0004119873046875 nb_pixel_total : 9768 time to create 1 rle with old method : 0.011789798736572266 length of segment : 115 time for calcul the mask position with numpy : 0.00031638145446777344 nb_pixel_total : 3952 time to create 1 rle with old method : 0.00491642951965332 length of segment : 98 time for calcul the mask position with numpy : 0.0006039142608642578 nb_pixel_total : 14906 time to create 1 rle with old method : 0.017206430435180664 length of segment : 178 time for calcul the mask position with numpy : 0.00033664703369140625 nb_pixel_total : 8512 time to create 1 rle with old method : 0.009914159774780273 length of segment : 142 time for calcul the mask position with numpy : 0.00035381317138671875 nb_pixel_total : 6818 time to create 1 rle with old method : 0.008061408996582031 length of segment : 118 time for calcul the mask position with numpy : 0.0002605915069580078 nb_pixel_total : 6375 time to create 1 rle with old method : 0.007714986801147461 length of segment : 73 time for calcul the mask position with numpy : 0.0002701282501220703 nb_pixel_total : 7535 time to create 1 rle with old method : 0.008838415145874023 length of segment : 82 time for calcul the mask position with numpy : 0.0007865428924560547 nb_pixel_total : 23481 time to create 1 rle with old method : 0.027797698974609375 length of segment : 202 time for calcul the mask position with numpy : 0.00039458274841308594 nb_pixel_total : 9986 time to create 1 rle with old method : 0.011688947677612305 length of segment : 73 time for calcul the mask position with numpy : 0.00019621849060058594 nb_pixel_total : 7285 time to create 1 rle with old method : 0.00874948501586914 length of segment : 83 time for calcul the mask position with numpy : 0.00013971328735351562 nb_pixel_total : 5123 time to create 1 rle with old method : 0.006183624267578125 length of segment : 59 time for calcul the mask position with numpy : 0.00047969818115234375 nb_pixel_total : 8411 time to create 1 rle with old method : 0.009820699691772461 length of segment : 112 time for calcul the mask position with numpy : 0.000476837158203125 nb_pixel_total : 11090 time to create 1 rle with old method : 0.012985944747924805 length of segment : 147 time for calcul the mask position with numpy : 0.0005433559417724609 nb_pixel_total : 17980 time to create 1 rle with old method : 0.020461082458496094 length of segment : 228 time for calcul the mask position with numpy : 0.0002429485321044922 nb_pixel_total : 4916 time to create 1 rle with old method : 0.005843400955200195 length of segment : 87 time for calcul the mask position with numpy : 0.00031638145446777344 nb_pixel_total : 6648 time to create 1 rle with old method : 0.007987260818481445 length of segment : 95 time for calcul the mask position with numpy : 0.0002849102020263672 nb_pixel_total : 4893 time to create 1 rle with old method : 0.005814552307128906 length of segment : 95 time for calcul the mask position with numpy : 0.00021147727966308594 nb_pixel_total : 4206 time to create 1 rle with old method : 0.0049703121185302734 length of segment : 97 time for calcul the mask position with numpy : 0.0008418560028076172 nb_pixel_total : 23054 time to create 1 rle with old method : 0.030071496963500977 length of segment : 193 time for calcul the mask position with numpy : 0.0003917217254638672 nb_pixel_total : 10836 time to create 1 rle with old method : 0.01294398307800293 length of segment : 119 time for calcul the mask position with numpy : 0.0003235340118408203 nb_pixel_total : 7976 time to create 1 rle with old method : 0.010608196258544922 length of segment : 110 time for calcul the mask position with numpy : 0.0005826950073242188 nb_pixel_total : 15154 time to create 1 rle with old method : 0.01832127571105957 length of segment : 192 time for calcul the mask position with numpy : 0.0009539127349853516 nb_pixel_total : 30564 time to create 1 rle with old method : 0.035436391830444336 length of segment : 175 time for calcul the mask position with numpy : 0.000308990478515625 nb_pixel_total : 5801 time to create 1 rle with old method : 0.008216381072998047 length of segment : 116 time for calcul the mask position with numpy : 0.0018510818481445312 nb_pixel_total : 64829 time to create 1 rle with old method : 0.07401537895202637 length of segment : 277 time for calcul the mask position with numpy : 0.0012061595916748047 nb_pixel_total : 50525 time to create 1 rle with old method : 0.05682229995727539 length of segment : 294 time for calcul the mask position with numpy : 0.00013780593872070312 nb_pixel_total : 5136 time to create 1 rle with old method : 0.00596308708190918 length of segment : 75 time for calcul the mask position with numpy : 0.00019097328186035156 nb_pixel_total : 5816 time to create 1 rle with old method : 0.006718873977661133 length of segment : 64 time for calcul the mask position with numpy : 0.00015878677368164062 nb_pixel_total : 4878 time to create 1 rle with old method : 0.005774736404418945 length of segment : 83 time for calcul the mask position with numpy : 0.00011992454528808594 nb_pixel_total : 4225 time to create 1 rle with old method : 0.005094766616821289 length of segment : 56 time for calcul the mask position with numpy : 0.0003726482391357422 nb_pixel_total : 12961 time to create 1 rle with old method : 0.01520085334777832 length of segment : 105 time for calcul the mask position with numpy : 0.00022172927856445312 nb_pixel_total : 6039 time to create 1 rle with old method : 0.007202863693237305 length of segment : 72 time for calcul the mask position with numpy : 0.0005767345428466797 nb_pixel_total : 15802 time to create 1 rle with old method : 0.018410921096801758 length of segment : 161 time for calcul the mask position with numpy : 0.00020194053649902344 nb_pixel_total : 3678 time to create 1 rle with old method : 0.004385709762573242 length of segment : 79 time for calcul the mask position with numpy : 0.005963802337646484 nb_pixel_total : 201208 time to create 1 rle with new method : 0.009074926376342773 length of segment : 483 time for calcul the mask position with numpy : 0.0002353191375732422 nb_pixel_total : 8312 time to create 1 rle with old method : 0.00959920883178711 length of segment : 156 time for calcul the mask position with numpy : 0.0003082752227783203 nb_pixel_total : 10139 time to create 1 rle with old method : 0.011883735656738281 length of segment : 98 time for calcul the mask position with numpy : 0.0012395381927490234 nb_pixel_total : 40047 time to create 1 rle with old method : 0.047872304916381836 length of segment : 344 time for calcul the mask position with numpy : 0.00021767616271972656 nb_pixel_total : 4475 time to create 1 rle with old method : 0.005227088928222656 length of segment : 83 time for calcul the mask position with numpy : 0.000301361083984375 nb_pixel_total : 6290 time to create 1 rle with old method : 0.007430315017700195 length of segment : 139 time for calcul the mask position with numpy : 0.0002410411834716797 nb_pixel_total : 8213 time to create 1 rle with old method : 0.009541749954223633 length of segment : 82 time for calcul the mask position with numpy : 0.00023245811462402344 nb_pixel_total : 5088 time to create 1 rle with old method : 0.006106376647949219 length of segment : 81 time for calcul the mask position with numpy : 0.00043129920959472656 nb_pixel_total : 11287 time to create 1 rle with old method : 0.013111114501953125 length of segment : 117 time for calcul the mask position with numpy : 0.0004162788391113281 nb_pixel_total : 14640 time to create 1 rle with old method : 0.01708197593688965 length of segment : 161 time for calcul the mask position with numpy : 0.0006923675537109375 nb_pixel_total : 25066 time to create 1 rle with old method : 0.028625965118408203 length of segment : 148 time for calcul the mask position with numpy : 0.002306222915649414 nb_pixel_total : 114588 time to create 1 rle with old method : 0.12866950035095215 length of segment : 551 time for calcul the mask position with numpy : 0.0007832050323486328 nb_pixel_total : 21017 time to create 1 rle with old method : 0.023869991302490234 length of segment : 161 time for calcul the mask position with numpy : 0.0006139278411865234 nb_pixel_total : 16483 time to create 1 rle with old method : 0.019009113311767578 length of segment : 178 time for calcul the mask position with numpy : 0.003198385238647461 nb_pixel_total : 97121 time to create 1 rle with old method : 0.11052203178405762 length of segment : 519 time for calcul the mask position with numpy : 0.00028061866760253906 nb_pixel_total : 6089 time to create 1 rle with old method : 0.006980180740356445 length of segment : 108 time for calcul the mask position with numpy : 0.0006041526794433594 nb_pixel_total : 17235 time to create 1 rle with old method : 0.01993536949157715 length of segment : 155 time for calcul the mask position with numpy : 0.0008854866027832031 nb_pixel_total : 23459 time to create 1 rle with old method : 0.026944637298583984 length of segment : 327 time for calcul the mask position with numpy : 0.0004684925079345703 nb_pixel_total : 10778 time to create 1 rle with old method : 0.013159513473510742 length of segment : 134 time for calcul the mask position with numpy : 0.0010845661163330078 nb_pixel_total : 36735 time to create 1 rle with old method : 0.04310274124145508 length of segment : 256 time for calcul the mask position with numpy : 0.0004971027374267578 nb_pixel_total : 5415 time to create 1 rle with old method : 0.006596803665161133 length of segment : 104 time for calcul the mask position with numpy : 0.002752065658569336 nb_pixel_total : 98804 time to create 1 rle with old method : 0.11473870277404785 length of segment : 521 time for calcul the mask position with numpy : 0.0005502700805664062 nb_pixel_total : 15257 time to create 1 rle with old method : 0.01743483543395996 length of segment : 132 time for calcul the mask position with numpy : 0.00019669532775878906 nb_pixel_total : 2533 time to create 1 rle with old method : 0.0031349658966064453 length of segment : 70 time for calcul the mask position with numpy : 0.0007975101470947266 nb_pixel_total : 25446 time to create 1 rle with old method : 0.029752731323242188 length of segment : 229 time for calcul the mask position with numpy : 0.0002760887145996094 nb_pixel_total : 3955 time to create 1 rle with old method : 0.004582405090332031 length of segment : 122 time for calcul the mask position with numpy : 0.00043511390686035156 nb_pixel_total : 14365 time to create 1 rle with old method : 0.016614675521850586 length of segment : 184 time for calcul the mask position with numpy : 0.0004229545593261719 nb_pixel_total : 15305 time to create 1 rle with old method : 0.017612695693969727 length of segment : 165 time for calcul the mask position with numpy : 0.0003666877746582031 nb_pixel_total : 7320 time to create 1 rle with old method : 0.008443832397460938 length of segment : 173 time for calcul the mask position with numpy : 0.00043964385986328125 nb_pixel_total : 6010 time to create 1 rle with old method : 0.007304668426513672 length of segment : 121 time for calcul the mask position with numpy : 0.002650022506713867 nb_pixel_total : 98066 time to create 1 rle with old method : 0.11165308952331543 length of segment : 580 time for calcul the mask position with numpy : 0.0006420612335205078 nb_pixel_total : 24702 time to create 1 rle with old method : 0.028342008590698242 length of segment : 220 time for calcul the mask position with numpy : 0.0006701946258544922 nb_pixel_total : 25030 time to create 1 rle with old method : 0.028871774673461914 length of segment : 170 time for calcul the mask position with numpy : 0.00018835067749023438 nb_pixel_total : 6143 time to create 1 rle with old method : 0.007131338119506836 length of segment : 97 time for calcul the mask position with numpy : 0.0004901885986328125 nb_pixel_total : 12270 time to create 1 rle with old method : 0.014039754867553711 length of segment : 188 time for calcul the mask position with numpy : 0.00010561943054199219 nb_pixel_total : 1449 time to create 1 rle with old method : 0.0018990039825439453 length of segment : 24 time for calcul the mask position with numpy : 0.0003495216369628906 nb_pixel_total : 10776 time to create 1 rle with old method : 0.012569189071655273 length of segment : 137 time for calcul the mask position with numpy : 0.0008194446563720703 nb_pixel_total : 34044 time to create 1 rle with old method : 0.03876614570617676 length of segment : 164 time for calcul the mask position with numpy : 0.00034046173095703125 nb_pixel_total : 9776 time to create 1 rle with old method : 0.013823509216308594 length of segment : 164 time for calcul the mask position with numpy : 0.0013725757598876953 nb_pixel_total : 47642 time to create 1 rle with old method : 0.06528973579406738 length of segment : 180 time for calcul the mask position with numpy : 0.0002624988555908203 nb_pixel_total : 7770 time to create 1 rle with old method : 0.009029626846313477 length of segment : 109 time for calcul the mask position with numpy : 0.0007617473602294922 nb_pixel_total : 36367 time to create 1 rle with old method : 0.05594992637634277 length of segment : 200 time for calcul the mask position with numpy : 0.0002808570861816406 nb_pixel_total : 5978 time to create 1 rle with old method : 0.0076367855072021484 length of segment : 73 time for calcul the mask position with numpy : 0.0005850791931152344 nb_pixel_total : 23813 time to create 1 rle with old method : 0.02802896499633789 length of segment : 160 time for calcul the mask position with numpy : 0.0004458427429199219 nb_pixel_total : 10512 time to create 1 rle with old method : 0.011987686157226562 length of segment : 189 time for calcul the mask position with numpy : 0.00026988983154296875 nb_pixel_total : 4672 time to create 1 rle with old method : 0.005634307861328125 length of segment : 98 time for calcul the mask position with numpy : 0.00028705596923828125 nb_pixel_total : 5820 time to create 1 rle with old method : 0.0069506168365478516 length of segment : 100 time for calcul the mask position with numpy : 0.0005161762237548828 nb_pixel_total : 15376 time to create 1 rle with old method : 0.017759323120117188 length of segment : 186 time for calcul the mask position with numpy : 0.0013418197631835938 nb_pixel_total : 58031 time to create 1 rle with old method : 0.06604909896850586 length of segment : 240 time for calcul the mask position with numpy : 0.0031325817108154297 nb_pixel_total : 85833 time to create 1 rle with old method : 0.0959482192993164 length of segment : 526 time for calcul the mask position with numpy : 0.0008645057678222656 nb_pixel_total : 17854 time to create 1 rle with old method : 0.02216815948486328 length of segment : 191 time for calcul the mask position with numpy : 0.00044465065002441406 nb_pixel_total : 5845 time to create 1 rle with old method : 0.006839752197265625 length of segment : 146 time for calcul the mask position with numpy : 0.0033359527587890625 nb_pixel_total : 97821 time to create 1 rle with old method : 0.11745309829711914 length of segment : 539 time for calcul the mask position with numpy : 0.0003333091735839844 nb_pixel_total : 3574 time to create 1 rle with old method : 0.00447845458984375 length of segment : 76 time for calcul the mask position with numpy : 0.0007197856903076172 nb_pixel_total : 12943 time to create 1 rle with old method : 0.015789508819580078 length of segment : 250 time for calcul the mask position with numpy : 0.0006585121154785156 nb_pixel_total : 17720 time to create 1 rle with old method : 0.020599365234375 length of segment : 176 time spent for convertir_results : 6.745992422103882 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 127 chid ids of type : 3594 Number RLEs to save : 21375 save missing photos in datou_result : time spend for datou_step_exec : 50.824222564697266 time spend to save output : 1.3798089027404785 total time spend for step 1 : 52.204031467437744 step2:crop_condition Fri Sep 5 12:11:26 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 32 ! batch 1 Loaded 127 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 56 About to insert : list_path_to_insert length 56 new photo from crops ! About to upload 56 photos upload in portfolio : 3736932 init cache_photo without model_param we have 56 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757067090_4136436 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 56 photos in the portfolio 3736932 time of upload the photos Elapsed time : 19.278295040130615 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 9 About to insert : list_path_to_insert length 9 new photo from crops ! About to upload 9 photos upload in portfolio : 3736932 init cache_photo without model_param we have 9 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757067114_4136436 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 9 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.57511568069458 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757067117_4136436 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 3.8076837062835693 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 41 About to insert : list_path_to_insert length 41 new photo from crops ! About to upload 41 photos upload in portfolio : 3736932 init cache_photo without model_param we have 41 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757067128_4136436 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 41 photos in the portfolio 3736932 time of upload the photos Elapsed time : 11.074918746948242 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 10 About to insert : list_path_to_insert length 10 new photo from crops ! About to upload 10 photos upload in portfolio : 3736932 init cache_photo without model_param we have 10 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757067140_4136436 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 10 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.8440942764282227 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757067144_4136436 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.8473320007324219 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 6 About to insert : list_path_to_insert length 6 new photo from crops ! About to upload 6 photos upload in portfolio : 3736932 init cache_photo without model_param we have 6 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757067146_4136436 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 6 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.7310214042663574 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1381701805, 1381701792, 1381701784, 1381701755, 1381701752, 1381701502, 1381701477, 1381701439, 1381701386, 1381701369, 1381701356, 1381701141, 1381701030, 1381700966, 1381700824, 1381700370, 1381700316, 1381700233, 1381700165, 1381700117, 1381700060, 1381699858, 1381699830, 1381699798, 1381699778, 1381699751, 1381699726, 1381699518, 1381699503, 1381699478, 1381699445, 1381699431] Looping around the photos to save general results len do output : 127 /1381717708Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717709Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717711Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717712Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717713Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717714Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717716Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717717Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717718Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717720Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717721Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717722Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717723Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717725Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717726Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717727Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717729Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717730Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717731Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717733Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717734Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717735Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717736Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717738Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717739Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717740Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717742Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717743Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717744Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717745Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717747Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717748Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717749Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717751Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717753Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717754Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717756Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717758Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717759Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717760Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717762Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717764Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717765Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717767Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717769Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717770Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717771Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717773Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717775Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717776Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717778Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717780Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717781Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717782Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717784Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717786Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717835Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717837Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717838Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717839Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717840Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717841Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717842Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717843Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717844Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717849Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717851Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717852Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717968Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717969Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717971Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717972Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717973Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717975Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717976Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717977Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717979Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717980Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717981Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717982Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717984Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717985Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717986Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717988Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717989Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717990Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717991Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717993Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717994Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717995Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717996Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717997Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717998Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381717999Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381718000Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381718001Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381718002Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381718003Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381718004Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381718005Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381718006Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381718007Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381718008Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381718009Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381718010Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381718011Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381718012Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381718013Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381718014Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381718019Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381718020Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381718021Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381718022Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381718023Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381718024Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381718025Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381718026Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381718027Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381718028Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381718033Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381718034Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381718037Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381718038Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381718039Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381718040Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381718041Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381718042Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701805', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701792', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701784', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701755', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701752', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701502', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701477', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701439', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701386', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701369', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701356', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701141', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701030', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381700966', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381700824', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381700370', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381700316', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381700233', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381700165', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381700117', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381700060', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381699858', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381699830', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381699798', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381699778', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381699751', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381699726', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381699518', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381699503', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381699478', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381699445', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381699431', None, None, None, None, None, '3669705') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 413 time used for this insertion : 0.02930617332458496 save_final save missing photos in datou_result : time spend for datou_step_exec : 61.52120327949524 time spend to save output : 0.03428339958190918 total time spend for step 2 : 61.55548667907715 step3:rle_unique_nms_with_priority Fri Sep 5 12:12:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 127 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 3 nb_hashtags : 3 time to prepare the origin masks : 0.2801375389099121 time for calcul the mask position with numpy : 0.13111424446105957 nb_pixel_total : 2042054 time to create 1 rle with new method : 0.08556103706359863 time for calcul the mask position with numpy : 0.008348941802978516 nb_pixel_total : 8276 time to create 1 rle with old method : 0.008924484252929688 time for calcul the mask position with numpy : 0.008815526962280273 nb_pixel_total : 12178 time to create 1 rle with old method : 0.014003515243530273 time for calcul the mask position with numpy : 0.009016036987304688 nb_pixel_total : 11092 time to create 1 rle with old method : 0.011959552764892578 create new chi : 0.2783834934234619 time to delete rle : 0.013851642608642578 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1816 TO DO : save crop sub photo not yet done ! save time : 0.14500880241394043 nb_obj : 4 nb_hashtags : 1 time to prepare the origin masks : 0.11077690124511719 time for calcul the mask position with numpy : 0.025971412658691406 nb_pixel_total : 2030000 time to create 1 rle with new method : 0.030366182327270508 time for calcul the mask position with numpy : 0.006542682647705078 nb_pixel_total : 14347 time to create 1 rle with old method : 0.01619553565979004 time for calcul the mask position with numpy : 0.007488250732421875 nb_pixel_total : 11668 time to create 1 rle with old method : 0.024296283721923828 time for calcul the mask position with numpy : 0.008292913436889648 nb_pixel_total : 10870 time to create 1 rle with old method : 0.013585805892944336 time for calcul the mask position with numpy : 0.006215572357177734 nb_pixel_total : 6715 time to create 1 rle with old method : 0.007493495941162109 create new chi : 0.1469271183013916 time to delete rle : 0.00035119056701660156 batch 1 Loaded 9 chid ids of type : 3594 +++++++Number RLEs to save : 2174 TO DO : save crop sub photo not yet done ! save time : 0.16552162170410156 nb_obj : 6 nb_hashtags : 4 time to prepare the origin masks : 0.08692598342895508 time for calcul the mask position with numpy : 0.035614728927612305 nb_pixel_total : 1385516 time to create 1 rle with new method : 0.11343812942504883 time for calcul the mask position with numpy : 0.013428211212158203 nb_pixel_total : 651876 time to create 1 rle with new method : 0.043487548828125 time for calcul the mask position with numpy : 0.007635831832885742 nb_pixel_total : 7096 time to create 1 rle with old method : 0.011571884155273438 time for calcul the mask position with numpy : 0.007974386215209961 nb_pixel_total : 7706 time to create 1 rle with old method : 0.012613058090209961 time for calcul the mask position with numpy : 0.00769805908203125 nb_pixel_total : 7710 time to create 1 rle with old method : 0.013982534408569336 time for calcul the mask position with numpy : 0.007524251937866211 nb_pixel_total : 6777 time to create 1 rle with old method : 0.011153697967529297 time for calcul the mask position with numpy : 0.00750422477722168 nb_pixel_total : 6919 time to create 1 rle with old method : 0.007769584655761719 create new chi : 0.3023374080657959 time to delete rle : 0.0008802413940429688 batch 1 Loaded 13 chid ids of type : 3594 ++++++Number RLEs to save : 3840 TO DO : save crop sub photo not yet done ! save time : 0.27570509910583496 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.057647705078125 time for calcul the mask position with numpy : 0.021312713623046875 nb_pixel_total : 2027275 time to create 1 rle with new method : 0.0309140682220459 time for calcul the mask position with numpy : 0.006852865219116211 nb_pixel_total : 27597 time to create 1 rle with old method : 0.03630185127258301 time for calcul the mask position with numpy : 0.006154775619506836 nb_pixel_total : 6412 time to create 1 rle with old method : 0.011588573455810547 time for calcul the mask position with numpy : 0.010557174682617188 nb_pixel_total : 12316 time to create 1 rle with old method : 0.013870000839233398 create new chi : 0.13808608055114746 time to delete rle : 0.0003452301025390625 batch 1 Loaded 7 chid ids of type : 3594 +++++Number RLEs to save : 2114 TO DO : save crop sub photo not yet done ! save time : 0.1465892791748047 nb_obj : 7 nb_hashtags : 3 time to prepare the origin masks : 0.1403517723083496 time for calcul the mask position with numpy : 0.02767181396484375 nb_pixel_total : 1896439 time to create 1 rle with new method : 0.06810522079467773 time for calcul the mask position with numpy : 0.006577491760253906 nb_pixel_total : 9 time to create 1 rle with old method : 3.4809112548828125e-05 time for calcul the mask position with numpy : 0.0068323612213134766 nb_pixel_total : 15668 time to create 1 rle with old method : 0.018947601318359375 time for calcul the mask position with numpy : 0.007313251495361328 nb_pixel_total : 4113 time to create 1 rle with old method : 0.005057096481323242 time for calcul the mask position with numpy : 0.007452487945556641 nb_pixel_total : 15452 time to create 1 rle with old method : 0.023172378540039062 time for calcul the mask position with numpy : 0.006375312805175781 nb_pixel_total : 1763 time to create 1 rle with old method : 0.0024216175079345703 time for calcul the mask position with numpy : 0.007035255432128906 nb_pixel_total : 96732 time to create 1 rle with old method : 0.11215806007385254 time for calcul the mask position with numpy : 0.007141590118408203 nb_pixel_total : 43424 time to create 1 rle with old method : 0.05880856513977051 create new chi : 0.36603736877441406 time to delete rle : 0.000614166259765625 batch 1 Loaded 15 chid ids of type : 3594 +++++++++Number RLEs to save : 3539 TO DO : save crop sub photo not yet done ! save time : 0.24687671661376953 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.05964970588684082 time for calcul the mask position with numpy : 0.02295088768005371 nb_pixel_total : 2056802 time to create 1 rle with new method : 0.032312631607055664 time for calcul the mask position with numpy : 0.006513118743896484 nb_pixel_total : 7299 time to create 1 rle with old method : 0.007886886596679688 time for calcul the mask position with numpy : 0.00610661506652832 nb_pixel_total : 5553 time to create 1 rle with old method : 0.007549285888671875 time for calcul the mask position with numpy : 0.010406017303466797 nb_pixel_total : 3946 time to create 1 rle with old method : 0.006037712097167969 create new chi : 0.10013031959533691 time to delete rle : 0.00033926963806152344 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1710 TO DO : save crop sub photo not yet done ! save time : 0.16566896438598633 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.0999908447265625 time for calcul the mask position with numpy : 0.03099226951599121 nb_pixel_total : 2018487 time to create 1 rle with new method : 0.0448606014251709 time for calcul the mask position with numpy : 0.007428884506225586 nb_pixel_total : 16119 time to create 1 rle with old method : 0.01968240737915039 time for calcul the mask position with numpy : 0.006582021713256836 nb_pixel_total : 6927 time to create 1 rle with old method : 0.007772922515869141 time for calcul the mask position with numpy : 0.0061492919921875 nb_pixel_total : 2298 time to create 1 rle with old method : 0.002596616744995117 time for calcul the mask position with numpy : 0.006288766860961914 nb_pixel_total : 29769 time to create 1 rle with old method : 0.03379702568054199 create new chi : 0.16664981842041016 time to delete rle : 0.00039315223693847656 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 2026 TO DO : save crop sub photo not yet done ! save time : 0.15565776824951172 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.06231546401977539 time for calcul the mask position with numpy : 0.020498991012573242 nb_pixel_total : 2042547 time to create 1 rle with new method : 0.033887386322021484 time for calcul the mask position with numpy : 0.007198810577392578 nb_pixel_total : 13470 time to create 1 rle with old method : 0.015131950378417969 time for calcul the mask position with numpy : 0.0062007904052734375 nb_pixel_total : 5565 time to create 1 rle with old method : 0.006264209747314453 time for calcul the mask position with numpy : 0.006392240524291992 nb_pixel_total : 4811 time to create 1 rle with old method : 0.00536036491394043 time for calcul the mask position with numpy : 0.006258726119995117 nb_pixel_total : 7207 time to create 1 rle with old method : 0.008198022842407227 create new chi : 0.11575508117675781 time to delete rle : 0.00034427642822265625 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 1850 TO DO : save crop sub photo not yet done ! save time : 0.13813376426696777 nb_obj : 7 nb_hashtags : 2 time to prepare the origin masks : 0.09249329566955566 time for calcul the mask position with numpy : 0.021970510482788086 nb_pixel_total : 2001135 time to create 1 rle with new method : 0.03701281547546387 time for calcul the mask position with numpy : 0.006472587585449219 nb_pixel_total : 8512 time to create 1 rle with old method : 0.009676456451416016 time for calcul the mask position with numpy : 0.0066318511962890625 nb_pixel_total : 14906 time to create 1 rle with old method : 0.01663041114807129 time for calcul the mask position with numpy : 0.006339550018310547 nb_pixel_total : 3952 time to create 1 rle with old method : 0.004470109939575195 time for calcul the mask position with numpy : 0.0060672760009765625 nb_pixel_total : 9768 time to create 1 rle with old method : 0.01307988166809082 time for calcul the mask position with numpy : 0.006366729736328125 nb_pixel_total : 5530 time to create 1 rle with old method : 0.006793022155761719 time for calcul the mask position with numpy : 0.007586002349853516 nb_pixel_total : 17321 time to create 1 rle with old method : 0.020415544509887695 time for calcul the mask position with numpy : 0.0066378116607666016 nb_pixel_total : 12476 time to create 1 rle with old method : 0.01401972770690918 create new chi : 0.19092917442321777 time to delete rle : 0.0006234645843505859 batch 1 Loaded 15 chid ids of type : 3594 ++++++++Number RLEs to save : 3014 TO DO : save crop sub photo not yet done ! save time : 0.2104039192199707 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.051840782165527344 time for calcul the mask position with numpy : 0.02083301544189453 nb_pixel_total : 2052872 time to create 1 rle with new method : 0.0300142765045166 time for calcul the mask position with numpy : 0.006478548049926758 nb_pixel_total : 7535 time to create 1 rle with old method : 0.00851750373840332 time for calcul the mask position with numpy : 0.006403446197509766 nb_pixel_total : 6375 time to create 1 rle with old method : 0.0072247982025146484 time for calcul the mask position with numpy : 0.007215738296508789 nb_pixel_total : 6818 time to create 1 rle with old method : 0.007663726806640625 create new chi : 0.09474372863769531 time to delete rle : 0.0002951622009277344 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1626 TO DO : save crop sub photo not yet done ! save time : 0.1353459358215332 nb_obj : 7 nb_hashtags : 2 time to prepare the origin masks : 0.10276412963867188 time for calcul the mask position with numpy : 0.020390033721923828 nb_pixel_total : 1990244 time to create 1 rle with new method : 0.0327601432800293 time for calcul the mask position with numpy : 0.006620645523071289 nb_pixel_total : 17980 time to create 1 rle with old method : 0.020094633102416992 time for calcul the mask position with numpy : 0.0063207149505615234 nb_pixel_total : 11090 time to create 1 rle with old method : 0.012184619903564453 time for calcul the mask position with numpy : 0.006124973297119141 nb_pixel_total : 8411 time to create 1 rle with old method : 0.009757518768310547 time for calcul the mask position with numpy : 0.006384134292602539 nb_pixel_total : 5123 time to create 1 rle with old method : 0.005753517150878906 time for calcul the mask position with numpy : 0.0061986446380615234 nb_pixel_total : 7285 time to create 1 rle with old method : 0.008187055587768555 time for calcul the mask position with numpy : 0.006449222564697266 nb_pixel_total : 9986 time to create 1 rle with old method : 0.015025138854980469 time for calcul the mask position with numpy : 0.00703883171081543 nb_pixel_total : 23481 time to create 1 rle with old method : 0.027333736419677734 create new chi : 0.19727563858032227 time to delete rle : 0.0005276203155517578 batch 1 Loaded 15 chid ids of type : 3594 ++++++++++Number RLEs to save : 2888 TO DO : save crop sub photo not yet done ! save time : 0.19363713264465332 nb_obj : 8 nb_hashtags : 4 time to prepare the origin masks : 0.09725332260131836 time for calcul the mask position with numpy : 0.021928787231445312 nb_pixel_total : 1995917 time to create 1 rle with new method : 0.09731149673461914 time for calcul the mask position with numpy : 0.0078046321868896484 nb_pixel_total : 15154 time to create 1 rle with old method : 0.016820192337036133 time for calcul the mask position with numpy : 0.007708311080932617 nb_pixel_total : 7976 time to create 1 rle with old method : 0.008934736251831055 time for calcul the mask position with numpy : 0.007902145385742188 nb_pixel_total : 10836 time to create 1 rle with old method : 0.011768341064453125 time for calcul the mask position with numpy : 0.008285045623779297 nb_pixel_total : 23054 time to create 1 rle with old method : 0.03457307815551758 time for calcul the mask position with numpy : 0.00787353515625 nb_pixel_total : 4206 time to create 1 rle with old method : 0.00757598876953125 time for calcul the mask position with numpy : 0.007893085479736328 nb_pixel_total : 4893 time to create 1 rle with old method : 0.008179426193237305 time for calcul the mask position with numpy : 0.007865428924560547 nb_pixel_total : 6648 time to create 1 rle with old method : 0.010174274444580078 time for calcul the mask position with numpy : 0.0073261260986328125 nb_pixel_total : 4916 time to create 1 rle with old method : 0.005504608154296875 create new chi : 0.2979719638824463 time to delete rle : 0.0009021759033203125 batch 1 Loaded 17 chid ids of type : 3594 ++++++++Number RLEs to save : 3056 TO DO : save crop sub photo not yet done ! save time : 0.2090609073638916 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 0.10873627662658691 time for calcul the mask position with numpy : 0.0301358699798584 nb_pixel_total : 1916745 time to create 1 rle with new method : 0.06554174423217773 time for calcul the mask position with numpy : 0.007509946823120117 nb_pixel_total : 5136 time to create 1 rle with old method : 0.0057904720306396484 time for calcul the mask position with numpy : 0.008130550384521484 nb_pixel_total : 50525 time to create 1 rle with old method : 0.06203484535217285 time for calcul the mask position with numpy : 0.013564109802246094 nb_pixel_total : 64829 time to create 1 rle with old method : 0.07202959060668945 time for calcul the mask position with numpy : 0.012652158737182617 nb_pixel_total : 5801 time to create 1 rle with old method : 0.007298946380615234 time for calcul the mask position with numpy : 0.007951736450195312 nb_pixel_total : 30564 time to create 1 rle with old method : 0.033431053161621094 create new chi : 0.32686519622802734 time to delete rle : 0.0008792877197265625 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 2954 TO DO : save crop sub photo not yet done ! save time : 0.20290112495422363 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 0.08590912818908691 time for calcul the mask position with numpy : 0.0402679443359375 nb_pixel_total : 2045720 time to create 1 rle with new method : 0.056914329528808594 time for calcul the mask position with numpy : 0.008514404296875 nb_pixel_total : 12961 time to create 1 rle with old method : 0.014638662338256836 time for calcul the mask position with numpy : 0.009727001190185547 nb_pixel_total : 4225 time to create 1 rle with old method : 0.008623123168945312 time for calcul the mask position with numpy : 0.008585691452026367 nb_pixel_total : 4878 time to create 1 rle with old method : 0.00615239143371582 time for calcul the mask position with numpy : 0.00805521011352539 nb_pixel_total : 5816 time to create 1 rle with old method : 0.006586313247680664 create new chi : 0.16866350173950195 time to delete rle : 0.0005795955657958984 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 1696 TO DO : save crop sub photo not yet done ! save time : 0.14208364486694336 nb_obj : 3 nb_hashtags : 1 time to prepare the origin masks : 0.0711979866027832 time for calcul the mask position with numpy : 0.03651618957519531 nb_pixel_total : 2048081 time to create 1 rle with new method : 0.045664310455322266 time for calcul the mask position with numpy : 0.008150100708007812 nb_pixel_total : 3678 time to create 1 rle with old method : 0.004390239715576172 time for calcul the mask position with numpy : 0.008082389831542969 nb_pixel_total : 15802 time to create 1 rle with old method : 0.02117300033569336 time for calcul the mask position with numpy : 0.008615493774414062 nb_pixel_total : 6039 time to create 1 rle with old method : 0.011345386505126953 create new chi : 0.1445906162261963 time to delete rle : 0.0006771087646484375 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1704 TO DO : save crop sub photo not yet done ! save time : 0.13671469688415527 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.06559085845947266 time for calcul the mask position with numpy : 0.032399654388427734 nb_pixel_total : 1864080 time to create 1 rle with new method : 0.07202696800231934 time for calcul the mask position with numpy : 0.007966279983520508 nb_pixel_total : 8312 time to create 1 rle with old method : 0.009563684463500977 time for calcul the mask position with numpy : 0.010027885437011719 nb_pixel_total : 201208 time to create 1 rle with new method : 0.03829073905944824 create new chi : 0.17105674743652344 time to delete rle : 0.000640869140625 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2358 TO DO : save crop sub photo not yet done ! save time : 0.1731419563293457 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.06260418891906738 time for calcul the mask position with numpy : 0.03758668899536133 nb_pixel_total : 2023414 time to create 1 rle with new method : 0.03986501693725586 time for calcul the mask position with numpy : 0.00806283950805664 nb_pixel_total : 40047 time to create 1 rle with old method : 0.04502606391906738 time for calcul the mask position with numpy : 0.007591724395751953 nb_pixel_total : 10139 time to create 1 rle with old method : 0.011470317840576172 create new chi : 0.1500246524810791 time to delete rle : 0.0006253719329833984 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1964 TO DO : save crop sub photo not yet done ! save time : 0.14202570915222168 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.059767961502075195 time for calcul the mask position with numpy : 0.03121161460876465 nb_pixel_total : 2062835 time to create 1 rle with new method : 0.04656171798706055 time for calcul the mask position with numpy : 0.0075457096099853516 nb_pixel_total : 6290 time to create 1 rle with old method : 0.007215261459350586 time for calcul the mask position with numpy : 0.012592554092407227 nb_pixel_total : 4475 time to create 1 rle with old method : 0.005025386810302734 create new chi : 0.1107325553894043 time to delete rle : 0.00048351287841796875 batch 1 Loaded 5 chid ids of type : 3594 +++Number RLEs to save : 1524 TO DO : save crop sub photo not yet done ! save time : 0.12746930122375488 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.09722900390625 time for calcul the mask position with numpy : 0.03173041343688965 nb_pixel_total : 2065387 time to create 1 rle with new method : 0.044612884521484375 time for calcul the mask position with numpy : 0.00774073600769043 nb_pixel_total : 8213 time to create 1 rle with old method : 0.009315013885498047 create new chi : 0.09370970726013184 time to delete rle : 0.0003902912139892578 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1244 TO DO : save crop sub photo not yet done ! save time : 0.11020755767822266 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 0.1012125015258789 time for calcul the mask position with numpy : 0.03152751922607422 nb_pixel_total : 2017519 time to create 1 rle with new method : 0.04443836212158203 time for calcul the mask position with numpy : 0.008016109466552734 nb_pixel_total : 25066 time to create 1 rle with old method : 0.02830338478088379 time for calcul the mask position with numpy : 0.007783412933349609 nb_pixel_total : 14640 time to create 1 rle with old method : 0.01635599136352539 time for calcul the mask position with numpy : 0.007775068283081055 nb_pixel_total : 11287 time to create 1 rle with old method : 0.012545347213745117 time for calcul the mask position with numpy : 0.007860898971557617 nb_pixel_total : 5088 time to create 1 rle with old method : 0.0058252811431884766 create new chi : 0.1709303855895996 time to delete rle : 0.0006248950958251953 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 2094 TO DO : save crop sub photo not yet done ! save time : 0.1623849868774414 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.05076885223388672 time for calcul the mask position with numpy : 0.029613733291625977 nb_pixel_total : 1959012 time to create 1 rle with new method : 0.039681434631347656 time for calcul the mask position with numpy : 0.008080482482910156 nb_pixel_total : 114588 time to create 1 rle with old method : 0.12717723846435547 create new chi : 0.2049698829650879 time to delete rle : 0.0005018711090087891 batch 1 Loaded 3 chid ids of type : 3594 ++Number RLEs to save : 2182 TO DO : save crop sub photo not yet done ! save time : 0.1615896224975586 nb_obj : 5 nb_hashtags : 2 time to prepare the origin masks : 0.11619424819946289 time for calcul the mask position with numpy : 0.032473087310791016 nb_pixel_total : 1915655 time to create 1 rle with new method : 0.044647216796875 time for calcul the mask position with numpy : 0.008087873458862305 nb_pixel_total : 17235 time to create 1 rle with old method : 0.019280195236206055 time for calcul the mask position with numpy : 0.007765054702758789 nb_pixel_total : 6089 time to create 1 rle with old method : 0.006833791732788086 time for calcul the mask position with numpy : 0.008208274841308594 nb_pixel_total : 97121 time to create 1 rle with old method : 0.10842156410217285 time for calcul the mask position with numpy : 0.008013486862182617 nb_pixel_total : 16483 time to create 1 rle with old method : 0.018551349639892578 time for calcul the mask position with numpy : 0.008277654647827148 nb_pixel_total : 21017 time to create 1 rle with old method : 0.023502349853515625 create new chi : 0.29485654830932617 time to delete rle : 0.0009815692901611328 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 3322 TO DO : save crop sub photo not yet done ! save time : 0.2294631004333496 nb_obj : 8 nb_hashtags : 5 time to prepare the origin masks : 0.14586997032165527 time for calcul the mask position with numpy : 0.06437277793884277 nb_pixel_total : 1855173 time to create 1 rle with new method : 0.10382437705993652 time for calcul the mask position with numpy : 0.006308317184448242 nb_pixel_total : 25446 time to create 1 rle with old method : 0.02811145782470703 time for calcul the mask position with numpy : 0.006352901458740234 nb_pixel_total : 2533 time to create 1 rle with old method : 0.0028541088104248047 time for calcul the mask position with numpy : 0.0062084197998046875 nb_pixel_total : 15257 time to create 1 rle with old method : 0.016927480697631836 time for calcul the mask position with numpy : 0.0072481632232666016 nb_pixel_total : 98804 time to create 1 rle with old method : 0.10824155807495117 time for calcul the mask position with numpy : 0.006425619125366211 nb_pixel_total : 5415 time to create 1 rle with old method : 0.006064891815185547 time for calcul the mask position with numpy : 0.006547451019287109 nb_pixel_total : 36735 time to create 1 rle with old method : 0.04060173034667969 time for calcul the mask position with numpy : 0.006338834762573242 nb_pixel_total : 10778 time to create 1 rle with old method : 0.011942148208618164 time for calcul the mask position with numpy : 0.0063054561614990234 nb_pixel_total : 23459 time to create 1 rle with old method : 0.0259857177734375 create new chi : 0.47126197814941406 time to delete rle : 0.0008385181427001953 batch 1 Loaded 17 chid ids of type : 3594 +++++++++++Number RLEs to save : 4626 TO DO : save crop sub photo not yet done ! save time : 0.2961916923522949 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.035085201263427734 time for calcul the mask position with numpy : 0.023225069046020508 nb_pixel_total : 2069645 time to create 1 rle with new method : 0.031124114990234375 time for calcul the mask position with numpy : 0.006599903106689453 nb_pixel_total : 3955 time to create 1 rle with old method : 0.004528999328613281 create new chi : 0.06571507453918457 time to delete rle : 0.0002834796905517578 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1324 TO DO : save crop sub photo not yet done ! save time : 0.10725808143615723 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.039975643157958984 time for calcul the mask position with numpy : 0.020751953125 nb_pixel_total : 2043930 time to create 1 rle with new method : 0.029618501663208008 time for calcul the mask position with numpy : 0.006396293640136719 nb_pixel_total : 15305 time to create 1 rle with old method : 0.017158985137939453 time for calcul the mask position with numpy : 0.006220340728759766 nb_pixel_total : 14365 time to create 1 rle with old method : 0.015961408615112305 create new chi : 0.09642338752746582 time to delete rle : 0.00031304359436035156 batch 1 Loaded 5 chid ids of type : 3594 ++++Number RLEs to save : 1778 TO DO : save crop sub photo not yet done ! save time : 0.1331501007080078 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.06425714492797852 time for calcul the mask position with numpy : 0.019977092742919922 nb_pixel_total : 1937502 time to create 1 rle with new method : 0.03106093406677246 time for calcul the mask position with numpy : 0.0065271854400634766 nb_pixel_total : 24702 time to create 1 rle with old method : 0.02755260467529297 time for calcul the mask position with numpy : 0.006875038146972656 nb_pixel_total : 98066 time to create 1 rle with old method : 0.10993552207946777 time for calcul the mask position with numpy : 0.006336688995361328 nb_pixel_total : 6010 time to create 1 rle with old method : 0.006745338439941406 time for calcul the mask position with numpy : 0.0064656734466552734 nb_pixel_total : 7320 time to create 1 rle with old method : 0.00824117660522461 create new chi : 0.23032903671264648 time to delete rle : 0.0005602836608886719 batch 1 Loaded 9 chid ids of type : 3594 +++++Number RLEs to save : 3268 TO DO : save crop sub photo not yet done ! save time : 0.2110426425933838 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 0.06940698623657227 time for calcul the mask position with numpy : 0.02070140838623047 nb_pixel_total : 2017932 time to create 1 rle with new method : 0.1331954002380371 time for calcul the mask position with numpy : 0.006302833557128906 nb_pixel_total : 10776 time to create 1 rle with old method : 0.01185154914855957 time for calcul the mask position with numpy : 0.0059185028076171875 nb_pixel_total : 1449 time to create 1 rle with old method : 0.001653909683227539 time for calcul the mask position with numpy : 0.006020069122314453 nb_pixel_total : 12270 time to create 1 rle with old method : 0.013367414474487305 time for calcul the mask position with numpy : 0.006188154220581055 nb_pixel_total : 6143 time to create 1 rle with old method : 0.006928205490112305 time for calcul the mask position with numpy : 0.00648808479309082 nb_pixel_total : 25030 time to create 1 rle with old method : 0.027950286865234375 create new chi : 0.2470860481262207 time to delete rle : 0.0004093647003173828 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 2312 TO DO : save crop sub photo not yet done ! save time : 0.1794908046722412 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.06546235084533691 time for calcul the mask position with numpy : 0.020303726196289062 nb_pixel_total : 1974368 time to create 1 rle with new method : 0.03371167182922363 time for calcul the mask position with numpy : 0.006403207778930664 nb_pixel_total : 7770 time to create 1 rle with old method : 0.008797645568847656 time for calcul the mask position with numpy : 0.0069577693939208984 nb_pixel_total : 47642 time to create 1 rle with old method : 0.05367016792297363 time for calcul the mask position with numpy : 0.006645679473876953 nb_pixel_total : 9776 time to create 1 rle with old method : 0.011021852493286133 time for calcul the mask position with numpy : 0.0066568851470947266 nb_pixel_total : 34044 time to create 1 rle with old method : 0.038286447525024414 create new chi : 0.19296002388000488 time to delete rle : 0.00047278404235839844 batch 1 Loaded 9 chid ids of type : 3594 +++++Number RLEs to save : 2314 TO DO : save crop sub photo not yet done ! save time : 0.15761446952819824 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.04082512855529785 time for calcul the mask position with numpy : 0.019780874252319336 nb_pixel_total : 2031255 time to create 1 rle with new method : 0.029689788818359375 time for calcul the mask position with numpy : 0.006172895431518555 nb_pixel_total : 5978 time to create 1 rle with old method : 0.006796598434448242 time for calcul the mask position with numpy : 0.006620645523071289 nb_pixel_total : 36367 time to create 1 rle with old method : 0.04199481010437012 create new chi : 0.11137843132019043 time to delete rle : 0.00029659271240234375 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1626 TO DO : save crop sub photo not yet done ! save time : 0.13099074363708496 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 0.06264472007751465 time for calcul the mask position with numpy : 0.023708105087280273 nb_pixel_total : 2028783 time to create 1 rle with new method : 0.033985137939453125 time for calcul the mask position with numpy : 0.007004261016845703 nb_pixel_total : 5820 time to create 1 rle with old method : 0.009537935256958008 time for calcul the mask position with numpy : 0.00667881965637207 nb_pixel_total : 4672 time to create 1 rle with old method : 0.005453348159790039 time for calcul the mask position with numpy : 0.0065517425537109375 nb_pixel_total : 10512 time to create 1 rle with old method : 0.011904716491699219 time for calcul the mask position with numpy : 0.006701469421386719 nb_pixel_total : 23813 time to create 1 rle with old method : 0.027013063430786133 create new chi : 0.1390819549560547 time to delete rle : 0.00043129920959472656 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 2174 TO DO : save crop sub photo not yet done ! save time : 0.15418624877929688 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.07317233085632324 time for calcul the mask position with numpy : 0.02726125717163086 nb_pixel_total : 1914360 time to create 1 rle with new method : 0.03928542137145996 time for calcul the mask position with numpy : 0.008249282836914062 nb_pixel_total : 85833 time to create 1 rle with old method : 0.09562849998474121 time for calcul the mask position with numpy : 0.008089303970336914 nb_pixel_total : 58031 time to create 1 rle with old method : 0.07411456108093262 time for calcul the mask position with numpy : 0.013715744018554688 nb_pixel_total : 15376 time to create 1 rle with old method : 0.017127275466918945 create new chi : 0.28426384925842285 time to delete rle : 0.0008294582366943359 batch 1 Loaded 7 chid ids of type : 3594 ++++Number RLEs to save : 2984 TO DO : save crop sub photo not yet done ! save time : 0.20090198516845703 nb_obj : 6 nb_hashtags : 2 time to prepare the origin masks : 0.19542503356933594 time for calcul the mask position with numpy : 0.03240513801574707 nb_pixel_total : 1917843 time to create 1 rle with new method : 0.04535984992980957 time for calcul the mask position with numpy : 0.008251190185546875 nb_pixel_total : 17720 time to create 1 rle with old method : 0.021373748779296875 time for calcul the mask position with numpy : 0.008840560913085938 nb_pixel_total : 12943 time to create 1 rle with old method : 0.023032426834106445 time for calcul the mask position with numpy : 0.00809931755065918 nb_pixel_total : 3574 time to create 1 rle with old method : 0.005966901779174805 time for calcul the mask position with numpy : 0.009068012237548828 nb_pixel_total : 97821 time to create 1 rle with old method : 0.12105655670166016 time for calcul the mask position with numpy : 0.00782012939453125 nb_pixel_total : 5845 time to create 1 rle with old method : 0.0066013336181640625 time for calcul the mask position with numpy : 0.007594585418701172 nb_pixel_total : 17854 time to create 1 rle with old method : 0.01998734474182129 create new chi : 0.32636308670043945 time to delete rle : 0.0010709762573242188 batch 1 Loaded 13 chid ids of type : 3594 +++++++++++++Number RLEs to save : 3836 TO DO : save crop sub photo not yet done ! save time : 0.25160813331604004 map_output_result : {1381701805: (0.0, 'Should be the crop_list due to order', 0), 1381701792: (0.0, 'Should be the crop_list due to order', 0), 1381701784: (0.0, 'Should be the crop_list due to order', 0), 1381701755: (0.0, 'Should be the crop_list due to order', 0), 1381701752: (0.0, 'Should be the crop_list due to order', 0), 1381701502: (0.0, 'Should be the crop_list due to order', 0), 1381701477: (0.0, 'Should be the crop_list due to order', 0), 1381701439: (0.0, 'Should be the crop_list due to order', 0), 1381701386: (0.0, 'Should be the crop_list due to order', 0), 1381701369: (0.0, 'Should be the crop_list due to order', 0), 1381701356: (0.0, 'Should be the crop_list due to order', 0), 1381701141: (0.0, 'Should be the crop_list due to order', 0), 1381701030: (0.0, 'Should be the crop_list due to order', 0), 1381700966: (0.0, 'Should be the crop_list due to order', 0), 1381700824: (0.0, 'Should be the crop_list due to order', 0), 1381700370: (0.0, 'Should be the crop_list due to order', 0), 1381700316: (0.0, 'Should be the crop_list due to order', 0), 1381700233: (0.0, 'Should be the crop_list due to order', 0), 1381700165: (0.0, 'Should be the crop_list due to order', 0), 1381700117: (0.0, 'Should be the crop_list due to order', 0), 1381700060: (0.0, 'Should be the crop_list due to order', 0), 1381699858: (0.0, 'Should be the crop_list due to order', 0), 1381699830: (0.0, 'Should be the crop_list due to order', 0), 1381699798: (0.0, 'Should be the crop_list due to order', 0), 1381699778: (0.0, 'Should be the crop_list due to order', 0), 1381699751: (0.0, 'Should be the crop_list due to order', 0), 1381699726: (0.0, 'Should be the crop_list due to order', 0), 1381699518: (0.0, 'Should be the crop_list due to order', 0), 1381699503: (0.0, 'Should be the crop_list due to order', 0), 1381699478: (0.0, 'Should be the crop_list due to order', 0), 1381699445: (0.0, 'Should be the crop_list due to order', 0), 1381699431: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1381701805, 1381701792, 1381701784, 1381701755, 1381701752, 1381701502, 1381701477, 1381701439, 1381701386, 1381701369, 1381701356, 1381701141, 1381701030, 1381700966, 1381700824, 1381700370, 1381700316, 1381700233, 1381700165, 1381700117, 1381700060, 1381699858, 1381699830, 1381699798, 1381699778, 1381699751, 1381699726, 1381699518, 1381699503, 1381699478, 1381699445, 1381699431] Looping around the photos to save general results len do output : 32 /1381701805.Didn't retrieve data . /1381701792.Didn't retrieve data . /1381701784.Didn't retrieve data . /1381701755.Didn't retrieve data . /1381701752.Didn't retrieve data . /1381701502.Didn't retrieve data . /1381701477.Didn't retrieve data . /1381701439.Didn't retrieve data . /1381701386.Didn't retrieve data . /1381701369.Didn't retrieve data . /1381701356.Didn't retrieve data . /1381701141.Didn't retrieve data . /1381701030.Didn't retrieve data . /1381700966.Didn't retrieve data . /1381700824.Didn't retrieve data . /1381700370.Didn't retrieve data . /1381700316.Didn't retrieve data . /1381700233.Didn't retrieve data . /1381700165.Didn't retrieve data . /1381700117.Didn't retrieve data . /1381700060.Didn't retrieve data . /1381699858.Didn't retrieve data . /1381699830.Didn't retrieve data . /1381699798.Didn't retrieve data . /1381699778.Didn't retrieve data . /1381699751.Didn't retrieve data . /1381699726.Didn't retrieve data . /1381699518.Didn't retrieve data . /1381699503.Didn't retrieve data . /1381699478.Didn't retrieve data . /1381699445.Didn't retrieve data . /1381699431.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701805', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701792', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701784', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701755', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701752', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701502', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701477', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701439', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701386', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701369', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701356', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701141', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701030', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381700966', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381700824', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381700370', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381700316', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381700233', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381700165', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381700117', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381700060', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381699858', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381699830', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381699798', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381699778', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381699751', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381699726', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381699518', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381699503', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381699478', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381699445', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381699431', None, None, None, None, None, '3669705') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 96 time used for this insertion : 0.01681375503540039 save_final save missing photos in datou_result : time spend for datou_step_exec : 15.833873510360718 time spend to save output : 0.01811814308166504 total time spend for step 3 : 15.851991653442383 step4:ventilate_hashtags_in_portfolio Fri Sep 5 12:12:43 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 26574891 get user id for portfolio 26574891 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26574891 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','mal_croppe','background','carton','papier','pehd','pet_fonce','metal','pet_clair','flou','autre')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26574891 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','mal_croppe','background','carton','papier','pehd','pet_fonce','metal','pet_clair','flou','autre')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26574891 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','mal_croppe','background','carton','papier','pehd','pet_fonce','metal','pet_clair','flou','autre')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/26575307,26575308,26575309,26575310,26575311,26575312,26575313,26575314,26575315,26575316,26575317?tags=environnement,mal_croppe,background,carton,papier,pehd,pet_fonce,metal,pet_clair,flou,autre Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1381701805, 1381701792, 1381701784, 1381701755, 1381701752, 1381701502, 1381701477, 1381701439, 1381701386, 1381701369, 1381701356, 1381701141, 1381701030, 1381700966, 1381700824, 1381700370, 1381700316, 1381700233, 1381700165, 1381700117, 1381700060, 1381699858, 1381699830, 1381699798, 1381699778, 1381699751, 1381699726, 1381699518, 1381699503, 1381699478, 1381699445, 1381699431] Looping around the photos to save general results len do output : 1 /26574891. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701805', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701792', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701784', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701755', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701752', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701502', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701477', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701439', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701386', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701369', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701356', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701141', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701030', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381700966', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381700824', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381700370', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381700316', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381700233', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381700165', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381700117', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381700060', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381699858', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381699830', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381699798', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381699778', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381699751', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381699726', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381699518', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381699503', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381699478', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381699445', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381699431', None, None, None, None, None, '3669705') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 33 time used for this insertion : 0.016438007354736328 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.733916997909546 time spend to save output : 0.01688408851623535 total time spend for step 4 : 1.7508010864257812 step5:final Fri Sep 5 12:12:45 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1381701805: ('0.046818832585841054',), 1381701792: ('0.046818832585841054',), 1381701784: ('0.046818832585841054',), 1381701755: ('0.046818832585841054',), 1381701752: ('0.046818832585841054',), 1381701502: ('0.046818832585841054',), 1381701477: ('0.046818832585841054',), 1381701439: ('0.046818832585841054',), 1381701386: ('0.046818832585841054',), 1381701369: ('0.046818832585841054',), 1381701356: ('0.046818832585841054',), 1381701141: ('0.046818832585841054',), 1381701030: ('0.046818832585841054',), 1381700966: ('0.046818832585841054',), 1381700824: ('0.046818832585841054',), 1381700370: ('0.046818832585841054',), 1381700316: ('0.046818832585841054',), 1381700233: ('0.046818832585841054',), 1381700165: ('0.046818832585841054',), 1381700117: ('0.046818832585841054',), 1381700060: ('0.046818832585841054',), 1381699858: ('0.046818832585841054',), 1381699830: ('0.046818832585841054',), 1381699798: ('0.046818832585841054',), 1381699778: ('0.046818832585841054',), 1381699751: ('0.046818832585841054',), 1381699726: ('0.046818832585841054',), 1381699518: ('0.046818832585841054',), 1381699503: ('0.046818832585841054',), 1381699478: ('0.046818832585841054',), 1381699445: ('0.046818832585841054',), 1381699431: ('0.046818832585841054',)} new output for save of step final : {1381701805: ('0.046818832585841054',), 1381701792: ('0.046818832585841054',), 1381701784: ('0.046818832585841054',), 1381701755: ('0.046818832585841054',), 1381701752: ('0.046818832585841054',), 1381701502: ('0.046818832585841054',), 1381701477: ('0.046818832585841054',), 1381701439: ('0.046818832585841054',), 1381701386: ('0.046818832585841054',), 1381701369: ('0.046818832585841054',), 1381701356: ('0.046818832585841054',), 1381701141: ('0.046818832585841054',), 1381701030: ('0.046818832585841054',), 1381700966: ('0.046818832585841054',), 1381700824: ('0.046818832585841054',), 1381700370: ('0.046818832585841054',), 1381700316: ('0.046818832585841054',), 1381700233: ('0.046818832585841054',), 1381700165: ('0.046818832585841054',), 1381700117: ('0.046818832585841054',), 1381700060: ('0.046818832585841054',), 1381699858: ('0.046818832585841054',), 1381699830: ('0.046818832585841054',), 1381699798: ('0.046818832585841054',), 1381699778: ('0.046818832585841054',), 1381699751: ('0.046818832585841054',), 1381699726: ('0.046818832585841054',), 1381699518: ('0.046818832585841054',), 1381699503: ('0.046818832585841054',), 1381699478: ('0.046818832585841054',), 1381699445: ('0.046818832585841054',), 1381699431: ('0.046818832585841054',)} [1381701805, 1381701792, 1381701784, 1381701755, 1381701752, 1381701502, 1381701477, 1381701439, 1381701386, 1381701369, 1381701356, 1381701141, 1381701030, 1381700966, 1381700824, 1381700370, 1381700316, 1381700233, 1381700165, 1381700117, 1381700060, 1381699858, 1381699830, 1381699798, 1381699778, 1381699751, 1381699726, 1381699518, 1381699503, 1381699478, 1381699445, 1381699431] Looping around the photos to save general results len do output : 32 /1381701805.Didn't retrieve data . /1381701792.Didn't retrieve data . /1381701784.Didn't retrieve data . /1381701755.Didn't retrieve data . /1381701752.Didn't retrieve data . /1381701502.Didn't retrieve data . /1381701477.Didn't retrieve data . /1381701439.Didn't retrieve data . /1381701386.Didn't retrieve data . /1381701369.Didn't retrieve data . /1381701356.Didn't retrieve data . /1381701141.Didn't retrieve data . /1381701030.Didn't retrieve data . /1381700966.Didn't retrieve data . /1381700824.Didn't retrieve data . /1381700370.Didn't retrieve data . /1381700316.Didn't retrieve data . /1381700233.Didn't retrieve data . /1381700165.Didn't retrieve data . /1381700117.Didn't retrieve data . /1381700060.Didn't retrieve data . /1381699858.Didn't retrieve data . /1381699830.Didn't retrieve data . /1381699798.Didn't retrieve data . /1381699778.Didn't retrieve data . /1381699751.Didn't retrieve data . /1381699726.Didn't retrieve data . /1381699518.Didn't retrieve data . /1381699503.Didn't retrieve data . /1381699478.Didn't retrieve data . /1381699445.Didn't retrieve data . /1381699431.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701805', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701792', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701784', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701755', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701752', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701502', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701477', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701439', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701386', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701369', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701356', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701141', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701030', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381700966', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381700824', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381700370', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381700316', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381700233', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381700165', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381700117', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381700060', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381699858', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381699830', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381699798', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381699778', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381699751', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381699726', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381699518', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381699503', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381699478', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381699445', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381699431', None, None, None, None, None, '3669705') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 96 time used for this insertion : 0.01782536506652832 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.12971925735473633 time spend to save output : 0.019212007522583008 total time spend for step 5 : 0.14893126487731934 step6:blur_detection Fri Sep 5 12:12:45 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1757067030_4136436_1381701805_3ce2789473ac5317d1c147fcbf53a9ba.jpg resize: (1080, 1920) 1381701805 0.838186713063724 treat image : temp/1757067030_4136436_1381701792_15121804484579dea1f3d6da0c7e074b.jpg resize: (1080, 1920) 1381701792 0.697077624418037 treat image : temp/1757067030_4136436_1381701784_0348902930c6748d240fcf6800bdcc1b.jpg resize: (1080, 1920) 1381701784 0.5651057646781048 treat image : temp/1757067030_4136436_1381701755_c12431a31cbf95b41cdbc1493e30c768.jpg resize: (1080, 1920) 1381701755 3.461008712453646 treat image : temp/1757067030_4136436_1381701752_0c6808c3caa48b28c6c153e7d04683ea.jpg resize: (1080, 1920) 1381701752 -0.05546217869031099 treat image : temp/1757067030_4136436_1381701502_454124e5ff2539a4383ac9d6655b8d79.jpg resize: (1080, 1920) 1381701502 0.6520094546198199 treat image : temp/1757067030_4136436_1381701477_196379ae7428be3cdff9c340119e25be.jpg resize: (1080, 1920) 1381701477 0.6102889523700906 treat image : temp/1757067030_4136436_1381701439_8af45327776f95d9f70d3e96e4ff123f.jpg resize: (1080, 1920) 1381701439 0.349526182110343 treat image : temp/1757067030_4136436_1381701386_bec76c481ea5e7daf0b356f76690f5ff.jpg resize: (1080, 1920) 1381701386 0.6165981685015487 treat image : temp/1757067030_4136436_1381701369_8ded124f2821fb76bf9089e075120aad.jpg resize: (1080, 1920) 1381701369 -0.16454169819267875 treat image : temp/1757067030_4136436_1381701356_70b9c57436791d9ef1c1f2b7e545d432.jpg resize: (1080, 1920) 1381701356 0.9715008321951751 treat image : temp/1757067030_4136436_1381701141_0ce117899e6ad373d45826152524e98e.jpg resize: (1080, 1920) 1381701141 0.6859312327573975 treat image : temp/1757067030_4136436_1381701030_4faa5bce65c04b17966cc3ee3ce5d041.jpg resize: (1080, 1920) 1381701030 0.5626548145262892 treat image : temp/1757067030_4136436_1381700966_d206e5240f091cc4bd7554c70457ad4d.jpg resize: (1080, 1920) 1381700966 -3.6505902667984063 treat image : temp/1757067030_4136436_1381700824_cf593b54ce7883419b4a29b4ded7ff3c.jpg resize: (1080, 1920) 1381700824 2.7118196847535323 treat image : temp/1757067030_4136436_1381700370_f20cf0999d1a20325585f85b13771d4e.jpg resize: (1080, 1920) 1381700370 -0.15222772515083696 treat image : temp/1757067030_4136436_1381700316_9f6163170536ee735d6383bfc79796d2.jpg resize: (1080, 1920) 1381700316 1.53908451157688 treat image : temp/1757067030_4136436_1381700233_6e1c77d2bcb670a1172f72d2aa40658a.jpg resize: (1080, 1920) 1381700233 -3.316690182011308 treat image : temp/1757067030_4136436_1381700165_a4d2a5e8cd3944f89c5eec8db86eeefb.jpg resize: (1080, 1920) 1381700165 0.33785578826193663 treat image : temp/1757067030_4136436_1381700117_b0157d4eb8d4b02fe290d43777ac93ae.jpg resize: (1080, 1920) 1381700117 -3.5091778803954026 treat image : temp/1757067030_4136436_1381700060_e5c3af34cb2b352a4aae9190f9bb8daf.jpg resize: (1080, 1920) 1381700060 0.8164902933525057 treat image : temp/1757067030_4136436_1381699858_e08283d054a34185c048ba97a8cdcc69.jpg resize: (1080, 1920) 1381699858 0.41292642593980133 treat image : temp/1757067030_4136436_1381699830_ca876b6ca61b9e7f3d83963ba4e1c808.jpg resize: (1080, 1920) 1381699830 -2.0910990157650233 treat image : temp/1757067030_4136436_1381699798_1413a61c587f5358fec00e57d846bd01.jpg resize: (1080, 1920) 1381699798 -0.3152303783949583 treat image : temp/1757067030_4136436_1381699778_fcf61a7efe1cf4904efce4612830d4fd.jpg resize: (1080, 1920) 1381699778 0.8075326945985144 treat image : temp/1757067030_4136436_1381699751_2ff5ab07454d0a928e4f78da9be955c3.jpg resize: (1080, 1920) 1381699751 2.5992548578637695 treat image : temp/1757067030_4136436_1381699726_25f72cc4ee3d9852ee6398d432179824.jpg resize: (1080, 1920) 1381699726 0.8485891518181408 treat image : temp/1757067030_4136436_1381699518_78eeae2ddb810cc903e4067e2e99c8d2.jpg resize: (1080, 1920) 1381699518 1.3995666706730594 treat image : temp/1757067030_4136436_1381699503_79d87b0f62ce5a8dd9d4606c96b69165.jpg resize: (1080, 1920) 1381699503 0.07666023626820091 treat image : temp/1757067030_4136436_1381699478_cb68f466e7cccec4275d5260782f18a7.jpg resize: (1080, 1920) 1381699478 1.0078895328926007 treat image : temp/1757067030_4136436_1381699445_1321788de8032e243de62ec5495c6c7f.jpg resize: (1080, 1920) 1381699445 1.358676841034101 treat image : temp/1757067030_4136436_1381699431_31d836ad90237f2fd642d62df26209ac.jpg resize: (1080, 1920) 1381699431 0.5532025409577144 treat image : temp/1757067030_4136436_1381701805_3ce2789473ac5317d1c147fcbf53a9ba_rle_crop_3945967800_0.png resize: (88, 173) 1381717708 -0.6744908671198361 treat image : temp/1757067030_4136436_1381701792_15121804484579dea1f3d6da0c7e074b_rle_crop_3945967803_0.png resize: (155, 81) 1381717709 -2.010185149972766 treat image : temp/1757067030_4136436_1381701792_15121804484579dea1f3d6da0c7e074b_rle_crop_3945967804_0.png resize: (113, 159) 1381717711 1.384970916727298 treat image : temp/1757067030_4136436_1381701792_15121804484579dea1f3d6da0c7e074b_rle_crop_3945967805_0.png resize: (120, 145) 1381717712 -0.8913696300113959 treat image : temp/1757067030_4136436_1381701792_15121804484579dea1f3d6da0c7e074b_rle_crop_3945967806_0.png resize: (97, 262) 1381717713 -0.8915373355756696 treat image : temp/1757067030_4136436_1381701784_0348902930c6748d240fcf6800bdcc1b_rle_crop_3945967807_0.png resize: (70, 128) 1381717714 0.6028375980983652 treat image : temp/1757067030_4136436_1381701784_0348902930c6748d240fcf6800bdcc1b_rle_crop_3945967808_0.png resize: (81, 120) 1381717716 -0.8730722439859725 treat image : temp/1757067030_4136436_1381701784_0348902930c6748d240fcf6800bdcc1b_rle_crop_3945967810_0.png resize: (61, 179) 1381717717 0.7808116530425204 treat image : temp/1757067030_4136436_1381701755_c12431a31cbf95b41cdbc1493e30c768_rle_crop_3945967813_0.png resize: (212, 80) 1381717718 -0.9985377023831613 treat image : temp/1757067030_4136436_1381701755_c12431a31cbf95b41cdbc1493e30c768_rle_crop_3945967814_0.png resize: (71, 140) 1381717720 0.02158497876863635 treat image : temp/1757067030_4136436_1381701752_0c6808c3caa48b28c6c153e7d04683ea_rle_crop_3945967816_0.png resize: (210, 356) 1381717721 -1.6564114275724473 treat image : temp/1757067030_4136436_1381701752_0c6808c3caa48b28c6c153e7d04683ea_rle_crop_3945967818_0.png resize: (113, 129) 1381717722 -1.2040657862389121 treat image : temp/1757067030_4136436_1381701752_0c6808c3caa48b28c6c153e7d04683ea_rle_crop_3945967819_0.png resize: (156, 156) 1381717723 -0.4115018546626736 treat image : temp/1757067030_4136436_1381701752_0c6808c3caa48b28c6c153e7d04683ea_rle_crop_3945967822_0.png resize: (109, 125) 1381717725 -0.775746204035797 treat image : temp/1757067030_4136436_1381701502_454124e5ff2539a4383ac9d6655b8d79_rle_crop_3945967823_0.png resize: (103, 58) 1381717726 -1.524163841800638 treat image : temp/1757067030_4136436_1381701502_454124e5ff2539a4383ac9d6655b8d79_rle_crop_3945967825_0.png resize: (80, 118) 1381717727 -0.3483433282093576 treat image : temp/1757067030_4136436_1381701477_196379ae7428be3cdff9c340119e25be_rle_crop_3945967828_0.png resize: (100, 92) 1381717729 -1.198067093645875 treat image : temp/1757067030_4136436_1381701386_bec76c481ea5e7daf0b356f76690f5ff_rle_crop_3945967834_0.png resize: (137, 175) 1381717730 -1.8307279559429634 treat image : temp/1757067030_4136436_1381701386_bec76c481ea5e7daf0b356f76690f5ff_rle_crop_3945967835_0.png resize: (199, 112) 1381717731 -0.09213794680642765 treat image : temp/1757067030_4136436_1381701386_bec76c481ea5e7daf0b356f76690f5ff_rle_crop_3945967838_0.png resize: (93, 123) 1381717733 -1.3785378866344458 treat image : temp/1757067030_4136436_1381701386_bec76c481ea5e7daf0b356f76690f5ff_rle_crop_3945967839_0.png resize: (151, 156) 1381717734 -1.686720987288113 treat image : temp/1757067030_4136436_1381701386_bec76c481ea5e7daf0b356f76690f5ff_rle_crop_3945967840_0.png resize: (141, 81) 1381717735 -0.604403085890447 treat image : temp/1757067030_4136436_1381701356_70b9c57436791d9ef1c1f2b7e545d432_rle_crop_3945967848_0.png resize: (110, 127) 1381717736 -1.9148350327064039 treat image : temp/1757067030_4136436_1381701356_70b9c57436791d9ef1c1f2b7e545d432_rle_crop_3945967850_0.png resize: (205, 147) 1381717738 2.3050828247208206 treat image : temp/1757067030_4136436_1381701141_0ce117899e6ad373d45826152524e98e_rle_crop_3945967851_0.png resize: (87, 74) 1381717739 0.13646155333533153 treat image : temp/1757067030_4136436_1381701141_0ce117899e6ad373d45826152524e98e_rle_crop_3945967852_0.png resize: (94, 106) 1381717740 -1.3749734884189355 treat image : temp/1757067030_4136436_1381701141_0ce117899e6ad373d45826152524e98e_rle_crop_3945967854_0.png resize: (97, 69) 1381717742 -2.0085483868874423 treat image : temp/1757067030_4136436_1381701141_0ce117899e6ad373d45826152524e98e_rle_crop_3945967856_0.png resize: (111, 136) 1381717743 -1.0133267495322928 treat image : temp/1757067030_4136436_1381701030_4faa5bce65c04b17966cc3ee3ce5d041_rle_crop_3945967860_0.png resize: (116, 66) 1381717744 0.08361216220862744 treat image : temp/1757067030_4136436_1381700966_d206e5240f091cc4bd7554c70457ad4d_rle_crop_3945967864_0.png resize: (63, 100) 1381717745 5.387261839112214 treat image : temp/1757067030_4136436_1381700966_d206e5240f091cc4bd7554c70457ad4d_rle_crop_3945967866_0.png resize: (56, 95) 1381717747 -4.30576075300189 treat image : temp/1757067030_4136436_1381700824_cf593b54ce7883419b4a29b4ded7ff3c_rle_crop_3945967868_0.png resize: (68, 102) 1381717748 2.6636695503656465 treat image : temp/1757067030_4136436_1381700824_cf593b54ce7883419b4a29b4ded7ff3c_rle_crop_3945967869_0.png resize: (138, 200) 1381717749 -1.0402082670178308 treat image : temp/1757067030_4136436_1381700824_cf593b54ce7883419b4a29b4ded7ff3c_rle_crop_3945967870_0.png resize: (78, 63) 1381717751 1.556971912304706 treat image : temp/1757067030_4136436_1381700370_f20cf0999d1a20325585f85b13771d4e_rle_crop_3945967872_0.png resize: (155, 104) 1381717753 -1.8510417666280117 treat image : temp/1757067030_4136436_1381700233_6e1c77d2bcb670a1172f72d2aa40658a_rle_crop_3945967876_0.png resize: (108, 90) 1381717754 -1.9974798651373797 treat image : temp/1757067030_4136436_1381700117_b0157d4eb8d4b02fe290d43777ac93ae_rle_crop_3945967879_0.png resize: (117, 186) 1381717756 -1.8184226639261596 treat image : temp/1757067030_4136436_1381699830_ca876b6ca61b9e7f3d83963ba4e1c808_rle_crop_3945967888_0.png resize: (219, 184) 1381717758 -2.5758920397535165 treat image : temp/1757067030_4136436_1381699830_ca876b6ca61b9e7f3d83963ba4e1c808_rle_crop_3945967891_0.png resize: (104, 110) 1381717759 -1.419939885015759 treat image : temp/1757067030_4136436_1381699830_ca876b6ca61b9e7f3d83963ba4e1c808_rle_crop_3945967894_0.png resize: (70, 50) 1381717760 -2.172810527816791 treat image : temp/1757067030_4136436_1381699798_1413a61c587f5358fec00e57d846bd01_rle_crop_3945967896_0.png resize: (122, 49) 1381717762 -1.4326005246271931 treat image : temp/1757067030_4136436_1381699751_2ff5ab07454d0a928e4f78da9be955c3_rle_crop_3945967899_0.png resize: (173, 52) 1381717764 0.027673414123264774 treat image : temp/1757067030_4136436_1381699751_2ff5ab07454d0a928e4f78da9be955c3_rle_crop_3945967900_0.png resize: (117, 128) 1381717765 -1.9044397230898982 treat image : temp/1757067030_4136436_1381699726_25f72cc4ee3d9852ee6398d432179824_rle_crop_3945967904_0.png resize: (96, 83) 1381717767 -0.3589599728007713 treat image : temp/1757067030_4136436_1381699726_25f72cc4ee3d9852ee6398d432179824_rle_crop_3945967905_0.png resize: (188, 91) 1381717769 -0.8791379663969442 treat image : temp/1757067030_4136436_1381699726_25f72cc4ee3d9852ee6398d432179824_rle_crop_3945967906_0.png resize: (24, 83) 1381717770 0.2298722372143494 treat image : temp/1757067030_4136436_1381699518_78eeae2ddb810cc903e4067e2e99c8d2_rle_crop_3945967909_0.png resize: (88, 163) 1381717771 -0.5826419414325852 treat image : temp/1757067030_4136436_1381699518_78eeae2ddb810cc903e4067e2e99c8d2_rle_crop_3945967910_0.png resize: (177, 400) 1381717773 -0.47805249248828063 treat image : temp/1757067030_4136436_1381699518_78eeae2ddb810cc903e4067e2e99c8d2_rle_crop_3945967911_0.png resize: (109, 90) 1381717775 4.926177078653244 treat image : temp/1757067030_4136436_1381699503_79d87b0f62ce5a8dd9d4606c96b69165_rle_crop_3945967913_0.png resize: (70, 108) 1381717776 2.3787371417726453 treat image : temp/1757067030_4136436_1381699478_cb68f466e7cccec4275d5260782f18a7_rle_crop_3945967915_0.png resize: (188, 86) 1381717778 -1.9660421911679629 treat image : temp/1757067030_4136436_1381699478_cb68f466e7cccec4275d5260782f18a7_rle_crop_3945967916_0.png resize: (97, 112) 1381717780 -0.4700391832040466 treat image : temp/1757067030_4136436_1381699445_1321788de8032e243de62ec5495c6c7f_rle_crop_3945967919_0.png resize: (231, 303) 1381717781 0.49816306913599984 treat image : temp/1757067030_4136436_1381699431_31d836ad90237f2fd642d62df26209ac_rle_crop_3945967922_0.png resize: (146, 51) 1381717782 0.9333944217680723 treat image : temp/1757067030_4136436_1381699431_31d836ad90237f2fd642d62df26209ac_rle_crop_3945967924_0.png resize: (69, 84) 1381717784 -2.815490795076164 treat image : temp/1757067030_4136436_1381699431_31d836ad90237f2fd642d62df26209ac_rle_crop_3945967925_0.png resize: (166, 164) 1381717786 -0.3581931808532559 treat image : temp/1757067030_4136436_1381701805_3ce2789473ac5317d1c147fcbf53a9ba_rle_crop_3945967801_0.png resize: (135, 147) 1381717835 -1.7937409446213324 treat image : temp/1757067030_4136436_1381701784_0348902930c6748d240fcf6800bdcc1b_rle_crop_3945967812_0.png resize: (977, 976) 1381717837 -0.05383601524037204 treat image : temp/1757067030_4136436_1381701502_454124e5ff2539a4383ac9d6655b8d79_rle_crop_3945967824_0.png resize: (113, 77) 1381717838 -2.1500021857685447 treat image : temp/1757067030_4136436_1381701439_8af45327776f95d9f70d3e96e4ff123f_rle_crop_3945967833_0.png resize: (118, 156) 1381717839 -1.3527816575354898 treat image : temp/1757067030_4136436_1381701386_bec76c481ea5e7daf0b356f76690f5ff_rle_crop_3945967836_0.png resize: (85, 99) 1381717840 -1.5733195940219182 treat image : temp/1757067030_4136436_1381701386_bec76c481ea5e7daf0b356f76690f5ff_rle_crop_3945967837_0.png resize: (103, 136) 1381717841 -1.1649773579926952 treat image : temp/1757067030_4136436_1381699830_ca876b6ca61b9e7f3d83963ba4e1c808_rle_crop_3945967892_0.png resize: (509, 340) 1381717842 -0.4171472600742599 treat image : temp/1757067030_4136436_1381699726_25f72cc4ee3d9852ee6398d432179824_rle_crop_3945967907_0.png resize: (136, 131) 1381717843 -1.9410966459127745 treat image : temp/1757067030_4136436_1381699478_cb68f466e7cccec4275d5260782f18a7_rle_crop_3945967917_0.png resize: (99, 90) 1381717844 -1.7144326446595282 treat image : temp/1757067030_4136436_1381701369_8ded124f2821fb76bf9089e075120aad_rle_crop_3945967842_0.png resize: (73, 121) 1381717849 -2.234576149428949 treat image : temp/1757067030_4136436_1381701369_8ded124f2821fb76bf9089e075120aad_rle_crop_3945967843_0.png resize: (82, 115) 1381717851 -0.784423137341792 treat image : temp/1757067030_4136436_1381701141_0ce117899e6ad373d45826152524e98e_rle_crop_3945967853_0.png resize: (95, 78) 1381717852 -2.3774263353680554 treat image : temp/1757067030_4136436_1381701805_3ce2789473ac5317d1c147fcbf53a9ba_rle_crop_3945967802_0.png resize: (112, 97) 1381717968 -3.3773446039964017 treat image : temp/1757067030_4136436_1381701784_0348902930c6748d240fcf6800bdcc1b_rle_crop_3945967811_0.png resize: (97, 92) 1381717969 0.48102524617419967 treat image : temp/1757067030_4136436_1381701755_c12431a31cbf95b41cdbc1493e30c768_rle_crop_3945967815_0.png resize: (207, 182) 1381717971 -1.3050551910400638 treat image : temp/1757067030_4136436_1381701752_0c6808c3caa48b28c6c153e7d04683ea_rle_crop_3945967817_0.png resize: (515, 344) 1381717972 -0.7110027737886923 treat image : temp/1757067030_4136436_1381701752_0c6808c3caa48b28c6c153e7d04683ea_rle_crop_3945967821_0.png resize: (154, 122) 1381717973 -0.6443280314426845 treat image : temp/1757067030_4136436_1381701477_196379ae7428be3cdff9c340119e25be_rle_crop_3945967826_0.png resize: (147, 280) 1381717975 -2.8125264527096063 treat image : temp/1757067030_4136436_1381701477_196379ae7428be3cdff9c340119e25be_rle_crop_3945967827_0.png resize: (74, 38) 1381717976 3.639741700436988 treat image : temp/1757067030_4136436_1381701477_196379ae7428be3cdff9c340119e25be_rle_crop_3945967829_0.png resize: (149, 142) 1381717977 0.6273202211307243 treat image : temp/1757067030_4136436_1381701356_70b9c57436791d9ef1c1f2b7e545d432_rle_crop_3945967844_0.png resize: (137, 286) 1381717979 -1.46889336245249 treat image : temp/1757067030_4136436_1381701356_70b9c57436791d9ef1c1f2b7e545d432_rle_crop_3945967845_0.png resize: (73, 177) 1381717980 -0.5035477553912193 treat image : temp/1757067030_4136436_1381701356_70b9c57436791d9ef1c1f2b7e545d432_rle_crop_3945967846_0.png resize: (83, 110) 1381717981 -0.5761424918789297 treat image : temp/1757067030_4136436_1381701356_70b9c57436791d9ef1c1f2b7e545d432_rle_crop_3945967847_0.png resize: (58, 115) 1381717982 -0.25543477293316946 treat image : temp/1757067030_4136436_1381701356_70b9c57436791d9ef1c1f2b7e545d432_rle_crop_3945967849_0.png resize: (139, 134) 1381717984 -0.463160719007293 treat image : temp/1757067030_4136436_1381701141_0ce117899e6ad373d45826152524e98e_rle_crop_3945967855_0.png resize: (193, 166) 1381717985 -0.8346744060459618 treat image : temp/1757067030_4136436_1381701141_0ce117899e6ad373d45826152524e98e_rle_crop_3945967858_0.png resize: (184, 140) 1381717986 -1.624405073515177 treat image : temp/1757067030_4136436_1381701030_4faa5bce65c04b17966cc3ee3ce5d041_rle_crop_3945967859_0.png resize: (166, 311) 1381717988 -0.2216778355305404 treat image : temp/1757067030_4136436_1381701030_4faa5bce65c04b17966cc3ee3ce5d041_rle_crop_3945967861_0.png resize: (276, 337) 1381717989 -1.5058141952540467 treat image : temp/1757067030_4136436_1381701030_4faa5bce65c04b17966cc3ee3ce5d041_rle_crop_3945967862_0.png resize: (265, 264) 1381717990 -0.9543520898553552 treat image : temp/1757067030_4136436_1381700966_d206e5240f091cc4bd7554c70457ad4d_rle_crop_3945967867_0.png resize: (103, 163) 1381717991 -0.3459059031870433 treat image : temp/1757067030_4136436_1381700370_f20cf0999d1a20325585f85b13771d4e_rle_crop_3945967871_0.png resize: (482, 544) 1381717993 -0.9972194864937513 treat image : temp/1757067030_4136436_1381700316_9f6163170536ee735d6383bfc79796d2_rle_crop_3945967874_0.png resize: (343, 157) 1381717994 -0.8920641569155662 treat image : temp/1757067030_4136436_1381700233_6e1c77d2bcb670a1172f72d2aa40658a_rle_crop_3945967875_0.png resize: (80, 70) 1381717995 -3.4493799439953823 treat image : temp/1757067030_4136436_1381700060_e5c3af34cb2b352a4aae9190f9bb8daf_rle_crop_3945967882_0.png resize: (499, 344) 1381717996 -0.6660966409258826 treat image : temp/1757067030_4136436_1381699858_e08283d054a34185c048ba97a8cdcc69_rle_crop_3945967883_0.png resize: (161, 195) 1381717997 -0.7227927436591358 treat image : temp/1757067030_4136436_1381699858_e08283d054a34185c048ba97a8cdcc69_rle_crop_3945967884_0.png resize: (178, 135) 1381717998 0.1298451290151165 treat image : temp/1757067030_4136436_1381699858_e08283d054a34185c048ba97a8cdcc69_rle_crop_3945967885_0.png resize: (490, 317) 1381717999 -0.280252729318701 treat image : temp/1757067030_4136436_1381699858_e08283d054a34185c048ba97a8cdcc69_rle_crop_3945967886_0.png resize: (108, 67) 1381718000 1.3207652431123567 treat image : temp/1757067030_4136436_1381699830_ca876b6ca61b9e7f3d83963ba4e1c808_rle_crop_3945967890_0.png resize: (222, 244) 1381718001 -1.1415376983227823 treat image : temp/1757067030_4136436_1381699830_ca876b6ca61b9e7f3d83963ba4e1c808_rle_crop_3945967893_0.png resize: (132, 147) 1381718002 -3.3026158568272654 treat image : temp/1757067030_4136436_1381699778_fcf61a7efe1cf4904efce4612830d4fd_rle_crop_3945967897_0.png resize: (128, 157) 1381718003 -0.05045991127993079 treat image : temp/1757067030_4136436_1381699751_2ff5ab07454d0a928e4f78da9be955c3_rle_crop_3945967901_0.png resize: (558, 338) 1381718004 -1.0700965818298407 treat image : temp/1757067030_4136436_1381699751_2ff5ab07454d0a928e4f78da9be955c3_rle_crop_3945967902_0.png resize: (220, 234) 1381718005 -1.4690562444868431 treat image : temp/1757067030_4136436_1381699726_25f72cc4ee3d9852ee6398d432179824_rle_crop_3945967903_0.png resize: (161, 231) 1381718006 -1.1974161653193554 treat image : temp/1757067030_4136436_1381699518_78eeae2ddb810cc903e4067e2e99c8d2_rle_crop_3945967908_0.png resize: (163, 290) 1381718007 0.09249603109502326 treat image : temp/1757067030_4136436_1381699503_79d87b0f62ce5a8dd9d4606c96b69165_rle_crop_3945967912_0.png resize: (199, 249) 1381718008 -1.020776681537258 treat image : temp/1757067030_4136436_1381699478_cb68f466e7cccec4275d5260782f18a7_rle_crop_3945967914_0.png resize: (160, 201) 1381718009 -1.0441453282659652 treat image : temp/1757067030_4136436_1381699445_1321788de8032e243de62ec5495c6c7f_rle_crop_3945967918_0.png resize: (148, 148) 1381718010 0.4072888602895498 treat image : temp/1757067030_4136436_1381699445_1321788de8032e243de62ec5495c6c7f_rle_crop_3945967920_0.png resize: (516, 325) 1381718011 -0.7219912416868844 treat image : temp/1757067030_4136436_1381699431_31d836ad90237f2fd642d62df26209ac_rle_crop_3945967921_0.png resize: (163, 233) 1381718012 -1.5258163273197007 treat image : temp/1757067030_4136436_1381699431_31d836ad90237f2fd642d62df26209ac_rle_crop_3945967923_0.png resize: (519, 284) 1381718013 -0.8799233278059762 treat image : temp/1757067030_4136436_1381699431_31d836ad90237f2fd642d62df26209ac_rle_crop_3945967926_0.png resize: (176, 150) 1381718014 -0.7163393436921602 treat image : temp/1757067030_4136436_1381701752_0c6808c3caa48b28c6c153e7d04683ea_rle_crop_3945967820_0.png resize: (71, 69) 1381718019 7.024893465300926 treat image : temp/1757067030_4136436_1381701141_0ce117899e6ad373d45826152524e98e_rle_crop_3945967857_0.png resize: (110, 98) 1381718020 -0.4850574366214633 treat image : temp/1757067030_4136436_1381701030_4faa5bce65c04b17966cc3ee3ce5d041_rle_crop_3945967863_0.png resize: (75, 87) 1381718021 1.295977324372559 treat image : temp/1757067030_4136436_1381700966_d206e5240f091cc4bd7554c70457ad4d_rle_crop_3945967865_0.png resize: (83, 75) 1381718022 -0.13917585924791542 treat image : temp/1757067030_4136436_1381700316_9f6163170536ee735d6383bfc79796d2_rle_crop_3945967873_0.png resize: (98, 140) 1381718023 -0.7377303454748756 treat image : temp/1757067030_4136436_1381700165_a4d2a5e8cd3944f89c5eec8db86eeefb_rle_crop_3945967877_0.png resize: (81, 107) 1381718024 1.6007221856400313 treat image : temp/1757067030_4136436_1381700117_b0157d4eb8d4b02fe290d43777ac93ae_rle_crop_3945967878_0.png resize: (80, 95) 1381718025 -0.5564235579437955 treat image : temp/1757067030_4136436_1381700117_b0157d4eb8d4b02fe290d43777ac93ae_rle_crop_3945967880_0.png resize: (139, 145) 1381718026 -2.7736748971259386 treat image : temp/1757067030_4136436_1381699830_ca876b6ca61b9e7f3d83963ba4e1c808_rle_crop_3945967889_0.png resize: (133, 122) 1381718027 -2.166513680071469 treat image : temp/1757067030_4136436_1381699778_fcf61a7efe1cf4904efce4612830d4fd_rle_crop_3945967898_0.png resize: (165, 122) 1381718028 -0.06972792041150945 treat image : temp/1757067030_4136436_1381701784_0348902930c6748d240fcf6800bdcc1b_rle_crop_3945967809_0.png resize: (88, 114) 1381718033 0.3877352179286324 treat image : temp/1757067030_4136436_1381699858_e08283d054a34185c048ba97a8cdcc69_rle_crop_3945967887_0.png resize: (155, 167) 1381718034 -1.2414439726565127 treat image : temp/1757067030_4136436_1381701439_8af45327776f95d9f70d3e96e4ff123f_rle_crop_3945967830_0.png resize: (103, 116) 1381718037 -2.168727124175317 treat image : temp/1757067030_4136436_1381701439_8af45327776f95d9f70d3e96e4ff123f_rle_crop_3945967831_0.png resize: (90, 69) 1381718038 1.8258535797288138 treat image : temp/1757067030_4136436_1381701439_8af45327776f95d9f70d3e96e4ff123f_rle_crop_3945967832_0.png resize: (73, 105) 1381718039 -0.7008345715747344 treat image : temp/1757067030_4136436_1381701369_8ded124f2821fb76bf9089e075120aad_rle_crop_3945967841_0.png resize: (118, 97) 1381718040 -1.1437195419632216 treat image : temp/1757067030_4136436_1381700117_b0157d4eb8d4b02fe290d43777ac93ae_rle_crop_3945967881_0.png resize: (141, 240) 1381718041 -1.247626424214826 treat image : temp/1757067030_4136436_1381699830_ca876b6ca61b9e7f3d83963ba4e1c808_rle_crop_3945967895_0.png resize: (169, 302) 1381718042 -2.0588389958456386 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 159 time used for this insertion : 0.019208192825317383 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 159 time used for this insertion : 0.029848098754882812 save missing photos in datou_result : time spend for datou_step_exec : 26.46039652824402 time spend to save output : 0.05486559867858887 total time spend for step 6 : 26.515262126922607 step7:brightness Fri Sep 5 12:13:12 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1757067030_4136436_1381701805_3ce2789473ac5317d1c147fcbf53a9ba.jpg treat image : temp/1757067030_4136436_1381701792_15121804484579dea1f3d6da0c7e074b.jpg treat image : temp/1757067030_4136436_1381701784_0348902930c6748d240fcf6800bdcc1b.jpg treat image : temp/1757067030_4136436_1381701755_c12431a31cbf95b41cdbc1493e30c768.jpg treat image : temp/1757067030_4136436_1381701752_0c6808c3caa48b28c6c153e7d04683ea.jpg treat image : temp/1757067030_4136436_1381701502_454124e5ff2539a4383ac9d6655b8d79.jpg treat image : temp/1757067030_4136436_1381701477_196379ae7428be3cdff9c340119e25be.jpg treat image : temp/1757067030_4136436_1381701439_8af45327776f95d9f70d3e96e4ff123f.jpg treat image : temp/1757067030_4136436_1381701386_bec76c481ea5e7daf0b356f76690f5ff.jpg treat image : temp/1757067030_4136436_1381701369_8ded124f2821fb76bf9089e075120aad.jpg treat image : temp/1757067030_4136436_1381701356_70b9c57436791d9ef1c1f2b7e545d432.jpg treat image : temp/1757067030_4136436_1381701141_0ce117899e6ad373d45826152524e98e.jpg treat image : temp/1757067030_4136436_1381701030_4faa5bce65c04b17966cc3ee3ce5d041.jpg treat image : temp/1757067030_4136436_1381700966_d206e5240f091cc4bd7554c70457ad4d.jpg treat image : temp/1757067030_4136436_1381700824_cf593b54ce7883419b4a29b4ded7ff3c.jpg treat image : temp/1757067030_4136436_1381700370_f20cf0999d1a20325585f85b13771d4e.jpg treat image : temp/1757067030_4136436_1381700316_9f6163170536ee735d6383bfc79796d2.jpg treat image : temp/1757067030_4136436_1381700233_6e1c77d2bcb670a1172f72d2aa40658a.jpg treat image : temp/1757067030_4136436_1381700165_a4d2a5e8cd3944f89c5eec8db86eeefb.jpg treat image : temp/1757067030_4136436_1381700117_b0157d4eb8d4b02fe290d43777ac93ae.jpg treat image : temp/1757067030_4136436_1381700060_e5c3af34cb2b352a4aae9190f9bb8daf.jpg treat image : temp/1757067030_4136436_1381699858_e08283d054a34185c048ba97a8cdcc69.jpg treat image : temp/1757067030_4136436_1381699830_ca876b6ca61b9e7f3d83963ba4e1c808.jpg treat image : temp/1757067030_4136436_1381699798_1413a61c587f5358fec00e57d846bd01.jpg treat image : temp/1757067030_4136436_1381699778_fcf61a7efe1cf4904efce4612830d4fd.jpg treat image : temp/1757067030_4136436_1381699751_2ff5ab07454d0a928e4f78da9be955c3.jpg treat image : temp/1757067030_4136436_1381699726_25f72cc4ee3d9852ee6398d432179824.jpg treat image : temp/1757067030_4136436_1381699518_78eeae2ddb810cc903e4067e2e99c8d2.jpg treat image : temp/1757067030_4136436_1381699503_79d87b0f62ce5a8dd9d4606c96b69165.jpg treat image : temp/1757067030_4136436_1381699478_cb68f466e7cccec4275d5260782f18a7.jpg treat image : temp/1757067030_4136436_1381699445_1321788de8032e243de62ec5495c6c7f.jpg treat image : temp/1757067030_4136436_1381699431_31d836ad90237f2fd642d62df26209ac.jpg treat image : temp/1757067030_4136436_1381701805_3ce2789473ac5317d1c147fcbf53a9ba_rle_crop_3945967800_0.png treat image : temp/1757067030_4136436_1381701792_15121804484579dea1f3d6da0c7e074b_rle_crop_3945967803_0.png treat image : temp/1757067030_4136436_1381701792_15121804484579dea1f3d6da0c7e074b_rle_crop_3945967804_0.png treat image : temp/1757067030_4136436_1381701792_15121804484579dea1f3d6da0c7e074b_rle_crop_3945967805_0.png treat image : temp/1757067030_4136436_1381701792_15121804484579dea1f3d6da0c7e074b_rle_crop_3945967806_0.png treat image : temp/1757067030_4136436_1381701784_0348902930c6748d240fcf6800bdcc1b_rle_crop_3945967807_0.png treat image : temp/1757067030_4136436_1381701784_0348902930c6748d240fcf6800bdcc1b_rle_crop_3945967808_0.png treat image : temp/1757067030_4136436_1381701784_0348902930c6748d240fcf6800bdcc1b_rle_crop_3945967810_0.png treat image : temp/1757067030_4136436_1381701755_c12431a31cbf95b41cdbc1493e30c768_rle_crop_3945967813_0.png treat image : temp/1757067030_4136436_1381701755_c12431a31cbf95b41cdbc1493e30c768_rle_crop_3945967814_0.png treat image : temp/1757067030_4136436_1381701752_0c6808c3caa48b28c6c153e7d04683ea_rle_crop_3945967816_0.png treat image : temp/1757067030_4136436_1381701752_0c6808c3caa48b28c6c153e7d04683ea_rle_crop_3945967818_0.png treat image : temp/1757067030_4136436_1381701752_0c6808c3caa48b28c6c153e7d04683ea_rle_crop_3945967819_0.png treat image : temp/1757067030_4136436_1381701752_0c6808c3caa48b28c6c153e7d04683ea_rle_crop_3945967822_0.png treat image : temp/1757067030_4136436_1381701502_454124e5ff2539a4383ac9d6655b8d79_rle_crop_3945967823_0.png treat image : temp/1757067030_4136436_1381701502_454124e5ff2539a4383ac9d6655b8d79_rle_crop_3945967825_0.png treat image : temp/1757067030_4136436_1381701477_196379ae7428be3cdff9c340119e25be_rle_crop_3945967828_0.png treat image : temp/1757067030_4136436_1381701386_bec76c481ea5e7daf0b356f76690f5ff_rle_crop_3945967834_0.png treat image : temp/1757067030_4136436_1381701386_bec76c481ea5e7daf0b356f76690f5ff_rle_crop_3945967835_0.png treat image : temp/1757067030_4136436_1381701386_bec76c481ea5e7daf0b356f76690f5ff_rle_crop_3945967838_0.png treat image : temp/1757067030_4136436_1381701386_bec76c481ea5e7daf0b356f76690f5ff_rle_crop_3945967839_0.png treat image : temp/1757067030_4136436_1381701386_bec76c481ea5e7daf0b356f76690f5ff_rle_crop_3945967840_0.png treat image : temp/1757067030_4136436_1381701356_70b9c57436791d9ef1c1f2b7e545d432_rle_crop_3945967848_0.png treat image : temp/1757067030_4136436_1381701356_70b9c57436791d9ef1c1f2b7e545d432_rle_crop_3945967850_0.png treat image : temp/1757067030_4136436_1381701141_0ce117899e6ad373d45826152524e98e_rle_crop_3945967851_0.png treat image : temp/1757067030_4136436_1381701141_0ce117899e6ad373d45826152524e98e_rle_crop_3945967852_0.png treat image : temp/1757067030_4136436_1381701141_0ce117899e6ad373d45826152524e98e_rle_crop_3945967854_0.png treat image : temp/1757067030_4136436_1381701141_0ce117899e6ad373d45826152524e98e_rle_crop_3945967856_0.png treat image : temp/1757067030_4136436_1381701030_4faa5bce65c04b17966cc3ee3ce5d041_rle_crop_3945967860_0.png treat image : temp/1757067030_4136436_1381700966_d206e5240f091cc4bd7554c70457ad4d_rle_crop_3945967864_0.png treat image : temp/1757067030_4136436_1381700966_d206e5240f091cc4bd7554c70457ad4d_rle_crop_3945967866_0.png treat image : temp/1757067030_4136436_1381700824_cf593b54ce7883419b4a29b4ded7ff3c_rle_crop_3945967868_0.png treat image : temp/1757067030_4136436_1381700824_cf593b54ce7883419b4a29b4ded7ff3c_rle_crop_3945967869_0.png treat image : temp/1757067030_4136436_1381700824_cf593b54ce7883419b4a29b4ded7ff3c_rle_crop_3945967870_0.png treat image : temp/1757067030_4136436_1381700370_f20cf0999d1a20325585f85b13771d4e_rle_crop_3945967872_0.png treat image : temp/1757067030_4136436_1381700233_6e1c77d2bcb670a1172f72d2aa40658a_rle_crop_3945967876_0.png treat image : temp/1757067030_4136436_1381700117_b0157d4eb8d4b02fe290d43777ac93ae_rle_crop_3945967879_0.png treat image : temp/1757067030_4136436_1381699830_ca876b6ca61b9e7f3d83963ba4e1c808_rle_crop_3945967888_0.png treat image : temp/1757067030_4136436_1381699830_ca876b6ca61b9e7f3d83963ba4e1c808_rle_crop_3945967891_0.png treat image : temp/1757067030_4136436_1381699830_ca876b6ca61b9e7f3d83963ba4e1c808_rle_crop_3945967894_0.png treat image : temp/1757067030_4136436_1381699798_1413a61c587f5358fec00e57d846bd01_rle_crop_3945967896_0.png treat image : temp/1757067030_4136436_1381699751_2ff5ab07454d0a928e4f78da9be955c3_rle_crop_3945967899_0.png treat image : temp/1757067030_4136436_1381699751_2ff5ab07454d0a928e4f78da9be955c3_rle_crop_3945967900_0.png treat image : temp/1757067030_4136436_1381699726_25f72cc4ee3d9852ee6398d432179824_rle_crop_3945967904_0.png treat image : temp/1757067030_4136436_1381699726_25f72cc4ee3d9852ee6398d432179824_rle_crop_3945967905_0.png treat image : temp/1757067030_4136436_1381699726_25f72cc4ee3d9852ee6398d432179824_rle_crop_3945967906_0.png treat image : temp/1757067030_4136436_1381699518_78eeae2ddb810cc903e4067e2e99c8d2_rle_crop_3945967909_0.png treat image : temp/1757067030_4136436_1381699518_78eeae2ddb810cc903e4067e2e99c8d2_rle_crop_3945967910_0.png treat image : temp/1757067030_4136436_1381699518_78eeae2ddb810cc903e4067e2e99c8d2_rle_crop_3945967911_0.png treat image : temp/1757067030_4136436_1381699503_79d87b0f62ce5a8dd9d4606c96b69165_rle_crop_3945967913_0.png treat image : temp/1757067030_4136436_1381699478_cb68f466e7cccec4275d5260782f18a7_rle_crop_3945967915_0.png treat image : temp/1757067030_4136436_1381699478_cb68f466e7cccec4275d5260782f18a7_rle_crop_3945967916_0.png treat image : temp/1757067030_4136436_1381699445_1321788de8032e243de62ec5495c6c7f_rle_crop_3945967919_0.png treat image : temp/1757067030_4136436_1381699431_31d836ad90237f2fd642d62df26209ac_rle_crop_3945967922_0.png treat image : temp/1757067030_4136436_1381699431_31d836ad90237f2fd642d62df26209ac_rle_crop_3945967924_0.png treat image : temp/1757067030_4136436_1381699431_31d836ad90237f2fd642d62df26209ac_rle_crop_3945967925_0.png treat image : temp/1757067030_4136436_1381701805_3ce2789473ac5317d1c147fcbf53a9ba_rle_crop_3945967801_0.png treat image : temp/1757067030_4136436_1381701784_0348902930c6748d240fcf6800bdcc1b_rle_crop_3945967812_0.png treat image : temp/1757067030_4136436_1381701502_454124e5ff2539a4383ac9d6655b8d79_rle_crop_3945967824_0.png treat image : temp/1757067030_4136436_1381701439_8af45327776f95d9f70d3e96e4ff123f_rle_crop_3945967833_0.png treat image : temp/1757067030_4136436_1381701386_bec76c481ea5e7daf0b356f76690f5ff_rle_crop_3945967836_0.png treat image : temp/1757067030_4136436_1381701386_bec76c481ea5e7daf0b356f76690f5ff_rle_crop_3945967837_0.png treat image : temp/1757067030_4136436_1381699830_ca876b6ca61b9e7f3d83963ba4e1c808_rle_crop_3945967892_0.png treat image : temp/1757067030_4136436_1381699726_25f72cc4ee3d9852ee6398d432179824_rle_crop_3945967907_0.png treat image : temp/1757067030_4136436_1381699478_cb68f466e7cccec4275d5260782f18a7_rle_crop_3945967917_0.png treat image : temp/1757067030_4136436_1381701369_8ded124f2821fb76bf9089e075120aad_rle_crop_3945967842_0.png treat image : temp/1757067030_4136436_1381701369_8ded124f2821fb76bf9089e075120aad_rle_crop_3945967843_0.png treat image : temp/1757067030_4136436_1381701141_0ce117899e6ad373d45826152524e98e_rle_crop_3945967853_0.png treat image : temp/1757067030_4136436_1381701805_3ce2789473ac5317d1c147fcbf53a9ba_rle_crop_3945967802_0.png treat image : temp/1757067030_4136436_1381701784_0348902930c6748d240fcf6800bdcc1b_rle_crop_3945967811_0.png treat image : temp/1757067030_4136436_1381701755_c12431a31cbf95b41cdbc1493e30c768_rle_crop_3945967815_0.png treat image : temp/1757067030_4136436_1381701752_0c6808c3caa48b28c6c153e7d04683ea_rle_crop_3945967817_0.png treat image : temp/1757067030_4136436_1381701752_0c6808c3caa48b28c6c153e7d04683ea_rle_crop_3945967821_0.png treat image : temp/1757067030_4136436_1381701477_196379ae7428be3cdff9c340119e25be_rle_crop_3945967826_0.png treat image : temp/1757067030_4136436_1381701477_196379ae7428be3cdff9c340119e25be_rle_crop_3945967827_0.png treat image : temp/1757067030_4136436_1381701477_196379ae7428be3cdff9c340119e25be_rle_crop_3945967829_0.png treat image : temp/1757067030_4136436_1381701356_70b9c57436791d9ef1c1f2b7e545d432_rle_crop_3945967844_0.png treat image : temp/1757067030_4136436_1381701356_70b9c57436791d9ef1c1f2b7e545d432_rle_crop_3945967845_0.png treat image : temp/1757067030_4136436_1381701356_70b9c57436791d9ef1c1f2b7e545d432_rle_crop_3945967846_0.png treat image : temp/1757067030_4136436_1381701356_70b9c57436791d9ef1c1f2b7e545d432_rle_crop_3945967847_0.png treat image : temp/1757067030_4136436_1381701356_70b9c57436791d9ef1c1f2b7e545d432_rle_crop_3945967849_0.png treat image : temp/1757067030_4136436_1381701141_0ce117899e6ad373d45826152524e98e_rle_crop_3945967855_0.png treat image : temp/1757067030_4136436_1381701141_0ce117899e6ad373d45826152524e98e_rle_crop_3945967858_0.png treat image : temp/1757067030_4136436_1381701030_4faa5bce65c04b17966cc3ee3ce5d041_rle_crop_3945967859_0.png treat image : temp/1757067030_4136436_1381701030_4faa5bce65c04b17966cc3ee3ce5d041_rle_crop_3945967861_0.png treat image : temp/1757067030_4136436_1381701030_4faa5bce65c04b17966cc3ee3ce5d041_rle_crop_3945967862_0.png treat image : temp/1757067030_4136436_1381700966_d206e5240f091cc4bd7554c70457ad4d_rle_crop_3945967867_0.png treat image : temp/1757067030_4136436_1381700370_f20cf0999d1a20325585f85b13771d4e_rle_crop_3945967871_0.png treat image : temp/1757067030_4136436_1381700316_9f6163170536ee735d6383bfc79796d2_rle_crop_3945967874_0.png treat image : temp/1757067030_4136436_1381700233_6e1c77d2bcb670a1172f72d2aa40658a_rle_crop_3945967875_0.png treat image : temp/1757067030_4136436_1381700060_e5c3af34cb2b352a4aae9190f9bb8daf_rle_crop_3945967882_0.png treat image : temp/1757067030_4136436_1381699858_e08283d054a34185c048ba97a8cdcc69_rle_crop_3945967883_0.png treat image : temp/1757067030_4136436_1381699858_e08283d054a34185c048ba97a8cdcc69_rle_crop_3945967884_0.png treat image : temp/1757067030_4136436_1381699858_e08283d054a34185c048ba97a8cdcc69_rle_crop_3945967885_0.png treat image : temp/1757067030_4136436_1381699858_e08283d054a34185c048ba97a8cdcc69_rle_crop_3945967886_0.png treat image : temp/1757067030_4136436_1381699830_ca876b6ca61b9e7f3d83963ba4e1c808_rle_crop_3945967890_0.png treat image : temp/1757067030_4136436_1381699830_ca876b6ca61b9e7f3d83963ba4e1c808_rle_crop_3945967893_0.png treat image : temp/1757067030_4136436_1381699778_fcf61a7efe1cf4904efce4612830d4fd_rle_crop_3945967897_0.png treat image : temp/1757067030_4136436_1381699751_2ff5ab07454d0a928e4f78da9be955c3_rle_crop_3945967901_0.png treat image : temp/1757067030_4136436_1381699751_2ff5ab07454d0a928e4f78da9be955c3_rle_crop_3945967902_0.png treat image : temp/1757067030_4136436_1381699726_25f72cc4ee3d9852ee6398d432179824_rle_crop_3945967903_0.png treat image : temp/1757067030_4136436_1381699518_78eeae2ddb810cc903e4067e2e99c8d2_rle_crop_3945967908_0.png treat image : temp/1757067030_4136436_1381699503_79d87b0f62ce5a8dd9d4606c96b69165_rle_crop_3945967912_0.png treat image : temp/1757067030_4136436_1381699478_cb68f466e7cccec4275d5260782f18a7_rle_crop_3945967914_0.png treat image : temp/1757067030_4136436_1381699445_1321788de8032e243de62ec5495c6c7f_rle_crop_3945967918_0.png treat image : temp/1757067030_4136436_1381699445_1321788de8032e243de62ec5495c6c7f_rle_crop_3945967920_0.png treat image : temp/1757067030_4136436_1381699431_31d836ad90237f2fd642d62df26209ac_rle_crop_3945967921_0.png treat image : temp/1757067030_4136436_1381699431_31d836ad90237f2fd642d62df26209ac_rle_crop_3945967923_0.png treat image : temp/1757067030_4136436_1381699431_31d836ad90237f2fd642d62df26209ac_rle_crop_3945967926_0.png treat image : temp/1757067030_4136436_1381701752_0c6808c3caa48b28c6c153e7d04683ea_rle_crop_3945967820_0.png treat image : temp/1757067030_4136436_1381701141_0ce117899e6ad373d45826152524e98e_rle_crop_3945967857_0.png treat image : temp/1757067030_4136436_1381701030_4faa5bce65c04b17966cc3ee3ce5d041_rle_crop_3945967863_0.png treat image : temp/1757067030_4136436_1381700966_d206e5240f091cc4bd7554c70457ad4d_rle_crop_3945967865_0.png treat image : temp/1757067030_4136436_1381700316_9f6163170536ee735d6383bfc79796d2_rle_crop_3945967873_0.png treat image : temp/1757067030_4136436_1381700165_a4d2a5e8cd3944f89c5eec8db86eeefb_rle_crop_3945967877_0.png treat image : temp/1757067030_4136436_1381700117_b0157d4eb8d4b02fe290d43777ac93ae_rle_crop_3945967878_0.png treat image : temp/1757067030_4136436_1381700117_b0157d4eb8d4b02fe290d43777ac93ae_rle_crop_3945967880_0.png treat image : temp/1757067030_4136436_1381699830_ca876b6ca61b9e7f3d83963ba4e1c808_rle_crop_3945967889_0.png treat image : temp/1757067030_4136436_1381699778_fcf61a7efe1cf4904efce4612830d4fd_rle_crop_3945967898_0.png treat image : temp/1757067030_4136436_1381701784_0348902930c6748d240fcf6800bdcc1b_rle_crop_3945967809_0.png treat image : temp/1757067030_4136436_1381699858_e08283d054a34185c048ba97a8cdcc69_rle_crop_3945967887_0.png treat image : temp/1757067030_4136436_1381701439_8af45327776f95d9f70d3e96e4ff123f_rle_crop_3945967830_0.png treat image : temp/1757067030_4136436_1381701439_8af45327776f95d9f70d3e96e4ff123f_rle_crop_3945967831_0.png treat image : temp/1757067030_4136436_1381701439_8af45327776f95d9f70d3e96e4ff123f_rle_crop_3945967832_0.png treat image : temp/1757067030_4136436_1381701369_8ded124f2821fb76bf9089e075120aad_rle_crop_3945967841_0.png treat image : temp/1757067030_4136436_1381700117_b0157d4eb8d4b02fe290d43777ac93ae_rle_crop_3945967881_0.png treat image : temp/1757067030_4136436_1381699830_ca876b6ca61b9e7f3d83963ba4e1c808_rle_crop_3945967895_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 159 time used for this insertion : 0.01873469352722168 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 159 time used for this insertion : 0.033362627029418945 save missing photos in datou_result : time spend for datou_step_exec : 7.681877851486206 time spend to save output : 0.05799102783203125 total time spend for step 7 : 7.739868879318237 step8:velours_tree Fri Sep 5 12:13:20 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.4058845043182373 time spend to save output : 9.799003601074219e-05 total time spend for step 8 : 0.40598249435424805 step9:send_mail_cod Fri Sep 5 12:13:20 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P26574891_05-09-2025_12_13_20.pdf 26575308 imagette265753081757067200 26575309 imagette265753091757067200 26575310 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette265753101757067200 26575311 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette265753111757067201 26575312 change filename to text .change filename to text .imagette265753121757067202 26575313 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette265753131757067202 26575314 change filename to text .change filename to text .change filename to text .imagette265753141757067202 26575315 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette265753151757067203 26575316 imagette265753161757067204 26575317 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette265753171757067204 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=26574891 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/26575307,26575308,26575309,26575310,26575311,26575312,26575313,26575314,26575315,26575316,26575317?tags=environnement,mal_croppe,background,carton,papier,pehd,pet_fonce,metal,pet_clair,flou,autre args[1381701805] : ((1381701805, 0.838186713063724, 492688767), (1381701805, 0.47637275873286006, 2107752395), '0.046818832585841054') We are sending mail with results at report@fotonower.com args[1381701792] : ((1381701792, 0.697077624418037, 492688767), (1381701792, 0.40360842212555387, 2107752395), '0.046818832585841054') We are sending mail with results at report@fotonower.com args[1381701784] : ((1381701784, 0.5651057646781048, 492688767), (1381701784, 0.44247652407055404, 2107752395), '0.046818832585841054') We are sending mail with results at report@fotonower.com args[1381701755] : ((1381701755, 3.461008712453646, 492688767), (1381701755, 0.5550698827178332, 2107752395), '0.046818832585841054') We are sending mail with results at report@fotonower.com args[1381701752] : ((1381701752, -0.05546217869031099, 492688767), (1381701752, 0.8194336035106736, 2107752395), '0.046818832585841054') We are sending mail with results at report@fotonower.com args[1381701502] : ((1381701502, 0.6520094546198199, 492688767), (1381701502, 0.5624844368270538, 2107752395), '0.046818832585841054') We are sending mail with results at report@fotonower.com args[1381701477] : ((1381701477, 0.6102889523700906, 492688767), (1381701477, 0.49774853405804964, 2107752395), '0.046818832585841054') We are sending mail with results at report@fotonower.com args[1381701439] : ((1381701439, 0.349526182110343, 492688767), (1381701439, 0.6913662847772767, 2107752395), '0.046818832585841054') We are sending mail with results at report@fotonower.com args[1381701386] : ((1381701386, 0.6165981685015487, 492688767), (1381701386, 0.46164745889492786, 2107752395), '0.046818832585841054') We are sending mail with results at report@fotonower.com args[1381701369] : ((1381701369, -0.16454169819267875, 492688767), (1381701369, 0.3547487982157153, 2107752395), '0.046818832585841054') We are sending mail with results at report@fotonower.com args[1381701356] : ((1381701356, 0.9715008321951751, 492688767), (1381701356, 0.3602469052803759, 2107752395), '0.046818832585841054') We are sending mail with results at report@fotonower.com args[1381701141] : ((1381701141, 0.6859312327573975, 492688767), (1381701141, 0.47030093313309235, 2107752395), '0.046818832585841054') We are sending mail with results at report@fotonower.com args[1381701030] : ((1381701030, 0.5626548145262892, 492688767), (1381701030, 0.5939448383693582, 2107752395), '0.046818832585841054') We are sending mail with results at report@fotonower.com args[1381700966] : ((1381700966, -3.6505902667984063, 492609224), (1381700966, 0.41551647522149915, 2107752395), '0.046818832585841054') We are sending mail with results at report@fotonower.com args[1381700824] : ((1381700824, 2.7118196847535323, 492688767), (1381700824, 0.4043174892396837, 2107752395), '0.046818832585841054') We are sending mail with results at report@fotonower.com args[1381700370] : ((1381700370, -0.15222772515083696, 492688767), (1381700370, 0.3146366091397289, 2107752395), '0.046818832585841054') We are sending mail with results at report@fotonower.com args[1381700316] : ((1381700316, 1.53908451157688, 492688767), (1381700316, 0.6945309420418925, 2107752395), '0.046818832585841054') We are sending mail with results at report@fotonower.com args[1381700233] : ((1381700233, -3.316690182011308, 492609224), (1381700233, 0.32072839022442007, 2107752395), '0.046818832585841054') We are sending mail with results at report@fotonower.com args[1381700165] : ((1381700165, 0.33785578826193663, 492688767), (1381700165, 0.868744786196445, 2107752395), '0.046818832585841054') We are sending mail with results at report@fotonower.com args[1381700117] : ((1381700117, -3.5091778803954026, 492609224), (1381700117, 0.39641762975735667, 2107752395), '0.046818832585841054') We are sending mail with results at report@fotonower.com args[1381700060] : ((1381700060, 0.8164902933525057, 492688767), (1381700060, 0.6270499931934324, 2107752395), '0.046818832585841054') We are sending mail with results at report@fotonower.com args[1381699858] : ((1381699858, 0.41292642593980133, 492688767), (1381699858, 0.7688085475553786, 2107752395), '0.046818832585841054') We are sending mail with results at report@fotonower.com args[1381699830] : ((1381699830, -2.0910990157650233, 492609224), (1381699830, 0.304100305563953, 2107752395), '0.046818832585841054') We are sending mail with results at report@fotonower.com args[1381699798] : ((1381699798, -0.3152303783949583, 492688767), (1381699798, 0.8743491290825849, 2107752395), '0.046818832585841054') We are sending mail with results at report@fotonower.com args[1381699778] : ((1381699778, 0.8075326945985144, 492688767), (1381699778, 0.8182214327190834, 2107752395), '0.046818832585841054') We are sending mail with results at report@fotonower.com args[1381699751] : ((1381699751, 2.5992548578637695, 492688767), (1381699751, 0.40758415340117693, 2107752395), '0.046818832585841054') We are sending mail with results at report@fotonower.com args[1381699726] : ((1381699726, 0.8485891518181408, 492688767), (1381699726, 0.5476118040628687, 2107752395), '0.046818832585841054') We are sending mail with results at report@fotonower.com args[1381699518] : ((1381699518, 1.3995666706730594, 492688767), (1381699518, 0.5613720614568991, 2107752395), '0.046818832585841054') We are sending mail with results at report@fotonower.com args[1381699503] : ((1381699503, 0.07666023626820091, 492688767), (1381699503, 0.9108868692262563, 2107752395), '0.046818832585841054') We are sending mail with results at report@fotonower.com args[1381699478] : ((1381699478, 1.0078895328926007, 492688767), (1381699478, 0.6037521716535759, 2107752395), '0.046818832585841054') We are sending mail with results at report@fotonower.com args[1381699445] : ((1381699445, 1.358676841034101, 492688767), (1381699445, 0.8278306586312865, 2107752395), '0.046818832585841054') We are sending mail with results at report@fotonower.com args[1381699431] : ((1381699431, 0.5532025409577144, 492688767), (1381699431, 0.7487847506130813, 2107752395), '0.046818832585841054') We are sending mail with results at report@fotonower.com refus_total : 0.046818832585841054 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=26574891 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26574891_05-09-2025_12_13_20.pdf results_Auto_P26574891_05-09-2025_12_13_20.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26574891_05-09-2025_12_13_20.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','26574891','results_Auto_P26574891_05-09-2025_12_13_20.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26574891_05-09-2025_12_13_20.pdf','pdf','','0.47','0.046818832585841054') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/26574891

https://www.fotonower.com/image?json=false&list_photos_id=1381701805
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381701792
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381701784
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381701755
La photo est trop floue, merci de reprendre une photo.(avec le score = 3.461008712453646)
https://www.fotonower.com/image?json=false&list_photos_id=1381701752
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381701502
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381701477
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381701439
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381701386
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381701369
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381701356
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381701141
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381701030
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381700966
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381700824
La photo est trop floue, merci de reprendre une photo.(avec le score = 2.7118196847535323)
https://www.fotonower.com/image?json=false&list_photos_id=1381700370
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381700316
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.53908451157688)
https://www.fotonower.com/image?json=false&list_photos_id=1381700233
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381700165
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381700117
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381700060
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381699858
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381699830
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381699798
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381699778
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381699751
La photo est trop floue, merci de reprendre une photo.(avec le score = 2.5992548578637695)
https://www.fotonower.com/image?json=false&list_photos_id=1381699726
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381699518
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.3995666706730594)
https://www.fotonower.com/image?json=false&list_photos_id=1381699503
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381699478
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.0078895328926007)
https://www.fotonower.com/image?json=false&list_photos_id=1381699445
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.358676841034101)
https://www.fotonower.com/image?json=false&list_photos_id=1381699431
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 4.68%
Veuillez trouver les photos des contaminants.

exemples de contaminants: carton: https://www.fotonower.com/view/26575310?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/26575311?limit=200
exemples de contaminants: pehd: https://www.fotonower.com/view/26575312?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/26575313?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/26575314?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/26575315?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/26575317?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26574891_05-09-2025_12_13_20.pdf.

Lien vers velours :https://marlene.fotonower.com/velours/26575307,26575308,26575309,26575310,26575311,26575312,26575313,26575314,26575315,26575316,26575317?tags=environnement,mal_croppe,background,carton,papier,pehd,pet_fonce,metal,pet_clair,flou,autre.


L'équipe Fotonower 202 b'' Server: nginx Date: Fri, 05 Sep 2025 10:13:27 GMT Content-Length: 0 Connection: close X-Message-Id: WxX2VEvwSO2GOG4fmgYY7w Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1381701805, 1381701792, 1381701784, 1381701755, 1381701752, 1381701502, 1381701477, 1381701439, 1381701386, 1381701369, 1381701356, 1381701141, 1381701030, 1381700966, 1381700824, 1381700370, 1381700316, 1381700233, 1381700165, 1381700117, 1381700060, 1381699858, 1381699830, 1381699798, 1381699778, 1381699751, 1381699726, 1381699518, 1381699503, 1381699478, 1381699445, 1381699431] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701805', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701792', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701784', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701755', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701752', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701502', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701477', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701439', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701386', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701369', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701356', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701141', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701030', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381700966', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381700824', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381700370', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381700316', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381700233', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381700165', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381700117', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381700060', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381699858', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381699830', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381699798', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381699778', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381699751', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381699726', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381699518', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381699503', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381699478', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381699445', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381699431', None, None, None, None, None, '3669705') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 32 time used for this insertion : 0.01649641990661621 save_final save missing photos in datou_result : time spend for datou_step_exec : 7.230107069015503 time spend to save output : 0.016962528228759766 total time spend for step 9 : 7.247069597244263 step10:split_time_score Fri Sep 5 12:13:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('11', 32),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 05092025 26574891 Nombre de photos uploadées : 32 / 23040 (0%) 05092025 26574891 Nombre de photos taguées (types de déchets): 0 / 32 (0%) 05092025 26574891 Nombre de photos taguées (volume) : 0 / 32 (0%) elapsed_time : load_data_split_time_score 1.9073486328125e-06 elapsed_time : order_list_meta_photo_and_scores 5.7220458984375e-06 ???????????????????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0015952587127685547 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.22859716415405273 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.09195606235970821 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26566359_05-09-2025_08_12_43.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26566359 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26566359 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26574866 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26574888 order by id desc limit 1 Qualite : 0.046818832585841054 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26574891_05-09-2025_12_13_20.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26574891 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26574891 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'05092025': {'nb_upload': 32, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1381701805, 1381701792, 1381701784, 1381701755, 1381701752, 1381701502, 1381701477, 1381701439, 1381701386, 1381701369, 1381701356, 1381701141, 1381701030, 1381700966, 1381700824, 1381700370, 1381700316, 1381700233, 1381700165, 1381700117, 1381700060, 1381699858, 1381699830, 1381699798, 1381699778, 1381699751, 1381699726, 1381699518, 1381699503, 1381699478, 1381699445, 1381699431] Looping around the photos to save general results len do output : 1 /26574891Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701805', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701792', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701784', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701755', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701752', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701502', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701477', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701439', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701386', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701369', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701356', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701141', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381701030', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381700966', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381700824', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381700370', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381700316', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381700233', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381700165', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381700117', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381700060', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381699858', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381699830', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381699798', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381699778', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381699751', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381699726', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381699518', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381699503', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381699478', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381699445', None, None, None, None, None, '3669705') ('3318', None, None, None, None, None, None, None, '3669705') ('3318', '26574891', '1381699431', None, None, None, None, None, '3669705') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 33 time used for this insertion : 0.01907944679260254 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.4677066802978516 time spend to save output : 0.01954960823059082 total time spend for step 10 : 2.4872562885284424 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 32 set_done_treatment 95.67user 37.95system 3:05.10elapsed 72%CPU (0avgtext+0avgdata 3283956maxresident)k 1748728inputs+39288outputs (18892major+2864728minor)pagefaults 0swaps