python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 890012 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3972170'] with mtr_portfolio_ids : ['28010444'] and first list_photo_ids : [] new path : /proc/890012/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 6 ; length of list_pids : 6 ; length of list_args : 6 time to download the photos : 1.6981918811798096 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Fri Oct 31 09:50:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10998 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-10-31 09:50:34.796097: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-10-31 09:50:34.846528: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493010000 Hz 2025-10-31 09:50:34.851894: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f37bc000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-10-31 09:50:34.851962: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-10-31 09:50:34.856937: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-10-31 09:50:35.417139: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0xb49fd20 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-10-31 09:50:35.417201: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-10-31 09:50:35.419916: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-10-31 09:50:35.420402: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-31 09:50:35.423091: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-31 09:50:35.426145: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-10-31 09:50:35.426760: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-10-31 09:50:35.430583: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-10-31 09:50:35.432313: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-10-31 09:50:35.437838: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-10-31 09:50:35.445846: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-10-31 09:50:35.446379: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-31 09:50:35.447969: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-10-31 09:50:35.447994: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-10-31 09:50:35.448004: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-10-31 09:50:35.452728: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10181 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-10-31 09:50:35.936423: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-10-31 09:50:35.936511: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-31 09:50:35.936529: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-31 09:50:35.936544: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-10-31 09:50:35.936559: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-10-31 09:50:35.936574: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-10-31 09:50:35.936588: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-10-31 09:50:35.936603: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-10-31 09:50:35.937908: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-10-31 09:50:35.939171: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-10-31 09:50:35.939217: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-31 09:50:35.939236: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-31 09:50:35.939253: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-10-31 09:50:35.939269: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-10-31 09:50:35.939286: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-10-31 09:50:35.939302: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-10-31 09:50:35.939319: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-10-31 09:50:35.940612: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-10-31 09:50:35.940640: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-10-31 09:50:35.940649: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-10-31 09:50:35.940657: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-10-31 09:50:35.942001: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10181 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-10-31 09:50:41.896557: W tensorflow/core/framework/cpu_allocator_impl.cc:81] Allocation of 51380224 exceeds 10% of free system memory. 2025-10-31 09:50:48.434947: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-31 09:50:48.620484: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 6 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 28 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 24 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 21 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 22 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 22 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 18 Detection mask done ! Trying to reset tf kernel 890638 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1929 tf kernel not reseted sub process len(results) : 6 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 6 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 7218 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0009412765502929688 nb_pixel_total : 39551 time to create 1 rle with old method : 0.04302978515625 length of segment : 235 time for calcul the mask position with numpy : 0.0008306503295898438 nb_pixel_total : 40052 time to create 1 rle with old method : 0.04438591003417969 length of segment : 297 time for calcul the mask position with numpy : 0.0010597705841064453 nb_pixel_total : 42901 time to create 1 rle with old method : 0.04852724075317383 length of segment : 261 time for calcul the mask position with numpy : 0.0006780624389648438 nb_pixel_total : 21835 time to create 1 rle with old method : 0.029957056045532227 length of segment : 177 time for calcul the mask position with numpy : 0.003198385238647461 nb_pixel_total : 103035 time to create 1 rle with old method : 0.11446666717529297 length of segment : 348 time for calcul the mask position with numpy : 0.00029349327087402344 nb_pixel_total : 14069 time to create 1 rle with old method : 0.01642441749572754 length of segment : 144 time for calcul the mask position with numpy : 0.0005252361297607422 nb_pixel_total : 32091 time to create 1 rle with old method : 0.038892269134521484 length of segment : 270 time for calcul the mask position with numpy : 0.0033299922943115234 nb_pixel_total : 153455 time to create 1 rle with new method : 0.007685422897338867 length of segment : 464 time for calcul the mask position with numpy : 0.0019567012786865234 nb_pixel_total : 107791 time to create 1 rle with old method : 0.12108349800109863 length of segment : 655 time for calcul the mask position with numpy : 0.00040078163146972656 nb_pixel_total : 16359 time to create 1 rle with old method : 0.019241809844970703 length of segment : 205 time for calcul the mask position with numpy : 0.00023746490478515625 nb_pixel_total : 12725 time to create 1 rle with old method : 0.014612913131713867 length of segment : 174 time for calcul the mask position with numpy : 0.0018010139465332031 nb_pixel_total : 102975 time to create 1 rle with old method : 0.12146663665771484 length of segment : 655 time for calcul the mask position with numpy : 0.0035588741302490234 nb_pixel_total : 157385 time to create 1 rle with new method : 0.014402151107788086 length of segment : 657 time for calcul the mask position with numpy : 0.0007441043853759766 nb_pixel_total : 15124 time to create 1 rle with old method : 0.019031286239624023 length of segment : 145 time for calcul the mask position with numpy : 0.0016202926635742188 nb_pixel_total : 37786 time to create 1 rle with old method : 0.04337334632873535 length of segment : 358 time for calcul the mask position with numpy : 0.002129077911376953 nb_pixel_total : 64962 time to create 1 rle with old method : 0.07265210151672363 length of segment : 251 time for calcul the mask position with numpy : 0.003502368927001953 nb_pixel_total : 102219 time to create 1 rle with old method : 0.11568856239318848 length of segment : 517 time for calcul the mask position with numpy : 0.0010385513305664062 nb_pixel_total : 26262 time to create 1 rle with old method : 0.030257701873779297 length of segment : 192 time for calcul the mask position with numpy : 0.0005621910095214844 nb_pixel_total : 11883 time to create 1 rle with old method : 0.014261007308959961 length of segment : 107 time for calcul the mask position with numpy : 0.003735780715942383 nb_pixel_total : 136961 time to create 1 rle with old method : 0.1545703411102295 length of segment : 473 time for calcul the mask position with numpy : 0.0009415149688720703 nb_pixel_total : 23725 time to create 1 rle with old method : 0.02724742889404297 length of segment : 323 time for calcul the mask position with numpy : 0.0026977062225341797 nb_pixel_total : 96633 time to create 1 rle with old method : 0.11212325096130371 length of segment : 268 time for calcul the mask position with numpy : 0.0007116794586181641 nb_pixel_total : 20987 time to create 1 rle with old method : 0.02457571029663086 length of segment : 132 time for calcul the mask position with numpy : 0.0028388500213623047 nb_pixel_total : 61871 time to create 1 rle with old method : 0.0706186294555664 length of segment : 474 time for calcul the mask position with numpy : 0.0002372264862060547 nb_pixel_total : 10366 time to create 1 rle with old method : 0.012295007705688477 length of segment : 110 time for calcul the mask position with numpy : 0.0005841255187988281 nb_pixel_total : 34280 time to create 1 rle with old method : 0.04004359245300293 length of segment : 159 time for calcul the mask position with numpy : 0.000766754150390625 nb_pixel_total : 26738 time to create 1 rle with old method : 0.031127214431762695 length of segment : 187 time for calcul the mask position with numpy : 0.0012242794036865234 nb_pixel_total : 29390 time to create 1 rle with old method : 0.03386855125427246 length of segment : 257 time for calcul the mask position with numpy : 0.002405405044555664 nb_pixel_total : 88142 time to create 1 rle with old method : 0.10065078735351562 length of segment : 290 time for calcul the mask position with numpy : 0.0021467208862304688 nb_pixel_total : 52753 time to create 1 rle with old method : 0.05989193916320801 length of segment : 470 time for calcul the mask position with numpy : 0.0011169910430908203 nb_pixel_total : 24734 time to create 1 rle with old method : 0.028913021087646484 length of segment : 307 time for calcul the mask position with numpy : 0.0004210472106933594 nb_pixel_total : 12545 time to create 1 rle with old method : 0.01474452018737793 length of segment : 112 time for calcul the mask position with numpy : 0.0008625984191894531 nb_pixel_total : 24907 time to create 1 rle with old method : 0.02894282341003418 length of segment : 156 time for calcul the mask position with numpy : 0.0028672218322753906 nb_pixel_total : 115415 time to create 1 rle with old method : 0.1321396827697754 length of segment : 394 time for calcul the mask position with numpy : 0.0018455982208251953 nb_pixel_total : 75361 time to create 1 rle with old method : 0.0864105224609375 length of segment : 220 time for calcul the mask position with numpy : 0.001651763916015625 nb_pixel_total : 52768 time to create 1 rle with old method : 0.05953502655029297 length of segment : 522 time for calcul the mask position with numpy : 0.001218557357788086 nb_pixel_total : 42079 time to create 1 rle with old method : 0.04747200012207031 length of segment : 317 time for calcul the mask position with numpy : 0.002048015594482422 nb_pixel_total : 75932 time to create 1 rle with old method : 0.08524322509765625 length of segment : 329 time for calcul the mask position with numpy : 0.0004887580871582031 nb_pixel_total : 10342 time to create 1 rle with old method : 0.012197732925415039 length of segment : 131 time for calcul the mask position with numpy : 0.001973390579223633 nb_pixel_total : 80514 time to create 1 rle with old method : 0.09372782707214355 length of segment : 239 time for calcul the mask position with numpy : 0.0033111572265625 nb_pixel_total : 96234 time to create 1 rle with old method : 0.10805439949035645 length of segment : 476 time for calcul the mask position with numpy : 0.0013256072998046875 nb_pixel_total : 36384 time to create 1 rle with old method : 0.04098653793334961 length of segment : 274 time for calcul the mask position with numpy : 0.0004119873046875 nb_pixel_total : 8779 time to create 1 rle with old method : 0.010408163070678711 length of segment : 100 time for calcul the mask position with numpy : 0.0011200904846191406 nb_pixel_total : 45171 time to create 1 rle with old method : 0.0518031120300293 length of segment : 185 time for calcul the mask position with numpy : 0.0012645721435546875 nb_pixel_total : 59030 time to create 1 rle with old method : 0.0660393238067627 length of segment : 375 time for calcul the mask position with numpy : 0.0005304813385009766 nb_pixel_total : 15512 time to create 1 rle with old method : 0.017828702926635742 length of segment : 150 time for calcul the mask position with numpy : 0.00145721435546875 nb_pixel_total : 34894 time to create 1 rle with old method : 0.039369821548461914 length of segment : 255 time for calcul the mask position with numpy : 0.00038242340087890625 nb_pixel_total : 10658 time to create 1 rle with old method : 0.012349605560302734 length of segment : 103 time for calcul the mask position with numpy : 0.00043892860412597656 nb_pixel_total : 14119 time to create 1 rle with old method : 0.016727924346923828 length of segment : 113 time for calcul the mask position with numpy : 0.0026993751525878906 nb_pixel_total : 76111 time to create 1 rle with old method : 0.08569717407226562 length of segment : 374 time for calcul the mask position with numpy : 0.00044536590576171875 nb_pixel_total : 11246 time to create 1 rle with old method : 0.013211965560913086 length of segment : 118 time for calcul the mask position with numpy : 0.0004508495330810547 nb_pixel_total : 12753 time to create 1 rle with old method : 0.015125751495361328 length of segment : 136 time for calcul the mask position with numpy : 0.003719329833984375 nb_pixel_total : 128337 time to create 1 rle with old method : 0.16992783546447754 length of segment : 359 time for calcul the mask position with numpy : 0.001333475112915039 nb_pixel_total : 41249 time to create 1 rle with old method : 0.046631574630737305 length of segment : 330 time for calcul the mask position with numpy : 0.0005805492401123047 nb_pixel_total : 15111 time to create 1 rle with old method : 0.01725482940673828 length of segment : 126 time for calcul the mask position with numpy : 0.0015702247619628906 nb_pixel_total : 46141 time to create 1 rle with old method : 0.05206298828125 length of segment : 273 time for calcul the mask position with numpy : 0.0007860660552978516 nb_pixel_total : 25676 time to create 1 rle with old method : 0.029099225997924805 length of segment : 214 time for calcul the mask position with numpy : 0.001140594482421875 nb_pixel_total : 38912 time to create 1 rle with old method : 0.04376578330993652 length of segment : 245 time for calcul the mask position with numpy : 0.0029027462005615234 nb_pixel_total : 118929 time to create 1 rle with old method : 0.14417219161987305 length of segment : 513 time for calcul the mask position with numpy : 0.0013744831085205078 nb_pixel_total : 43018 time to create 1 rle with old method : 0.053516387939453125 length of segment : 287 time for calcul the mask position with numpy : 0.0007479190826416016 nb_pixel_total : 14316 time to create 1 rle with old method : 0.01649761199951172 length of segment : 276 time for calcul the mask position with numpy : 0.003078460693359375 nb_pixel_total : 109125 time to create 1 rle with old method : 0.1426219940185547 length of segment : 384 time for calcul the mask position with numpy : 0.0015943050384521484 nb_pixel_total : 73003 time to create 1 rle with old method : 0.09203195571899414 length of segment : 398 time for calcul the mask position with numpy : 0.002852916717529297 nb_pixel_total : 100960 time to create 1 rle with old method : 0.11466145515441895 length of segment : 411 time for calcul the mask position with numpy : 0.001455068588256836 nb_pixel_total : 32123 time to create 1 rle with old method : 0.03695368766784668 length of segment : 311 time for calcul the mask position with numpy : 0.0008728504180908203 nb_pixel_total : 22224 time to create 1 rle with old method : 0.026662111282348633 length of segment : 215 time spent for convertir_results : 6.5096116065979 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 66 chid ids of type : 3594 Number RLEs to save : 18983 save missing photos in datou_result : time spend for datou_step_exec : 50.33017301559448 time spend to save output : 1.640995740890503 total time spend for step 1 : 51.971168756484985 step2:crop_condition Fri Oct 31 09:51:22 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 6 ! batch 1 Loaded 66 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 40 About to insert : list_path_to_insert length 40 new photo from crops ! About to upload 40 photos upload in portfolio : 3736932 init cache_photo without model_param we have 40 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1761900694_890012 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761900703), 0.0, 0.0, 14, '', 0, 0, '1761900629_890012_1390395695_e0492fa60c84124868ca64de5a2962fc_7627173_rle_crop_4009048006_0.png', 0, 230, 234, 0, 1761900703,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761900703), 0.0, 0.0, 14, '', 0, 0, '1761900629_890012_1390395695_e0492fa60c84124868ca64de5a2962fc_7627173_rle_crop_4009048011_0.png', 0, 143, 142, 0, 1761900703,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761900703), 0.0, 0.0, 14, '', 0, 0, '1761900629_890012_1390395695_e0492fa60c84124868ca64de5a2962fc_7627173_rle_crop_4009048012_0.png', 0, 185, 247, 0, 1761900703,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761900703), 0.0, 0.0, 14, '', 0, 0, '1761900629_890012_1390395695_e0492fa60c84124868ca64de5a2962fc_7627173_rle_crop_4009048015_0.png', 0, 160, 183, 0, 1761900703,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761900703), 0.0, 0.0, 14, '', 0, 0, '1761900629_890012_1390395695_e0492fa60c84124868ca64de5a2962fc_7627173_rle_crop_4009048016_0.png', 0, 103, 173, 0, 1761900703,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761900703), 0.0, 0.0, 14, '', 0, 0, '1761900629_890012_1390395695_e0492fa60c84124868ca64de5a2962fc_7627173_rle_crop_4009048017_0.png', 0, 347, 441, 0, 1761900703,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761900703), 0.0, 0.0, 14, '', 0, 0, '1761900629_890012_1390395695_e0492fa60c84124868ca64de5a2962fc_7627173_rle_crop_4009048018_0.png', 0, 592, 504, 0, 1761900703,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761900703), 0.0, 0.0, 14, '', 0, 0, '1761900629_890012_1390395694_fce6bc323d4024c076a29ecafd0e2116_59350938_rle_crop_4009048019_0.png', 0, 202, 145, 0, 1761900703,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761900703), 0.0, 0.0, 14, '', 0, 0, '1761900629_890012_1390395694_fce6bc323d4024c076a29ecafd0e2116_59350938_rle_crop_4009048020_0.png', 0, 223, 358, 0, 1761900703,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761900703), 0.0, 0.0, 14, '', 0, 0, '1761900629_890012_1390395694_fce6bc323d4024c076a29ecafd0e2116_59350938_rle_crop_4009048023_0.png', 0, 205, 192, 0, 1761900703,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761900703), 0.0, 0.0, 14, '', 0, 0, '1761900629_890012_1390395694_fce6bc323d4024c076a29ecafd0e2116_59350938_rle_crop_4009048024_0.png', 0, 173, 107, 0, 1761900703,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761900703), 0.0, 0.0, 14, '', 0, 0, '1761900629_890012_1390395694_fce6bc323d4024c076a29ecafd0e2116_59350938_rle_crop_4009048025_0.png', 0, 407, 466, 0, 1761900703,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761900703), 0.0, 0.0, 14, '', 0, 0, '1761900629_890012_1390395694_fce6bc323d4024c076a29ecafd0e2116_59350938_rle_crop_4009048026_0.png', 0, 89, 308, 0, 1761900703,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761900703), 0.0, 0.0, 14, '', 0, 0, '1761900629_890012_1390395694_fce6bc323d4024c076a29ecafd0e2116_59350938_rle_crop_4009048030_0.png', 0, 124, 104, 0, 1761900703,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761900703), 0.0, 0.0, 14, '', 0, 0, '1761900629_890012_1390395693_fd2c2984dca2ba8e7cecf0ca346ee736_85658575_rle_crop_4009048032_0.png', 0, 198, 180, 0, 1761900703,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761900703), 0.0, 0.0, 14, '', 0, 0, '1761900629_890012_1390395693_fd2c2984dca2ba8e7cecf0ca346ee736_85658575_rle_crop_4009048036_0.png', 0, 238, 202, 0, 1761900703,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761900703), 0.0, 0.0, 14, '', 0, 0, '1761900629_890012_1390395693_fd2c2984dca2ba8e7cecf0ca346ee736_85658575_rle_crop_4009048037_0.png', 0, 148, 112, 0, 1761900703,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761900703), 0.0, 0.0, 14, '', 0, 0, '1761900629_890012_1390395693_fd2c2984dca2ba8e7cecf0ca346ee736_85658575_rle_crop_4009048038_0.png', 0, 269, 156, 0, 1761900703,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761900703), 0.0, 0.0, 14, '', 0, 0, '1761900629_890012_1390395693_fd2c2984dca2ba8e7cecf0ca346ee736_85658575_rle_crop_4009048039_0.png', 0, 424, 394, 0, 1761900703,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761900703), 0.0, 0.0, 14, '', 0, 0, '1761900629_890012_1390395693_fd2c2984dca2ba8e7cecf0ca346ee736_85658575_rle_crop_4009048041_0.png', 0, 440, 253, 0, 1761900703,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761900703), 0.0, 0.0, 14, '', 0, 0, '1761900629_890012_1390395693_fd2c2984dca2ba8e7cecf0ca346ee736_85658575_rle_crop_4009048042_0.png', 0, 201, 312, 0, 1761900703,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761900703), 0.0, 0.0, 14, '', 0, 0, '1761900629_890012_1390395692_15488464781a44e0da51073c50c21a84_28516741_rle_crop_4009048043_0.png', 0, 330, 306, 0, 1761900703,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761900703), 0.0, 0.0, 14, '', 0, 0, '1761900629_890012_1390395692_15488464781a44e0da51073c50c21a84_28516741_rle_crop_4009048044_0.png', 0, 109, 129, 0, 1761900703,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761900703), 0.0, 0.0, 14, '', 0, 0, '1761900629_890012_1390395692_15488464781a44e0da51073c50c21a84_28516741_rle_crop_4009048046_0.png', 0, 427, 403, 0, 1761900703,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761900703), 0.0, 0.0, 14, '', 0, 0, '1761900629_890012_1390395692_15488464781a44e0da51073c50c21a84_28516741_rle_crop_4009048047_0.png', 0, 189, 274, 0, 1761900703,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761900703), 0.0, 0.0, 14, '', 0, 0, '1761900629_890012_1390395692_15488464781a44e0da51073c50c21a84_28516741_rle_crop_4009048051_0.png', 0, 135, 149, 0, 1761900703,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761900703), 0.0, 0.0, 14, '', 0, 0, '1761900629_890012_1390395692_15488464781a44e0da51073c50c21a84_28516741_rle_crop_4009048052_0.png', 0, 216, 255, 0, 1761900703,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761900703), 0.0, 0.0, 14, '', 0, 0, '1761900629_890012_1390395692_15488464781a44e0da51073c50c21a84_28516741_rle_crop_4009048054_0.png', 0, 161, 109, 0, 1761900703,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761900703), 0.0, 0.0, 14, '', 0, 0, '1761900629_890012_1390395691_0994dfebb24ffe3d004a512a169ea946_65613793_rle_crop_4009048055_0.png', 0, 375, 318, 0, 1761900703,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761900703), 0.0, 0.0, 14, '', 0, 0, '1761900629_890012_1390395691_0994dfebb24ffe3d004a512a169ea946_65613793_rle_crop_4009048056_0.png', 0, 124, 117, 0, 1761900703,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761900703), 0.0, 0.0, 14, '', 0, 0, '1761900629_890012_1390395691_0994dfebb24ffe3d004a512a169ea946_65613793_rle_crop_4009048057_0.png', 0, 196, 104, 0, 1761900703,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761900703), 0.0, 0.0, 14, '', 0, 0, '1761900629_890012_1390395691_0994dfebb24ffe3d004a512a169ea946_65613793_rle_crop_4009048059_0.png', 0, 162, 330, 0, 1761900703,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761900703), 0.0, 0.0, 14, '', 0, 0, '1761900629_890012_1390395691_0994dfebb24ffe3d004a512a169ea946_65613793_rle_crop_4009048060_0.png', 0, 164, 126, 0, 1761900703,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761900703), 0.0, 0.0, 14, '', 0, 0, '1761900629_890012_1390395691_0994dfebb24ffe3d004a512a169ea946_65613793_rle_crop_4009048061_0.png', 0, 303, 262, 0, 1761900703,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761900703), 0.0, 0.0, 14, '', 0, 0, '1761900629_890012_1390395691_0994dfebb24ffe3d004a512a169ea946_65613793_rle_crop_4009048062_0.png', 0, 153, 214, 0, 1761900703,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761900703), 0.0, 0.0, 14, '', 0, 0, '1761900629_890012_1390395690_e45ae4f21f14dc33beae85dc1252e755_75968042_rle_crop_4009048063_0.png', 0, 249, 245, 0, 1761900703,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761900703), 0.0, 0.0, 14, '', 0, 0, '1761900629_890012_1390395690_e45ae4f21f14dc33beae85dc1252e755_75968042_rle_crop_4009048064_0.png', 0, 296, 513, 0, 1761900703,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761900703), 0.0, 0.0, 14, '', 0, 0, '1761900629_890012_1390395690_e45ae4f21f14dc33beae85dc1252e755_75968042_rle_crop_4009048065_0.png', 0, 215, 282, 0, 1761900703,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761900703), 0.0, 0.0, 14, '', 0, 0, '1761900629_890012_1390395690_e45ae4f21f14dc33beae85dc1252e755_75968042_rle_crop_4009048066_0.png', 0, 88, 276, 0, 1761900703,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761900703), 0.0, 0.0, 14, '', 0, 0, '1761900629_890012_1390395690_e45ae4f21f14dc33beae85dc1252e755_75968042_rle_crop_4009048070_0.png', 0, 346, 264, 0, 1761900703,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 40 photos in the portfolio 3736932 time of upload the photos Elapsed time : 10.15246057510376 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1761900706_890012 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761900707), 0.0, 0.0, 14, '', 0, 0, '1761900629_890012_1390395695_e0492fa60c84124868ca64de5a2962fc_7627173_rle_crop_4009048008_0.png', 0, 221, 252, 0, 1761900707,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761900707), 0.0, 0.0, 14, '', 0, 0, '1761900629_890012_1390395693_fd2c2984dca2ba8e7cecf0ca346ee736_85658575_rle_crop_4009048033_0.png', 0, 228, 257, 0, 1761900707,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761900707), 0.0, 0.0, 14, '', 0, 0, '1761900629_890012_1390395690_e45ae4f21f14dc33beae85dc1252e755_75968042_rle_crop_4009048071_0.png', 0, 195, 187, 0, 1761900707,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.4453787803649902 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 22 About to insert : list_path_to_insert length 22 new photo from crops ! About to upload 22 photos upload in portfolio : 3736932 init cache_photo without model_param we have 22 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1761900715_890012 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761900720), 0.0, 0.0, 14, '', 0, 0, '1761900629_890012_1390395695_e0492fa60c84124868ca64de5a2962fc_7627173_rle_crop_4009048007_0.png', 0, 174, 290, 0, 1761900720,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761900720), 0.0, 0.0, 14, '', 0, 0, '1761900629_890012_1390395695_e0492fa60c84124868ca64de5a2962fc_7627173_rle_crop_4009048009_0.png', 0, 224, 147, 0, 1761900720,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761900720), 0.0, 0.0, 14, '', 0, 0, '1761900629_890012_1390395695_e0492fa60c84124868ca64de5a2962fc_7627173_rle_crop_4009048010_0.png', 0, 450, 345, 0, 1761900720,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761900720), 0.0, 0.0, 14, '', 0, 0, '1761900629_890012_1390395695_e0492fa60c84124868ca64de5a2962fc_7627173_rle_crop_4009048013_0.png', 0, 494, 454, 0, 1761900720,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761900720), 0.0, 0.0, 14, '', 0, 0, '1761900629_890012_1390395695_e0492fa60c84124868ca64de5a2962fc_7627173_rle_crop_4009048014_0.png', 0, 355, 452, 0, 1761900720,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761900720), 0.0, 0.0, 14, '', 0, 0, '1761900629_890012_1390395694_fce6bc323d4024c076a29ecafd0e2116_59350938_rle_crop_4009048021_0.png', 0, 433, 227, 0, 1761900720,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761900720), 0.0, 0.0, 14, '', 0, 0, '1761900629_890012_1390395694_fce6bc323d4024c076a29ecafd0e2116_59350938_rle_crop_4009048022_0.png', 0, 460, 363, 0, 1761900720,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761900720), 0.0, 0.0, 14, '', 0, 0, '1761900629_890012_1390395694_fce6bc323d4024c076a29ecafd0e2116_59350938_rle_crop_4009048027_0.png', 0, 605, 258, 0, 1761900720,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761900720), 0.0, 0.0, 14, '', 0, 0, '1761900629_890012_1390395694_fce6bc323d4024c076a29ecafd0e2116_59350938_rle_crop_4009048028_0.png', 0, 223, 132, 0, 1761900720,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761900720), 0.0, 0.0, 14, '', 0, 0, '1761900629_890012_1390395694_fce6bc323d4024c076a29ecafd0e2116_59350938_rle_crop_4009048029_0.png', 0, 277, 472, 0, 1761900720,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761900720), 0.0, 0.0, 14, '', 0, 0, '1761900629_890012_1390395694_fce6bc323d4024c076a29ecafd0e2116_59350938_rle_crop_4009048031_0.png', 0, 261, 157, 0, 1761900720,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761900720), 0.0, 0.0, 14, '', 0, 0, '1761900629_890012_1390395693_fd2c2984dca2ba8e7cecf0ca346ee736_85658575_rle_crop_4009048034_0.png', 0, 447, 277, 0, 1761900720,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761900720), 0.0, 0.0, 14, '', 0, 0, '1761900629_890012_1390395693_fd2c2984dca2ba8e7cecf0ca346ee736_85658575_rle_crop_4009048035_0.png', 0, 254, 451, 0, 1761900720,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761900720), 0.0, 0.0, 14, '', 0, 0, '1761900629_890012_1390395693_fd2c2984dca2ba8e7cecf0ca346ee736_85658575_rle_crop_4009048040_0.png', 0, 481, 217, 0, 1761900720,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761900720), 0.0, 0.0, 14, '', 0, 0, '1761900629_890012_1390395692_15488464781a44e0da51073c50c21a84_28516741_rle_crop_4009048045_0.png', 0, 467, 238, 0, 1761900720,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761900720), 0.0, 0.0, 14, '', 0, 0, '1761900629_890012_1390395692_15488464781a44e0da51073c50c21a84_28516741_rle_crop_4009048048_0.png', 0, 118, 99, 0, 1761900720,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761900720), 0.0, 0.0, 14, '', 0, 0, '1761900629_890012_1390395692_15488464781a44e0da51073c50c21a84_28516741_rle_crop_4009048050_0.png', 0, 262, 306, 0, 1761900720,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761900720), 0.0, 0.0, 14, '', 0, 0, '1761900629_890012_1390395692_15488464781a44e0da51073c50c21a84_28516741_rle_crop_4009048053_0.png', 0, 128, 102, 0, 1761900720,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761900720), 0.0, 0.0, 14, '', 0, 0, '1761900629_890012_1390395691_0994dfebb24ffe3d004a512a169ea946_65613793_rle_crop_4009048058_0.png', 0, 544, 302, 0, 1761900720,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761900720), 0.0, 0.0, 14, '', 0, 0, '1761900629_890012_1390395690_e45ae4f21f14dc33beae85dc1252e755_75968042_rle_crop_4009048067_0.png', 0, 344, 381, 0, 1761900720,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761900720), 0.0, 0.0, 14, '', 0, 0, '1761900629_890012_1390395690_e45ae4f21f14dc33beae85dc1252e755_75968042_rle_crop_4009048068_0.png', 0, 262, 397, 0, 1761900720,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761900720), 0.0, 0.0, 14, '', 0, 0, '1761900629_890012_1390395690_e45ae4f21f14dc33beae85dc1252e755_75968042_rle_crop_4009048069_0.png', 0, 369, 411, 0, 1761900720,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 22 photos in the portfolio 3736932 time of upload the photos Elapsed time : 5.665661096572876 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1761900722_890012 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761900722), 0.0, 0.0, 14, '', 0, 0, '1761900629_890012_1390395692_15488464781a44e0da51073c50c21a84_28516741_rle_crop_4009048049_0.png', 0, 322, 184, 0, 1761900722,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.47466588020324707 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1390395695, 1390395694, 1390395693, 1390395692, 1390395691, 1390395690] Looping around the photos to save general results len do output : 66 /1391074555Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391074556Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391074557Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391074558Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391074559Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391074560Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391074561Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391074562Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391074563Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391074564Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391074565Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391074566Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391074567Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391074568Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391074569Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391074570Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391074571Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391074572Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391074573Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391074574Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391074575Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391074576Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391074577Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391074578Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391074579Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391074580Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391074581Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391074582Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391074583Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391074584Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391074585Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391074586Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391074587Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391074588Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391074589Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391074590Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391074591Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391074592Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391074593Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391074594Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391074616Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391074618Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391074619Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391074774Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391074775Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391074776Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391074777Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391074778Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391074779Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391074780Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391074781Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391074782Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391074783Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391074784Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391074786Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391074787Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391074788Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391074789Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391074791Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391074792Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391074793Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391074794Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391074796Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391074797Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391074798Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391074817Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3972170') ('3318', '28010444', '1390395695', None, None, None, None, None, '3972170') ('3318', None, None, None, None, None, None, None, '3972170') ('3318', '28010444', '1390395694', None, None, None, None, None, '3972170') ('3318', None, None, None, None, None, None, None, '3972170') ('3318', '28010444', '1390395693', None, None, None, None, None, '3972170') ('3318', None, None, None, None, None, None, None, '3972170') ('3318', '28010444', '1390395692', None, None, None, None, None, '3972170') ('3318', None, None, None, None, None, None, None, '3972170') ('3318', '28010444', '1390395691', None, None, None, None, None, '3972170') ('3318', None, None, None, None, None, None, None, '3972170') ('3318', '28010444', '1390395690', None, None, None, None, None, '3972170') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 204 time used for this insertion : 0.0278475284576416 save_final save missing photos in datou_result : time spend for datou_step_exec : 40.05524516105652 time spend to save output : 0.030510425567626953 total time spend for step 2 : 40.085755586624146 step3:rle_unique_nms_with_priority Fri Oct 31 09:52:02 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 66 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 13 nb_hashtags : 3 time to prepare the origin masks : 5.355042457580566 time for calcul the mask position with numpy : 0.4466214179992676 nb_pixel_total : 7450176 time to create 1 rle with new method : 1.070054054260254 time for calcul the mask position with numpy : 0.03210711479187012 nb_pixel_total : 157385 time to create 1 rle with new method : 0.7363235950469971 time for calcul the mask position with numpy : 0.03237152099609375 nb_pixel_total : 102975 time to create 1 rle with old method : 0.12438797950744629 time for calcul the mask position with numpy : 0.027425050735473633 nb_pixel_total : 12725 time to create 1 rle with old method : 0.014190435409545898 time for calcul the mask position with numpy : 0.028337478637695312 nb_pixel_total : 16359 time to create 1 rle with old method : 0.01978302001953125 time for calcul the mask position with numpy : 0.02855086326599121 nb_pixel_total : 107791 time to create 1 rle with old method : 0.14424777030944824 time for calcul the mask position with numpy : 0.02847146987915039 nb_pixel_total : 153455 time to create 1 rle with new method : 0.9764111042022705 time for calcul the mask position with numpy : 0.03488326072692871 nb_pixel_total : 32091 time to create 1 rle with old method : 0.03570866584777832 time for calcul the mask position with numpy : 0.028261184692382812 nb_pixel_total : 14069 time to create 1 rle with old method : 0.015708208084106445 time for calcul the mask position with numpy : 0.025727272033691406 nb_pixel_total : 103035 time to create 1 rle with old method : 0.11332321166992188 time for calcul the mask position with numpy : 0.025699138641357422 nb_pixel_total : 21835 time to create 1 rle with old method : 0.024453163146972656 time for calcul the mask position with numpy : 0.025403738021850586 nb_pixel_total : 42901 time to create 1 rle with old method : 0.04725456237792969 time for calcul the mask position with numpy : 0.027042388916015625 nb_pixel_total : 40052 time to create 1 rle with old method : 0.043646812438964844 time for calcul the mask position with numpy : 0.02475142478942871 nb_pixel_total : 39551 time to create 1 rle with old method : 0.0428774356842041 create new chi : 4.322746753692627 time to delete rle : 0.02695441246032715 batch 1 Loaded 27 chid ids of type : 3594 +++++++++++++++++++Number RLEs to save : 11244 TO DO : save crop sub photo not yet done ! save time : 0.6115608215332031 nb_obj : 13 nb_hashtags : 2 time to prepare the origin masks : 5.179276466369629 time for calcul the mask position with numpy : 0.8181655406951904 nb_pixel_total : 7651971 time to create 1 rle with new method : 0.6013045310974121 time for calcul the mask position with numpy : 0.028316497802734375 nb_pixel_total : 34280 time to create 1 rle with old method : 0.038252830505371094 time for calcul the mask position with numpy : 0.027477025985717773 nb_pixel_total : 10366 time to create 1 rle with old method : 0.011516571044921875 time for calcul the mask position with numpy : 0.027121305465698242 nb_pixel_total : 61871 time to create 1 rle with old method : 0.07525634765625 time for calcul the mask position with numpy : 0.025446414947509766 nb_pixel_total : 20987 time to create 1 rle with old method : 0.022556781768798828 time for calcul the mask position with numpy : 0.02581310272216797 nb_pixel_total : 96003 time to create 1 rle with old method : 0.10413336753845215 time for calcul the mask position with numpy : 0.025220870971679688 nb_pixel_total : 23725 time to create 1 rle with old method : 0.026505470275878906 time for calcul the mask position with numpy : 0.028080224990844727 nb_pixel_total : 136961 time to create 1 rle with old method : 0.1517040729522705 time for calcul the mask position with numpy : 0.02713751792907715 nb_pixel_total : 11883 time to create 1 rle with old method : 0.012973308563232422 time for calcul the mask position with numpy : 0.024395227432250977 nb_pixel_total : 26262 time to create 1 rle with old method : 0.028057575225830078 time for calcul the mask position with numpy : 0.02464008331298828 nb_pixel_total : 102219 time to create 1 rle with old method : 0.11657023429870605 time for calcul the mask position with numpy : 0.026916980743408203 nb_pixel_total : 64962 time to create 1 rle with old method : 0.07525491714477539 time for calcul the mask position with numpy : 0.025146007537841797 nb_pixel_total : 37786 time to create 1 rle with old method : 0.04786276817321777 time for calcul the mask position with numpy : 0.02613377571105957 nb_pixel_total : 15124 time to create 1 rle with old method : 0.016683101654052734 create new chi : 2.5380992889404297 time to delete rle : 0.0010721683502197266 batch 1 Loaded 27 chid ids of type : 3594 +++++++++++++++++Number RLEs to save : 9161 TO DO : save crop sub photo not yet done ! save time : 0.5164892673492432 nb_obj : 11 nb_hashtags : 3 time to prepare the origin masks : 5.345984697341919 time for calcul the mask position with numpy : 0.6087651252746582 nb_pixel_total : 7772412 time to create 1 rle with new method : 0.5409364700317383 time for calcul the mask position with numpy : 0.041112422943115234 nb_pixel_total : 42079 time to create 1 rle with old method : 0.04655599594116211 time for calcul the mask position with numpy : 0.025508880615234375 nb_pixel_total : 29924 time to create 1 rle with old method : 0.03300666809082031 time for calcul the mask position with numpy : 0.025979042053222656 nb_pixel_total : 75361 time to create 1 rle with old method : 0.08379888534545898 time for calcul the mask position with numpy : 0.027446508407592773 nb_pixel_total : 115415 time to create 1 rle with old method : 0.12828707695007324 time for calcul the mask position with numpy : 0.025530576705932617 nb_pixel_total : 24907 time to create 1 rle with old method : 0.027059555053710938 time for calcul the mask position with numpy : 0.02375054359436035 nb_pixel_total : 12545 time to create 1 rle with old method : 0.013573646545410156 time for calcul the mask position with numpy : 0.02603769302368164 nb_pixel_total : 24734 time to create 1 rle with old method : 0.027141332626342773 time for calcul the mask position with numpy : 0.02445816993713379 nb_pixel_total : 52753 time to create 1 rle with old method : 0.05756783485412598 time for calcul the mask position with numpy : 0.0272674560546875 nb_pixel_total : 88142 time to create 1 rle with old method : 0.10207843780517578 time for calcul the mask position with numpy : 0.02893829345703125 nb_pixel_total : 29390 time to create 1 rle with old method : 0.03444099426269531 time for calcul the mask position with numpy : 0.030239105224609375 nb_pixel_total : 26738 time to create 1 rle with old method : 0.0331268310546875 create new chi : 2.090097665786743 time to delete rle : 0.0012083053588867188 batch 1 Loaded 23 chid ids of type : 3594 +++++++++++++++++++++++Number RLEs to save : 8422 TO DO : save crop sub photo not yet done ! save time : 0.5118210315704346 nb_obj : 12 nb_hashtags : 3 time to prepare the origin masks : 4.909662246704102 time for calcul the mask position with numpy : 0.655357837677002 nb_pixel_total : 7827803 time to create 1 rle with new method : 0.4414041042327881 time for calcul the mask position with numpy : 0.026009082794189453 nb_pixel_total : 14119 time to create 1 rle with old method : 0.016383886337280273 time for calcul the mask position with numpy : 0.028867006301879883 nb_pixel_total : 10658 time to create 1 rle with old method : 0.012376785278320312 time for calcul the mask position with numpy : 0.027437925338745117 nb_pixel_total : 34894 time to create 1 rle with old method : 0.03882169723510742 time for calcul the mask position with numpy : 0.026125192642211914 nb_pixel_total : 15512 time to create 1 rle with old method : 0.01727914810180664 time for calcul the mask position with numpy : 0.025514602661132812 nb_pixel_total : 38058 time to create 1 rle with old method : 0.04242444038391113 time for calcul the mask position with numpy : 0.026081085205078125 nb_pixel_total : 45171 time to create 1 rle with old method : 0.049921512603759766 time for calcul the mask position with numpy : 0.02656245231628418 nb_pixel_total : 8779 time to create 1 rle with old method : 0.009844064712524414 time for calcul the mask position with numpy : 0.02789592742919922 nb_pixel_total : 36384 time to create 1 rle with old method : 0.040198564529418945 time for calcul the mask position with numpy : 0.02501058578491211 nb_pixel_total : 96234 time to create 1 rle with old method : 0.1016092300415039 time for calcul the mask position with numpy : 0.025229692459106445 nb_pixel_total : 80514 time to create 1 rle with old method : 0.0866084098815918 time for calcul the mask position with numpy : 0.025549650192260742 nb_pixel_total : 10342 time to create 1 rle with old method : 0.011272668838500977 time for calcul the mask position with numpy : 0.026298999786376953 nb_pixel_total : 75932 time to create 1 rle with old method : 0.08106374740600586 create new chi : 1.9718537330627441 time to delete rle : 0.0009963512420654297 batch 1 Loaded 25 chid ids of type : 3594 +++++++++++++++Number RLEs to save : 7361 TO DO : save crop sub photo not yet done ! save time : 0.4520556926727295 nb_obj : 8 nb_hashtags : 2 time to prepare the origin masks : 3.195833921432495 time for calcul the mask position with numpy : 0.5236227512359619 nb_pixel_total : 7937776 time to create 1 rle with new method : 0.7453083992004395 time for calcul the mask position with numpy : 0.025603771209716797 nb_pixel_total : 25676 time to create 1 rle with old method : 0.02868175506591797 time for calcul the mask position with numpy : 0.026473522186279297 nb_pixel_total : 46141 time to create 1 rle with old method : 0.05107378959655762 time for calcul the mask position with numpy : 0.025894880294799805 nb_pixel_total : 15111 time to create 1 rle with old method : 0.01684856414794922 time for calcul the mask position with numpy : 0.02627730369567871 nb_pixel_total : 41249 time to create 1 rle with old method : 0.04581928253173828 time for calcul the mask position with numpy : 0.02637195587158203 nb_pixel_total : 128337 time to create 1 rle with old method : 0.1706833839416504 time for calcul the mask position with numpy : 0.028064727783203125 nb_pixel_total : 12753 time to create 1 rle with old method : 0.02089524269104004 time for calcul the mask position with numpy : 0.027751684188842773 nb_pixel_total : 11246 time to create 1 rle with old method : 0.014038562774658203 time for calcul the mask position with numpy : 0.026768207550048828 nb_pixel_total : 76111 time to create 1 rle with old method : 0.0843043327331543 create new chi : 1.9639036655426025 time to delete rle : 0.0009326934814453125 batch 1 Loaded 17 chid ids of type : 3594 +++++++++Number RLEs to save : 6020 TO DO : save crop sub photo not yet done ! save time : 0.36603569984436035 nb_obj : 9 nb_hashtags : 3 time to prepare the origin masks : 3.698561429977417 time for calcul the mask position with numpy : 0.4895031452178955 nb_pixel_total : 7741790 time to create 1 rle with new method : 1.0710036754608154 time for calcul the mask position with numpy : 0.026760578155517578 nb_pixel_total : 22224 time to create 1 rle with old method : 0.03625297546386719 time for calcul the mask position with numpy : 0.02817511558532715 nb_pixel_total : 32123 time to create 1 rle with old method : 0.03660917282104492 time for calcul the mask position with numpy : 0.028716564178466797 nb_pixel_total : 100960 time to create 1 rle with old method : 0.11069059371948242 time for calcul the mask position with numpy : 0.025281906127929688 nb_pixel_total : 73003 time to create 1 rle with old method : 0.07878732681274414 time for calcul the mask position with numpy : 0.02642655372619629 nb_pixel_total : 109125 time to create 1 rle with old method : 0.12120389938354492 time for calcul the mask position with numpy : 0.025714397430419922 nb_pixel_total : 14316 time to create 1 rle with old method : 0.016054153442382812 time for calcul the mask position with numpy : 0.026166915893554688 nb_pixel_total : 43018 time to create 1 rle with old method : 0.04688620567321777 time for calcul the mask position with numpy : 0.025534868240356445 nb_pixel_total : 118929 time to create 1 rle with old method : 0.1253647804260254 time for calcul the mask position with numpy : 0.024577617645263672 nb_pixel_total : 38912 time to create 1 rle with old method : 0.04317927360534668 create new chi : 2.4600167274475098 time to delete rle : 0.001093149185180664 batch 1 Loaded 19 chid ids of type : 3594 +++++++++++Number RLEs to save : 8240 TO DO : save crop sub photo not yet done ! save time : 0.47455382347106934 map_output_result : {1390395695: (0.0, 'Should be the crop_list due to order', 0), 1390395694: (0.0, 'Should be the crop_list due to order', 0), 1390395693: (0.0, 'Should be the crop_list due to order', 0), 1390395692: (0.0, 'Should be the crop_list due to order', 0), 1390395691: (0.0, 'Should be the crop_list due to order', 0), 1390395690: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1390395695, 1390395694, 1390395693, 1390395692, 1390395691, 1390395690] Looping around the photos to save general results len do output : 6 /1390395695.Didn't retrieve data . /1390395694.Didn't retrieve data . /1390395693.Didn't retrieve data . /1390395692.Didn't retrieve data . /1390395691.Didn't retrieve data . /1390395690.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3972170') ('3318', '28010444', '1390395695', None, None, None, None, None, '3972170') ('3318', None, None, None, None, None, None, None, '3972170') ('3318', '28010444', '1390395694', None, None, None, None, None, '3972170') ('3318', None, None, None, None, None, None, None, '3972170') ('3318', '28010444', '1390395693', None, None, None, None, None, '3972170') ('3318', None, None, None, None, None, None, None, '3972170') ('3318', '28010444', '1390395692', None, None, None, None, None, '3972170') ('3318', None, None, None, None, None, None, None, '3972170') ('3318', '28010444', '1390395691', None, None, None, None, None, '3972170') ('3318', None, None, None, None, None, None, None, '3972170') ('3318', '28010444', '1390395690', None, None, None, None, None, '3972170') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 18 time used for this insertion : 0.010124683380126953 save_final save missing photos in datou_result : time spend for datou_step_exec : 46.995819330215454 time spend to save output : 0.01049661636352539 total time spend for step 3 : 47.00631594657898 step4:ventilate_hashtags_in_portfolio Fri Oct 31 09:52:49 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 28010444 get user id for portfolio 28010444 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28010444 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('flou','carton','papier','mal_croppe','pehd','background','metal','autre','pet_clair','pet_fonce','environnement')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28010444 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('flou','carton','papier','mal_croppe','pehd','background','metal','autre','pet_clair','pet_fonce','environnement')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28010444 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('flou','carton','papier','mal_croppe','pehd','background','metal','autre','pet_clair','pet_fonce','environnement')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/28011752,28011753,28011754,28011755,28011756,28011757,28011758,28011759,28011760,28011761,28011762?tags=flou,carton,papier,mal_croppe,pehd,background,metal,autre,pet_clair,pet_fonce,environnement Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1390395695, 1390395694, 1390395693, 1390395692, 1390395691, 1390395690] Looping around the photos to save general results len do output : 1 /28010444. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3972170') ('3318', '28010444', '1390395695', None, None, None, None, None, '3972170') ('3318', None, None, None, None, None, None, None, '3972170') ('3318', '28010444', '1390395694', None, None, None, None, None, '3972170') ('3318', None, None, None, None, None, None, None, '3972170') ('3318', '28010444', '1390395693', None, None, None, None, None, '3972170') ('3318', None, None, None, None, None, None, None, '3972170') ('3318', '28010444', '1390395692', None, None, None, None, None, '3972170') ('3318', None, None, None, None, None, None, None, '3972170') ('3318', '28010444', '1390395691', None, None, None, None, None, '3972170') ('3318', None, None, None, None, None, None, None, '3972170') ('3318', '28010444', '1390395690', None, None, None, None, None, '3972170') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 7 time used for this insertion : 0.012118816375732422 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.610206127166748 time spend to save output : 0.012356281280517578 total time spend for step 4 : 1.6225624084472656 step5:final Fri Oct 31 09:52:51 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1390395695: ('0.06800716949588477',), 1390395694: ('0.06800716949588477',), 1390395693: ('0.06800716949588477',), 1390395692: ('0.06800716949588477',), 1390395691: ('0.06800716949588477',), 1390395690: ('0.06800716949588477',)} new output for save of step final : {1390395695: ('0.06800716949588477',), 1390395694: ('0.06800716949588477',), 1390395693: ('0.06800716949588477',), 1390395692: ('0.06800716949588477',), 1390395691: ('0.06800716949588477',), 1390395690: ('0.06800716949588477',)} [1390395695, 1390395694, 1390395693, 1390395692, 1390395691, 1390395690] Looping around the photos to save general results len do output : 6 /1390395695.Didn't retrieve data . /1390395694.Didn't retrieve data . /1390395693.Didn't retrieve data . /1390395692.Didn't retrieve data . /1390395691.Didn't retrieve data . /1390395690.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3972170') ('3318', '28010444', '1390395695', None, None, None, None, None, '3972170') ('3318', None, None, None, None, None, None, None, '3972170') ('3318', '28010444', '1390395694', None, None, None, None, None, '3972170') ('3318', None, None, None, None, None, None, None, '3972170') ('3318', '28010444', '1390395693', None, None, None, None, None, '3972170') ('3318', None, None, None, None, None, None, None, '3972170') ('3318', '28010444', '1390395692', None, None, None, None, None, '3972170') ('3318', None, None, None, None, None, None, None, '3972170') ('3318', '28010444', '1390395691', None, None, None, None, None, '3972170') ('3318', None, None, None, None, None, None, None, '3972170') ('3318', '28010444', '1390395690', None, None, None, None, None, '3972170') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 18 time used for this insertion : 0.01040029525756836 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11456012725830078 time spend to save output : 0.010826587677001953 total time spend for step 5 : 0.12538671493530273 step6:blur_detection Fri Oct 31 09:52:51 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1761900629_890012_1390395695_e0492fa60c84124868ca64de5a2962fc_7627173.jpg resize: (2160, 3840) 1390395695 -6.911052032573633 treat image : temp/1761900629_890012_1390395694_fce6bc323d4024c076a29ecafd0e2116_59350938.jpg resize: (2160, 3840) 1390395694 -6.912543633745884 treat image : temp/1761900629_890012_1390395693_fd2c2984dca2ba8e7cecf0ca346ee736_85658575.jpg resize: (2160, 3840) 1390395693 -6.9097032072411135 treat image : temp/1761900629_890012_1390395692_15488464781a44e0da51073c50c21a84_28516741.jpg resize: (2160, 3840) 1390395692 -6.741385469674996 treat image : temp/1761900629_890012_1390395691_0994dfebb24ffe3d004a512a169ea946_65613793.jpg resize: (2160, 3840) 1390395691 -6.885027756251397 treat image : temp/1761900629_890012_1390395690_e45ae4f21f14dc33beae85dc1252e755_75968042.jpg resize: (2160, 3840) 1390395690 -6.99416383249181 treat image : temp/1761900629_890012_1390395695_e0492fa60c84124868ca64de5a2962fc_7627173_rle_crop_4009048006_0.png resize: (234, 230) 1391074555 -3.7590463272188885 treat image : temp/1761900629_890012_1390395695_e0492fa60c84124868ca64de5a2962fc_7627173_rle_crop_4009048011_0.png resize: (142, 143) 1391074556 -4.234145203505882 treat image : temp/1761900629_890012_1390395695_e0492fa60c84124868ca64de5a2962fc_7627173_rle_crop_4009048012_0.png resize: (247, 185) 1391074557 -5.183550608038118 treat image : temp/1761900629_890012_1390395695_e0492fa60c84124868ca64de5a2962fc_7627173_rle_crop_4009048015_0.png resize: (183, 160) 1391074558 -3.002805390207436 treat image : temp/1761900629_890012_1390395695_e0492fa60c84124868ca64de5a2962fc_7627173_rle_crop_4009048016_0.png resize: (173, 103) 1391074559 -2.012206555339609 treat image : temp/1761900629_890012_1390395695_e0492fa60c84124868ca64de5a2962fc_7627173_rle_crop_4009048017_0.png resize: (441, 347) 1391074560 -3.938365867387857 treat image : temp/1761900629_890012_1390395695_e0492fa60c84124868ca64de5a2962fc_7627173_rle_crop_4009048018_0.png resize: (504, 592) 1391074561 -4.777193463993052 treat image : temp/1761900629_890012_1390395694_fce6bc323d4024c076a29ecafd0e2116_59350938_rle_crop_4009048019_0.png resize: (145, 202) 1391074562 -4.437512320170803 treat image : temp/1761900629_890012_1390395694_fce6bc323d4024c076a29ecafd0e2116_59350938_rle_crop_4009048020_0.png resize: (358, 223) 1391074563 -2.587093961527055 treat image : temp/1761900629_890012_1390395694_fce6bc323d4024c076a29ecafd0e2116_59350938_rle_crop_4009048023_0.png resize: (192, 205) 1391074564 -3.7155630647060582 treat image : temp/1761900629_890012_1390395694_fce6bc323d4024c076a29ecafd0e2116_59350938_rle_crop_4009048024_0.png resize: (107, 173) 1391074565 -2.0499438971867936 treat image : temp/1761900629_890012_1390395694_fce6bc323d4024c076a29ecafd0e2116_59350938_rle_crop_4009048025_0.png resize: (466, 407) 1391074566 -4.850871260783639 treat image : temp/1761900629_890012_1390395694_fce6bc323d4024c076a29ecafd0e2116_59350938_rle_crop_4009048026_0.png resize: (308, 89) 1391074567 0.1875298413622034 treat image : temp/1761900629_890012_1390395694_fce6bc323d4024c076a29ecafd0e2116_59350938_rle_crop_4009048030_0.png resize: (104, 124) 1391074568 -3.895119931166386 treat image : temp/1761900629_890012_1390395693_fd2c2984dca2ba8e7cecf0ca346ee736_85658575_rle_crop_4009048032_0.png resize: (180, 198) 1391074569 -3.4056980808525417 treat image : temp/1761900629_890012_1390395693_fd2c2984dca2ba8e7cecf0ca346ee736_85658575_rle_crop_4009048036_0.png resize: (202, 238) 1391074570 -3.571473261525446 treat image : temp/1761900629_890012_1390395693_fd2c2984dca2ba8e7cecf0ca346ee736_85658575_rle_crop_4009048037_0.png resize: (112, 148) 1391074571 -4.423399892507487 treat image : temp/1761900629_890012_1390395693_fd2c2984dca2ba8e7cecf0ca346ee736_85658575_rle_crop_4009048038_0.png resize: (156, 269) 1391074572 -0.1874072865935816 treat image : temp/1761900629_890012_1390395693_fd2c2984dca2ba8e7cecf0ca346ee736_85658575_rle_crop_4009048039_0.png resize: (394, 424) 1391074573 -1.631332890770079 treat image : temp/1761900629_890012_1390395693_fd2c2984dca2ba8e7cecf0ca346ee736_85658575_rle_crop_4009048041_0.png resize: (253, 440) 1391074574 -1.583735343526135 treat image : temp/1761900629_890012_1390395693_fd2c2984dca2ba8e7cecf0ca346ee736_85658575_rle_crop_4009048042_0.png resize: (312, 201) 1391074575 -3.99653159908992 treat image : temp/1761900629_890012_1390395692_15488464781a44e0da51073c50c21a84_28516741_rle_crop_4009048043_0.png resize: (306, 330) 1391074576 -1.629806942071709 treat image : temp/1761900629_890012_1390395692_15488464781a44e0da51073c50c21a84_28516741_rle_crop_4009048044_0.png resize: (129, 109) 1391074577 -2.802380703269716 treat image : temp/1761900629_890012_1390395692_15488464781a44e0da51073c50c21a84_28516741_rle_crop_4009048046_0.png resize: (403, 427) 1391074578 -4.0322674809568975 treat image : temp/1761900629_890012_1390395692_15488464781a44e0da51073c50c21a84_28516741_rle_crop_4009048047_0.png resize: (274, 189) 1391074579 -3.482057683879812 treat image : temp/1761900629_890012_1390395692_15488464781a44e0da51073c50c21a84_28516741_rle_crop_4009048051_0.png resize: (149, 135) 1391074580 -3.0854147476369382 treat image : temp/1761900629_890012_1390395692_15488464781a44e0da51073c50c21a84_28516741_rle_crop_4009048052_0.png resize: (255, 216) 1391074581 -4.592040030153327 treat image : temp/1761900629_890012_1390395692_15488464781a44e0da51073c50c21a84_28516741_rle_crop_4009048054_0.png resize: (109, 161) 1391074582 -2.8211962691377988 treat image : temp/1761900629_890012_1390395691_0994dfebb24ffe3d004a512a169ea946_65613793_rle_crop_4009048055_0.png resize: (318, 375) 1391074583 -1.6551060148389236 treat image : temp/1761900629_890012_1390395691_0994dfebb24ffe3d004a512a169ea946_65613793_rle_crop_4009048056_0.png resize: (117, 124) 1391074584 -3.3127976867248887 treat image : temp/1761900629_890012_1390395691_0994dfebb24ffe3d004a512a169ea946_65613793_rle_crop_4009048057_0.png resize: (104, 196) 1391074585 -4.139547638687691 treat image : temp/1761900629_890012_1390395691_0994dfebb24ffe3d004a512a169ea946_65613793_rle_crop_4009048059_0.png resize: (330, 162) 1391074586 -2.9993368625312677 treat image : temp/1761900629_890012_1390395691_0994dfebb24ffe3d004a512a169ea946_65613793_rle_crop_4009048060_0.png resize: (126, 164) 1391074587 -3.163803863677738 treat image : temp/1761900629_890012_1390395691_0994dfebb24ffe3d004a512a169ea946_65613793_rle_crop_4009048061_0.png resize: (262, 303) 1391074588 -3.888485253541687 treat image : temp/1761900629_890012_1390395691_0994dfebb24ffe3d004a512a169ea946_65613793_rle_crop_4009048062_0.png resize: (214, 153) 1391074589 -2.884343674912388 treat image : temp/1761900629_890012_1390395690_e45ae4f21f14dc33beae85dc1252e755_75968042_rle_crop_4009048063_0.png resize: (245, 249) 1391074590 -3.996773756893837 treat image : temp/1761900629_890012_1390395690_e45ae4f21f14dc33beae85dc1252e755_75968042_rle_crop_4009048064_0.png resize: (513, 296) 1391074591 -2.623229926571591 treat image : temp/1761900629_890012_1390395690_e45ae4f21f14dc33beae85dc1252e755_75968042_rle_crop_4009048065_0.png resize: (282, 215) 1391074592 -4.014852324195597 treat image : temp/1761900629_890012_1390395690_e45ae4f21f14dc33beae85dc1252e755_75968042_rle_crop_4009048066_0.png resize: (276, 88) 1391074593 -3.818946689790969 treat image : temp/1761900629_890012_1390395690_e45ae4f21f14dc33beae85dc1252e755_75968042_rle_crop_4009048070_0.png resize: (264, 346) 1391074594 -1.7961300983107378 treat image : temp/1761900629_890012_1390395695_e0492fa60c84124868ca64de5a2962fc_7627173_rle_crop_4009048008_0.png resize: (252, 221) 1391074616 -2.8601911588237234 treat image : temp/1761900629_890012_1390395693_fd2c2984dca2ba8e7cecf0ca346ee736_85658575_rle_crop_4009048033_0.png resize: (257, 228) 1391074618 -2.872997754269793 treat image : temp/1761900629_890012_1390395690_e45ae4f21f14dc33beae85dc1252e755_75968042_rle_crop_4009048071_0.png resize: (187, 195) 1391074619 -3.724960917273339 treat image : temp/1761900629_890012_1390395695_e0492fa60c84124868ca64de5a2962fc_7627173_rle_crop_4009048007_0.png resize: (290, 174) 1391074774 -2.8844930417827155 treat image : temp/1761900629_890012_1390395695_e0492fa60c84124868ca64de5a2962fc_7627173_rle_crop_4009048009_0.png resize: (147, 224) 1391074775 -2.9505211746045057 treat image : temp/1761900629_890012_1390395695_e0492fa60c84124868ca64de5a2962fc_7627173_rle_crop_4009048010_0.png resize: (345, 450) 1391074776 -4.189574779358425 treat image : temp/1761900629_890012_1390395695_e0492fa60c84124868ca64de5a2962fc_7627173_rle_crop_4009048013_0.png resize: (454, 494) 1391074777 -4.774857410664117 treat image : temp/1761900629_890012_1390395695_e0492fa60c84124868ca64de5a2962fc_7627173_rle_crop_4009048014_0.png resize: (452, 355) 1391074778 -4.462669882944119 treat image : temp/1761900629_890012_1390395694_fce6bc323d4024c076a29ecafd0e2116_59350938_rle_crop_4009048021_0.png resize: (227, 433) 1391074779 -3.1008276105461907 treat image : temp/1761900629_890012_1390395694_fce6bc323d4024c076a29ecafd0e2116_59350938_rle_crop_4009048022_0.png resize: (363, 460) 1391074780 -4.154273005811736 treat image : temp/1761900629_890012_1390395694_fce6bc323d4024c076a29ecafd0e2116_59350938_rle_crop_4009048027_0.png resize: (258, 605) 1391074781 -4.039844322336932 treat image : temp/1761900629_890012_1390395694_fce6bc323d4024c076a29ecafd0e2116_59350938_rle_crop_4009048028_0.png resize: (132, 223) 1391074782 -3.53113740055106 treat image : temp/1761900629_890012_1390395694_fce6bc323d4024c076a29ecafd0e2116_59350938_rle_crop_4009048029_0.png resize: (472, 277) 1391074783 -3.9090261765968184 treat image : temp/1761900629_890012_1390395694_fce6bc323d4024c076a29ecafd0e2116_59350938_rle_crop_4009048031_0.png resize: (157, 261) 1391074784 -4.958403815409112 treat image : temp/1761900629_890012_1390395693_fd2c2984dca2ba8e7cecf0ca346ee736_85658575_rle_crop_4009048034_0.png resize: (277, 447) 1391074786 -4.715328131830471 treat image : temp/1761900629_890012_1390395693_fd2c2984dca2ba8e7cecf0ca346ee736_85658575_rle_crop_4009048035_0.png resize: (451, 254) 1391074787 -4.674980970298503 treat image : temp/1761900629_890012_1390395693_fd2c2984dca2ba8e7cecf0ca346ee736_85658575_rle_crop_4009048040_0.png resize: (217, 481) 1391074788 -2.5563872502324454 treat image : temp/1761900629_890012_1390395692_15488464781a44e0da51073c50c21a84_28516741_rle_crop_4009048045_0.png resize: (238, 467) 1391074789 -2.82722181186742 treat image : temp/1761900629_890012_1390395692_15488464781a44e0da51073c50c21a84_28516741_rle_crop_4009048048_0.png resize: (99, 118) 1391074791 -2.7477761227820108 treat image : temp/1761900629_890012_1390395692_15488464781a44e0da51073c50c21a84_28516741_rle_crop_4009048050_0.png resize: (306, 262) 1391074792 -4.517311400575938 treat image : temp/1761900629_890012_1390395692_15488464781a44e0da51073c50c21a84_28516741_rle_crop_4009048053_0.png resize: (102, 128) 1391074793 -4.28378599944856 treat image : temp/1761900629_890012_1390395691_0994dfebb24ffe3d004a512a169ea946_65613793_rle_crop_4009048058_0.png resize: (302, 544) 1391074794 -5.323268464284872 treat image : temp/1761900629_890012_1390395690_e45ae4f21f14dc33beae85dc1252e755_75968042_rle_crop_4009048067_0.png resize: (381, 344) 1391074796 -4.652122857140821 treat image : temp/1761900629_890012_1390395690_e45ae4f21f14dc33beae85dc1252e755_75968042_rle_crop_4009048068_0.png resize: (397, 262) 1391074797 -4.351052276105858 treat image : temp/1761900629_890012_1390395690_e45ae4f21f14dc33beae85dc1252e755_75968042_rle_crop_4009048069_0.png resize: (411, 369) 1391074798 -3.9517915190525525 treat image : temp/1761900629_890012_1390395692_15488464781a44e0da51073c50c21a84_28516741_rle_crop_4009048049_0.png resize: (184, 322) 1391074817 -3.8873212388208565 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 72 time used for this insertion : 0.01136159896850586 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 72 time used for this insertion : 0.011771917343139648 save missing photos in datou_result : time spend for datou_step_exec : 24.953415155410767 time spend to save output : 0.027848243713378906 total time spend for step 6 : 24.981263399124146 step7:brightness Fri Oct 31 09:53:16 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1761900629_890012_1390395695_e0492fa60c84124868ca64de5a2962fc_7627173.jpg treat image : temp/1761900629_890012_1390395694_fce6bc323d4024c076a29ecafd0e2116_59350938.jpg treat image : temp/1761900629_890012_1390395693_fd2c2984dca2ba8e7cecf0ca346ee736_85658575.jpg treat image : temp/1761900629_890012_1390395692_15488464781a44e0da51073c50c21a84_28516741.jpg treat image : temp/1761900629_890012_1390395691_0994dfebb24ffe3d004a512a169ea946_65613793.jpg treat image : temp/1761900629_890012_1390395690_e45ae4f21f14dc33beae85dc1252e755_75968042.jpg treat image : temp/1761900629_890012_1390395695_e0492fa60c84124868ca64de5a2962fc_7627173_rle_crop_4009048006_0.png treat image : temp/1761900629_890012_1390395695_e0492fa60c84124868ca64de5a2962fc_7627173_rle_crop_4009048011_0.png treat image : temp/1761900629_890012_1390395695_e0492fa60c84124868ca64de5a2962fc_7627173_rle_crop_4009048012_0.png treat image : temp/1761900629_890012_1390395695_e0492fa60c84124868ca64de5a2962fc_7627173_rle_crop_4009048015_0.png treat image : temp/1761900629_890012_1390395695_e0492fa60c84124868ca64de5a2962fc_7627173_rle_crop_4009048016_0.png treat image : temp/1761900629_890012_1390395695_e0492fa60c84124868ca64de5a2962fc_7627173_rle_crop_4009048017_0.png treat image : temp/1761900629_890012_1390395695_e0492fa60c84124868ca64de5a2962fc_7627173_rle_crop_4009048018_0.png treat image : temp/1761900629_890012_1390395694_fce6bc323d4024c076a29ecafd0e2116_59350938_rle_crop_4009048019_0.png treat image : temp/1761900629_890012_1390395694_fce6bc323d4024c076a29ecafd0e2116_59350938_rle_crop_4009048020_0.png treat image : temp/1761900629_890012_1390395694_fce6bc323d4024c076a29ecafd0e2116_59350938_rle_crop_4009048023_0.png treat image : temp/1761900629_890012_1390395694_fce6bc323d4024c076a29ecafd0e2116_59350938_rle_crop_4009048024_0.png treat image : temp/1761900629_890012_1390395694_fce6bc323d4024c076a29ecafd0e2116_59350938_rle_crop_4009048025_0.png treat image : temp/1761900629_890012_1390395694_fce6bc323d4024c076a29ecafd0e2116_59350938_rle_crop_4009048026_0.png treat image : temp/1761900629_890012_1390395694_fce6bc323d4024c076a29ecafd0e2116_59350938_rle_crop_4009048030_0.png treat image : temp/1761900629_890012_1390395693_fd2c2984dca2ba8e7cecf0ca346ee736_85658575_rle_crop_4009048032_0.png treat image : temp/1761900629_890012_1390395693_fd2c2984dca2ba8e7cecf0ca346ee736_85658575_rle_crop_4009048036_0.png treat image : temp/1761900629_890012_1390395693_fd2c2984dca2ba8e7cecf0ca346ee736_85658575_rle_crop_4009048037_0.png treat image : temp/1761900629_890012_1390395693_fd2c2984dca2ba8e7cecf0ca346ee736_85658575_rle_crop_4009048038_0.png treat image : temp/1761900629_890012_1390395693_fd2c2984dca2ba8e7cecf0ca346ee736_85658575_rle_crop_4009048039_0.png treat image : temp/1761900629_890012_1390395693_fd2c2984dca2ba8e7cecf0ca346ee736_85658575_rle_crop_4009048041_0.png treat image : temp/1761900629_890012_1390395693_fd2c2984dca2ba8e7cecf0ca346ee736_85658575_rle_crop_4009048042_0.png treat image : temp/1761900629_890012_1390395692_15488464781a44e0da51073c50c21a84_28516741_rle_crop_4009048043_0.png treat image : temp/1761900629_890012_1390395692_15488464781a44e0da51073c50c21a84_28516741_rle_crop_4009048044_0.png treat image : temp/1761900629_890012_1390395692_15488464781a44e0da51073c50c21a84_28516741_rle_crop_4009048046_0.png treat image : temp/1761900629_890012_1390395692_15488464781a44e0da51073c50c21a84_28516741_rle_crop_4009048047_0.png treat image : temp/1761900629_890012_1390395692_15488464781a44e0da51073c50c21a84_28516741_rle_crop_4009048051_0.png treat image : temp/1761900629_890012_1390395692_15488464781a44e0da51073c50c21a84_28516741_rle_crop_4009048052_0.png treat image : temp/1761900629_890012_1390395692_15488464781a44e0da51073c50c21a84_28516741_rle_crop_4009048054_0.png treat image : temp/1761900629_890012_1390395691_0994dfebb24ffe3d004a512a169ea946_65613793_rle_crop_4009048055_0.png treat image : temp/1761900629_890012_1390395691_0994dfebb24ffe3d004a512a169ea946_65613793_rle_crop_4009048056_0.png treat image : temp/1761900629_890012_1390395691_0994dfebb24ffe3d004a512a169ea946_65613793_rle_crop_4009048057_0.png treat image : temp/1761900629_890012_1390395691_0994dfebb24ffe3d004a512a169ea946_65613793_rle_crop_4009048059_0.png treat image : temp/1761900629_890012_1390395691_0994dfebb24ffe3d004a512a169ea946_65613793_rle_crop_4009048060_0.png treat image : temp/1761900629_890012_1390395691_0994dfebb24ffe3d004a512a169ea946_65613793_rle_crop_4009048061_0.png treat image : temp/1761900629_890012_1390395691_0994dfebb24ffe3d004a512a169ea946_65613793_rle_crop_4009048062_0.png treat image : temp/1761900629_890012_1390395690_e45ae4f21f14dc33beae85dc1252e755_75968042_rle_crop_4009048063_0.png treat image : temp/1761900629_890012_1390395690_e45ae4f21f14dc33beae85dc1252e755_75968042_rle_crop_4009048064_0.png treat image : temp/1761900629_890012_1390395690_e45ae4f21f14dc33beae85dc1252e755_75968042_rle_crop_4009048065_0.png treat image : temp/1761900629_890012_1390395690_e45ae4f21f14dc33beae85dc1252e755_75968042_rle_crop_4009048066_0.png treat image : temp/1761900629_890012_1390395690_e45ae4f21f14dc33beae85dc1252e755_75968042_rle_crop_4009048070_0.png treat image : temp/1761900629_890012_1390395695_e0492fa60c84124868ca64de5a2962fc_7627173_rle_crop_4009048008_0.png treat image : temp/1761900629_890012_1390395693_fd2c2984dca2ba8e7cecf0ca346ee736_85658575_rle_crop_4009048033_0.png treat image : temp/1761900629_890012_1390395690_e45ae4f21f14dc33beae85dc1252e755_75968042_rle_crop_4009048071_0.png treat image : temp/1761900629_890012_1390395695_e0492fa60c84124868ca64de5a2962fc_7627173_rle_crop_4009048007_0.png treat image : temp/1761900629_890012_1390395695_e0492fa60c84124868ca64de5a2962fc_7627173_rle_crop_4009048009_0.png treat image : temp/1761900629_890012_1390395695_e0492fa60c84124868ca64de5a2962fc_7627173_rle_crop_4009048010_0.png treat image : temp/1761900629_890012_1390395695_e0492fa60c84124868ca64de5a2962fc_7627173_rle_crop_4009048013_0.png treat image : temp/1761900629_890012_1390395695_e0492fa60c84124868ca64de5a2962fc_7627173_rle_crop_4009048014_0.png treat image : temp/1761900629_890012_1390395694_fce6bc323d4024c076a29ecafd0e2116_59350938_rle_crop_4009048021_0.png treat image : temp/1761900629_890012_1390395694_fce6bc323d4024c076a29ecafd0e2116_59350938_rle_crop_4009048022_0.png treat image : temp/1761900629_890012_1390395694_fce6bc323d4024c076a29ecafd0e2116_59350938_rle_crop_4009048027_0.png treat image : temp/1761900629_890012_1390395694_fce6bc323d4024c076a29ecafd0e2116_59350938_rle_crop_4009048028_0.png treat image : temp/1761900629_890012_1390395694_fce6bc323d4024c076a29ecafd0e2116_59350938_rle_crop_4009048029_0.png treat image : temp/1761900629_890012_1390395694_fce6bc323d4024c076a29ecafd0e2116_59350938_rle_crop_4009048031_0.png treat image : temp/1761900629_890012_1390395693_fd2c2984dca2ba8e7cecf0ca346ee736_85658575_rle_crop_4009048034_0.png treat image : temp/1761900629_890012_1390395693_fd2c2984dca2ba8e7cecf0ca346ee736_85658575_rle_crop_4009048035_0.png treat image : temp/1761900629_890012_1390395693_fd2c2984dca2ba8e7cecf0ca346ee736_85658575_rle_crop_4009048040_0.png treat image : temp/1761900629_890012_1390395692_15488464781a44e0da51073c50c21a84_28516741_rle_crop_4009048045_0.png treat image : temp/1761900629_890012_1390395692_15488464781a44e0da51073c50c21a84_28516741_rle_crop_4009048048_0.png treat image : temp/1761900629_890012_1390395692_15488464781a44e0da51073c50c21a84_28516741_rle_crop_4009048050_0.png treat image : temp/1761900629_890012_1390395692_15488464781a44e0da51073c50c21a84_28516741_rle_crop_4009048053_0.png treat image : temp/1761900629_890012_1390395691_0994dfebb24ffe3d004a512a169ea946_65613793_rle_crop_4009048058_0.png treat image : temp/1761900629_890012_1390395690_e45ae4f21f14dc33beae85dc1252e755_75968042_rle_crop_4009048067_0.png treat image : temp/1761900629_890012_1390395690_e45ae4f21f14dc33beae85dc1252e755_75968042_rle_crop_4009048068_0.png treat image : temp/1761900629_890012_1390395690_e45ae4f21f14dc33beae85dc1252e755_75968042_rle_crop_4009048069_0.png treat image : temp/1761900629_890012_1390395692_15488464781a44e0da51073c50c21a84_28516741_rle_crop_4009048049_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 72 time used for this insertion : 0.01215052604675293 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 72 time used for this insertion : 0.013041973114013672 save missing photos in datou_result : time spend for datou_step_exec : 7.19786262512207 time spend to save output : 0.029587268829345703 total time spend for step 7 : 7.227449893951416 step8:velours_tree Fri Oct 31 09:53:23 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.0862283706665039 time spend to save output : 3.409385681152344e-05 total time spend for step 8 : 0.08626246452331543 step9:send_mail_cod Fri Oct 31 09:53:24 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P28010444_31-10-2025_09_53_24.pdf 28011752 imagette280117521761900804 28011753 change filename to text .change filename to text .change filename to text .imagette280117531761900804 28011754 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette280117541761900804 28011755 imagette280117551761900806 28011756 imagette280117561761900806 28011757 imagette280117571761900806 28011758 imagette280117581761900806 28011759 imagette280117591761900806 28011760 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette280117601761900806 28011761 change filename to text .imagette280117611761900808 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=28010444 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/28011752,28011753,28011754,28011755,28011756,28011757,28011758,28011759,28011760,28011761,28011762?tags=flou,carton,papier,mal_croppe,pehd,background,metal,autre,pet_clair,pet_fonce,environnement args[1390395695] : ((1390395695, -6.911052032573633, 492609224), (1390395695, 0.7686297286010311, 2107752395), '0.06800716949588477') We are sending mail with results at report@fotonower.com args[1390395694] : ((1390395694, -6.912543633745884, 492609224), (1390395694, 0.8264939965014665, 2107752395), '0.06800716949588477') We are sending mail with results at report@fotonower.com args[1390395693] : ((1390395693, -6.9097032072411135, 492609224), (1390395693, 0.8892360275165099, 2107752395), '0.06800716949588477') We are sending mail with results at report@fotonower.com args[1390395692] : ((1390395692, -6.741385469674996, 492609224), (1390395692, 0.8030559297023663, 2107752395), '0.06800716949588477') We are sending mail with results at report@fotonower.com args[1390395691] : ((1390395691, -6.885027756251397, 492609224), (1390395691, 0.7842257999546106, 2107752395), '0.06800716949588477') We are sending mail with results at report@fotonower.com args[1390395690] : ((1390395690, -6.99416383249181, 492609224), (1390395690, 0.8268456755065432, 2107752395), '0.06800716949588477') We are sending mail with results at report@fotonower.com refus_total : 0.06800716949588477 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos_view ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=28010444 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28010444_31-10-2025_09_53_24.pdf results_Auto_P28010444_31-10-2025_09_53_24.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28010444_31-10-2025_09_53_24.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','28010444','results_Auto_P28010444_31-10-2025_09_53_24.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28010444_31-10-2025_09_53_24.pdf','pdf','','0.51','0.06800716949588477') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/28010444

https://www.fotonower.com/image?json=false&list_photos_id=1390395695
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1390395694
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1390395693
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1390395692
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1390395691
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1390395690
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 6.80%
Veuillez trouver les photos des contaminants.

exemples de contaminants: carton: https://www.fotonower.com/view/28011753?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/28011754?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/28011760?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/28011761?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28010444_31-10-2025_09_53_24.pdf.

Lien vers velours :https://marlene.fotonower.com/velours/28011752,28011753,28011754,28011755,28011756,28011757,28011758,28011759,28011760,28011761,28011762?tags=flou,carton,papier,mal_croppe,pehd,background,metal,autre,pet_clair,pet_fonce,environnement.


L'équipe Fotonower 202 b'' Server: nginx Date: Fri, 31 Oct 2025 08:53:30 GMT Content-Length: 0 Connection: close X-Message-Id: dkdBHzXuSNS9ijZO_zwFUA Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1390395695, 1390395694, 1390395693, 1390395692, 1390395691, 1390395690] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3972170') ('3318', '28010444', '1390395695', None, None, None, None, None, '3972170') ('3318', None, None, None, None, None, None, None, '3972170') ('3318', '28010444', '1390395694', None, None, None, None, None, '3972170') ('3318', None, None, None, None, None, None, None, '3972170') ('3318', '28010444', '1390395693', None, None, None, None, None, '3972170') ('3318', None, None, None, None, None, None, None, '3972170') ('3318', '28010444', '1390395692', None, None, None, None, None, '3972170') ('3318', None, None, None, None, None, None, None, '3972170') ('3318', '28010444', '1390395691', None, None, None, None, None, '3972170') ('3318', None, None, None, None, None, None, None, '3972170') ('3318', '28010444', '1390395690', None, None, None, None, None, '3972170') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.009515523910522461 save_final save missing photos in datou_result : time spend for datou_step_exec : 6.7357497215271 time spend to save output : 0.009753704071044922 total time spend for step 9 : 6.7455034255981445 step10:split_time_score Fri Oct 31 09:53:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('15', 6),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 21102025 28010444 Nombre de photos uploadées : 6 / 23040 (0%) 21102025 28010444 Nombre de photos taguées (types de déchets): 0 / 6 (0%) 21102025 28010444 Nombre de photos taguées (volume) : 0 / 6 (0%) elapsed_time : load_data_split_time_score 2.1457672119140625e-06 elapsed_time : order_list_meta_photo_and_scores 5.9604644775390625e-06 ?????? elapsed_time : fill_and_build_computed_from_old_data 0.00030303001403808594 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.19444680213928223 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28010059 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28010077 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28010135 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28010190 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28010191 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28010216 order by id desc limit 1 Qualite : 0.01929798002462724 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28010259_31-10-2025_09_40_02.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28010259 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28010259 AND mptpi.`type`=3726 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28010376 order by id desc limit 1 Qualite : 0.06800716949588477 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28010444_31-10-2025_09_53_24.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28010444 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28010444 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28010460 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28010591 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28010594 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28010617 order by id desc limit 1 Qualite : 0.0 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28010619_31-10-2025_09_47_01.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28010619 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28010619 AND mptpi.`type`=3726 To do Qualite : 0.15954648259874507 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28010637_31-10-2025_09_42_35.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28010637 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28010637 AND mptpi.`type`=3726 To do Qualite : 0.18081841802240806 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28010690_31-10-2025_09_44_39.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28010690 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28010690 AND mptpi.`type`=3726 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'21102025': {'nb_upload': 6, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1390395695, 1390395694, 1390395693, 1390395692, 1390395691, 1390395690] Looping around the photos to save general results len do output : 1 /28010444Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3972170') ('3318', '28010444', '1390395695', None, None, None, None, None, '3972170') ('3318', None, None, None, None, None, None, None, '3972170') ('3318', '28010444', '1390395694', None, None, None, None, None, '3972170') ('3318', None, None, None, None, None, None, None, '3972170') ('3318', '28010444', '1390395693', None, None, None, None, None, '3972170') ('3318', None, None, None, None, None, None, None, '3972170') ('3318', '28010444', '1390395692', None, None, None, None, None, '3972170') ('3318', None, None, None, None, None, None, None, '3972170') ('3318', '28010444', '1390395691', None, None, None, None, None, '3972170') ('3318', None, None, None, None, None, None, None, '3972170') ('3318', '28010444', '1390395690', None, None, None, None, None, '3972170') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 7 time used for this insertion : 0.011846303939819336 save_final save missing photos in datou_result : time spend for datou_step_exec : 15.395068645477295 time spend to save output : 0.012034416198730469 total time spend for step 10 : 15.407103061676025 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 6 set_done_treatment 83.83user 71.05system 3:21.82elapsed 76%CPU (0avgtext+0avgdata 3770292maxresident)k 1726816inputs+77424outputs (5626major+7489613minor)pagefaults 0swaps