python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1406847 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['4042346'] with mtr_portfolio_ids : ['28495493'] and first list_photo_ids : [] new path : /proc/1406847/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 20 ; length of list_pids : 20 ; length of list_args : 20 time to download the photos : 3.1832058429718018 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Thu Nov 13 20:20:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10998 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-11-13 20:20:33.819856: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-11-13 20:20:33.846536: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493010000 Hz 2025-11-13 20:20:33.848763: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f41fc000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-11-13 20:20:33.848821: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-11-13 20:20:33.852765: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-11-13 20:20:34.153110: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x9c877a0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-11-13 20:20:34.153174: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-11-13 20:20:34.154736: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-11-13 20:20:34.155179: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-13 20:20:34.158720: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-13 20:20:34.161952: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-11-13 20:20:34.162524: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-11-13 20:20:34.165268: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-11-13 20:20:34.166353: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-11-13 20:20:34.171029: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-11-13 20:20:34.172528: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-11-13 20:20:34.172600: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-13 20:20:34.173354: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-11-13 20:20:34.173370: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-11-13 20:20:34.173378: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-11-13 20:20:34.174754: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10193 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-11-13 20:20:34.537734: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-11-13 20:20:34.537851: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-13 20:20:34.537880: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-13 20:20:34.537905: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-11-13 20:20:34.537929: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-11-13 20:20:34.537954: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-11-13 20:20:34.537978: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-11-13 20:20:34.538002: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-11-13 20:20:34.539976: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-11-13 20:20:34.541306: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-11-13 20:20:34.541367: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-13 20:20:34.541384: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-13 20:20:34.541398: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-11-13 20:20:34.541412: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-11-13 20:20:34.541426: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-11-13 20:20:34.541439: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-11-13 20:20:34.541453: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-11-13 20:20:34.542785: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-11-13 20:20:34.542820: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-11-13 20:20:34.542829: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-11-13 20:20:34.542837: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-11-13 20:20:34.544227: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10193 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-11-13 20:20:43.235479: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-13 20:20:43.415458: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 20 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 23.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 34.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 39.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 35.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 49.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 20.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 43.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 46.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 35.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 58.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 55.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 1 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 45.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 47.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 40.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 Detection mask done ! Trying to reset tf kernel 1407458 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5706 tf kernel not reseted sub process len(results) : 20 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 20 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10998 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.00018358230590820312 nb_pixel_total : 4263 time to create 1 rle with old method : 0.005244016647338867 length of segment : 62 time for calcul the mask position with numpy : 9.059906005859375e-05 nb_pixel_total : 2771 time to create 1 rle with old method : 0.003520965576171875 length of segment : 53 time for calcul the mask position with numpy : 0.00018525123596191406 nb_pixel_total : 10982 time to create 1 rle with old method : 0.01792597770690918 length of segment : 84 time for calcul the mask position with numpy : 0.002297639846801758 nb_pixel_total : 103261 time to create 1 rle with old method : 0.16055655479431152 length of segment : 568 time for calcul the mask position with numpy : 0.0001513957977294922 nb_pixel_total : 2780 time to create 1 rle with old method : 0.004635810852050781 length of segment : 60 time for calcul the mask position with numpy : 0.02119898796081543 nb_pixel_total : 974017 time to create 1 rle with new method : 0.3528144359588623 length of segment : 1444 time for calcul the mask position with numpy : 0.00011301040649414062 nb_pixel_total : 3473 time to create 1 rle with old method : 0.0041348934173583984 length of segment : 51 time for calcul the mask position with numpy : 9.846687316894531e-05 nb_pixel_total : 3681 time to create 1 rle with old method : 0.008205175399780273 length of segment : 58 time for calcul the mask position with numpy : 0.00028228759765625 nb_pixel_total : 6705 time to create 1 rle with old method : 0.007838249206542969 length of segment : 109 time for calcul the mask position with numpy : 0.00018930435180664062 nb_pixel_total : 5039 time to create 1 rle with old method : 0.005706310272216797 length of segment : 77 time for calcul the mask position with numpy : 0.00018262863159179688 nb_pixel_total : 6233 time to create 1 rle with old method : 0.007125139236450195 length of segment : 93 time for calcul the mask position with numpy : 0.0002167224884033203 nb_pixel_total : 5589 time to create 1 rle with old method : 0.006476402282714844 length of segment : 86 time for calcul the mask position with numpy : 0.0004019737243652344 nb_pixel_total : 10814 time to create 1 rle with old method : 0.011971473693847656 length of segment : 189 time for calcul the mask position with numpy : 0.000274658203125 nb_pixel_total : 10088 time to create 1 rle with old method : 0.011441946029663086 length of segment : 108 time for calcul the mask position with numpy : 0.00040650367736816406 nb_pixel_total : 18744 time to create 1 rle with old method : 0.021263599395751953 length of segment : 110 time for calcul the mask position with numpy : 9.918212890625e-05 nb_pixel_total : 4600 time to create 1 rle with old method : 0.005221128463745117 length of segment : 54 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 1351 time to create 1 rle with old method : 0.0015797615051269531 length of segment : 38 time for calcul the mask position with numpy : 0.0002853870391845703 nb_pixel_total : 4825 time to create 1 rle with old method : 0.005465984344482422 length of segment : 166 time for calcul the mask position with numpy : 0.0001819133758544922 nb_pixel_total : 5917 time to create 1 rle with old method : 0.0064182281494140625 length of segment : 104 time for calcul the mask position with numpy : 0.0025336742401123047 nb_pixel_total : 102482 time to create 1 rle with old method : 0.10951781272888184 length of segment : 592 time for calcul the mask position with numpy : 0.0002472400665283203 nb_pixel_total : 10617 time to create 1 rle with old method : 0.01178598403930664 length of segment : 185 time for calcul the mask position with numpy : 0.0002956390380859375 nb_pixel_total : 6934 time to create 1 rle with old method : 0.007884740829467773 length of segment : 123 time for calcul the mask position with numpy : 0.0006573200225830078 nb_pixel_total : 29365 time to create 1 rle with old method : 0.03303956985473633 length of segment : 187 time for calcul the mask position with numpy : 0.0005178451538085938 nb_pixel_total : 14418 time to create 1 rle with old method : 0.01695561408996582 length of segment : 149 time for calcul the mask position with numpy : 0.0022373199462890625 nb_pixel_total : 105997 time to create 1 rle with old method : 0.11798262596130371 length of segment : 543 time for calcul the mask position with numpy : 0.00020170211791992188 nb_pixel_total : 6753 time to create 1 rle with old method : 0.007422685623168945 length of segment : 108 time for calcul the mask position with numpy : 0.00015735626220703125 nb_pixel_total : 11259 time to create 1 rle with old method : 0.012773513793945312 length of segment : 120 time for calcul the mask position with numpy : 7.343292236328125e-05 nb_pixel_total : 3470 time to create 1 rle with old method : 0.004029989242553711 length of segment : 49 time for calcul the mask position with numpy : 0.00010776519775390625 nb_pixel_total : 5865 time to create 1 rle with old method : 0.0066454410552978516 length of segment : 107 time for calcul the mask position with numpy : 7.891654968261719e-05 nb_pixel_total : 2766 time to create 1 rle with old method : 0.0031957626342773438 length of segment : 120 time for calcul the mask position with numpy : 0.00010180473327636719 nb_pixel_total : 4679 time to create 1 rle with old method : 0.005393505096435547 length of segment : 82 time for calcul the mask position with numpy : 6.031990051269531e-05 nb_pixel_total : 1815 time to create 1 rle with old method : 0.0021855831146240234 length of segment : 45 time for calcul the mask position with numpy : 0.00014019012451171875 nb_pixel_total : 7673 time to create 1 rle with old method : 0.008464336395263672 length of segment : 118 time for calcul the mask position with numpy : 6.222724914550781e-05 nb_pixel_total : 2419 time to create 1 rle with old method : 0.002808094024658203 length of segment : 59 time for calcul the mask position with numpy : 0.00015020370483398438 nb_pixel_total : 4508 time to create 1 rle with old method : 0.004977703094482422 length of segment : 81 time for calcul the mask position with numpy : 0.0001842975616455078 nb_pixel_total : 4088 time to create 1 rle with old method : 0.0046732425689697266 length of segment : 81 time for calcul the mask position with numpy : 0.0006053447723388672 nb_pixel_total : 18090 time to create 1 rle with old method : 0.02109813690185547 length of segment : 321 time for calcul the mask position with numpy : 0.0002033710479736328 nb_pixel_total : 8728 time to create 1 rle with old method : 0.009502172470092773 length of segment : 128 time for calcul the mask position with numpy : 0.001951456069946289 nb_pixel_total : 108150 time to create 1 rle with old method : 0.11846470832824707 length of segment : 517 time for calcul the mask position with numpy : 0.00028896331787109375 nb_pixel_total : 7683 time to create 1 rle with old method : 0.009135961532592773 length of segment : 108 time for calcul the mask position with numpy : 0.000179290771484375 nb_pixel_total : 4357 time to create 1 rle with old method : 0.005095243453979492 length of segment : 82 time for calcul the mask position with numpy : 0.0021886825561523438 nb_pixel_total : 105425 time to create 1 rle with old method : 0.11475133895874023 length of segment : 531 time for calcul the mask position with numpy : 8.082389831542969e-05 nb_pixel_total : 1370 time to create 1 rle with old method : 0.0016045570373535156 length of segment : 40 time for calcul the mask position with numpy : 0.025598526000976562 nb_pixel_total : 1117396 time to create 1 rle with new method : 0.05896592140197754 length of segment : 1093 time for calcul the mask position with numpy : 0.008300065994262695 nb_pixel_total : 594670 time to create 1 rle with new method : 0.03401613235473633 length of segment : 964 time for calcul the mask position with numpy : 0.007399082183837891 nb_pixel_total : 579254 time to create 1 rle with new method : 0.01489877700805664 length of segment : 954 time for calcul the mask position with numpy : 0.00014209747314453125 nb_pixel_total : 2023 time to create 1 rle with old method : 0.002300739288330078 length of segment : 55 time for calcul the mask position with numpy : 0.0019114017486572266 nb_pixel_total : 107239 time to create 1 rle with old method : 0.11456727981567383 length of segment : 540 time for calcul the mask position with numpy : 0.000110626220703125 nb_pixel_total : 4957 time to create 1 rle with old method : 0.005758047103881836 length of segment : 64 time for calcul the mask position with numpy : 0.0003235340118408203 nb_pixel_total : 13136 time to create 1 rle with old method : 0.014808416366577148 length of segment : 140 time for calcul the mask position with numpy : 0.0002574920654296875 nb_pixel_total : 5738 time to create 1 rle with old method : 0.006602764129638672 length of segment : 114 time for calcul the mask position with numpy : 0.0005192756652832031 nb_pixel_total : 16019 time to create 1 rle with old method : 0.017640352249145508 length of segment : 238 time for calcul the mask position with numpy : 0.00018548965454101562 nb_pixel_total : 3693 time to create 1 rle with old method : 0.004585742950439453 length of segment : 61 time for calcul the mask position with numpy : 0.0025773048400878906 nb_pixel_total : 80866 time to create 1 rle with old method : 0.08805608749389648 length of segment : 528 time for calcul the mask position with numpy : 0.00017070770263671875 nb_pixel_total : 5343 time to create 1 rle with old method : 0.006014823913574219 length of segment : 74 time for calcul the mask position with numpy : 0.0005357265472412109 nb_pixel_total : 14177 time to create 1 rle with old method : 0.015868425369262695 length of segment : 228 time for calcul the mask position with numpy : 0.00015544891357421875 nb_pixel_total : 7932 time to create 1 rle with old method : 0.008871793746948242 length of segment : 117 time for calcul the mask position with numpy : 0.0008320808410644531 nb_pixel_total : 36184 time to create 1 rle with old method : 0.03949403762817383 length of segment : 327 time for calcul the mask position with numpy : 0.00045108795166015625 nb_pixel_total : 12022 time to create 1 rle with old method : 0.019713640213012695 length of segment : 175 time for calcul the mask position with numpy : 0.0001323223114013672 nb_pixel_total : 3296 time to create 1 rle with old method : 0.00583195686340332 length of segment : 43 time for calcul the mask position with numpy : 0.00040459632873535156 nb_pixel_total : 11387 time to create 1 rle with old method : 0.016252994537353516 length of segment : 130 time spent for convertir_results : 4.39689040184021 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 61 chid ids of type : 3594 Number RLEs to save : 13835 save missing photos in datou_result : time spend for datou_step_exec : 32.744425773620605 time spend to save output : 1.6712584495544434 total time spend for step 1 : 34.41568422317505 step2:crop_condition Thu Nov 13 20:21:05 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 20 ! batch 1 Loaded 61 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 36 About to insert : list_path_to_insert length 36 new photo from crops ! About to upload 36 photos upload in portfolio : 3736932 init cache_photo without model_param we have 36 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1763061667_1406847 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763061673), 0.0, 0.0, 14, '', 0, 0, '1763061627_1406847_1394222167_e4a023fe61b22151ae0a49f229cfa58b_rle_crop_4032613526_0.png', 0, 107, 59, 0, 1763061673,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763061673), 0.0, 0.0, 14, '', 0, 0, '1763061627_1406847_1394222167_e4a023fe61b22151ae0a49f229cfa58b_rle_crop_4032613527_0.png', 0, 73, 53, 0, 1763061673,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763061673), 0.0, 0.0, 14, '', 0, 0, '1763061627_1406847_1394222167_e4a023fe61b22151ae0a49f229cfa58b_rle_crop_4032613528_0.png', 0, 187, 82, 0, 1763061673,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763061673), 0.0, 0.0, 14, '', 0, 0, '1763061627_1406847_1394222160_cc0ecdc3dbcbb5d8279cb60b957abe82_rle_crop_4032613530_0.png', 0, 68, 60, 0, 1763061673,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763061673), 0.0, 0.0, 14, '', 0, 0, '1763061627_1406847_1394222160_cc0ecdc3dbcbb5d8279cb60b957abe82_rle_crop_4032613532_0.png', 0, 96, 51, 0, 1763061673,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763061673), 0.0, 0.0, 14, '', 0, 0, '1763061627_1406847_1394222154_a35db6e9dfcc09724ced0f381e4cb9d2_rle_crop_4032613533_0.png', 0, 97, 57, 0, 1763061673,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763061673), 0.0, 0.0, 14, '', 0, 0, '1763061627_1406847_1394222154_a35db6e9dfcc09724ced0f381e4cb9d2_rle_crop_4032613534_0.png', 0, 96, 109, 0, 1763061673,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763061673), 0.0, 0.0, 14, '', 0, 0, '1763061627_1406847_1394222154_a35db6e9dfcc09724ced0f381e4cb9d2_rle_crop_4032613536_0.png', 0, 101, 90, 0, 1763061673,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763061673), 0.0, 0.0, 14, '', 0, 0, '1763061627_1406847_1394222149_762ed0fbe3a1ceb79b35bdd1a34d2b6f_rle_crop_4032613537_0.png', 0, 102, 86, 0, 1763061673,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763061673), 0.0, 0.0, 14, '', 0, 0, '1763061627_1406847_1394222149_762ed0fbe3a1ceb79b35bdd1a34d2b6f_rle_crop_4032613538_0.png', 0, 93, 189, 0, 1763061673,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763061673), 0.0, 0.0, 14, '', 0, 0, '1763061627_1406847_1394222138_1d52a34fc9389d40dd6c44794e23d2d1_rle_crop_4032613541_0.png', 0, 107, 54, 0, 1763061673,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763061673), 0.0, 0.0, 14, '', 0, 0, '1763061627_1406847_1394222138_1d52a34fc9389d40dd6c44794e23d2d1_rle_crop_4032613542_0.png', 0, 41, 38, 0, 1763061673,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763061673), 0.0, 0.0, 14, '', 0, 0, '1763061627_1406847_1394221035_a70e200bc0650b89e09ba1f2abb12f62_rle_crop_4032613543_0.png', 0, 70, 166, 0, 1763061673,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763061673), 0.0, 0.0, 14, '', 0, 0, '1763061627_1406847_1394220908_93e62113d265028da95139fd3491e408_rle_crop_4032613544_0.png', 0, 85, 86, 0, 1763061673,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763061673), 0.0, 0.0, 14, '', 0, 0, '1763061627_1406847_1394220908_93e62113d265028da95139fd3491e408_rle_crop_4032613546_0.png', 0, 95, 184, 0, 1763061673,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763061673), 0.0, 0.0, 14, '', 0, 0, '1763061627_1406847_1394220755_57fc8fc9df5eac6fb635424d5c3ad541_rle_crop_4032613553_0.png', 0, 95, 49, 0, 1763061673,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763061673), 0.0, 0.0, 14, '', 0, 0, '1763061627_1406847_1394220755_57fc8fc9df5eac6fb635424d5c3ad541_rle_crop_4032613554_0.png', 0, 79, 107, 0, 1763061673,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763061673), 0.0, 0.0, 14, '', 0, 0, '1763061627_1406847_1394220755_57fc8fc9df5eac6fb635424d5c3ad541_rle_crop_4032613555_0.png', 0, 79, 79, 0, 1763061673,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763061673), 0.0, 0.0, 14, '', 0, 0, '1763061627_1406847_1394220755_57fc8fc9df5eac6fb635424d5c3ad541_rle_crop_4032613556_0.png', 0, 88, 82, 0, 1763061673,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763061673), 0.0, 0.0, 14, '', 0, 0, '1763061627_1406847_1394220755_57fc8fc9df5eac6fb635424d5c3ad541_rle_crop_4032613557_0.png', 0, 72, 45, 0, 1763061673,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763061673), 0.0, 0.0, 14, '', 0, 0, '1763061627_1406847_1394220755_57fc8fc9df5eac6fb635424d5c3ad541_rle_crop_4032613558_0.png', 0, 135, 106, 0, 1763061673,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763061673), 0.0, 0.0, 14, '', 0, 0, '1763061627_1406847_1394220755_57fc8fc9df5eac6fb635424d5c3ad541_rle_crop_4032613559_0.png', 0, 57, 59, 0, 1763061673,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763061673), 0.0, 0.0, 14, '', 0, 0, '1763061627_1406847_1394220129_639d9513c529a96b870323cd869c56d0_rle_crop_4032613560_0.png', 0, 66, 81, 0, 1763061673,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763061673), 0.0, 0.0, 14, '', 0, 0, '1763061627_1406847_1394219974_a16d990f365f5556d3f3f11e67206c33_rle_crop_4032613563_0.png', 0, 113, 127, 0, 1763061673,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763061673), 0.0, 0.0, 14, '', 0, 0, '1763061627_1406847_1394219929_317051797c8322228c91830a202eb388_rle_crop_4032613565_0.png', 0, 107, 104, 0, 1763061673,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763061673), 0.0, 0.0, 14, '', 0, 0, '1763061627_1406847_1394219929_317051797c8322228c91830a202eb388_rle_crop_4032613566_0.png', 0, 70, 79, 0, 1763061673,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763061673), 0.0, 0.0, 14, '', 0, 0, '1763061627_1406847_1394219919_3e1667fd77d26c1cfcc60e27c6d4b0a7_rle_crop_4032613568_0.png', 0, 50, 40, 0, 1763061673,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763061673), 0.0, 0.0, 14, '', 0, 0, '1763061627_1406847_1394219691_8c0f5d9a70f4c979bb4fa96069f49af7_rle_crop_4032613572_0.png', 0, 49, 55, 0, 1763061673,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763061673), 0.0, 0.0, 14, '', 0, 0, '1763061627_1406847_1394219686_8810a7133709f85631b828c533baa8b5_rle_crop_4032613576_0.png', 0, 76, 114, 0, 1763061673,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763061673), 0.0, 0.0, 14, '', 0, 0, '1763061627_1406847_1394219686_8810a7133709f85631b828c533baa8b5_rle_crop_4032613577_0.png', 0, 118, 235, 0, 1763061673,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763061673), 0.0, 0.0, 14, '', 0, 0, '1763061627_1406847_1394219686_8810a7133709f85631b828c533baa8b5_rle_crop_4032613578_0.png', 0, 128, 61, 0, 1763061673,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763061673), 0.0, 0.0, 14, '', 0, 0, '1763061627_1406847_1394219592_748f8682c3a2c1c1a371c5ae56861dd3_rle_crop_4032613580_0.png', 0, 100, 74, 0, 1763061673,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763061673), 0.0, 0.0, 14, '', 0, 0, '1763061627_1406847_1394219592_748f8682c3a2c1c1a371c5ae56861dd3_rle_crop_4032613581_0.png', 0, 146, 204, 0, 1763061673,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763061673), 0.0, 0.0, 14, '', 0, 0, '1763061627_1406847_1394219592_748f8682c3a2c1c1a371c5ae56861dd3_rle_crop_4032613582_0.png', 0, 89, 116, 0, 1763061673,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763061673), 0.0, 0.0, 14, '', 0, 0, '1763061627_1406847_1394219150_08d1cad5c14941a371192fa36fdc0a97_rle_crop_4032613584_0.png', 0, 133, 155, 0, 1763061673,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763061673), 0.0, 0.0, 14, '', 0, 0, '1763061627_1406847_1394219150_08d1cad5c14941a371192fa36fdc0a97_rle_crop_4032613585_0.png', 0, 126, 43, 0, 1763061673,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 36 photos in the portfolio 3736932 time of upload the photos Elapsed time : 9.381694078445435 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1763061677_1406847 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763061678), 0.0, 0.0, 14, '', 0, 0, '1763061627_1406847_1394222167_e4a023fe61b22151ae0a49f229cfa58b_rle_crop_4032613529_0.png', 0, 321, 502, 0, 1763061678,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763061678), 0.0, 0.0, 14, '', 0, 0, '1763061627_1406847_1394219974_a16d990f365f5556d3f3f11e67206c33_rle_crop_4032613561_0.png', 0, 83, 80, 0, 1763061678,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.9088637828826904 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1763061679_1406847 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763061679), 0.0, 0.0, 14, '', 0, 0, '1763061627_1406847_1394222154_a35db6e9dfcc09724ced0f381e4cb9d2_rle_crop_4032613535_0.png', 0, 80, 77, 0, 1763061679,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763061679), 0.0, 0.0, 14, '', 0, 0, '1763061627_1406847_1394220825_99e4e5c83c938f9d46edba57326882c2_rle_crop_4032613547_0.png', 0, 98, 119, 0, 1763061679,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763061679), 0.0, 0.0, 14, '', 0, 0, '1763061627_1406847_1394220825_99e4e5c83c938f9d46edba57326882c2_rle_crop_4032613552_0.png', 0, 123, 113, 0, 1763061679,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.9936294555664062 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 18 About to insert : list_path_to_insert length 18 new photo from crops ! About to upload 18 photos upload in portfolio : 3736932 init cache_photo without model_param we have 18 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1763061696_1406847 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763061700), 0.0, 0.0, 14, '', 0, 0, '1763061627_1406847_1394222160_cc0ecdc3dbcbb5d8279cb60b957abe82_rle_crop_4032613531_0.png', 0, 1369, 989, 0, 1763061700,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763061700), 0.0, 0.0, 14, '', 0, 0, '1763061627_1406847_1394222138_1d52a34fc9389d40dd6c44794e23d2d1_rle_crop_4032613540_0.png', 0, 222, 106, 0, 1763061700,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763061700), 0.0, 0.0, 14, '', 0, 0, '1763061627_1406847_1394220908_93e62113d265028da95139fd3491e408_rle_crop_4032613545_0.png', 0, 316, 567, 0, 1763061700,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763061700), 0.0, 0.0, 14, '', 0, 0, '1763061627_1406847_1394220825_99e4e5c83c938f9d46edba57326882c2_rle_crop_4032613548_0.png', 0, 218, 168, 0, 1763061700,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763061700), 0.0, 0.0, 14, '', 0, 0, '1763061627_1406847_1394220825_99e4e5c83c938f9d46edba57326882c2_rle_crop_4032613549_0.png', 0, 210, 143, 0, 1763061700,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763061700), 0.0, 0.0, 14, '', 0, 0, '1763061627_1406847_1394220825_99e4e5c83c938f9d46edba57326882c2_rle_crop_4032613550_0.png', 0, 330, 534, 0, 1763061700,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763061700), 0.0, 0.0, 14, '', 0, 0, '1763061627_1406847_1394220825_99e4e5c83c938f9d46edba57326882c2_rle_crop_4032613551_0.png', 0, 105, 95, 0, 1763061700,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763061700), 0.0, 0.0, 14, '', 0, 0, '1763061627_1406847_1394219974_a16d990f365f5556d3f3f11e67206c33_rle_crop_4032613562_0.png', 0, 279, 148, 0, 1763061700,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763061700), 0.0, 0.0, 14, '', 0, 0, '1763061627_1406847_1394219974_a16d990f365f5556d3f3f11e67206c33_rle_crop_4032613564_0.png', 0, 329, 517, 0, 1763061700,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763061700), 0.0, 0.0, 14, '', 0, 0, '1763061627_1406847_1394219919_3e1667fd77d26c1cfcc60e27c6d4b0a7_rle_crop_4032613567_0.png', 0, 321, 529, 0, 1763061700,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763061700), 0.0, 0.0, 14, '', 0, 0, '1763061627_1406847_1394219795_4fe8b6652b8ef719e7d680c5f95f113e_rle_crop_4032613569_0.png', 0, 1356, 992, 0, 1763061700,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763061700), 0.0, 0.0, 14, '', 0, 0, '1763061627_1406847_1394219795_4fe8b6652b8ef719e7d680c5f95f113e_rle_crop_4032613570_0.png', 0, 909, 951, 0, 1763061700,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763061700), 0.0, 0.0, 14, '', 0, 0, '1763061627_1406847_1394219696_4f745e82547296febecca8b76f8376e0_rle_crop_4032613571_0.png', 0, 989, 923, 0, 1763061700,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763061700), 0.0, 0.0, 14, '', 0, 0, '1763061627_1406847_1394219691_8c0f5d9a70f4c979bb4fa96069f49af7_rle_crop_4032613573_0.png', 0, 326, 527, 0, 1763061700,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763061700), 0.0, 0.0, 14, '', 0, 0, '1763061627_1406847_1394219691_8c0f5d9a70f4c979bb4fa96069f49af7_rle_crop_4032613574_0.png', 0, 104, 63, 0, 1763061700,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763061700), 0.0, 0.0, 14, '', 0, 0, '1763061627_1406847_1394219691_8c0f5d9a70f4c979bb4fa96069f49af7_rle_crop_4032613575_0.png', 0, 139, 138, 0, 1763061700,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763061700), 0.0, 0.0, 14, '', 0, 0, '1763061627_1406847_1394219686_8810a7133709f85631b828c533baa8b5_rle_crop_4032613579_0.png', 0, 299, 509, 0, 1763061700,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763061700), 0.0, 0.0, 14, '', 0, 0, '1763061627_1406847_1394219150_08d1cad5c14941a371192fa36fdc0a97_rle_crop_4032613586_0.png', 0, 119, 123, 0, 1763061700,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 18 photos in the portfolio 3736932 time of upload the photos Elapsed time : 6.584886074066162 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1763061703_1406847 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763061703), 0.0, 0.0, 14, '', 0, 0, '1763061627_1406847_1394222149_762ed0fbe3a1ceb79b35bdd1a34d2b6f_rle_crop_4032613539_0.png', 0, 118, 100, 0, 1763061703,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1763061703), 0.0, 0.0, 14, '', 0, 0, '1763061627_1406847_1394219592_748f8682c3a2c1c1a371c5ae56861dd3_rle_crop_4032613583_0.png', 0, 162, 327, 0, 1763061703,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.8939828872680664 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1394222167, 1394222160, 1394222154, 1394222149, 1394222138, 1394221035, 1394220908, 1394220825, 1394220755, 1394220129, 1394219974, 1394219929, 1394219919, 1394219795, 1394219701, 1394219696, 1394219691, 1394219686, 1394219592, 1394219150] Looping around the photos to save general results len do output : 61 /1394270712Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394270715Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394270717Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394270721Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394270722Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394270726Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394270727Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394270730Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394270732Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394270734Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394270737Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394270738Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394270741Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394270743Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394270745Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394270748Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394270749Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394270753Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394270754Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394270756Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394270759Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394270761Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394270764Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394270765Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394270769Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394270770Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394270774Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394270775Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394270777Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394270780Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394270782Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394270785Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394270787Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394270790Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394270792Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394270795Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394270827Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394270828Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394270855Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394270858Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394270860Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394271239Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394271243Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394271244Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394271248Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394271251Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394271254Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394271256Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394271259Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394271261Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394271264Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394271267Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394271269Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394271273Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394271274Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394271278Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394271279Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394271283Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394271285Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394271309Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1394271313Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394222167', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394222160', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394222154', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394222149', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394222138', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394221035', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394220908', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394220825', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394220755', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394220129', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394219974', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394219929', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394219919', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394219795', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394219701', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394219696', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394219691', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394219686', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394219592', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394219150', None, None, None, None, None, '4042346') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 203 time used for this insertion : 0.0638124942779541 save_final save missing photos in datou_result : time spend for datou_step_exec : 38.41443419456482 time spend to save output : 0.0663917064666748 total time spend for step 2 : 38.480825901031494 step3:rle_unique_nms_with_priority Thu Nov 13 20:21:43 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 61 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.38681936264038086 time for calcul the mask position with numpy : 0.19405698776245117 nb_pixel_total : 1952323 time to create 1 rle with new method : 0.1656649112701416 time for calcul the mask position with numpy : 0.006630659103393555 nb_pixel_total : 103261 time to create 1 rle with old method : 0.11897826194763184 time for calcul the mask position with numpy : 0.006551027297973633 nb_pixel_total : 10982 time to create 1 rle with old method : 0.01180124282836914 time for calcul the mask position with numpy : 0.006227731704711914 nb_pixel_total : 2771 time to create 1 rle with old method : 0.003115415573120117 time for calcul the mask position with numpy : 0.006044626235961914 nb_pixel_total : 4263 time to create 1 rle with old method : 0.004604816436767578 create new chi : 0.5344126224517822 time to delete rle : 0.04168391227722168 batch 1 Loaded 9 chid ids of type : 3594 +++++Number RLEs to save : 2614 TO DO : save crop sub photo not yet done ! save time : 0.28020501136779785 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.24454569816589355 time for calcul the mask position with numpy : 0.18110370635986328 nb_pixel_total : 1096110 time to create 1 rle with new method : 0.08599162101745605 time for calcul the mask position with numpy : 0.006234884262084961 nb_pixel_total : 3473 time to create 1 rle with old method : 0.003935337066650391 time for calcul the mask position with numpy : 0.012906789779663086 nb_pixel_total : 971237 time to create 1 rle with new method : 0.15011048316955566 time for calcul the mask position with numpy : 0.006601810455322266 nb_pixel_total : 2780 time to create 1 rle with old method : 0.0031228065490722656 create new chi : 0.45757579803466797 time to delete rle : 0.0006203651428222656 batch 1 Loaded 7 chid ids of type : 3594 +++++Number RLEs to save : 4190 TO DO : save crop sub photo not yet done ! save time : 0.40473318099975586 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.12022089958190918 time for calcul the mask position with numpy : 0.1401841640472412 nb_pixel_total : 2051942 time to create 1 rle with new method : 0.08597159385681152 time for calcul the mask position with numpy : 0.0061321258544921875 nb_pixel_total : 6233 time to create 1 rle with old method : 0.00679779052734375 time for calcul the mask position with numpy : 0.0061969757080078125 nb_pixel_total : 5039 time to create 1 rle with old method : 0.0064275264739990234 time for calcul the mask position with numpy : 0.009838104248046875 nb_pixel_total : 6705 time to create 1 rle with old method : 0.010527610778808594 time for calcul the mask position with numpy : 0.0062487125396728516 nb_pixel_total : 3681 time to create 1 rle with old method : 0.004201412200927734 create new chi : 0.2934408187866211 time to delete rle : 0.00028586387634277344 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 1754 TO DO : save crop sub photo not yet done ! save time : 0.23163461685180664 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.05209922790527344 time for calcul the mask position with numpy : 0.06772089004516602 nb_pixel_total : 2047109 time to create 1 rle with new method : 0.14090800285339355 time for calcul the mask position with numpy : 0.0070455074310302734 nb_pixel_total : 10088 time to create 1 rle with old method : 0.011225461959838867 time for calcul the mask position with numpy : 0.0059566497802734375 nb_pixel_total : 10814 time to create 1 rle with old method : 0.014945507049560547 time for calcul the mask position with numpy : 0.005929231643676758 nb_pixel_total : 5589 time to create 1 rle with old method : 0.0064470767974853516 create new chi : 0.269486665725708 time to delete rle : 0.00030040740966796875 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1846 TO DO : save crop sub photo not yet done ! save time : 0.2474966049194336 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.04951047897338867 time for calcul the mask position with numpy : 0.041817665100097656 nb_pixel_total : 2048905 time to create 1 rle with new method : 0.12470602989196777 time for calcul the mask position with numpy : 0.010400772094726562 nb_pixel_total : 1351 time to create 1 rle with old method : 0.0014235973358154297 time for calcul the mask position with numpy : 0.009973764419555664 nb_pixel_total : 4600 time to create 1 rle with old method : 0.0050470829010009766 time for calcul the mask position with numpy : 0.010286092758178711 nb_pixel_total : 18744 time to create 1 rle with old method : 0.020772695541381836 create new chi : 0.23526763916015625 time to delete rle : 0.0002963542938232422 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1484 TO DO : save crop sub photo not yet done ! save time : 0.20264339447021484 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.06240558624267578 time for calcul the mask position with numpy : 0.022796154022216797 nb_pixel_total : 2068775 time to create 1 rle with new method : 0.09248733520507812 time for calcul the mask position with numpy : 0.006610870361328125 nb_pixel_total : 4825 time to create 1 rle with old method : 0.005808591842651367 create new chi : 0.13695192337036133 time to delete rle : 0.0002589225769042969 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1412 TO DO : save crop sub photo not yet done ! save time : 0.19914960861206055 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.2268071174621582 time for calcul the mask position with numpy : 0.07789373397827148 nb_pixel_total : 1954584 time to create 1 rle with new method : 0.07840967178344727 time for calcul the mask position with numpy : 0.006043434143066406 nb_pixel_total : 10617 time to create 1 rle with old method : 0.011460542678833008 time for calcul the mask position with numpy : 0.0064771175384521484 nb_pixel_total : 102482 time to create 1 rle with old method : 0.11318445205688477 time for calcul the mask position with numpy : 0.006433010101318359 nb_pixel_total : 5917 time to create 1 rle with old method : 0.0066432952880859375 create new chi : 0.3171701431274414 time to delete rle : 0.0004792213439941406 batch 1 Loaded 7 chid ids of type : 3594 +++++Number RLEs to save : 2842 TO DO : save crop sub photo not yet done ! save time : 0.3408021926879883 nb_obj : 6 nb_hashtags : 2 time to prepare the origin masks : 0.4218423366546631 time for calcul the mask position with numpy : 0.05757474899291992 nb_pixel_total : 1898874 time to create 1 rle with new method : 0.2041616439819336 time for calcul the mask position with numpy : 0.006391763687133789 nb_pixel_total : 11259 time to create 1 rle with old method : 0.01233530044555664 time for calcul the mask position with numpy : 0.00660395622253418 nb_pixel_total : 6753 time to create 1 rle with old method : 0.007618904113769531 time for calcul the mask position with numpy : 0.007257938385009766 nb_pixel_total : 105997 time to create 1 rle with old method : 0.12340450286865234 time for calcul the mask position with numpy : 0.006464719772338867 nb_pixel_total : 14418 time to create 1 rle with old method : 0.015664100646972656 time for calcul the mask position with numpy : 0.006326436996459961 nb_pixel_total : 29365 time to create 1 rle with old method : 0.03284788131713867 time for calcul the mask position with numpy : 0.0065457820892333984 nb_pixel_total : 6934 time to create 1 rle with old method : 0.007843732833862305 create new chi : 0.5112283229827881 time to delete rle : 0.0005824565887451172 batch 1 Loaded 13 chid ids of type : 3594 ++++++++Number RLEs to save : 3540 TO DO : save crop sub photo not yet done ! save time : 0.4314992427825928 nb_obj : 7 nb_hashtags : 1 time to prepare the origin masks : 0.09450817108154297 time for calcul the mask position with numpy : 0.07784628868103027 nb_pixel_total : 2044913 time to create 1 rle with new method : 0.08863329887390137 time for calcul the mask position with numpy : 0.006197929382324219 nb_pixel_total : 2419 time to create 1 rle with old method : 0.0027768611907958984 time for calcul the mask position with numpy : 0.006097078323364258 nb_pixel_total : 7673 time to create 1 rle with old method : 0.008771896362304688 time for calcul the mask position with numpy : 0.00621485710144043 nb_pixel_total : 1815 time to create 1 rle with old method : 0.0021016597747802734 time for calcul the mask position with numpy : 0.006010770797729492 nb_pixel_total : 4679 time to create 1 rle with old method : 0.005242347717285156 time for calcul the mask position with numpy : 0.005986213684082031 nb_pixel_total : 2766 time to create 1 rle with old method : 0.003064393997192383 time for calcul the mask position with numpy : 0.006039142608642578 nb_pixel_total : 5865 time to create 1 rle with old method : 0.006535053253173828 time for calcul the mask position with numpy : 0.006090879440307617 nb_pixel_total : 3470 time to create 1 rle with old method : 0.003731250762939453 create new chi : 0.2516195774078369 time to delete rle : 0.0004124641418457031 batch 1 Loaded 15 chid ids of type : 3594 +++++++++Number RLEs to save : 2240 TO DO : save crop sub photo not yet done ! save time : 0.2870445251464844 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.034502506256103516 time for calcul the mask position with numpy : 0.020414113998413086 nb_pixel_total : 2069092 time to create 1 rle with new method : 0.028662443161010742 time for calcul the mask position with numpy : 0.006031990051269531 nb_pixel_total : 4508 time to create 1 rle with old method : 0.005044698715209961 create new chi : 0.06037473678588867 time to delete rle : 0.0002224445343017578 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1242 TO DO : save crop sub photo not yet done ! save time : 0.18702387809753418 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 0.05359625816345215 time for calcul the mask position with numpy : 0.03646278381347656 nb_pixel_total : 1934544 time to create 1 rle with new method : 0.11931109428405762 time for calcul the mask position with numpy : 0.007033824920654297 nb_pixel_total : 108150 time to create 1 rle with old method : 0.12511730194091797 time for calcul the mask position with numpy : 0.005875587463378906 nb_pixel_total : 8728 time to create 1 rle with old method : 0.010492563247680664 time for calcul the mask position with numpy : 0.0060231685638427734 nb_pixel_total : 18090 time to create 1 rle with old method : 0.019593000411987305 time for calcul the mask position with numpy : 0.006371498107910156 nb_pixel_total : 4088 time to create 1 rle with old method : 0.004660606384277344 create new chi : 0.3524963855743408 time to delete rle : 0.0005092620849609375 batch 1 Loaded 9 chid ids of type : 3594 +++++++Number RLEs to save : 3174 TO DO : save crop sub photo not yet done ! save time : 0.38249850273132324 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.043778181076049805 time for calcul the mask position with numpy : 0.019481420516967773 nb_pixel_total : 2061560 time to create 1 rle with new method : 0.06931710243225098 time for calcul the mask position with numpy : 0.005942821502685547 nb_pixel_total : 4357 time to create 1 rle with old method : 0.006882667541503906 time for calcul the mask position with numpy : 0.0060710906982421875 nb_pixel_total : 7683 time to create 1 rle with old method : 0.008364439010620117 create new chi : 0.11631584167480469 time to delete rle : 0.00023174285888671875 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1460 TO DO : save crop sub photo not yet done ! save time : 0.22397446632385254 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.14263200759887695 time for calcul the mask position with numpy : 0.05572843551635742 nb_pixel_total : 1966805 time to create 1 rle with new method : 0.16846323013305664 time for calcul the mask position with numpy : 0.006931781768798828 nb_pixel_total : 1370 time to create 1 rle with old method : 0.0023040771484375 time for calcul the mask position with numpy : 0.007470369338989258 nb_pixel_total : 105425 time to create 1 rle with old method : 0.1159830093383789 create new chi : 0.3706350326538086 time to delete rle : 0.00037670135498046875 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2222 TO DO : save crop sub photo not yet done ! save time : 0.31490302085876465 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.04761934280395508 time for calcul the mask position with numpy : 0.009303569793701172 nb_pixel_total : 493979 time to create 1 rle with new method : 0.14216375350952148 time for calcul the mask position with numpy : 0.009180784225463867 nb_pixel_total : 462225 time to create 1 rle with new method : 0.07260680198669434 time for calcul the mask position with numpy : 0.08377790451049805 nb_pixel_total : 1117396 time to create 1 rle with new method : 0.09299039840698242 create new chi : 0.43529534339904785 time to delete rle : 0.0008184909820556641 batch 1 Loaded 5 chid ids of type : 3594 ++++Number RLEs to save : 4777 TO DO : save crop sub photo not yet done ! save time : 0.5514781475067139 No data in photo_id : 1394219701 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03805112838745117 time for calcul the mask position with numpy : 0.04531741142272949 nb_pixel_total : 1494346 time to create 1 rle with new method : 0.1674365997314453 time for calcul the mask position with numpy : 0.010033130645751953 nb_pixel_total : 579254 time to create 1 rle with new method : 0.06744766235351562 create new chi : 0.298201322555542 time to delete rle : 0.00035858154296875 batch 1 Loaded 3 chid ids of type : 3594 ++Number RLEs to save : 2988 TO DO : save crop sub photo not yet done ! save time : 0.38351893424987793 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.21384406089782715 time for calcul the mask position with numpy : 0.07799792289733887 nb_pixel_total : 1946245 time to create 1 rle with new method : 0.20095038414001465 time for calcul the mask position with numpy : 0.0061626434326171875 nb_pixel_total : 13136 time to create 1 rle with old method : 0.014160871505737305 time for calcul the mask position with numpy : 0.0058476924896240234 nb_pixel_total : 4957 time to create 1 rle with old method : 0.0056498050689697266 time for calcul the mask position with numpy : 0.006472587585449219 nb_pixel_total : 107239 time to create 1 rle with old method : 0.12069845199584961 time for calcul the mask position with numpy : 0.0064885616302490234 nb_pixel_total : 2023 time to create 1 rle with old method : 0.002364635467529297 create new chi : 0.45630311965942383 time to delete rle : 0.0005283355712890625 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 2678 TO DO : save crop sub photo not yet done ! save time : 0.3802976608276367 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.05836057662963867 time for calcul the mask position with numpy : 0.06049060821533203 nb_pixel_total : 1967284 time to create 1 rle with new method : 0.12599897384643555 time for calcul the mask position with numpy : 0.007394552230834961 nb_pixel_total : 80866 time to create 1 rle with old method : 0.09148859977722168 time for calcul the mask position with numpy : 0.0057070255279541016 nb_pixel_total : 3693 time to create 1 rle with old method : 0.004110097885131836 time for calcul the mask position with numpy : 0.005715370178222656 nb_pixel_total : 16019 time to create 1 rle with old method : 0.017472267150878906 time for calcul the mask position with numpy : 0.006336212158203125 nb_pixel_total : 5738 time to create 1 rle with old method : 0.006220340728759766 create new chi : 0.34232544898986816 time to delete rle : 0.000484466552734375 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 2962 TO DO : save crop sub photo not yet done ! save time : 0.41260790824890137 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.058684349060058594 time for calcul the mask position with numpy : 0.12863588333129883 nb_pixel_total : 2009964 time to create 1 rle with new method : 0.07565689086914062 time for calcul the mask position with numpy : 0.006063938140869141 nb_pixel_total : 36184 time to create 1 rle with old method : 0.0391087532043457 time for calcul the mask position with numpy : 0.006267547607421875 nb_pixel_total : 7932 time to create 1 rle with old method : 0.010389328002929688 time for calcul the mask position with numpy : 0.006719112396240234 nb_pixel_total : 14177 time to create 1 rle with old method : 0.023055076599121094 time for calcul the mask position with numpy : 0.006498098373413086 nb_pixel_total : 5343 time to create 1 rle with old method : 0.008659839630126953 create new chi : 0.3217449188232422 time to delete rle : 0.0005717277526855469 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 2572 TO DO : save crop sub photo not yet done ! save time : 0.5322175025939941 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.04769706726074219 time for calcul the mask position with numpy : 0.10813665390014648 nb_pixel_total : 2046895 time to create 1 rle with new method : 0.14302277565002441 time for calcul the mask position with numpy : 0.006041288375854492 nb_pixel_total : 11387 time to create 1 rle with old method : 0.012440919876098633 time for calcul the mask position with numpy : 0.005837202072143555 nb_pixel_total : 3296 time to create 1 rle with old method : 0.003675699234008789 time for calcul the mask position with numpy : 0.009838342666625977 nb_pixel_total : 12022 time to create 1 rle with old method : 0.012779474258422852 create new chi : 0.31070566177368164 time to delete rle : 0.0003848075866699219 batch 1 Loaded 7 chid ids of type : 3594 +++++Number RLEs to save : 1776 TO DO : save crop sub photo not yet done ! save time : 0.24820566177368164 map_output_result : {1394222167: (0.0, 'Should be the crop_list due to order', 0), 1394222160: (0.0, 'Should be the crop_list due to order', 0), 1394222154: (0.0, 'Should be the crop_list due to order', 0), 1394222149: (0.0, 'Should be the crop_list due to order', 0), 1394222138: (0.0, 'Should be the crop_list due to order', 0), 1394221035: (0.0, 'Should be the crop_list due to order', 0), 1394220908: (0.0, 'Should be the crop_list due to order', 0), 1394220825: (0.0, 'Should be the crop_list due to order', 0), 1394220755: (0.0, 'Should be the crop_list due to order', 0), 1394220129: (0.0, 'Should be the crop_list due to order', 0), 1394219974: (0.0, 'Should be the crop_list due to order', 0), 1394219929: (0.0, 'Should be the crop_list due to order', 0), 1394219919: (0.0, 'Should be the crop_list due to order', 0), 1394219795: (0.0, 'Should be the crop_list due to order', 0), 1394219701: (0.0, 'Should be the crop_list due to order', 0.0), 1394219696: (0.0, 'Should be the crop_list due to order', 0), 1394219691: (0.0, 'Should be the crop_list due to order', 0), 1394219686: (0.0, 'Should be the crop_list due to order', 0), 1394219592: (0.0, 'Should be the crop_list due to order', 0), 1394219150: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1394222167, 1394222160, 1394222154, 1394222149, 1394222138, 1394221035, 1394220908, 1394220825, 1394220755, 1394220129, 1394219974, 1394219929, 1394219919, 1394219795, 1394219701, 1394219696, 1394219691, 1394219686, 1394219592, 1394219150] Looping around the photos to save general results len do output : 20 /1394222167.Didn't retrieve data . /1394222160.Didn't retrieve data . /1394222154.Didn't retrieve data . /1394222149.Didn't retrieve data . /1394222138.Didn't retrieve data . /1394221035.Didn't retrieve data . /1394220908.Didn't retrieve data . /1394220825.Didn't retrieve data . /1394220755.Didn't retrieve data . /1394220129.Didn't retrieve data . /1394219974.Didn't retrieve data . /1394219929.Didn't retrieve data . /1394219919.Didn't retrieve data . /1394219795.Didn't retrieve data . /1394219701.Didn't retrieve data . /1394219696.Didn't retrieve data . /1394219691.Didn't retrieve data . /1394219686.Didn't retrieve data . /1394219592.Didn't retrieve data . /1394219150.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394222167', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394222160', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394222154', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394222149', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394222138', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394221035', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394220908', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394220825', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394220755', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394220129', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394219974', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394219929', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394219919', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394219795', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394219701', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394219696', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394219691', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394219686', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394219592', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394219150', None, None, None, None, None, '4042346') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 60 time used for this insertion : 0.03319668769836426 save_final save missing photos in datou_result : time spend for datou_step_exec : 15.561802864074707 time spend to save output : 0.03383016586303711 total time spend for step 3 : 15.595633029937744 step4:ventilate_hashtags_in_portfolio Thu Nov 13 20:21:59 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 28495493 get user id for portfolio 28495493 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28495493 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','background','carton','autre','pet_clair','metal','mal_croppe','flou','pehd','pet_fonce','papier')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28495493 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','background','carton','autre','pet_clair','metal','mal_croppe','flou','pehd','pet_fonce','papier')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28495493 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','background','carton','autre','pet_clair','metal','mal_croppe','flou','pehd','pet_fonce','papier')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/28496194,28496195,28496196,28496197,28496198,28496199,28496200,28496201,28496202,28496203,28496204?tags=environnement,background,carton,autre,pet_clair,metal,mal_croppe,flou,pehd,pet_fonce,papier Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1394222167, 1394222160, 1394222154, 1394222149, 1394222138, 1394221035, 1394220908, 1394220825, 1394220755, 1394220129, 1394219974, 1394219929, 1394219919, 1394219795, 1394219701, 1394219696, 1394219691, 1394219686, 1394219592, 1394219150] Looping around the photos to save general results len do output : 1 /28495493. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394222167', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394222160', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394222154', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394222149', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394222138', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394221035', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394220908', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394220825', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394220755', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394220129', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394219974', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394219929', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394219919', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394219795', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394219701', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394219696', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394219691', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394219686', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394219592', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394219150', None, None, None, None, None, '4042346') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 21 time used for this insertion : 0.040540456771850586 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.335268020629883 time spend to save output : 0.04092860221862793 total time spend for step 4 : 4.376196622848511 step5:final Thu Nov 13 20:22:03 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1394222167: ('0.10233774594907408',), 1394222160: ('0.10233774594907408',), 1394222154: ('0.10233774594907408',), 1394222149: ('0.10233774594907408',), 1394222138: ('0.10233774594907408',), 1394221035: ('0.10233774594907408',), 1394220908: ('0.10233774594907408',), 1394220825: ('0.10233774594907408',), 1394220755: ('0.10233774594907408',), 1394220129: ('0.10233774594907408',), 1394219974: ('0.10233774594907408',), 1394219929: ('0.10233774594907408',), 1394219919: ('0.10233774594907408',), 1394219795: ('0.10233774594907408',), 1394219701: ('0.10233774594907408',), 1394219696: ('0.10233774594907408',), 1394219691: ('0.10233774594907408',), 1394219686: ('0.10233774594907408',), 1394219592: ('0.10233774594907408',), 1394219150: ('0.10233774594907408',)} new output for save of step final : {1394222167: ('0.10233774594907408',), 1394222160: ('0.10233774594907408',), 1394222154: ('0.10233774594907408',), 1394222149: ('0.10233774594907408',), 1394222138: ('0.10233774594907408',), 1394221035: ('0.10233774594907408',), 1394220908: ('0.10233774594907408',), 1394220825: ('0.10233774594907408',), 1394220755: ('0.10233774594907408',), 1394220129: ('0.10233774594907408',), 1394219974: ('0.10233774594907408',), 1394219929: ('0.10233774594907408',), 1394219919: ('0.10233774594907408',), 1394219795: ('0.10233774594907408',), 1394219701: ('0.10233774594907408',), 1394219696: ('0.10233774594907408',), 1394219691: ('0.10233774594907408',), 1394219686: ('0.10233774594907408',), 1394219592: ('0.10233774594907408',), 1394219150: ('0.10233774594907408',)} [1394222167, 1394222160, 1394222154, 1394222149, 1394222138, 1394221035, 1394220908, 1394220825, 1394220755, 1394220129, 1394219974, 1394219929, 1394219919, 1394219795, 1394219701, 1394219696, 1394219691, 1394219686, 1394219592, 1394219150] Looping around the photos to save general results len do output : 20 /1394222167.Didn't retrieve data . /1394222160.Didn't retrieve data . /1394222154.Didn't retrieve data . /1394222149.Didn't retrieve data . /1394222138.Didn't retrieve data . /1394221035.Didn't retrieve data . /1394220908.Didn't retrieve data . /1394220825.Didn't retrieve data . /1394220755.Didn't retrieve data . /1394220129.Didn't retrieve data . /1394219974.Didn't retrieve data . /1394219929.Didn't retrieve data . /1394219919.Didn't retrieve data . /1394219795.Didn't retrieve data . /1394219701.Didn't retrieve data . /1394219696.Didn't retrieve data . /1394219691.Didn't retrieve data . /1394219686.Didn't retrieve data . /1394219592.Didn't retrieve data . /1394219150.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394222167', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394222160', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394222154', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394222149', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394222138', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394221035', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394220908', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394220825', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394220755', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394220129', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394219974', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394219929', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394219919', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394219795', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394219701', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394219696', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394219691', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394219686', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394219592', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394219150', None, None, None, None, None, '4042346') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 60 time used for this insertion : 0.033056020736694336 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.3109719753265381 time spend to save output : 0.034027099609375 total time spend for step 5 : 0.3449990749359131 step6:blur_detection Thu Nov 13 20:22:04 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1763061627_1406847_1394222167_e4a023fe61b22151ae0a49f229cfa58b.jpg resize: (1080, 1920) 1394222167 0.28603918995201855 treat image : temp/1763061627_1406847_1394222160_cc0ecdc3dbcbb5d8279cb60b957abe82.jpg resize: (1080, 1920) 1394222160 1.25385295042148 treat image : temp/1763061627_1406847_1394222154_a35db6e9dfcc09724ced0f381e4cb9d2.jpg resize: (1080, 1920) 1394222154 0.29088632730163816 treat image : temp/1763061627_1406847_1394222149_762ed0fbe3a1ceb79b35bdd1a34d2b6f.jpg resize: (1080, 1920) 1394222149 -0.45869588835926445 treat image : temp/1763061627_1406847_1394222138_1d52a34fc9389d40dd6c44794e23d2d1.jpg resize: (1080, 1920) 1394222138 -4.39952705376962 treat image : temp/1763061627_1406847_1394221035_a70e200bc0650b89e09ba1f2abb12f62.jpg resize: (1080, 1920) 1394221035 0.8666795834171841 treat image : temp/1763061627_1406847_1394220908_93e62113d265028da95139fd3491e408.jpg resize: (1080, 1920) 1394220908 -0.25520276110866985 treat image : temp/1763061627_1406847_1394220825_99e4e5c83c938f9d46edba57326882c2.jpg resize: (1080, 1920) 1394220825 -4.192435619270508 treat image : temp/1763061627_1406847_1394220755_57fc8fc9df5eac6fb635424d5c3ad541.jpg resize: (1080, 1920) 1394220755 -3.6028272176647187 treat image : temp/1763061627_1406847_1394220129_639d9513c529a96b870323cd869c56d0.jpg resize: (1080, 1920) 1394220129 -1.5810162543418804 treat image : temp/1763061627_1406847_1394219974_a16d990f365f5556d3f3f11e67206c33.jpg resize: (1080, 1920) 1394219974 -4.238330520120668 treat image : temp/1763061627_1406847_1394219929_317051797c8322228c91830a202eb388.jpg resize: (1080, 1920) 1394219929 0.01586714782639726 treat image : temp/1763061627_1406847_1394219919_3e1667fd77d26c1cfcc60e27c6d4b0a7.jpg resize: (1080, 1920) 1394219919 -4.097223300209947 treat image : temp/1763061627_1406847_1394219795_4fe8b6652b8ef719e7d680c5f95f113e.jpg resize: (1080, 1920) 1394219795 1.440214436034338 treat image : temp/1763061627_1406847_1394219701_bb1e3ba2100d85064b6094863b4f7a36.jpg resize: (1080, 1920) 1394219701 -0.7280764927175915 treat image : temp/1763061627_1406847_1394219696_4f745e82547296febecca8b76f8376e0.jpg resize: (1080, 1920) 1394219696 -0.6519978494721199 treat image : temp/1763061627_1406847_1394219691_8c0f5d9a70f4c979bb4fa96069f49af7.jpg resize: (1080, 1920) 1394219691 -3.9671692768935443 treat image : temp/1763061627_1406847_1394219686_8810a7133709f85631b828c533baa8b5.jpg resize: (1080, 1920) 1394219686 0.8534408356652698 treat image : temp/1763061627_1406847_1394219592_748f8682c3a2c1c1a371c5ae56861dd3.jpg resize: (1080, 1920) 1394219592 -2.6046284284948764 treat image : temp/1763061627_1406847_1394219150_08d1cad5c14941a371192fa36fdc0a97.jpg resize: (1080, 1920) 1394219150 -0.5411475563200084 treat image : temp/1763061627_1406847_1394222167_e4a023fe61b22151ae0a49f229cfa58b_rle_crop_4032613526_0.png resize: (59, 107) 1394270712 -1.4606856770154646 treat image : temp/1763061627_1406847_1394222167_e4a023fe61b22151ae0a49f229cfa58b_rle_crop_4032613527_0.png resize: (53, 73) 1394270715 0.2594780045873585 treat image : temp/1763061627_1406847_1394222167_e4a023fe61b22151ae0a49f229cfa58b_rle_crop_4032613528_0.png resize: (82, 187) 1394270717 -1.1376692843607934 treat image : temp/1763061627_1406847_1394222160_cc0ecdc3dbcbb5d8279cb60b957abe82_rle_crop_4032613530_0.png resize: (60, 68) 1394270721 -1.0954016019257213 treat image : temp/1763061627_1406847_1394222160_cc0ecdc3dbcbb5d8279cb60b957abe82_rle_crop_4032613532_0.png resize: (51, 96) 1394270722 -0.18107811240297111 treat image : temp/1763061627_1406847_1394222154_a35db6e9dfcc09724ced0f381e4cb9d2_rle_crop_4032613533_0.png resize: (57, 97) 1394270726 -1.4004922361930314 treat image : temp/1763061627_1406847_1394222154_a35db6e9dfcc09724ced0f381e4cb9d2_rle_crop_4032613534_0.png resize: (109, 96) 1394270727 -1.5548225827812554 treat image : temp/1763061627_1406847_1394222154_a35db6e9dfcc09724ced0f381e4cb9d2_rle_crop_4032613536_0.png resize: (90, 101) 1394270730 -1.3845260847188958 treat image : temp/1763061627_1406847_1394222149_762ed0fbe3a1ceb79b35bdd1a34d2b6f_rle_crop_4032613537_0.png resize: (86, 102) 1394270732 -1.2010447199928729 treat image : temp/1763061627_1406847_1394222149_762ed0fbe3a1ceb79b35bdd1a34d2b6f_rle_crop_4032613538_0.png resize: (189, 93) 1394270734 -0.7427217275257408 treat image : temp/1763061627_1406847_1394222138_1d52a34fc9389d40dd6c44794e23d2d1_rle_crop_4032613541_0.png resize: (54, 107) 1394270737 -4.521039033992465 treat image : temp/1763061627_1406847_1394222138_1d52a34fc9389d40dd6c44794e23d2d1_rle_crop_4032613542_0.png resize: (38, 41) 1394270738 0.20674250085931933 treat image : temp/1763061627_1406847_1394221035_a70e200bc0650b89e09ba1f2abb12f62_rle_crop_4032613543_0.png resize: (166, 70) 1394270741 -2.5301099004856185 treat image : temp/1763061627_1406847_1394220908_93e62113d265028da95139fd3491e408_rle_crop_4032613544_0.png resize: (86, 85) 1394270743 -0.8887932542724312 treat image : temp/1763061627_1406847_1394220908_93e62113d265028da95139fd3491e408_rle_crop_4032613546_0.png resize: (184, 95) 1394270745 -0.9831109856126469 treat image : temp/1763061627_1406847_1394220755_57fc8fc9df5eac6fb635424d5c3ad541_rle_crop_4032613553_0.png resize: (49, 95) 1394270748 -1.5653864321516204 treat image : temp/1763061627_1406847_1394220755_57fc8fc9df5eac6fb635424d5c3ad541_rle_crop_4032613554_0.png resize: (107, 79) 1394270749 -0.7288479306556436 treat image : temp/1763061627_1406847_1394220755_57fc8fc9df5eac6fb635424d5c3ad541_rle_crop_4032613555_0.png resize: (79, 79) 1394270753 5.517648151635918 treat image : temp/1763061627_1406847_1394220755_57fc8fc9df5eac6fb635424d5c3ad541_rle_crop_4032613556_0.png resize: (82, 88) 1394270754 -4.138653157462996 treat image : temp/1763061627_1406847_1394220755_57fc8fc9df5eac6fb635424d5c3ad541_rle_crop_4032613557_0.png resize: (45, 72) 1394270756 -2.152097987635958 treat image : temp/1763061627_1406847_1394220755_57fc8fc9df5eac6fb635424d5c3ad541_rle_crop_4032613558_0.png resize: (106, 135) 1394270759 -4.093030688203725 treat image : temp/1763061627_1406847_1394220755_57fc8fc9df5eac6fb635424d5c3ad541_rle_crop_4032613559_0.png resize: (59, 57) 1394270761 -5.014963431136851 treat image : temp/1763061627_1406847_1394220129_639d9513c529a96b870323cd869c56d0_rle_crop_4032613560_0.png resize: (81, 66) 1394270764 1.697796026131587 treat image : temp/1763061627_1406847_1394219974_a16d990f365f5556d3f3f11e67206c33_rle_crop_4032613563_0.png resize: (127, 113) 1394270765 -1.6138087809400843 treat image : temp/1763061627_1406847_1394219929_317051797c8322228c91830a202eb388_rle_crop_4032613565_0.png resize: (104, 107) 1394270769 -0.767531657529661 treat image : temp/1763061627_1406847_1394219929_317051797c8322228c91830a202eb388_rle_crop_4032613566_0.png resize: (79, 70) 1394270770 0.6869123333018956 treat image : temp/1763061627_1406847_1394219919_3e1667fd77d26c1cfcc60e27c6d4b0a7_rle_crop_4032613568_0.png resize: (40, 50) 1394270774 0.38561498936076105 treat image : temp/1763061627_1406847_1394219691_8c0f5d9a70f4c979bb4fa96069f49af7_rle_crop_4032613572_0.png resize: (55, 49) 1394270775 1.229684608149847 treat image : temp/1763061627_1406847_1394219686_8810a7133709f85631b828c533baa8b5_rle_crop_4032613576_0.png resize: (114, 76) 1394270777 -1.1784945186279283 treat image : temp/1763061627_1406847_1394219686_8810a7133709f85631b828c533baa8b5_rle_crop_4032613577_0.png resize: (235, 118) 1394270780 -1.1148905116725227 treat image : temp/1763061627_1406847_1394219686_8810a7133709f85631b828c533baa8b5_rle_crop_4032613578_0.png resize: (61, 128) 1394270782 -1.4613473374564692 treat image : temp/1763061627_1406847_1394219592_748f8682c3a2c1c1a371c5ae56861dd3_rle_crop_4032613580_0.png resize: (74, 100) 1394270785 -0.759499885526986 treat image : temp/1763061627_1406847_1394219592_748f8682c3a2c1c1a371c5ae56861dd3_rle_crop_4032613581_0.png resize: (204, 146) 1394270787 -2.3144747661144103 treat image : temp/1763061627_1406847_1394219592_748f8682c3a2c1c1a371c5ae56861dd3_rle_crop_4032613582_0.png resize: (116, 89) 1394270790 -0.1986629590367898 treat image : temp/1763061627_1406847_1394219150_08d1cad5c14941a371192fa36fdc0a97_rle_crop_4032613584_0.png resize: (155, 133) 1394270792 -0.8481642626129859 treat image : temp/1763061627_1406847_1394219150_08d1cad5c14941a371192fa36fdc0a97_rle_crop_4032613585_0.png resize: (43, 126) 1394270795 0.19936405498136842 treat image : temp/1763061627_1406847_1394222167_e4a023fe61b22151ae0a49f229cfa58b_rle_crop_4032613529_0.png resize: (502, 321) 1394270827 0.051903940228464854 treat image : temp/1763061627_1406847_1394219974_a16d990f365f5556d3f3f11e67206c33_rle_crop_4032613561_0.png resize: (80, 83) 1394270828 -1.3083674075623144 treat image : temp/1763061627_1406847_1394222154_a35db6e9dfcc09724ced0f381e4cb9d2_rle_crop_4032613535_0.png resize: (77, 80) 1394270855 -0.716562798491284 treat image : temp/1763061627_1406847_1394220825_99e4e5c83c938f9d46edba57326882c2_rle_crop_4032613547_0.png resize: (119, 98) 1394270858 -2.0455612340630314 treat image : temp/1763061627_1406847_1394220825_99e4e5c83c938f9d46edba57326882c2_rle_crop_4032613552_0.png resize: (113, 123) 1394270860 -2.735957602781395 treat image : temp/1763061627_1406847_1394222160_cc0ecdc3dbcbb5d8279cb60b957abe82_rle_crop_4032613531_0.png resize: (989, 1369) 1394271239 -0.9467241307191361 treat image : temp/1763061627_1406847_1394222138_1d52a34fc9389d40dd6c44794e23d2d1_rle_crop_4032613540_0.png resize: (106, 222) 1394271243 -2.7255151092115226 treat image : temp/1763061627_1406847_1394220908_93e62113d265028da95139fd3491e408_rle_crop_4032613545_0.png resize: (567, 316) 1394271244 -0.1609441692257225 treat image : temp/1763061627_1406847_1394220825_99e4e5c83c938f9d46edba57326882c2_rle_crop_4032613548_0.png resize: (168, 218) 1394271248 -3.2764307083025384 treat image : temp/1763061627_1406847_1394220825_99e4e5c83c938f9d46edba57326882c2_rle_crop_4032613549_0.png resize: (143, 210) 1394271251 -3.31786401948642 treat image : temp/1763061627_1406847_1394220825_99e4e5c83c938f9d46edba57326882c2_rle_crop_4032613550_0.png resize: (534, 330) 1394271254 0.27570481818237563 treat image : temp/1763061627_1406847_1394220825_99e4e5c83c938f9d46edba57326882c2_rle_crop_4032613551_0.png resize: (95, 105) 1394271256 -2.4493227784986638 treat image : temp/1763061627_1406847_1394219974_a16d990f365f5556d3f3f11e67206c33_rle_crop_4032613562_0.png resize: (148, 279) 1394271259 -3.663149116226133 treat image : temp/1763061627_1406847_1394219974_a16d990f365f5556d3f3f11e67206c33_rle_crop_4032613564_0.png resize: (517, 329) 1394271261 0.2390950777041845 treat image : temp/1763061627_1406847_1394219919_3e1667fd77d26c1cfcc60e27c6d4b0a7_rle_crop_4032613567_0.png resize: (529, 321) 1394271264 -0.2067016273400135 treat image : temp/1763061627_1406847_1394219795_4fe8b6652b8ef719e7d680c5f95f113e_rle_crop_4032613569_0.png resize: (992, 1356) 1394271267 0.05311946033505847 treat image : temp/1763061627_1406847_1394219795_4fe8b6652b8ef719e7d680c5f95f113e_rle_crop_4032613570_0.png resize: (951, 909) 1394271269 1.5913178943482955 treat image : temp/1763061627_1406847_1394219696_4f745e82547296febecca8b76f8376e0_rle_crop_4032613571_0.png resize: (923, 989) 1394271273 0.838529083035946 treat image : temp/1763061627_1406847_1394219691_8c0f5d9a70f4c979bb4fa96069f49af7_rle_crop_4032613573_0.png resize: (527, 326) 1394271274 0.2416660312133465 treat image : temp/1763061627_1406847_1394219691_8c0f5d9a70f4c979bb4fa96069f49af7_rle_crop_4032613574_0.png resize: (63, 104) 1394271278 -1.218238935424386 treat image : temp/1763061627_1406847_1394219691_8c0f5d9a70f4c979bb4fa96069f49af7_rle_crop_4032613575_0.png resize: (138, 139) 1394271279 -4.313922329118136 treat image : temp/1763061627_1406847_1394219686_8810a7133709f85631b828c533baa8b5_rle_crop_4032613579_0.png resize: (509, 299) 1394271283 -0.020464570672438284 treat image : temp/1763061627_1406847_1394219150_08d1cad5c14941a371192fa36fdc0a97_rle_crop_4032613586_0.png resize: (123, 119) 1394271285 -0.3024477270481677 treat image : temp/1763061627_1406847_1394222149_762ed0fbe3a1ceb79b35bdd1a34d2b6f_rle_crop_4032613539_0.png resize: (100, 118) 1394271309 1.7590620596439468 treat image : temp/1763061627_1406847_1394219592_748f8682c3a2c1c1a371c5ae56861dd3_rle_crop_4032613583_0.png resize: (327, 162) 1394271313 -1.083037342033812 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 81 time used for this insertion : 0.03486061096191406 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 81 time used for this insertion : 0.03468918800354004 save missing photos in datou_result : time spend for datou_step_exec : 17.402503967285156 time spend to save output : 0.08594036102294922 total time spend for step 6 : 17.488444328308105 step7:brightness Thu Nov 13 20:22:21 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1763061627_1406847_1394222167_e4a023fe61b22151ae0a49f229cfa58b.jpg treat image : temp/1763061627_1406847_1394222160_cc0ecdc3dbcbb5d8279cb60b957abe82.jpg treat image : temp/1763061627_1406847_1394222154_a35db6e9dfcc09724ced0f381e4cb9d2.jpg treat image : temp/1763061627_1406847_1394222149_762ed0fbe3a1ceb79b35bdd1a34d2b6f.jpg treat image : temp/1763061627_1406847_1394222138_1d52a34fc9389d40dd6c44794e23d2d1.jpg treat image : temp/1763061627_1406847_1394221035_a70e200bc0650b89e09ba1f2abb12f62.jpg treat image : temp/1763061627_1406847_1394220908_93e62113d265028da95139fd3491e408.jpg treat image : temp/1763061627_1406847_1394220825_99e4e5c83c938f9d46edba57326882c2.jpg treat image : temp/1763061627_1406847_1394220755_57fc8fc9df5eac6fb635424d5c3ad541.jpg treat image : temp/1763061627_1406847_1394220129_639d9513c529a96b870323cd869c56d0.jpg treat image : temp/1763061627_1406847_1394219974_a16d990f365f5556d3f3f11e67206c33.jpg treat image : temp/1763061627_1406847_1394219929_317051797c8322228c91830a202eb388.jpg treat image : temp/1763061627_1406847_1394219919_3e1667fd77d26c1cfcc60e27c6d4b0a7.jpg treat image : temp/1763061627_1406847_1394219795_4fe8b6652b8ef719e7d680c5f95f113e.jpg treat image : temp/1763061627_1406847_1394219701_bb1e3ba2100d85064b6094863b4f7a36.jpg treat image : temp/1763061627_1406847_1394219696_4f745e82547296febecca8b76f8376e0.jpg treat image : temp/1763061627_1406847_1394219691_8c0f5d9a70f4c979bb4fa96069f49af7.jpg treat image : temp/1763061627_1406847_1394219686_8810a7133709f85631b828c533baa8b5.jpg treat image : temp/1763061627_1406847_1394219592_748f8682c3a2c1c1a371c5ae56861dd3.jpg treat image : temp/1763061627_1406847_1394219150_08d1cad5c14941a371192fa36fdc0a97.jpg treat image : temp/1763061627_1406847_1394222167_e4a023fe61b22151ae0a49f229cfa58b_rle_crop_4032613526_0.png treat image : temp/1763061627_1406847_1394222167_e4a023fe61b22151ae0a49f229cfa58b_rle_crop_4032613527_0.png treat image : temp/1763061627_1406847_1394222167_e4a023fe61b22151ae0a49f229cfa58b_rle_crop_4032613528_0.png treat image : temp/1763061627_1406847_1394222160_cc0ecdc3dbcbb5d8279cb60b957abe82_rle_crop_4032613530_0.png treat image : temp/1763061627_1406847_1394222160_cc0ecdc3dbcbb5d8279cb60b957abe82_rle_crop_4032613532_0.png treat image : temp/1763061627_1406847_1394222154_a35db6e9dfcc09724ced0f381e4cb9d2_rle_crop_4032613533_0.png treat image : temp/1763061627_1406847_1394222154_a35db6e9dfcc09724ced0f381e4cb9d2_rle_crop_4032613534_0.png treat image : temp/1763061627_1406847_1394222154_a35db6e9dfcc09724ced0f381e4cb9d2_rle_crop_4032613536_0.png treat image : temp/1763061627_1406847_1394222149_762ed0fbe3a1ceb79b35bdd1a34d2b6f_rle_crop_4032613537_0.png treat image : temp/1763061627_1406847_1394222149_762ed0fbe3a1ceb79b35bdd1a34d2b6f_rle_crop_4032613538_0.png treat image : temp/1763061627_1406847_1394222138_1d52a34fc9389d40dd6c44794e23d2d1_rle_crop_4032613541_0.png treat image : temp/1763061627_1406847_1394222138_1d52a34fc9389d40dd6c44794e23d2d1_rle_crop_4032613542_0.png treat image : temp/1763061627_1406847_1394221035_a70e200bc0650b89e09ba1f2abb12f62_rle_crop_4032613543_0.png treat image : temp/1763061627_1406847_1394220908_93e62113d265028da95139fd3491e408_rle_crop_4032613544_0.png treat image : temp/1763061627_1406847_1394220908_93e62113d265028da95139fd3491e408_rle_crop_4032613546_0.png treat image : temp/1763061627_1406847_1394220755_57fc8fc9df5eac6fb635424d5c3ad541_rle_crop_4032613553_0.png treat image : temp/1763061627_1406847_1394220755_57fc8fc9df5eac6fb635424d5c3ad541_rle_crop_4032613554_0.png treat image : temp/1763061627_1406847_1394220755_57fc8fc9df5eac6fb635424d5c3ad541_rle_crop_4032613555_0.png treat image : temp/1763061627_1406847_1394220755_57fc8fc9df5eac6fb635424d5c3ad541_rle_crop_4032613556_0.png treat image : temp/1763061627_1406847_1394220755_57fc8fc9df5eac6fb635424d5c3ad541_rle_crop_4032613557_0.png treat image : temp/1763061627_1406847_1394220755_57fc8fc9df5eac6fb635424d5c3ad541_rle_crop_4032613558_0.png treat image : temp/1763061627_1406847_1394220755_57fc8fc9df5eac6fb635424d5c3ad541_rle_crop_4032613559_0.png treat image : temp/1763061627_1406847_1394220129_639d9513c529a96b870323cd869c56d0_rle_crop_4032613560_0.png treat image : temp/1763061627_1406847_1394219974_a16d990f365f5556d3f3f11e67206c33_rle_crop_4032613563_0.png treat image : temp/1763061627_1406847_1394219929_317051797c8322228c91830a202eb388_rle_crop_4032613565_0.png treat image : temp/1763061627_1406847_1394219929_317051797c8322228c91830a202eb388_rle_crop_4032613566_0.png treat image : temp/1763061627_1406847_1394219919_3e1667fd77d26c1cfcc60e27c6d4b0a7_rle_crop_4032613568_0.png treat image : temp/1763061627_1406847_1394219691_8c0f5d9a70f4c979bb4fa96069f49af7_rle_crop_4032613572_0.png treat image : temp/1763061627_1406847_1394219686_8810a7133709f85631b828c533baa8b5_rle_crop_4032613576_0.png treat image : temp/1763061627_1406847_1394219686_8810a7133709f85631b828c533baa8b5_rle_crop_4032613577_0.png treat image : temp/1763061627_1406847_1394219686_8810a7133709f85631b828c533baa8b5_rle_crop_4032613578_0.png treat image : temp/1763061627_1406847_1394219592_748f8682c3a2c1c1a371c5ae56861dd3_rle_crop_4032613580_0.png treat image : temp/1763061627_1406847_1394219592_748f8682c3a2c1c1a371c5ae56861dd3_rle_crop_4032613581_0.png treat image : temp/1763061627_1406847_1394219592_748f8682c3a2c1c1a371c5ae56861dd3_rle_crop_4032613582_0.png treat image : temp/1763061627_1406847_1394219150_08d1cad5c14941a371192fa36fdc0a97_rle_crop_4032613584_0.png treat image : temp/1763061627_1406847_1394219150_08d1cad5c14941a371192fa36fdc0a97_rle_crop_4032613585_0.png treat image : temp/1763061627_1406847_1394222167_e4a023fe61b22151ae0a49f229cfa58b_rle_crop_4032613529_0.png treat image : temp/1763061627_1406847_1394219974_a16d990f365f5556d3f3f11e67206c33_rle_crop_4032613561_0.png treat image : temp/1763061627_1406847_1394222154_a35db6e9dfcc09724ced0f381e4cb9d2_rle_crop_4032613535_0.png treat image : temp/1763061627_1406847_1394220825_99e4e5c83c938f9d46edba57326882c2_rle_crop_4032613547_0.png treat image : temp/1763061627_1406847_1394220825_99e4e5c83c938f9d46edba57326882c2_rle_crop_4032613552_0.png treat image : temp/1763061627_1406847_1394222160_cc0ecdc3dbcbb5d8279cb60b957abe82_rle_crop_4032613531_0.png treat image : temp/1763061627_1406847_1394222138_1d52a34fc9389d40dd6c44794e23d2d1_rle_crop_4032613540_0.png treat image : temp/1763061627_1406847_1394220908_93e62113d265028da95139fd3491e408_rle_crop_4032613545_0.png treat image : temp/1763061627_1406847_1394220825_99e4e5c83c938f9d46edba57326882c2_rle_crop_4032613548_0.png treat image : temp/1763061627_1406847_1394220825_99e4e5c83c938f9d46edba57326882c2_rle_crop_4032613549_0.png treat image : temp/1763061627_1406847_1394220825_99e4e5c83c938f9d46edba57326882c2_rle_crop_4032613550_0.png treat image : temp/1763061627_1406847_1394220825_99e4e5c83c938f9d46edba57326882c2_rle_crop_4032613551_0.png treat image : temp/1763061627_1406847_1394219974_a16d990f365f5556d3f3f11e67206c33_rle_crop_4032613562_0.png treat image : temp/1763061627_1406847_1394219974_a16d990f365f5556d3f3f11e67206c33_rle_crop_4032613564_0.png treat image : temp/1763061627_1406847_1394219919_3e1667fd77d26c1cfcc60e27c6d4b0a7_rle_crop_4032613567_0.png treat image : temp/1763061627_1406847_1394219795_4fe8b6652b8ef719e7d680c5f95f113e_rle_crop_4032613569_0.png treat image : temp/1763061627_1406847_1394219795_4fe8b6652b8ef719e7d680c5f95f113e_rle_crop_4032613570_0.png treat image : temp/1763061627_1406847_1394219696_4f745e82547296febecca8b76f8376e0_rle_crop_4032613571_0.png treat image : temp/1763061627_1406847_1394219691_8c0f5d9a70f4c979bb4fa96069f49af7_rle_crop_4032613573_0.png treat image : temp/1763061627_1406847_1394219691_8c0f5d9a70f4c979bb4fa96069f49af7_rle_crop_4032613574_0.png treat image : temp/1763061627_1406847_1394219691_8c0f5d9a70f4c979bb4fa96069f49af7_rle_crop_4032613575_0.png treat image : temp/1763061627_1406847_1394219686_8810a7133709f85631b828c533baa8b5_rle_crop_4032613579_0.png treat image : temp/1763061627_1406847_1394219150_08d1cad5c14941a371192fa36fdc0a97_rle_crop_4032613586_0.png treat image : temp/1763061627_1406847_1394222149_762ed0fbe3a1ceb79b35bdd1a34d2b6f_rle_crop_4032613539_0.png treat image : temp/1763061627_1406847_1394219592_748f8682c3a2c1c1a371c5ae56861dd3_rle_crop_4032613583_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 81 time used for this insertion : 0.04617047309875488 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 81 time used for this insertion : 0.04771256446838379 save missing photos in datou_result : time spend for datou_step_exec : 5.426962375640869 time spend to save output : 0.11359739303588867 total time spend for step 7 : 5.540559768676758 step8:velours_tree Thu Nov 13 20:22:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.10210824012756348 time spend to save output : 5.698204040527344e-05 total time spend for step 8 : 0.10216522216796875 step9:send_mail_cod Thu Nov 13 20:22:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P28495493_13-11-2025_20_22_27.pdf 28496195 imagette284961951763061747 28496196 change filename to text .change filename to text .imagette284961961763061747 28496197 change filename to text .change filename to text .imagette284961971763061747 28496198 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette284961981763061747 28496199 change filename to text .change filename to text .change filename to text .imagette284961991763061749 28496200 imagette284962001763061749 28496201 imagette284962011763061749 28496202 imagette284962021763061749 28496203 imagette284962031763061749 28496204 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette284962041763061749 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=28495493 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/28496194,28496195,28496196,28496197,28496198,28496199,28496200,28496201,28496202,28496203,28496204?tags=environnement,background,carton,autre,pet_clair,metal,mal_croppe,flou,pehd,pet_fonce,papier args[1394222167] : ((1394222167, 0.28603918995201855, 492688767), (1394222167, 0.42574353106102225, 2107752395), '0.10233774594907408') We are sending mail with results at report@fotonower.com args[1394222160] : ((1394222160, 1.25385295042148, 492688767), (1394222160, 0.39891975972267957, 2107752395), '0.10233774594907408') We are sending mail with results at report@fotonower.com args[1394222154] : ((1394222154, 0.29088632730163816, 492688767), (1394222154, 0.5796220579915305, 2107752395), '0.10233774594907408') We are sending mail with results at report@fotonower.com args[1394222149] : ((1394222149, -0.45869588835926445, 492688767), (1394222149, 0.48993816802437157, 2107752395), '0.10233774594907408') We are sending mail with results at report@fotonower.com args[1394222138] : ((1394222138, -4.39952705376962, 492609224), (1394222138, 0.4884816839351195, 2107752395), '0.10233774594907408') We are sending mail with results at report@fotonower.com args[1394221035] : ((1394221035, 0.8666795834171841, 492688767), (1394221035, 0.41602370549363565, 2107752395), '0.10233774594907408') We are sending mail with results at report@fotonower.com args[1394220908] : ((1394220908, -0.25520276110866985, 492688767), (1394220908, 0.7642781682530481, 2107752395), '0.10233774594907408') We are sending mail with results at report@fotonower.com args[1394220825] : ((1394220825, -4.192435619270508, 492609224), (1394220825, 0.5861202667297359, 2107752395), '0.10233774594907408') We are sending mail with results at report@fotonower.com args[1394220755] : ((1394220755, -3.6028272176647187, 492609224), (1394220755, 0.378646105205419, 2107752395), '0.10233774594907408') We are sending mail with results at report@fotonower.com args[1394220129] : ((1394220129, -1.5810162543418804, 492688767), (1394220129, 0.6365651675496942, 2107752395), '0.10233774594907408') We are sending mail with results at report@fotonower.com args[1394219974] : ((1394219974, -4.238330520120668, 492609224), (1394219974, 0.4421278755258291, 2107752395), '0.10233774594907408') We are sending mail with results at report@fotonower.com args[1394219929] : ((1394219929, 0.01586714782639726, 492688767), (1394219929, 0.6993180473609082, 2107752395), '0.10233774594907408') We are sending mail with results at report@fotonower.com args[1394219919] : ((1394219919, -4.097223300209947, 492609224), (1394219919, 0.4653059140106664, 2107752395), '0.10233774594907408') We are sending mail with results at report@fotonower.com args[1394219795] : ((1394219795, 1.440214436034338, 492688767), (1394219795, 1.0671846997985037, 2107752395), '0.10233774594907408') We are sending mail with results at report@fotonower.com args[1394219701] : ((1394219701, -0.7280764927175915, 492688767), (1394219701, 1.2088048338619308, 2107752395), '0.10233774594907408') We are sending mail with results at report@fotonower.com args[1394219696] : ((1394219696, -0.6519978494721199, 492688767), (1394219696, 0.8104959379980038, 2107752395), '0.10233774594907408') We are sending mail with results at report@fotonower.com args[1394219691] : ((1394219691, -3.9671692768935443, 492609224), (1394219691, 0.38837651506746346, 2107752395), '0.10233774594907408') We are sending mail with results at report@fotonower.com args[1394219686] : ((1394219686, 0.8534408356652698, 492688767), (1394219686, 0.9808771310397925, 2107752395), '0.10233774594907408') We are sending mail with results at report@fotonower.com args[1394219592] : ((1394219592, -2.6046284284948764, 492609224), (1394219592, 0.30439454577673186, 2107752395), '0.10233774594907408') We are sending mail with results at report@fotonower.com args[1394219150] : ((1394219150, -0.5411475563200084, 492688767), (1394219150, 0.7436834745557862, 2107752395), '0.10233774594907408') We are sending mail with results at report@fotonower.com refus_total : 0.10233774594907408 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos_view ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=28495493 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28495493_13-11-2025_20_22_27.pdf results_Auto_P28495493_13-11-2025_20_22_27.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28495493_13-11-2025_20_22_27.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','28495493','results_Auto_P28495493_13-11-2025_20_22_27.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28495493_13-11-2025_20_22_27.pdf','pdf','','0.6','0.10233774594907408') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/28495493

https://www.fotonower.com/image?json=false&list_photos_id=1394222167
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1394222160
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.25385295042148)
https://www.fotonower.com/image?json=false&list_photos_id=1394222154
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1394222149
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1394222138
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1394221035
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1394220908
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1394220825
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1394220755
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1394220129
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1394219974
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1394219929
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1394219919
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1394219795
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.440214436034338)
https://www.fotonower.com/image?json=false&list_photos_id=1394219701
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1394219696
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1394219691
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1394219686
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1394219592
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1394219150
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 10.23%
Veuillez trouver les photos des contaminants.

exemples de contaminants: carton: https://www.fotonower.com/view/28496196?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/28496197?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/28496198?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/28496199?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/28496204?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28495493_13-11-2025_20_22_27.pdf.

Lien vers velours :https://marlene.fotonower.com/velours/28496194,28496195,28496196,28496197,28496198,28496199,28496200,28496201,28496202,28496203,28496204?tags=environnement,background,carton,autre,pet_clair,metal,mal_croppe,flou,pehd,pet_fonce,papier.


L'équipe Fotonower 202 b'' Date: Thu, 13 Nov 2025 19:22:34 GMT Content-Length: 0 Connection: close Server: nginx X-Message-Id: 9Nq2WhzPRvWVlBF5yjDi9w Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1394222167, 1394222160, 1394222154, 1394222149, 1394222138, 1394221035, 1394220908, 1394220825, 1394220755, 1394220129, 1394219974, 1394219929, 1394219919, 1394219795, 1394219701, 1394219696, 1394219691, 1394219686, 1394219592, 1394219150] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394222167', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394222160', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394222154', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394222149', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394222138', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394221035', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394220908', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394220825', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394220755', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394220129', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394219974', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394219929', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394219919', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394219795', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394219701', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394219696', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394219691', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394219686', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394219592', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394219150', None, None, None, None, None, '4042346') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 20 time used for this insertion : 0.04793238639831543 save_final save missing photos in datou_result : time spend for datou_step_exec : 6.739329814910889 time spend to save output : 0.04824995994567871 total time spend for step 9 : 6.787579774856567 step10:split_time_score Thu Nov 13 20:22:34 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('17', 20),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 13112025 28495493 Nombre de photos uploadées : 20 / 23040 (0%) 13112025 28495493 Nombre de photos taguées (types de déchets): 0 / 20 (0%) 13112025 28495493 Nombre de photos taguées (volume) : 0 / 20 (0%) elapsed_time : load_data_split_time_score 1.430511474609375e-06 elapsed_time : order_list_meta_photo_and_scores 5.0067901611328125e-06 ???????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0008709430694580078 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.7092311382293701 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.03839044013631688 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28485361_13-11-2025_11_11_28.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28485361 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28485361 AND mptpi.`type`=3594 To do Qualite : 0.09246572788065842 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28484569_13-11-2025_11_01_42.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28484569 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28484569 AND mptpi.`type`=3594 To do Qualite : 0.06026636043595675 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28484571_13-11-2025_10_51_50.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28484571 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28484571 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28495449 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28495453 order by id desc limit 1 Qualite : 0.10233774594907408 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28495493_13-11-2025_20_22_27.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28495493 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28495493 AND mptpi.`type`=3594 To do Qualite : 0.18898649691358027 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28495509_13-11-2025_20_11_46.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28495509 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28495509 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'13112025': {'nb_upload': 20, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1394222167, 1394222160, 1394222154, 1394222149, 1394222138, 1394221035, 1394220908, 1394220825, 1394220755, 1394220129, 1394219974, 1394219929, 1394219919, 1394219795, 1394219701, 1394219696, 1394219691, 1394219686, 1394219592, 1394219150] Looping around the photos to save general results len do output : 1 /28495493Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394222167', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394222160', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394222154', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394222149', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394222138', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394221035', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394220908', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394220825', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394220755', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394220129', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394219974', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394219929', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394219919', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394219795', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394219701', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394219696', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394219691', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394219686', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394219592', None, None, None, None, None, '4042346') ('3318', None, None, None, None, None, None, None, '4042346') ('3318', '28495493', '1394219150', None, None, None, None, None, '4042346') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 21 time used for this insertion : 0.032586097717285156 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.694618225097656 time spend to save output : 0.03284502029418945 total time spend for step 10 : 4.727463245391846 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 20 set_done_treatment 67.12user 28.28system 2:14.13elapsed 71%CPU (0avgtext+0avgdata 2999500maxresident)k 140184inputs+42536outputs (0major+2171628minor)pagefaults 0swaps