python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 109147 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['4104491'] with mtr_portfolio_ids : ['28839450'] and first list_photo_ids : [] new path : /proc/109147/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 10 ; length of list_pids : 10 ; length of list_args : 10 time to download the photos : 1.3671362400054932 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Mon Nov 24 18:10:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10998 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-11-24 18:10:34.975662: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-11-24 18:10:35.006454: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493010000 Hz 2025-11-24 18:10:35.008603: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f1fb8000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-11-24 18:10:35.008660: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-11-24 18:10:35.012436: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-11-24 18:10:35.326766: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x3ae3b5f0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-11-24 18:10:35.326830: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-11-24 18:10:35.328562: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-11-24 18:10:35.330252: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-24 18:10:35.362000: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-24 18:10:35.381265: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-11-24 18:10:35.385137: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-11-24 18:10:35.418053: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-11-24 18:10:35.423017: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-11-24 18:10:35.480678: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-11-24 18:10:35.483150: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-11-24 18:10:35.483602: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-24 18:10:35.485376: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-11-24 18:10:35.485396: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-11-24 18:10:35.485408: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-11-24 18:10:35.487507: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10193 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-11-24 18:10:35.874241: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-11-24 18:10:35.874338: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-24 18:10:35.874357: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-24 18:10:35.874372: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-11-24 18:10:35.874387: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-11-24 18:10:35.874401: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-11-24 18:10:35.874415: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-11-24 18:10:35.874430: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-11-24 18:10:35.875740: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-11-24 18:10:35.876957: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-11-24 18:10:35.876989: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-24 18:10:35.877005: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-24 18:10:35.877018: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-11-24 18:10:35.877032: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-11-24 18:10:35.877046: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-11-24 18:10:35.877060: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-11-24 18:10:35.877073: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-11-24 18:10:35.878385: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-11-24 18:10:35.878414: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-11-24 18:10:35.878422: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-11-24 18:10:35.878430: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-11-24 18:10:35.879778: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10193 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-11-24 18:10:40.992283: W tensorflow/core/framework/cpu_allocator_impl.cc:81] Allocation of 51380224 exceeds 10% of free system memory. 2025-11-24 18:10:44.415358: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-24 18:10:44.765706: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 16 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 37.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 43.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 20.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 34.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 33.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 12.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 15 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 11 Detection mask done ! Trying to reset tf kernel 110416 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5706 tf kernel not reseted sub process len(results) : 10 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 10 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10998 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] DEBUG bbox = [492, 1026, 651, 1149] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0003573894500732422 nb_pixel_total : 11021 time to create 1 rle with old method : 0.012027263641357422 length of segment : 151 DEBUG bbox = [924, 468, 984, 588] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00011229515075683594 nb_pixel_total : 3767 time to create 1 rle with old method : 0.004395008087158203 length of segment : 56 DEBUG bbox = [897, 1245, 1071, 1590] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0006198883056640625 nb_pixel_total : 29193 time to create 1 rle with old method : 0.03135108947753906 length of segment : 162 DEBUG bbox = [972, 504, 1068, 663] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00017547607421875 nb_pixel_total : 9539 time to create 1 rle with old method : 0.010789871215820312 length of segment : 89 DEBUG bbox = [954, 396, 1077, 537] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00015091896057128906 nb_pixel_total : 3435 time to create 1 rle with old method : 0.004052400588989258 length of segment : 146 DEBUG bbox = [672, 678, 795, 801] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00019049644470214844 nb_pixel_total : 11800 time to create 1 rle with old method : 0.013200759887695312 length of segment : 125 DEBUG bbox = [900, 756, 1056, 939] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0003082752227783203 nb_pixel_total : 6070 time to create 1 rle with old method : 0.0070989131927490234 length of segment : 221 DEBUG bbox = [870, 1236, 1008, 1389] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00022125244140625 nb_pixel_total : 12468 time to create 1 rle with old method : 0.013735294342041016 length of segment : 120 DEBUG bbox = [816, 255, 1080, 927] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0014729499816894531 nb_pixel_total : 81970 time to create 1 rle with old method : 0.08798432350158691 length of segment : 242 DEBUG bbox = [297, 960, 414, 1068] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0001583099365234375 nb_pixel_total : 7498 time to create 1 rle with old method : 0.008008718490600586 length of segment : 122 DEBUG bbox = [771, 894, 1035, 1161] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0005729198455810547 nb_pixel_total : 30894 time to create 1 rle with old method : 0.03401446342468262 length of segment : 217 DEBUG bbox = [951, 1164, 1077, 1431] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00026726722717285156 nb_pixel_total : 16130 time to create 1 rle with old method : 0.0174710750579834 length of segment : 199 DEBUG bbox = [861, 1269, 1041, 1449] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0002949237823486328 nb_pixel_total : 18448 time to create 1 rle with old method : 0.02007889747619629 length of segment : 169 DEBUG bbox = [996, 1056, 1074, 1116] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 8.082389831542969e-05 nb_pixel_total : 3532 time to create 1 rle with old method : 0.003790140151977539 length of segment : 78 DEBUG bbox = [0, 1167, 87, 1386] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00017261505126953125 nb_pixel_total : 10448 time to create 1 rle with old method : 0.011585712432861328 length of segment : 82 DEBUG bbox = [816, 579, 888, 627] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 6.723403930664062e-05 nb_pixel_total : 2096 time to create 1 rle with old method : 0.0023267269134521484 length of segment : 73 DEBUG bbox = [963, 786, 1080, 1062] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00025963783264160156 nb_pixel_total : 15120 time to create 1 rle with old method : 0.016265869140625 length of segment : 105 DEBUG bbox = [885, 309, 1074, 588] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00045680999755859375 nb_pixel_total : 35377 time to create 1 rle with old method : 0.03803515434265137 length of segment : 219 DEBUG bbox = [612, 1560, 1053, 1908] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0011522769927978516 nb_pixel_total : 78879 time to create 1 rle with old method : 0.0814201831817627 length of segment : 464 DEBUG bbox = [894, 1485, 1068, 1638] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00022459030151367188 nb_pixel_total : 9105 time to create 1 rle with old method : 0.009816646575927734 length of segment : 172 DEBUG bbox = [609, 912, 702, 1182] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00021266937255859375 nb_pixel_total : 12465 time to create 1 rle with old method : 0.013569831848144531 length of segment : 94 DEBUG bbox = [246, 996, 570, 1305] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0007991790771484375 nb_pixel_total : 52292 time to create 1 rle with old method : 0.05614876747131348 length of segment : 315 DEBUG bbox = [777, 822, 867, 900] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00010633468627929688 nb_pixel_total : 5175 time to create 1 rle with old method : 0.005544424057006836 length of segment : 86 DEBUG bbox = [729, 840, 798, 957] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 8.58306884765625e-05 nb_pixel_total : 3787 time to create 1 rle with old method : 0.004225730895996094 length of segment : 60 DEBUG bbox = [243, 1092, 345, 1188] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00010824203491210938 nb_pixel_total : 4583 time to create 1 rle with old method : 0.004899263381958008 length of segment : 90 DEBUG bbox = [1002, 1224, 1080, 1383] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0003120899200439453 nb_pixel_total : 7723 time to create 1 rle with old method : 0.008516788482666016 length of segment : 73 DEBUG bbox = [9, 1029, 144, 1110] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00030231475830078125 nb_pixel_total : 7938 time to create 1 rle with old method : 0.008369922637939453 length of segment : 134 DEBUG bbox = [669, 474, 1041, 846] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0019295215606689453 nb_pixel_total : 42569 time to create 1 rle with old method : 0.05860185623168945 length of segment : 307 DEBUG bbox = [864, 645, 1080, 1134] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0010631084442138672 nb_pixel_total : 50449 time to create 1 rle with old method : 0.05404257774353027 length of segment : 170 DEBUG bbox = [342, 1029, 633, 1182] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0008652210235595703 nb_pixel_total : 22517 time to create 1 rle with old method : 0.02387547492980957 length of segment : 314 DEBUG bbox = [909, 1143, 1014, 1296] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00022268295288085938 nb_pixel_total : 7301 time to create 1 rle with old method : 0.008036136627197266 length of segment : 95 DEBUG bbox = [981, 1194, 1077, 1281] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00021576881408691406 nb_pixel_total : 4132 time to create 1 rle with old method : 0.0046231746673583984 length of segment : 96 DEBUG bbox = [996, 1122, 1080, 1230] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0001270771026611328 nb_pixel_total : 5108 time to create 1 rle with old method : 0.005840301513671875 length of segment : 82 DEBUG bbox = [855, 1092, 984, 1233] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00034046173095703125 nb_pixel_total : 7595 time to create 1 rle with old method : 0.008722543716430664 length of segment : 205 DEBUG bbox = [891, 711, 1008, 867] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00024962425231933594 nb_pixel_total : 9808 time to create 1 rle with old method : 0.010668516159057617 length of segment : 109 DEBUG bbox = [993, 1050, 1080, 1155] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00011539459228515625 nb_pixel_total : 5313 time to create 1 rle with old method : 0.005950212478637695 length of segment : 82 DEBUG bbox = [237, 1092, 345, 1197] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0003199577331542969 nb_pixel_total : 6189 time to create 1 rle with old method : 0.006957530975341797 length of segment : 77 DEBUG bbox = [768, 1092, 1011, 1419] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0012919902801513672 nb_pixel_total : 40066 time to create 1 rle with old method : 0.043276309967041016 length of segment : 227 DEBUG bbox = [720, 1425, 837, 1518] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0002505779266357422 nb_pixel_total : 7308 time to create 1 rle with old method : 0.008292198181152344 length of segment : 109 DEBUG bbox = [513, 960, 693, 1158] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0006387233734130859 nb_pixel_total : 13044 time to create 1 rle with old method : 0.014716148376464844 length of segment : 136 DEBUG bbox = [915, 321, 1068, 585] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0006103515625 nb_pixel_total : 8112 time to create 1 rle with old method : 0.009129047393798828 length of segment : 104 DEBUG bbox = [936, 771, 1074, 876] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00031495094299316406 nb_pixel_total : 9746 time to create 1 rle with old method : 0.010551691055297852 length of segment : 136 DEBUG bbox = [696, 795, 828, 924] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00037384033203125 nb_pixel_total : 9716 time to create 1 rle with old method : 0.01085042953491211 length of segment : 147 DEBUG bbox = [939, 450, 1074, 720] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0002589225769042969 nb_pixel_total : 9051 time to create 1 rle with old method : 0.010097265243530273 length of segment : 141 DEBUG bbox = [735, 1158, 966, 1443] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00101470947265625 nb_pixel_total : 43461 time to create 1 rle with old method : 0.04625892639160156 length of segment : 225 DEBUG bbox = [762, 831, 834, 954] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00018477439880371094 nb_pixel_total : 5573 time to create 1 rle with old method : 0.006101369857788086 length of segment : 57 DEBUG bbox = [729, 780, 783, 861] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00011706352233886719 nb_pixel_total : 2675 time to create 1 rle with old method : 0.003125429153442383 length of segment : 49 DEBUG bbox = [1032, 1215, 1074, 1347] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.000152587890625 nb_pixel_total : 3654 time to create 1 rle with old method : 0.004115581512451172 length of segment : 41 DEBUG bbox = [984, 1137, 1035, 1191] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00011539459228515625 nb_pixel_total : 1663 time to create 1 rle with old method : 0.001916646957397461 length of segment : 50 DEBUG bbox = [711, 861, 783, 975] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00011968612670898438 nb_pixel_total : 4632 time to create 1 rle with old method : 0.005201816558837891 length of segment : 68 DEBUG bbox = [1005, 213, 1077, 336] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00020694732666015625 nb_pixel_total : 4425 time to create 1 rle with old method : 0.004946231842041016 length of segment : 84 DEBUG bbox = [930, 1044, 984, 1104] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 9.72747802734375e-05 nb_pixel_total : 1940 time to create 1 rle with old method : 0.0022499561309814453 length of segment : 53 time spent for convertir_results : 2.2420191764831543 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 52 chid ids of type : 3594 Number RLEs to save : 7228 save missing photos in datou_result : time spend for datou_step_exec : 25.919217109680176 time spend to save output : 0.5575282573699951 total time spend for step 1 : 26.47674536705017 step2:crop_condition Mon Nov 24 18:10:57 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 10 ! batch 1 Loaded 52 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 28 About to insert : list_path_to_insert length 28 new photo from crops ! About to upload 28 photos upload in portfolio : 3736932 init cache_photo without model_param we have 28 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1764004260_109147 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764004265), 0.0, 0.0, 14, '', 0, 0, '1764004229_109147_1395925189_45b5884b8199060d9b7cad31ee5119d5_rle_crop_4043910211_0.png', 0, 116, 149, 0, 1764004265,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764004265), 0.0, 0.0, 14, '', 0, 0, '1764004229_109147_1395925189_45b5884b8199060d9b7cad31ee5119d5_rle_crop_4043910212_0.png', 0, 118, 56, 0, 1764004265,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764004265), 0.0, 0.0, 14, '', 0, 0, '1764004229_109147_1395925189_45b5884b8199060d9b7cad31ee5119d5_rle_crop_4043910215_0.png', 0, 103, 112, 0, 1764004265,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764004265), 0.0, 0.0, 14, '', 0, 0, '1764004229_109147_1395925187_264bd4118c474b9a190761502e290bde_rle_crop_4043910216_0.png', 0, 113, 123, 0, 1764004265,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764004265), 0.0, 0.0, 14, '', 0, 0, '1764004229_109147_1395925187_264bd4118c474b9a190761502e290bde_rle_crop_4043910217_0.png', 0, 169, 137, 0, 1764004265,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764004265), 0.0, 0.0, 14, '', 0, 0, '1764004229_109147_1395925187_264bd4118c474b9a190761502e290bde_rle_crop_4043910221_0.png', 0, 214, 214, 0, 1764004265,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764004265), 0.0, 0.0, 14, '', 0, 0, '1764004229_109147_1395925169_c3d32cdde9195e09bd2ef62561aac669_rle_crop_4043910223_0.png', 0, 160, 169, 0, 1764004265,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764004265), 0.0, 0.0, 14, '', 0, 0, '1764004229_109147_1395925169_c3d32cdde9195e09bd2ef62561aac669_rle_crop_4043910224_0.png', 0, 56, 78, 0, 1764004265,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764004265), 0.0, 0.0, 14, '', 0, 0, '1764004229_109147_1395925169_c3d32cdde9195e09bd2ef62561aac669_rle_crop_4043910226_0.png', 0, 36, 71, 0, 1764004265,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764004265), 0.0, 0.0, 14, '', 0, 0, '1764004229_109147_1395924873_f92b6c712b47cb36167623033a816b76_rle_crop_4043910231_0.png', 0, 243, 81, 0, 1764004265,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764004265), 0.0, 0.0, 14, '', 0, 0, '1764004229_109147_1395924757_7d29a282e53d7c99335344c7a8cdbe76_rle_crop_4043910233_0.png', 0, 71, 86, 0, 1764004265,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764004265), 0.0, 0.0, 14, '', 0, 0, '1764004229_109147_1395924757_7d29a282e53d7c99335344c7a8cdbe76_rle_crop_4043910234_0.png', 0, 109, 60, 0, 1764004265,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764004265), 0.0, 0.0, 14, '', 0, 0, '1764004229_109147_1395924742_a550332d376f66da8bdbe86d3fd0dde6_rle_crop_4043910238_0.png', 0, 307, 307, 0, 1764004265,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764004265), 0.0, 0.0, 14, '', 0, 0, '1764004229_109147_1395924742_a550332d376f66da8bdbe86d3fd0dde6_rle_crop_4043910239_0.png', 0, 415, 151, 0, 1764004265,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764004265), 0.0, 0.0, 14, '', 0, 0, '1764004229_109147_1395924742_a550332d376f66da8bdbe86d3fd0dde6_rle_crop_4043910241_0.png', 0, 147, 82, 0, 1764004265,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764004265), 0.0, 0.0, 14, '', 0, 0, '1764004229_109147_1395924054_bf783c39ef4e0865027a7f57dcbc7d45_rle_crop_4043910242_0.png', 0, 76, 93, 0, 1764004265,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764004265), 0.0, 0.0, 14, '', 0, 0, '1764004229_109147_1395924054_bf783c39ef4e0865027a7f57dcbc7d45_rle_crop_4043910243_0.png', 0, 99, 77, 0, 1764004265,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764004265), 0.0, 0.0, 14, '', 0, 0, '1764004229_109147_1395924054_bf783c39ef4e0865027a7f57dcbc7d45_rle_crop_4043910244_0.png', 0, 139, 124, 0, 1764004265,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764004265), 0.0, 0.0, 14, '', 0, 0, '1764004229_109147_1395924054_bf783c39ef4e0865027a7f57dcbc7d45_rle_crop_4043910245_0.png', 0, 154, 108, 0, 1764004265,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764004265), 0.0, 0.0, 14, '', 0, 0, '1764004229_109147_1395923993_035566727230bed29c027b483da0595f_rle_crop_4043910248_0.png', 0, 303, 226, 0, 1764004265,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764004265), 0.0, 0.0, 14, '', 0, 0, '1764004229_109147_1395923993_035566727230bed29c027b483da0595f_rle_crop_4043910250_0.png', 0, 161, 127, 0, 1764004265,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764004265), 0.0, 0.0, 14, '', 0, 0, '1764004229_109147_1395923993_035566727230bed29c027b483da0595f_rle_crop_4043910253_0.png', 0, 115, 111, 0, 1764004265,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764004265), 0.0, 0.0, 14, '', 0, 0, '1764004229_109147_1395923926_1092014368b138ff64b8def801027a83_rle_crop_4043910255_0.png', 0, 266, 206, 0, 1764004265,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764004265), 0.0, 0.0, 14, '', 0, 0, '1764004229_109147_1395923926_1092014368b138ff64b8def801027a83_rle_crop_4043910256_0.png', 0, 116, 56, 0, 1764004265,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764004265), 0.0, 0.0, 14, '', 0, 0, '1764004229_109147_1395923926_1092014368b138ff64b8def801027a83_rle_crop_4043910257_0.png', 0, 80, 47, 0, 1764004265,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764004265), 0.0, 0.0, 14, '', 0, 0, '1764004229_109147_1395923926_1092014368b138ff64b8def801027a83_rle_crop_4043910259_0.png', 0, 50, 50, 0, 1764004265,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764004265), 0.0, 0.0, 14, '', 0, 0, '1764004229_109147_1395923926_1092014368b138ff64b8def801027a83_rle_crop_4043910260_0.png', 0, 99, 59, 0, 1764004265,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764004265), 0.0, 0.0, 14, '', 0, 0, '1764004229_109147_1395923926_1092014368b138ff64b8def801027a83_rle_crop_4043910262_0.png', 0, 59, 53, 0, 1764004265,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 28 photos in the portfolio 3736932 time of upload the photos Elapsed time : 7.224430084228516 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 8 About to insert : list_path_to_insert length 8 new photo from crops ! About to upload 8 photos upload in portfolio : 3736932 init cache_photo without model_param we have 8 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1764004268_109147 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764004269), 0.0, 0.0, 14, '', 0, 0, '1764004229_109147_1395925187_264bd4118c474b9a190761502e290bde_rle_crop_4043910220_0.png', 0, 107, 113, 0, 1764004269,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764004269), 0.0, 0.0, 14, '', 0, 0, '1764004229_109147_1395924873_f92b6c712b47cb36167623033a816b76_rle_crop_4043910232_0.png', 0, 300, 310, 0, 1764004269,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764004269), 0.0, 0.0, 14, '', 0, 0, '1764004229_109147_1395924757_7d29a282e53d7c99335344c7a8cdbe76_rle_crop_4043910235_0.png', 0, 84, 72, 0, 1764004269,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764004269), 0.0, 0.0, 14, '', 0, 0, '1764004229_109147_1395924742_a550332d376f66da8bdbe86d3fd0dde6_rle_crop_4043910236_0.png', 0, 154, 73, 0, 1764004269,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764004269), 0.0, 0.0, 14, '', 0, 0, '1764004229_109147_1395924742_a550332d376f66da8bdbe86d3fd0dde6_rle_crop_4043910240_0.png', 0, 138, 276, 0, 1764004269,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764004269), 0.0, 0.0, 14, '', 0, 0, '1764004229_109147_1395923993_035566727230bed29c027b483da0595f_rle_crop_4043910247_0.png', 0, 96, 76, 0, 1764004269,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764004269), 0.0, 0.0, 14, '', 0, 0, '1764004229_109147_1395923993_035566727230bed29c027b483da0595f_rle_crop_4043910251_0.png', 0, 177, 72, 0, 1764004269,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764004269), 0.0, 0.0, 14, '', 0, 0, '1764004229_109147_1395923993_035566727230bed29c027b483da0595f_rle_crop_4043910252_0.png', 0, 94, 136, 0, 1764004269,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 8 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.2931203842163086 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1764004270_109147 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764004270), 0.0, 0.0, 14, '', 0, 0, '1764004229_109147_1395923993_035566727230bed29c027b483da0595f_rle_crop_4043910249_0.png', 0, 81, 109, 0, 1764004270,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.7725639343261719 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 14 About to insert : list_path_to_insert length 14 new photo from crops ! About to upload 14 photos upload in portfolio : 3736932 init cache_photo without model_param we have 14 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1764004273_109147 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764004275), 0.0, 0.0, 14, '', 0, 0, '1764004229_109147_1395925189_45b5884b8199060d9b7cad31ee5119d5_rle_crop_4043910213_0.png', 0, 274, 161, 0, 1764004275,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764004275), 0.0, 0.0, 14, '', 0, 0, '1764004229_109147_1395925189_45b5884b8199060d9b7cad31ee5119d5_rle_crop_4043910214_0.png', 0, 152, 88, 0, 1764004275,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764004275), 0.0, 0.0, 14, '', 0, 0, '1764004229_109147_1395925187_264bd4118c474b9a190761502e290bde_rle_crop_4043910218_0.png', 0, 145, 120, 0, 1764004275,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764004275), 0.0, 0.0, 14, '', 0, 0, '1764004229_109147_1395925187_264bd4118c474b9a190761502e290bde_rle_crop_4043910219_0.png', 0, 539, 224, 0, 1764004275,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764004275), 0.0, 0.0, 14, '', 0, 0, '1764004229_109147_1395925187_264bd4118c474b9a190761502e290bde_rle_crop_4043910222_0.png', 0, 253, 115, 0, 1764004275,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764004275), 0.0, 0.0, 14, '', 0, 0, '1764004229_109147_1395925169_c3d32cdde9195e09bd2ef62561aac669_rle_crop_4043910225_0.png', 0, 194, 82, 0, 1764004275,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764004275), 0.0, 0.0, 14, '', 0, 0, '1764004229_109147_1395924873_f92b6c712b47cb36167623033a816b76_rle_crop_4043910227_0.png', 0, 248, 104, 0, 1764004275,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764004275), 0.0, 0.0, 14, '', 0, 0, '1764004229_109147_1395924873_f92b6c712b47cb36167623033a816b76_rle_crop_4043910228_0.png', 0, 269, 185, 0, 1764004275,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764004275), 0.0, 0.0, 14, '', 0, 0, '1764004229_109147_1395924873_f92b6c712b47cb36167623033a816b76_rle_crop_4043910229_0.png', 0, 309, 424, 0, 1764004275,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764004275), 0.0, 0.0, 14, '', 0, 0, '1764004229_109147_1395924873_f92b6c712b47cb36167623033a816b76_rle_crop_4043910230_0.png', 0, 113, 170, 0, 1764004275,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764004275), 0.0, 0.0, 14, '', 0, 0, '1764004229_109147_1395924742_a550332d376f66da8bdbe86d3fd0dde6_rle_crop_4043910237_0.png', 0, 73, 132, 0, 1764004275,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764004275), 0.0, 0.0, 14, '', 0, 0, '1764004229_109147_1395924054_bf783c39ef4e0865027a7f57dcbc7d45_rle_crop_4043910246_0.png', 0, 91, 80, 0, 1764004275,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764004275), 0.0, 0.0, 14, '', 0, 0, '1764004229_109147_1395923993_035566727230bed29c027b483da0595f_rle_crop_4043910254_0.png', 0, 187, 103, 0, 1764004275,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764004275), 0.0, 0.0, 14, '', 0, 0, '1764004229_109147_1395923926_1092014368b138ff64b8def801027a83_rle_crop_4043910261_0.png', 0, 116, 70, 0, 1764004275,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 14 photos in the portfolio 3736932 time of upload the photos Elapsed time : 3.873155117034912 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1764004277_109147 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764004277), 0.0, 0.0, 14, '', 0, 0, '1764004229_109147_1395923926_1092014368b138ff64b8def801027a83_rle_crop_4043910258_0.png', 0, 114, 41, 0, 1764004277,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.64266037940979 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1395925189, 1395925187, 1395925169, 1395924873, 1395924794, 1395924757, 1395924742, 1395924054, 1395923993, 1395923926] Looping around the photos to save general results len do output : 52 /1395935560Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395935561Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395935562Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395935563Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395935564Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395935565Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395935566Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395935567Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395935568Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395935569Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395935570Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395935571Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395935572Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395935573Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395935574Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395935575Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395935577Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395935578Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395935579Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395935580Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395935581Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395935582Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395935583Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395935584Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395935585Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395935586Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395935587Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395935588Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395935591Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395935592Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395935593Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395935594Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395935595Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395935596Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395935598Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395935599Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395935600Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395935602Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395935603Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395935604Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395935606Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395935607Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395935608Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395935609Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395935610Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395935611Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395935612Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395935613Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395935614Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395935615Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395935616Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1395935617Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4104491') ('3318', '28839450', '1395925189', None, None, None, None, None, '4104491') ('3318', None, None, None, None, None, None, None, '4104491') ('3318', '28839450', '1395925187', None, None, None, None, None, '4104491') ('3318', None, None, None, None, None, None, None, '4104491') ('3318', '28839450', '1395925169', None, None, None, None, None, '4104491') ('3318', None, None, None, None, None, None, None, '4104491') ('3318', '28839450', '1395924873', None, None, None, None, None, '4104491') ('3318', None, None, None, None, None, None, None, '4104491') ('3318', '28839450', '1395924794', None, None, None, None, None, '4104491') ('3318', None, None, None, None, None, None, None, '4104491') ('3318', '28839450', '1395924757', None, None, None, None, None, '4104491') ('3318', None, None, None, None, None, None, None, '4104491') ('3318', '28839450', '1395924742', None, None, None, None, None, '4104491') ('3318', None, None, None, None, None, None, None, '4104491') ('3318', '28839450', '1395924054', None, None, None, None, None, '4104491') ('3318', None, None, None, None, None, None, None, '4104491') ('3318', '28839450', '1395923993', None, None, None, None, None, '4104491') ('3318', None, None, None, None, None, None, None, '4104491') ('3318', '28839450', '1395923926', None, None, None, None, None, '4104491') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 166 time used for this insertion : 0.02254652976989746 save_final save missing photos in datou_result : time spend for datou_step_exec : 19.716707229614258 time spend to save output : 0.024616003036499023 total time spend for step 2 : 19.741323232650757 step3:rle_unique_nms_with_priority Mon Nov 24 18:11:17 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 52 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 5 nb_hashtags : 2 time to prepare the origin masks : 0.2736539840698242 time for calcul the mask position with numpy : 0.08437561988830566 nb_pixel_total : 2016645 time to create 1 rle with new method : 0.08207273483276367 time for calcul the mask position with numpy : 0.006275653839111328 nb_pixel_total : 3435 time to create 1 rle with old method : 0.004050731658935547 time for calcul the mask position with numpy : 0.00612640380859375 nb_pixel_total : 9539 time to create 1 rle with old method : 0.01064753532409668 time for calcul the mask position with numpy : 0.006113767623901367 nb_pixel_total : 29193 time to create 1 rle with old method : 0.0321049690246582 time for calcul the mask position with numpy : 0.005959033966064453 nb_pixel_total : 3767 time to create 1 rle with old method : 0.004239082336425781 time for calcul the mask position with numpy : 0.0060617923736572266 nb_pixel_total : 11021 time to create 1 rle with old method : 0.012483596801757812 create new chi : 0.2700376510620117 time to delete rle : 0.025390625 batch 1 Loaded 11 chid ids of type : 3594 ++++++++Number RLEs to save : 2288 TO DO : save crop sub photo not yet done ! save time : 0.19944453239440918 nb_obj : 7 nb_hashtags : 3 time to prepare the origin masks : 0.2799060344696045 time for calcul the mask position with numpy : 0.08043432235717773 nb_pixel_total : 1906848 time to create 1 rle with new method : 0.09461021423339844 time for calcul the mask position with numpy : 0.006089448928833008 nb_pixel_total : 16130 time to create 1 rle with old method : 0.01746511459350586 time for calcul the mask position with numpy : 0.006145477294921875 nb_pixel_total : 30894 time to create 1 rle with old method : 0.03341317176818848 time for calcul the mask position with numpy : 0.0061948299407958984 nb_pixel_total : 7498 time to create 1 rle with old method : 0.008281707763671875 time for calcul the mask position with numpy : 0.006471872329711914 nb_pixel_total : 81892 time to create 1 rle with old method : 0.08914637565612793 time for calcul the mask position with numpy : 0.010168075561523438 nb_pixel_total : 12468 time to create 1 rle with old method : 0.013706445693969727 time for calcul the mask position with numpy : 0.006282329559326172 nb_pixel_total : 6070 time to create 1 rle with old method : 0.007005929946899414 time for calcul the mask position with numpy : 0.006119728088378906 nb_pixel_total : 11800 time to create 1 rle with old method : 0.01297450065612793 create new chi : 0.41383790969848633 time to delete rle : 0.0005166530609130859 batch 1 Loaded 15 chid ids of type : 3594 +++++++++++++++Number RLEs to save : 3557 TO DO : save crop sub photo not yet done ! save time : 0.2994086742401123 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.0963900089263916 time for calcul the mask position with numpy : 0.026807308197021484 nb_pixel_total : 2039076 time to create 1 rle with new method : 0.07936215400695801 time for calcul the mask position with numpy : 0.005973100662231445 nb_pixel_total : 2096 time to create 1 rle with old method : 0.002403736114501953 time for calcul the mask position with numpy : 0.006038665771484375 nb_pixel_total : 10448 time to create 1 rle with old method : 0.01169443130493164 time for calcul the mask position with numpy : 0.006021976470947266 nb_pixel_total : 3532 time to create 1 rle with old method : 0.003870725631713867 time for calcul the mask position with numpy : 0.006102323532104492 nb_pixel_total : 18448 time to create 1 rle with old method : 0.020039796829223633 create new chi : 0.16866517066955566 time to delete rle : 0.0002942085266113281 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 1884 TO DO : save crop sub photo not yet done ! save time : 0.18118715286254883 nb_obj : 6 nb_hashtags : 3 time to prepare the origin masks : 0.12181687355041504 time for calcul the mask position with numpy : 0.061199188232421875 nb_pixel_total : 1870362 time to create 1 rle with new method : 0.10699081420898438 time for calcul the mask position with numpy : 0.006268978118896484 nb_pixel_total : 52292 time to create 1 rle with old method : 0.05617713928222656 time for calcul the mask position with numpy : 0.005951881408691406 nb_pixel_total : 12465 time to create 1 rle with old method : 0.013460874557495117 time for calcul the mask position with numpy : 0.0059490203857421875 nb_pixel_total : 9105 time to create 1 rle with old method : 0.009764909744262695 time for calcul the mask position with numpy : 0.0064771175384521484 nb_pixel_total : 78879 time to create 1 rle with old method : 0.08731198310852051 time for calcul the mask position with numpy : 0.006999492645263672 nb_pixel_total : 35377 time to create 1 rle with old method : 0.03793072700500488 time for calcul the mask position with numpy : 0.006171703338623047 nb_pixel_total : 15120 time to create 1 rle with old method : 0.01605224609375 create new chi : 0.436556339263916 time to delete rle : 0.00051116943359375 batch 1 Loaded 13 chid ids of type : 3594 +++++++++Number RLEs to save : 3812 TO DO : save crop sub photo not yet done ! save time : 0.3021845817565918 No data in photo_id : 1395924794 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.04905557632446289 time for calcul the mask position with numpy : 0.018873214721679688 nb_pixel_total : 2060055 time to create 1 rle with new method : 0.09309673309326172 time for calcul the mask position with numpy : 0.0070343017578125 nb_pixel_total : 4583 time to create 1 rle with old method : 0.006723880767822266 time for calcul the mask position with numpy : 0.010030984878540039 nb_pixel_total : 3787 time to create 1 rle with old method : 0.004195213317871094 time for calcul the mask position with numpy : 0.006103515625 nb_pixel_total : 5175 time to create 1 rle with old method : 0.005633115768432617 create new chi : 0.15206646919250488 time to delete rle : 0.000244140625 batch 1 Loaded 7 chid ids of type : 3594 ++++++Number RLEs to save : 1552 TO DO : save crop sub photo not yet done ! save time : 0.15867018699645996 nb_obj : 6 nb_hashtags : 3 time to prepare the origin masks : 0.15297698974609375 time for calcul the mask position with numpy : 0.10166549682617188 nb_pixel_total : 1935103 time to create 1 rle with new method : 0.09311676025390625 time for calcul the mask position with numpy : 0.0058438777923583984 nb_pixel_total : 7301 time to create 1 rle with old method : 0.00788116455078125 time for calcul the mask position with numpy : 0.005776166915893555 nb_pixel_total : 22517 time to create 1 rle with old method : 0.024251461029052734 time for calcul the mask position with numpy : 0.005938529968261719 nb_pixel_total : 50449 time to create 1 rle with old method : 0.05400252342224121 time for calcul the mask position with numpy : 0.006319761276245117 nb_pixel_total : 42569 time to create 1 rle with old method : 0.04624319076538086 time for calcul the mask position with numpy : 0.006038665771484375 nb_pixel_total : 7938 time to create 1 rle with old method : 0.008708000183105469 time for calcul the mask position with numpy : 0.005946636199951172 nb_pixel_total : 7723 time to create 1 rle with old method : 0.008329629898071289 create new chi : 0.38988590240478516 time to delete rle : 0.00044536590576171875 batch 1 Loaded 13 chid ids of type : 3594 ++++++Number RLEs to save : 3266 TO DO : save crop sub photo not yet done ! save time : 0.25956225395202637 nb_obj : 5 nb_hashtags : 2 time to prepare the origin masks : 0.06531620025634766 time for calcul the mask position with numpy : 0.01861119270324707 nb_pixel_total : 2041676 time to create 1 rle with new method : 0.07946920394897461 time for calcul the mask position with numpy : 0.005819082260131836 nb_pixel_total : 5281 time to create 1 rle with old method : 0.00567936897277832 time for calcul the mask position with numpy : 0.0058841705322265625 nb_pixel_total : 9808 time to create 1 rle with old method : 0.010590076446533203 time for calcul the mask position with numpy : 0.006082057952880859 nb_pixel_total : 7595 time to create 1 rle with old method : 0.008346796035766602 time for calcul the mask position with numpy : 0.0059795379638671875 nb_pixel_total : 5108 time to create 1 rle with old method : 0.005498409271240234 time for calcul the mask position with numpy : 0.006136417388916016 nb_pixel_total : 4132 time to create 1 rle with old method : 0.004538774490356445 create new chi : 0.1693589687347412 time to delete rle : 0.00034046173095703125 batch 1 Loaded 11 chid ids of type : 3594 ++++++++Number RLEs to save : 2193 TO DO : save crop sub photo not yet done ! save time : 0.19539833068847656 nb_obj : 8 nb_hashtags : 4 time to prepare the origin masks : 0.3687417507171631 time for calcul the mask position with numpy : 0.06416654586791992 nb_pixel_total : 1971200 time to create 1 rle with new method : 0.1016991138458252 time for calcul the mask position with numpy : 0.006316661834716797 nb_pixel_total : 8219 time to create 1 rle with old method : 0.009500265121459961 time for calcul the mask position with numpy : 0.006134510040283203 nb_pixel_total : 9716 time to create 1 rle with old method : 0.011045694351196289 time for calcul the mask position with numpy : 0.006319284439086914 nb_pixel_total : 9746 time to create 1 rle with old method : 0.010870218276977539 time for calcul the mask position with numpy : 0.006579875946044922 nb_pixel_total : 8112 time to create 1 rle with old method : 0.009292125701904297 time for calcul the mask position with numpy : 0.006487607955932617 nb_pixel_total : 13044 time to create 1 rle with old method : 0.014979362487792969 time for calcul the mask position with numpy : 0.006458759307861328 nb_pixel_total : 7308 time to create 1 rle with old method : 0.008337736129760742 time for calcul the mask position with numpy : 0.006789207458496094 nb_pixel_total : 40066 time to create 1 rle with old method : 0.044785261154174805 time for calcul the mask position with numpy : 0.006386280059814453 nb_pixel_total : 6189 time to create 1 rle with old method : 0.006909847259521484 create new chi : 0.3435237407684326 time to delete rle : 0.0005037784576416016 batch 1 Loaded 17 chid ids of type : 3594 +++++++++++++Number RLEs to save : 3185 TO DO : save crop sub photo not yet done ! save time : 0.268221378326416 nb_obj : 8 nb_hashtags : 3 time to prepare the origin masks : 0.10417532920837402 time for calcul the mask position with numpy : 0.07570075988769531 nb_pixel_total : 2005820 time to create 1 rle with new method : 0.07670760154724121 time for calcul the mask position with numpy : 0.006034374237060547 nb_pixel_total : 1940 time to create 1 rle with old method : 0.0021288394927978516 time for calcul the mask position with numpy : 0.005967140197753906 nb_pixel_total : 4425 time to create 1 rle with old method : 0.004825592041015625 time for calcul the mask position with numpy : 0.005954265594482422 nb_pixel_total : 4389 time to create 1 rle with old method : 0.004950284957885742 time for calcul the mask position with numpy : 0.00586700439453125 nb_pixel_total : 1663 time to create 1 rle with old method : 0.0018391609191894531 time for calcul the mask position with numpy : 0.005885601043701172 nb_pixel_total : 3654 time to create 1 rle with old method : 0.003973484039306641 time for calcul the mask position with numpy : 0.0060579776763916016 nb_pixel_total : 2675 time to create 1 rle with old method : 0.0029256343841552734 time for calcul the mask position with numpy : 0.006123542785644531 nb_pixel_total : 5573 time to create 1 rle with old method : 0.006237983703613281 time for calcul the mask position with numpy : 0.00625300407409668 nb_pixel_total : 43461 time to create 1 rle with old method : 0.04767632484436035 create new chi : 0.28322625160217285 time to delete rle : 0.0004200935363769531 batch 1 Loaded 17 chid ids of type : 3594 ++++++++Number RLEs to save : 2314 TO DO : save crop sub photo not yet done ! save time : 0.1936943531036377 map_output_result : {1395925189: (0.0, 'Should be the crop_list due to order', 0), 1395925187: (0.0, 'Should be the crop_list due to order', 0), 1395925169: (0.0, 'Should be the crop_list due to order', 0), 1395924873: (0.0, 'Should be the crop_list due to order', 0), 1395924794: (0.0, 'Should be the crop_list due to order', 0.0), 1395924757: (0.0, 'Should be the crop_list due to order', 0), 1395924742: (0.0, 'Should be the crop_list due to order', 0), 1395924054: (0.0, 'Should be the crop_list due to order', 0), 1395923993: (0.0, 'Should be the crop_list due to order', 0), 1395923926: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1395925189, 1395925187, 1395925169, 1395924873, 1395924794, 1395924757, 1395924742, 1395924054, 1395923993, 1395923926] Looping around the photos to save general results len do output : 10 /1395925189.Didn't retrieve data . /1395925187.Didn't retrieve data . /1395925169.Didn't retrieve data . /1395924873.Didn't retrieve data . /1395924794.Didn't retrieve data . /1395924757.Didn't retrieve data . /1395924742.Didn't retrieve data . /1395924054.Didn't retrieve data . /1395923993.Didn't retrieve data . /1395923926.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4104491') ('3318', '28839450', '1395925189', None, None, None, None, None, '4104491') ('3318', None, None, None, None, None, None, None, '4104491') ('3318', '28839450', '1395925187', None, None, None, None, None, '4104491') ('3318', None, None, None, None, None, None, None, '4104491') ('3318', '28839450', '1395925169', None, None, None, None, None, '4104491') ('3318', None, None, None, None, None, None, None, '4104491') ('3318', '28839450', '1395924873', None, None, None, None, None, '4104491') ('3318', None, None, None, None, None, None, None, '4104491') ('3318', '28839450', '1395924794', None, None, None, None, None, '4104491') ('3318', None, None, None, None, None, None, None, '4104491') ('3318', '28839450', '1395924757', None, None, None, None, None, '4104491') ('3318', None, None, None, None, None, None, None, '4104491') ('3318', '28839450', '1395924742', None, None, None, None, None, '4104491') ('3318', None, None, None, None, None, None, None, '4104491') ('3318', '28839450', '1395924054', None, None, None, None, None, '4104491') ('3318', None, None, None, None, None, None, None, '4104491') ('3318', '28839450', '1395923993', None, None, None, None, None, '4104491') ('3318', None, None, None, None, None, None, None, '4104491') ('3318', '28839450', '1395923926', None, None, None, None, None, '4104491') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 30 time used for this insertion : 0.017800331115722656 save_final save missing photos in datou_result : time spend for datou_step_exec : 6.564051389694214 time spend to save output : 0.01825428009033203 total time spend for step 3 : 6.582305669784546 step4:ventilate_hashtags_in_portfolio Mon Nov 24 18:11:24 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 28839450 get user id for portfolio 28839450 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28839450 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','flou','autre','carton','background','pehd','pet_fonce','pet_clair','papier','mal_croppe','environnement')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28839450 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','flou','autre','carton','background','pehd','pet_fonce','pet_clair','papier','mal_croppe','environnement')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28839450 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','flou','autre','carton','background','pehd','pet_fonce','pet_clair','papier','mal_croppe','environnement')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/28839638,28839639,28839640,28839641,28839642,28839643,28839644,28839645,28839646,28839647,28839648?tags=metal,flou,autre,carton,background,pehd,pet_fonce,pet_clair,papier,mal_croppe,environnement Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1395925189, 1395925187, 1395925169, 1395924873, 1395924794, 1395924757, 1395924742, 1395924054, 1395923993, 1395923926] Looping around the photos to save general results len do output : 1 /28839450. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4104491') ('3318', '28839450', '1395925189', None, None, None, None, None, '4104491') ('3318', None, None, None, None, None, None, None, '4104491') ('3318', '28839450', '1395925187', None, None, None, None, None, '4104491') ('3318', None, None, None, None, None, None, None, '4104491') ('3318', '28839450', '1395925169', None, None, None, None, None, '4104491') ('3318', None, None, None, None, None, None, None, '4104491') ('3318', '28839450', '1395924873', None, None, None, None, None, '4104491') ('3318', None, None, None, None, None, None, None, '4104491') ('3318', '28839450', '1395924794', None, None, None, None, None, '4104491') ('3318', None, None, None, None, None, None, None, '4104491') ('3318', '28839450', '1395924757', None, None, None, None, None, '4104491') ('3318', None, None, None, None, None, None, None, '4104491') ('3318', '28839450', '1395924742', None, None, None, None, None, '4104491') ('3318', None, None, None, None, None, None, None, '4104491') ('3318', '28839450', '1395924054', None, None, None, None, None, '4104491') ('3318', None, None, None, None, None, None, None, '4104491') ('3318', '28839450', '1395923993', None, None, None, None, None, '4104491') ('3318', None, None, None, None, None, None, None, '4104491') ('3318', '28839450', '1395923926', None, None, None, None, None, '4104491') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.01865553855895996 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.9894604682922363 time spend to save output : 0.01894402503967285 total time spend for step 4 : 2.008404493331909 step5:final Mon Nov 24 18:11:26 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1395925189: ('0.039333285108024696',), 1395925187: ('0.039333285108024696',), 1395925169: ('0.039333285108024696',), 1395924873: ('0.039333285108024696',), 1395924794: ('0.039333285108024696',), 1395924757: ('0.039333285108024696',), 1395924742: ('0.039333285108024696',), 1395924054: ('0.039333285108024696',), 1395923993: ('0.039333285108024696',), 1395923926: ('0.039333285108024696',)} new output for save of step final : {1395925189: ('0.039333285108024696',), 1395925187: ('0.039333285108024696',), 1395925169: ('0.039333285108024696',), 1395924873: ('0.039333285108024696',), 1395924794: ('0.039333285108024696',), 1395924757: ('0.039333285108024696',), 1395924742: ('0.039333285108024696',), 1395924054: ('0.039333285108024696',), 1395923993: ('0.039333285108024696',), 1395923926: ('0.039333285108024696',)} [1395925189, 1395925187, 1395925169, 1395924873, 1395924794, 1395924757, 1395924742, 1395924054, 1395923993, 1395923926] Looping around the photos to save general results len do output : 10 /1395925189.Didn't retrieve data . /1395925187.Didn't retrieve data . /1395925169.Didn't retrieve data . /1395924873.Didn't retrieve data . /1395924794.Didn't retrieve data . /1395924757.Didn't retrieve data . /1395924742.Didn't retrieve data . /1395924054.Didn't retrieve data . /1395923993.Didn't retrieve data . /1395923926.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4104491') ('3318', '28839450', '1395925189', None, None, None, None, None, '4104491') ('3318', None, None, None, None, None, None, None, '4104491') ('3318', '28839450', '1395925187', None, None, None, None, None, '4104491') ('3318', None, None, None, None, None, None, None, '4104491') ('3318', '28839450', '1395925169', None, None, None, None, None, '4104491') ('3318', None, None, None, None, None, None, None, '4104491') ('3318', '28839450', '1395924873', None, None, None, None, None, '4104491') ('3318', None, None, None, None, None, None, None, '4104491') ('3318', '28839450', '1395924794', None, None, None, None, None, '4104491') ('3318', None, None, None, None, None, None, None, '4104491') ('3318', '28839450', '1395924757', None, None, None, None, None, '4104491') ('3318', None, None, None, None, None, None, None, '4104491') ('3318', '28839450', '1395924742', None, None, None, None, None, '4104491') ('3318', None, None, None, None, None, None, None, '4104491') ('3318', '28839450', '1395924054', None, None, None, None, None, '4104491') ('3318', None, None, None, None, None, None, None, '4104491') ('3318', '28839450', '1395923993', None, None, None, None, None, '4104491') ('3318', None, None, None, None, None, None, None, '4104491') ('3318', '28839450', '1395923926', None, None, None, None, None, '4104491') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 30 time used for this insertion : 0.019093990325927734 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.15617585182189941 time spend to save output : 0.019599437713623047 total time spend for step 5 : 0.17577528953552246 step6:blur_detection Mon Nov 24 18:11:26 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1764004229_109147_1395925189_45b5884b8199060d9b7cad31ee5119d5.jpg resize: (1080, 1920) 1395925189 -1.5877289990779204 treat image : temp/1764004229_109147_1395925187_264bd4118c474b9a190761502e290bde.jpg resize: (1080, 1920) 1395925187 0.31572540172094055 treat image : temp/1764004229_109147_1395925169_c3d32cdde9195e09bd2ef62561aac669.jpg resize: (1080, 1920) 1395925169 0.8981203592811174 treat image : temp/1764004229_109147_1395924873_f92b6c712b47cb36167623033a816b76.jpg resize: (1080, 1920) 1395924873 -3.788666001036635 treat image : temp/1764004229_109147_1395924794_0d30fbf8578609a832903e9477b223e1.jpg resize: (1080, 1920) 1395924794 0.47928620954150875 treat image : temp/1764004229_109147_1395924757_7d29a282e53d7c99335344c7a8cdbe76.jpg resize: (1080, 1920) 1395924757 -3.5854995005818875 treat image : temp/1764004229_109147_1395924742_a550332d376f66da8bdbe86d3fd0dde6.jpg resize: (1080, 1920) 1395924742 0.6718285632153823 treat image : temp/1764004229_109147_1395924054_bf783c39ef4e0865027a7f57dcbc7d45.jpg resize: (1080, 1920) 1395924054 0.6214800140891591 treat image : temp/1764004229_109147_1395923993_035566727230bed29c027b483da0595f.jpg resize: (1080, 1920) 1395923993 -3.5721679411407012 treat image : temp/1764004229_109147_1395923926_1092014368b138ff64b8def801027a83.jpg resize: (1080, 1920) 1395923926 -2.8222481839023037 treat image : temp/1764004229_109147_1395925189_45b5884b8199060d9b7cad31ee5119d5_rle_crop_4043910211_0.png resize: (149, 116) 1395935560 -2.2946979838068517 treat image : temp/1764004229_109147_1395925189_45b5884b8199060d9b7cad31ee5119d5_rle_crop_4043910212_0.png resize: (56, 118) 1395935561 -1.870055836511312 treat image : temp/1764004229_109147_1395925189_45b5884b8199060d9b7cad31ee5119d5_rle_crop_4043910215_0.png resize: (112, 103) 1395935562 -1.3887071128070572 treat image : temp/1764004229_109147_1395925187_264bd4118c474b9a190761502e290bde_rle_crop_4043910216_0.png resize: (123, 113) 1395935563 6.965779053140763 treat image : temp/1764004229_109147_1395925187_264bd4118c474b9a190761502e290bde_rle_crop_4043910217_0.png resize: (137, 169) 1395935564 -1.7434688674835666 treat image : temp/1764004229_109147_1395925187_264bd4118c474b9a190761502e290bde_rle_crop_4043910221_0.png resize: (214, 214) 1395935565 -1.0357746241528927 treat image : temp/1764004229_109147_1395925169_c3d32cdde9195e09bd2ef62561aac669_rle_crop_4043910223_0.png resize: (169, 160) 1395935566 -1.1445890459632586 treat image : temp/1764004229_109147_1395925169_c3d32cdde9195e09bd2ef62561aac669_rle_crop_4043910224_0.png resize: (78, 56) 1395935567 0.1400631673894715 treat image : temp/1764004229_109147_1395925169_c3d32cdde9195e09bd2ef62561aac669_rle_crop_4043910226_0.png resize: (71, 36) 1395935568 20.0 treat image : temp/1764004229_109147_1395924873_f92b6c712b47cb36167623033a816b76_rle_crop_4043910231_0.png resize: (81, 243) 1395935569 -5.402604428813955 treat image : temp/1764004229_109147_1395924757_7d29a282e53d7c99335344c7a8cdbe76_rle_crop_4043910233_0.png resize: (86, 71) 1395935570 4.333926556238041 treat image : temp/1764004229_109147_1395924757_7d29a282e53d7c99335344c7a8cdbe76_rle_crop_4043910234_0.png resize: (60, 109) 1395935571 -2.2451116307052046 treat image : temp/1764004229_109147_1395924742_a550332d376f66da8bdbe86d3fd0dde6_rle_crop_4043910238_0.png resize: (307, 307) 1395935572 -0.08329343867913123 treat image : temp/1764004229_109147_1395924742_a550332d376f66da8bdbe86d3fd0dde6_rle_crop_4043910239_0.png resize: (151, 415) 1395935573 -1.3376207284514043 treat image : temp/1764004229_109147_1395924742_a550332d376f66da8bdbe86d3fd0dde6_rle_crop_4043910241_0.png resize: (82, 147) 1395935574 -1.1645042222083535 treat image : temp/1764004229_109147_1395924054_bf783c39ef4e0865027a7f57dcbc7d45_rle_crop_4043910242_0.png resize: (93, 76) 1395935575 -0.7996311131822028 treat image : temp/1764004229_109147_1395924054_bf783c39ef4e0865027a7f57dcbc7d45_rle_crop_4043910243_0.png resize: (77, 99) 1395935577 1.4381675262238491 treat image : temp/1764004229_109147_1395924054_bf783c39ef4e0865027a7f57dcbc7d45_rle_crop_4043910244_0.png resize: (124, 139) 1395935578 -0.5900125035760151 treat image : temp/1764004229_109147_1395924054_bf783c39ef4e0865027a7f57dcbc7d45_rle_crop_4043910245_0.png resize: (108, 154) 1395935579 -2.3355478772733465 treat image : temp/1764004229_109147_1395923993_035566727230bed29c027b483da0595f_rle_crop_4043910248_0.png resize: (226, 303) 1395935580 -1.943665713580564 treat image : temp/1764004229_109147_1395923993_035566727230bed29c027b483da0595f_rle_crop_4043910250_0.png resize: (127, 161) 1395935581 -4.195433151727011 treat image : temp/1764004229_109147_1395923993_035566727230bed29c027b483da0595f_rle_crop_4043910253_0.png resize: (111, 115) 1395935582 -5.403568404414569 treat image : temp/1764004229_109147_1395923926_1092014368b138ff64b8def801027a83_rle_crop_4043910255_0.png resize: (206, 266) 1395935583 -4.111106396429801 treat image : temp/1764004229_109147_1395923926_1092014368b138ff64b8def801027a83_rle_crop_4043910256_0.png resize: (56, 116) 1395935584 -1.307437256653085 treat image : temp/1764004229_109147_1395923926_1092014368b138ff64b8def801027a83_rle_crop_4043910257_0.png resize: (47, 80) 1395935585 0.469295620405823 treat image : temp/1764004229_109147_1395923926_1092014368b138ff64b8def801027a83_rle_crop_4043910259_0.png resize: (50, 50) 1395935586 -0.13954009744307214 treat image : temp/1764004229_109147_1395923926_1092014368b138ff64b8def801027a83_rle_crop_4043910260_0.png resize: (59, 99) 1395935587 1.669146318493792 treat image : temp/1764004229_109147_1395923926_1092014368b138ff64b8def801027a83_rle_crop_4043910262_0.png resize: (53, 59) 1395935588 -2.7420070935718 treat image : temp/1764004229_109147_1395925187_264bd4118c474b9a190761502e290bde_rle_crop_4043910220_0.png resize: (113, 107) 1395935591 -1.9153947763545263 treat image : temp/1764004229_109147_1395924873_f92b6c712b47cb36167623033a816b76_rle_crop_4043910232_0.png resize: (310, 300) 1395935592 -1.2809565222907537 treat image : temp/1764004229_109147_1395924757_7d29a282e53d7c99335344c7a8cdbe76_rle_crop_4043910235_0.png resize: (72, 84) 1395935593 -1.9140380931121974 treat image : temp/1764004229_109147_1395924742_a550332d376f66da8bdbe86d3fd0dde6_rle_crop_4043910236_0.png resize: (73, 154) 1395935594 -1.1557684199547276 treat image : temp/1764004229_109147_1395924742_a550332d376f66da8bdbe86d3fd0dde6_rle_crop_4043910240_0.png resize: (276, 138) 1395935595 -2.4643306803826013 treat image : temp/1764004229_109147_1395923993_035566727230bed29c027b483da0595f_rle_crop_4043910247_0.png resize: (76, 96) 1395935596 2.0031569823705375 treat image : temp/1764004229_109147_1395923993_035566727230bed29c027b483da0595f_rle_crop_4043910251_0.png resize: (72, 177) 1395935598 -3.4704919334783435 treat image : temp/1764004229_109147_1395923993_035566727230bed29c027b483da0595f_rle_crop_4043910252_0.png resize: (136, 94) 1395935599 -1.0851534691766618 treat image : temp/1764004229_109147_1395923993_035566727230bed29c027b483da0595f_rle_crop_4043910249_0.png resize: (109, 81) 1395935600 -1.7159415827387325 treat image : temp/1764004229_109147_1395925189_45b5884b8199060d9b7cad31ee5119d5_rle_crop_4043910213_0.png resize: (161, 274) 1395935602 -1.5095614224720615 treat image : temp/1764004229_109147_1395925189_45b5884b8199060d9b7cad31ee5119d5_rle_crop_4043910214_0.png resize: (88, 152) 1395935603 -2.2476627061278633 treat image : temp/1764004229_109147_1395925187_264bd4118c474b9a190761502e290bde_rle_crop_4043910218_0.png resize: (120, 145) 1395935604 -0.98177693273077 treat image : temp/1764004229_109147_1395925187_264bd4118c474b9a190761502e290bde_rle_crop_4043910219_0.png resize: (224, 539) 1395935606 -1.5752061333676708 treat image : temp/1764004229_109147_1395925187_264bd4118c474b9a190761502e290bde_rle_crop_4043910222_0.png resize: (115, 253) 1395935607 -1.0088311320214673 treat image : temp/1764004229_109147_1395925169_c3d32cdde9195e09bd2ef62561aac669_rle_crop_4043910225_0.png resize: (82, 194) 1395935608 1.7448538519470267 treat image : temp/1764004229_109147_1395924873_f92b6c712b47cb36167623033a816b76_rle_crop_4043910227_0.png resize: (104, 248) 1395935609 -3.6795477273109287 treat image : temp/1764004229_109147_1395924873_f92b6c712b47cb36167623033a816b76_rle_crop_4043910228_0.png resize: (185, 269) 1395935610 -3.526022451776613 treat image : temp/1764004229_109147_1395924873_f92b6c712b47cb36167623033a816b76_rle_crop_4043910229_0.png resize: (424, 309) 1395935611 -0.2717887179829348 treat image : temp/1764004229_109147_1395924873_f92b6c712b47cb36167623033a816b76_rle_crop_4043910230_0.png resize: (170, 113) 1395935612 -1.4327642254640367 treat image : temp/1764004229_109147_1395924742_a550332d376f66da8bdbe86d3fd0dde6_rle_crop_4043910237_0.png resize: (132, 73) 1395935613 -1.5160113656223795 treat image : temp/1764004229_109147_1395924054_bf783c39ef4e0865027a7f57dcbc7d45_rle_crop_4043910246_0.png resize: (80, 91) 1395935614 0.46283120994848514 treat image : temp/1764004229_109147_1395923993_035566727230bed29c027b483da0595f_rle_crop_4043910254_0.png resize: (103, 187) 1395935615 -3.404718037106492 treat image : temp/1764004229_109147_1395923926_1092014368b138ff64b8def801027a83_rle_crop_4043910261_0.png resize: (70, 116) 1395935616 -1.9878670982962472 treat image : temp/1764004229_109147_1395923926_1092014368b138ff64b8def801027a83_rle_crop_4043910258_0.png resize: (41, 114) 1395935617 0.2221344399416642 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 62 time used for this insertion : 0.017255544662475586 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 62 time used for this insertion : 0.020853042602539062 save missing photos in datou_result : time spend for datou_step_exec : 8.121477127075195 time spend to save output : 0.04393577575683594 total time spend for step 6 : 8.165412902832031 step7:brightness Mon Nov 24 18:11:34 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1764004229_109147_1395925189_45b5884b8199060d9b7cad31ee5119d5.jpg treat image : temp/1764004229_109147_1395925187_264bd4118c474b9a190761502e290bde.jpg treat image : temp/1764004229_109147_1395925169_c3d32cdde9195e09bd2ef62561aac669.jpg treat image : temp/1764004229_109147_1395924873_f92b6c712b47cb36167623033a816b76.jpg treat image : temp/1764004229_109147_1395924794_0d30fbf8578609a832903e9477b223e1.jpg treat image : temp/1764004229_109147_1395924757_7d29a282e53d7c99335344c7a8cdbe76.jpg treat image : temp/1764004229_109147_1395924742_a550332d376f66da8bdbe86d3fd0dde6.jpg treat image : temp/1764004229_109147_1395924054_bf783c39ef4e0865027a7f57dcbc7d45.jpg treat image : temp/1764004229_109147_1395923993_035566727230bed29c027b483da0595f.jpg treat image : temp/1764004229_109147_1395923926_1092014368b138ff64b8def801027a83.jpg treat image : temp/1764004229_109147_1395925189_45b5884b8199060d9b7cad31ee5119d5_rle_crop_4043910211_0.png treat image : temp/1764004229_109147_1395925189_45b5884b8199060d9b7cad31ee5119d5_rle_crop_4043910212_0.png treat image : temp/1764004229_109147_1395925189_45b5884b8199060d9b7cad31ee5119d5_rle_crop_4043910215_0.png treat image : temp/1764004229_109147_1395925187_264bd4118c474b9a190761502e290bde_rle_crop_4043910216_0.png treat image : temp/1764004229_109147_1395925187_264bd4118c474b9a190761502e290bde_rle_crop_4043910217_0.png treat image : temp/1764004229_109147_1395925187_264bd4118c474b9a190761502e290bde_rle_crop_4043910221_0.png treat image : temp/1764004229_109147_1395925169_c3d32cdde9195e09bd2ef62561aac669_rle_crop_4043910223_0.png treat image : temp/1764004229_109147_1395925169_c3d32cdde9195e09bd2ef62561aac669_rle_crop_4043910224_0.png treat image : temp/1764004229_109147_1395925169_c3d32cdde9195e09bd2ef62561aac669_rle_crop_4043910226_0.png treat image : temp/1764004229_109147_1395924873_f92b6c712b47cb36167623033a816b76_rle_crop_4043910231_0.png treat image : temp/1764004229_109147_1395924757_7d29a282e53d7c99335344c7a8cdbe76_rle_crop_4043910233_0.png treat image : temp/1764004229_109147_1395924757_7d29a282e53d7c99335344c7a8cdbe76_rle_crop_4043910234_0.png treat image : temp/1764004229_109147_1395924742_a550332d376f66da8bdbe86d3fd0dde6_rle_crop_4043910238_0.png treat image : temp/1764004229_109147_1395924742_a550332d376f66da8bdbe86d3fd0dde6_rle_crop_4043910239_0.png treat image : temp/1764004229_109147_1395924742_a550332d376f66da8bdbe86d3fd0dde6_rle_crop_4043910241_0.png treat image : temp/1764004229_109147_1395924054_bf783c39ef4e0865027a7f57dcbc7d45_rle_crop_4043910242_0.png treat image : temp/1764004229_109147_1395924054_bf783c39ef4e0865027a7f57dcbc7d45_rle_crop_4043910243_0.png treat image : temp/1764004229_109147_1395924054_bf783c39ef4e0865027a7f57dcbc7d45_rle_crop_4043910244_0.png treat image : temp/1764004229_109147_1395924054_bf783c39ef4e0865027a7f57dcbc7d45_rle_crop_4043910245_0.png treat image : temp/1764004229_109147_1395923993_035566727230bed29c027b483da0595f_rle_crop_4043910248_0.png treat image : temp/1764004229_109147_1395923993_035566727230bed29c027b483da0595f_rle_crop_4043910250_0.png treat image : temp/1764004229_109147_1395923993_035566727230bed29c027b483da0595f_rle_crop_4043910253_0.png treat image : temp/1764004229_109147_1395923926_1092014368b138ff64b8def801027a83_rle_crop_4043910255_0.png treat image : temp/1764004229_109147_1395923926_1092014368b138ff64b8def801027a83_rle_crop_4043910256_0.png treat image : temp/1764004229_109147_1395923926_1092014368b138ff64b8def801027a83_rle_crop_4043910257_0.png treat image : temp/1764004229_109147_1395923926_1092014368b138ff64b8def801027a83_rle_crop_4043910259_0.png treat image : temp/1764004229_109147_1395923926_1092014368b138ff64b8def801027a83_rle_crop_4043910260_0.png treat image : temp/1764004229_109147_1395923926_1092014368b138ff64b8def801027a83_rle_crop_4043910262_0.png treat image : temp/1764004229_109147_1395925187_264bd4118c474b9a190761502e290bde_rle_crop_4043910220_0.png treat image : temp/1764004229_109147_1395924873_f92b6c712b47cb36167623033a816b76_rle_crop_4043910232_0.png treat image : temp/1764004229_109147_1395924757_7d29a282e53d7c99335344c7a8cdbe76_rle_crop_4043910235_0.png treat image : temp/1764004229_109147_1395924742_a550332d376f66da8bdbe86d3fd0dde6_rle_crop_4043910236_0.png treat image : temp/1764004229_109147_1395924742_a550332d376f66da8bdbe86d3fd0dde6_rle_crop_4043910240_0.png treat image : temp/1764004229_109147_1395923993_035566727230bed29c027b483da0595f_rle_crop_4043910247_0.png treat image : temp/1764004229_109147_1395923993_035566727230bed29c027b483da0595f_rle_crop_4043910251_0.png treat image : temp/1764004229_109147_1395923993_035566727230bed29c027b483da0595f_rle_crop_4043910252_0.png treat image : temp/1764004229_109147_1395923993_035566727230bed29c027b483da0595f_rle_crop_4043910249_0.png treat image : temp/1764004229_109147_1395925189_45b5884b8199060d9b7cad31ee5119d5_rle_crop_4043910213_0.png treat image : temp/1764004229_109147_1395925189_45b5884b8199060d9b7cad31ee5119d5_rle_crop_4043910214_0.png treat image : temp/1764004229_109147_1395925187_264bd4118c474b9a190761502e290bde_rle_crop_4043910218_0.png treat image : temp/1764004229_109147_1395925187_264bd4118c474b9a190761502e290bde_rle_crop_4043910219_0.png treat image : temp/1764004229_109147_1395925187_264bd4118c474b9a190761502e290bde_rle_crop_4043910222_0.png treat image : temp/1764004229_109147_1395925169_c3d32cdde9195e09bd2ef62561aac669_rle_crop_4043910225_0.png treat image : temp/1764004229_109147_1395924873_f92b6c712b47cb36167623033a816b76_rle_crop_4043910227_0.png treat image : temp/1764004229_109147_1395924873_f92b6c712b47cb36167623033a816b76_rle_crop_4043910228_0.png treat image : temp/1764004229_109147_1395924873_f92b6c712b47cb36167623033a816b76_rle_crop_4043910229_0.png treat image : temp/1764004229_109147_1395924873_f92b6c712b47cb36167623033a816b76_rle_crop_4043910230_0.png treat image : temp/1764004229_109147_1395924742_a550332d376f66da8bdbe86d3fd0dde6_rle_crop_4043910237_0.png treat image : temp/1764004229_109147_1395924054_bf783c39ef4e0865027a7f57dcbc7d45_rle_crop_4043910246_0.png treat image : temp/1764004229_109147_1395923993_035566727230bed29c027b483da0595f_rle_crop_4043910254_0.png treat image : temp/1764004229_109147_1395923926_1092014368b138ff64b8def801027a83_rle_crop_4043910261_0.png treat image : temp/1764004229_109147_1395923926_1092014368b138ff64b8def801027a83_rle_crop_4043910258_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 62 time used for this insertion : 0.018688440322875977 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 62 time used for this insertion : 0.02006077766418457 save missing photos in datou_result : time spend for datou_step_exec : 2.384228467941284 time spend to save output : 0.04437875747680664 total time spend for step 7 : 2.428607225418091 step8:velours_tree Mon Nov 24 18:11:36 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.12794756889343262 time spend to save output : 3.266334533691406e-05 total time spend for step 8 : 0.12798023223876953 step9:send_mail_cod Mon Nov 24 18:11:36 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P28839450_24-11-2025_18_11_36.pdf 28839638 change filename to text .imagette288396381764004296 28839639 imagette288396391764004297 28839640 change filename to text .imagette288396401764004297 28839641 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette288396411764004297 28839642 imagette288396421764004297 28839643 imagette288396431764004297 28839644 imagette288396441764004297 28839645 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette288396451764004297 28839646 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette288396461764004298 28839647 imagette288396471764004300 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=28839450 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/28839638,28839639,28839640,28839641,28839642,28839643,28839644,28839645,28839646,28839647,28839648?tags=metal,flou,autre,carton,background,pehd,pet_fonce,pet_clair,papier,mal_croppe,environnement args[1395925189] : ((1395925189, -1.5877289990779204, 492688767), (1395925189, 0.8554446379071287, 2107752395), '0.039333285108024696') We are sending mail with results at report@fotonower.com args[1395925187] : ((1395925187, 0.31572540172094055, 492688767), (1395925187, 0.8365723882707156, 2107752395), '0.039333285108024696') We are sending mail with results at report@fotonower.com args[1395925169] : ((1395925169, 0.8981203592811174, 492688767), (1395925169, 0.7906811809797182, 2107752395), '0.039333285108024696') We are sending mail with results at report@fotonower.com args[1395924873] : ((1395924873, -3.788666001036635, 492609224), (1395924873, 0.5020061443512119, 2107752395), '0.039333285108024696') We are sending mail with results at report@fotonower.com args[1395924794] : ((1395924794, 0.47928620954150875, 492688767), (1395924794, 0.719146696869533, 2107752395), '0.039333285108024696') We are sending mail with results at report@fotonower.com args[1395924757] : ((1395924757, -3.5854995005818875, 492609224), (1395924757, 0.5507272518351918, 2107752395), '0.039333285108024696') We are sending mail with results at report@fotonower.com args[1395924742] : ((1395924742, 0.6718285632153823, 492688767), (1395924742, 0.7743862617150067, 2107752395), '0.039333285108024696') We are sending mail with results at report@fotonower.com args[1395924054] : ((1395924054, 0.6214800140891591, 492688767), (1395924054, 0.4144419568933389, 2107752395), '0.039333285108024696') We are sending mail with results at report@fotonower.com args[1395923993] : ((1395923993, -3.5721679411407012, 492609224), (1395923993, 0.22158775955130786, 2107752395), '0.039333285108024696') We are sending mail with results at report@fotonower.com args[1395923926] : ((1395923926, -2.8222481839023037, 492609224), (1395923926, 0.35597586296181344, 2107752395), '0.039333285108024696') We are sending mail with results at report@fotonower.com refus_total : 0.039333285108024696 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos_view ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=28839450 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28839450_24-11-2025_18_11_36.pdf results_Auto_P28839450_24-11-2025_18_11_36.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28839450_24-11-2025_18_11_36.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','28839450','results_Auto_P28839450_24-11-2025_18_11_36.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28839450_24-11-2025_18_11_36.pdf','pdf','','0.2','0.039333285108024696') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/28839450

https://www.fotonower.com/image?json=false&list_photos_id=1395925189
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1395925187
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1395925169
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1395924873
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1395924794
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1395924757
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1395924742
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1395924054
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1395923993
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1395923926
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 3.93%
Veuillez trouver les photos des contaminants.

exemples de contaminants: metal: https://www.fotonower.com/view/28839638?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/28839640?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/28839641?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/28839645?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/28839646?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28839450_24-11-2025_18_11_36.pdf.

Lien vers velours :https://marlene.fotonower.com/velours/28839638,28839639,28839640,28839641,28839642,28839643,28839644,28839645,28839646,28839647,28839648?tags=metal,flou,autre,carton,background,pehd,pet_fonce,pet_clair,papier,mal_croppe,environnement.


L'équipe Fotonower 202 b'' Date: Mon, 24 Nov 2025 17:11:41 GMT Content-Length: 0 Connection: close Server: nginx X-Message-Id: RM69hvA9QCu3wJya2zpOaQ Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1395925189, 1395925187, 1395925169, 1395924873, 1395924794, 1395924757, 1395924742, 1395924054, 1395923993, 1395923926] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4104491') ('3318', '28839450', '1395925189', None, None, None, None, None, '4104491') ('3318', None, None, None, None, None, None, None, '4104491') ('3318', '28839450', '1395925187', None, None, None, None, None, '4104491') ('3318', None, None, None, None, None, None, None, '4104491') ('3318', '28839450', '1395925169', None, None, None, None, None, '4104491') ('3318', None, None, None, None, None, None, None, '4104491') ('3318', '28839450', '1395924873', None, None, None, None, None, '4104491') ('3318', None, None, None, None, None, None, None, '4104491') ('3318', '28839450', '1395924794', None, None, None, None, None, '4104491') ('3318', None, None, None, None, None, None, None, '4104491') ('3318', '28839450', '1395924757', None, None, None, None, None, '4104491') ('3318', None, None, None, None, None, None, None, '4104491') ('3318', '28839450', '1395924742', None, None, None, None, None, '4104491') ('3318', None, None, None, None, None, None, None, '4104491') ('3318', '28839450', '1395924054', None, None, None, None, None, '4104491') ('3318', None, None, None, None, None, None, None, '4104491') ('3318', '28839450', '1395923993', None, None, None, None, None, '4104491') ('3318', None, None, None, None, None, None, None, '4104491') ('3318', '28839450', '1395923926', None, None, None, None, None, '4104491') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.018999814987182617 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.740577697753906 time spend to save output : 0.019215822219848633 total time spend for step 9 : 4.759793519973755 step10:split_time_score Mon Nov 24 18:11:41 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('17', 10),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 24112025 28839450 Nombre de photos uploadées : 10 / 23040 (0%) 24112025 28839450 Nombre de photos taguées (types de déchets): 0 / 10 (0%) 24112025 28839450 Nombre de photos taguées (volume) : 0 / 10 (0%) elapsed_time : load_data_split_time_score 1.6689300537109375e-06 elapsed_time : order_list_meta_photo_and_scores 6.9141387939453125e-06 ?????????? elapsed_time : fill_and_build_computed_from_old_data 0.000591278076171875 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.23578476905822754 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.1292190272955247 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28828426_24-11-2025_14_21_29.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28828426 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28828426 AND mptpi.`type`=3594 To do Qualite : 0.07383158114711934 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28828428_24-11-2025_14_31_44.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28828428 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28828428 AND mptpi.`type`=3594 To do Qualite : 0.07008904145622898 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28828431_24-11-2025_13_52_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28828431 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28828431 AND mptpi.`type`=3594 To do Qualite : 0.25237177426268853 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28828433_24-11-2025_12_21_46.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28828433 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28828433 AND mptpi.`type`=3594 To do Qualite : 0.021958550347222217 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28828435_24-11-2025_12_41_57.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28828435 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28828435 AND mptpi.`type`=3594 To do Qualite : 0.05147855581275721 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28828444_24-11-2025_12_11_42.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28828444 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28828444 AND mptpi.`type`=3594 To do Qualite : 0.030636240206552704 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28829905_24-11-2025_13_41_32.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28829905 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28829905 AND mptpi.`type`=3594 To do Qualite : 0.03575169994212963 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28829907_24-11-2025_13_23_01.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28829907 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28829907 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28838759 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28838789 order by id desc limit 1 Qualite : 0.06617281539351852 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28838790_24-11-2025_18_01_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28838790 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28838790 AND mptpi.`type`=3594 To do Qualite : 0.16357031249999998 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28838794_24-11-2025_17_51_57.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28838794 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28838794 AND mptpi.`type`=3594 To do Qualite : 0.08623340115989649 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28838796_24-11-2025_17_42_40.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28838796 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28838796 AND mptpi.`type`=3594 To do Qualite : 0.039333285108024696 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28839450_24-11-2025_18_11_36.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28839450 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28839450 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'24112025': {'nb_upload': 10, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1395925189, 1395925187, 1395925169, 1395924873, 1395924794, 1395924757, 1395924742, 1395924054, 1395923993, 1395923926] Looping around the photos to save general results len do output : 1 /28839450Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4104491') ('3318', '28839450', '1395925189', None, None, None, None, None, '4104491') ('3318', None, None, None, None, None, None, None, '4104491') ('3318', '28839450', '1395925187', None, None, None, None, None, '4104491') ('3318', None, None, None, None, None, None, None, '4104491') ('3318', '28839450', '1395925169', None, None, None, None, None, '4104491') ('3318', None, None, None, None, None, None, None, '4104491') ('3318', '28839450', '1395924873', None, None, None, None, None, '4104491') ('3318', None, None, None, None, None, None, None, '4104491') ('3318', '28839450', '1395924794', None, None, None, None, None, '4104491') ('3318', None, None, None, None, None, None, None, '4104491') ('3318', '28839450', '1395924757', None, None, None, None, None, '4104491') ('3318', None, None, None, None, None, None, None, '4104491') ('3318', '28839450', '1395924742', None, None, None, None, None, '4104491') ('3318', None, None, None, None, None, None, None, '4104491') ('3318', '28839450', '1395924054', None, None, None, None, None, '4104491') ('3318', None, None, None, None, None, None, None, '4104491') ('3318', '28839450', '1395923993', None, None, None, None, None, '4104491') ('3318', None, None, None, None, None, None, None, '4104491') ('3318', '28839450', '1395923926', None, None, None, None, None, '4104491') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.015156745910644531 save_final save missing photos in datou_result : time spend for datou_step_exec : 3.6925716400146484 time spend to save output : 0.015359640121459961 total time spend for step 10 : 3.7079312801361084 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 10 set_done_treatment 34.76user 17.56system 1:19.80elapsed 65%CPU (0avgtext+0avgdata 2878380maxresident)k 2240080inputs+16176outputs (8181major+1470990minor)pagefaults 0swaps