python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2533687 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3988924'] with mtr_portfolio_ids : ['28108358'] and first list_photo_ids : [] new path : /proc/2533687/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 20 ; length of list_pids : 20 ; length of list_args : 20 time to download the photos : 2.9760851860046387 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Mon Nov 3 19:40:33 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10553 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-11-03 19:40:35.990982: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-11-03 19:40:36.018649: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493010000 Hz 2025-11-03 19:40:36.020817: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f8ebc000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-11-03 19:40:36.020885: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-11-03 19:40:36.024813: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-11-03 19:40:36.157704: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x22be9160 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-11-03 19:40:36.157742: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-11-03 19:40:36.158872: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-11-03 19:40:36.159178: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-03 19:40:36.161235: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-03 19:40:36.163219: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-11-03 19:40:36.163586: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-11-03 19:40:36.165800: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-11-03 19:40:36.167019: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-11-03 19:40:36.171624: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-11-03 19:40:36.173387: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-11-03 19:40:36.173461: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-03 19:40:36.174386: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-11-03 19:40:36.174405: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-11-03 19:40:36.174415: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-11-03 19:40:36.176057: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9633 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-11-03 19:40:36.474106: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-11-03 19:40:36.474198: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-03 19:40:36.474225: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-03 19:40:36.474250: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-11-03 19:40:36.474316: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-11-03 19:40:36.474350: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-11-03 19:40:36.474375: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-11-03 19:40:36.474398: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-11-03 19:40:36.475936: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-11-03 19:40:36.477081: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-11-03 19:40:36.477113: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-03 19:40:36.477129: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-03 19:40:36.477142: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-11-03 19:40:36.477156: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-11-03 19:40:36.477169: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-11-03 19:40:36.477182: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-11-03 19:40:36.477196: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-11-03 19:40:36.478449: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-11-03 19:40:36.478478: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-11-03 19:40:36.478486: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-11-03 19:40:36.478494: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-11-03 19:40:36.479804: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9633 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-11-03 19:40:45.551071: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-03 19:40:45.784854: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 20 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 44.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 9.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 48.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 47.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 21.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 56.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 49.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 39.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 46.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 47.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 37.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 41.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 48.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 1 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 34.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 38.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 42.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 45.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 49.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 49.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 33.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 15 Detection mask done ! Trying to reset tf kernel 2534421 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 294 tf kernel not reseted sub process len(results) : 20 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 20 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5583 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.00036406517028808594 nb_pixel_total : 13498 time to create 1 rle with old method : 0.019056081771850586 length of segment : 118 time for calcul the mask position with numpy : 0.00035953521728515625 nb_pixel_total : 14986 time to create 1 rle with old method : 0.01690196990966797 length of segment : 187 time for calcul the mask position with numpy : 0.00014710426330566406 nb_pixel_total : 6305 time to create 1 rle with old method : 0.007035017013549805 length of segment : 125 time for calcul the mask position with numpy : 0.00015306472778320312 nb_pixel_total : 7743 time to create 1 rle with old method : 0.008666753768920898 length of segment : 104 time for calcul the mask position with numpy : 7.724761962890625e-05 nb_pixel_total : 3003 time to create 1 rle with old method : 0.003463268280029297 length of segment : 65 time for calcul the mask position with numpy : 0.00019073486328125 nb_pixel_total : 9408 time to create 1 rle with old method : 0.01093435287475586 length of segment : 103 time for calcul the mask position with numpy : 0.0007998943328857422 nb_pixel_total : 50668 time to create 1 rle with old method : 0.05659151077270508 length of segment : 197 time for calcul the mask position with numpy : 0.00018167495727539062 nb_pixel_total : 10984 time to create 1 rle with old method : 0.012292146682739258 length of segment : 99 time for calcul the mask position with numpy : 0.0001590251922607422 nb_pixel_total : 8915 time to create 1 rle with old method : 0.009681224822998047 length of segment : 195 time for calcul the mask position with numpy : 0.00027251243591308594 nb_pixel_total : 14892 time to create 1 rle with old method : 0.01668238639831543 length of segment : 209 time for calcul the mask position with numpy : 0.0012562274932861328 nb_pixel_total : 74108 time to create 1 rle with old method : 0.08160734176635742 length of segment : 562 time for calcul the mask position with numpy : 0.0002486705780029297 nb_pixel_total : 13937 time to create 1 rle with old method : 0.015789508819580078 length of segment : 209 time for calcul the mask position with numpy : 0.00015282630920410156 nb_pixel_total : 4981 time to create 1 rle with old method : 0.005647182464599609 length of segment : 83 time for calcul the mask position with numpy : 0.002125263214111328 nb_pixel_total : 117350 time to create 1 rle with old method : 0.1270754337310791 length of segment : 547 time for calcul the mask position with numpy : 0.0005195140838623047 nb_pixel_total : 23520 time to create 1 rle with old method : 0.02634716033935547 length of segment : 159 time for calcul the mask position with numpy : 0.0002040863037109375 nb_pixel_total : 13880 time to create 1 rle with old method : 0.015428781509399414 length of segment : 147 time for calcul the mask position with numpy : 0.00016570091247558594 nb_pixel_total : 7573 time to create 1 rle with old method : 0.008573293685913086 length of segment : 207 time for calcul the mask position with numpy : 0.00016546249389648438 nb_pixel_total : 8395 time to create 1 rle with old method : 0.009516477584838867 length of segment : 118 time for calcul the mask position with numpy : 0.0002951622009277344 nb_pixel_total : 14801 time to create 1 rle with old method : 0.016078710556030273 length of segment : 401 time for calcul the mask position with numpy : 0.01890110969543457 nb_pixel_total : 974279 time to create 1 rle with new method : 0.03420257568359375 length of segment : 1689 time for calcul the mask position with numpy : 0.0003304481506347656 nb_pixel_total : 13578 time to create 1 rle with old method : 0.015567779541015625 length of segment : 262 time for calcul the mask position with numpy : 0.0017242431640625 nb_pixel_total : 110650 time to create 1 rle with old method : 0.1237037181854248 length of segment : 528 time for calcul the mask position with numpy : 0.0003018379211425781 nb_pixel_total : 12574 time to create 1 rle with old method : 0.014394521713256836 length of segment : 246 time for calcul the mask position with numpy : 0.000659942626953125 nb_pixel_total : 41229 time to create 1 rle with old method : 0.046234130859375 length of segment : 400 time for calcul the mask position with numpy : 0.00037097930908203125 nb_pixel_total : 8606 time to create 1 rle with old method : 0.015003442764282227 length of segment : 388 time for calcul the mask position with numpy : 0.00042724609375 nb_pixel_total : 8236 time to create 1 rle with old method : 0.015842676162719727 length of segment : 193 time for calcul the mask position with numpy : 0.00021791458129882812 nb_pixel_total : 3713 time to create 1 rle with old method : 0.0068264007568359375 length of segment : 102 time for calcul the mask position with numpy : 0.00017499923706054688 nb_pixel_total : 5998 time to create 1 rle with old method : 0.007503032684326172 length of segment : 113 time for calcul the mask position with numpy : 0.0008778572082519531 nb_pixel_total : 38288 time to create 1 rle with old method : 0.06849360466003418 length of segment : 172 time for calcul the mask position with numpy : 0.00011849403381347656 nb_pixel_total : 4514 time to create 1 rle with old method : 0.005827903747558594 length of segment : 40 time for calcul the mask position with numpy : 0.00020194053649902344 nb_pixel_total : 8564 time to create 1 rle with old method : 0.010255575180053711 length of segment : 132 time for calcul the mask position with numpy : 0.0005924701690673828 nb_pixel_total : 33039 time to create 1 rle with old method : 0.043344736099243164 length of segment : 150 time for calcul the mask position with numpy : 0.00016498565673828125 nb_pixel_total : 1662 time to create 1 rle with old method : 0.0019502639770507812 length of segment : 50 time for calcul the mask position with numpy : 0.0005772113800048828 nb_pixel_total : 11440 time to create 1 rle with old method : 0.012670755386352539 length of segment : 285 time for calcul the mask position with numpy : 0.00011706352233886719 nb_pixel_total : 5227 time to create 1 rle with old method : 0.006027698516845703 length of segment : 110 time for calcul the mask position with numpy : 0.0005512237548828125 nb_pixel_total : 16467 time to create 1 rle with old method : 0.018480300903320312 length of segment : 149 time for calcul the mask position with numpy : 0.0004398822784423828 nb_pixel_total : 12627 time to create 1 rle with old method : 0.014238834381103516 length of segment : 142 time for calcul the mask position with numpy : 0.00022935867309570312 nb_pixel_total : 13588 time to create 1 rle with old method : 0.01617717742919922 length of segment : 56 time for calcul the mask position with numpy : 0.0015761852264404297 nb_pixel_total : 82053 time to create 1 rle with old method : 0.08982253074645996 length of segment : 478 time for calcul the mask position with numpy : 0.0005204677581787109 nb_pixel_total : 14717 time to create 1 rle with old method : 0.01670360565185547 length of segment : 174 time for calcul the mask position with numpy : 0.0005636215209960938 nb_pixel_total : 11837 time to create 1 rle with old method : 0.013241291046142578 length of segment : 238 time for calcul the mask position with numpy : 0.0021429061889648438 nb_pixel_total : 98243 time to create 1 rle with old method : 0.10756111145019531 length of segment : 531 time for calcul the mask position with numpy : 0.0011224746704101562 nb_pixel_total : 27408 time to create 1 rle with old method : 0.030497074127197266 length of segment : 450 time for calcul the mask position with numpy : 0.00024390220642089844 nb_pixel_total : 10058 time to create 1 rle with old method : 0.012069463729858398 length of segment : 235 time for calcul the mask position with numpy : 0.0003502368927001953 nb_pixel_total : 7800 time to create 1 rle with old method : 0.00948023796081543 length of segment : 104 time for calcul the mask position with numpy : 0.024810075759887695 nb_pixel_total : 992044 time to create 1 rle with new method : 0.03347945213317871 length of segment : 1471 time for calcul the mask position with numpy : 0.00015926361083984375 nb_pixel_total : 6000 time to create 1 rle with old method : 0.007000923156738281 length of segment : 66 time for calcul the mask position with numpy : 0.0001480579376220703 nb_pixel_total : 5883 time to create 1 rle with old method : 0.006858348846435547 length of segment : 89 time for calcul the mask position with numpy : 0.0002701282501220703 nb_pixel_total : 17888 time to create 1 rle with old method : 0.020183563232421875 length of segment : 132 time for calcul the mask position with numpy : 0.0004010200500488281 nb_pixel_total : 14071 time to create 1 rle with old method : 0.015819549560546875 length of segment : 202 time for calcul the mask position with numpy : 0.004628658294677734 nb_pixel_total : 189851 time to create 1 rle with new method : 0.020581483840942383 length of segment : 1301 time for calcul the mask position with numpy : 0.0005285739898681641 nb_pixel_total : 11153 time to create 1 rle with old method : 0.012827634811401367 length of segment : 141 time for calcul the mask position with numpy : 0.0005171298980712891 nb_pixel_total : 6656 time to create 1 rle with old method : 0.007535219192504883 length of segment : 156 time spent for convertir_results : 3.5625104904174805 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 53 chid ids of type : 3594 Number RLEs to save : 14810 save missing photos in datou_result : time spend for datou_step_exec : 29.892022132873535 time spend to save output : 0.8717391490936279 total time spend for step 1 : 30.763761281967163 step2:crop_condition Mon Nov 3 19:41:04 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 20 ! batch 1 Loaded 53 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 30 About to insert : list_path_to_insert length 30 new photo from crops ! About to upload 30 photos upload in portfolio : 3736932 init cache_photo without model_param we have 30 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1762195266_2533687 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762195272), 0.0, 0.0, 14, '', 0, 0, '1762195230_2533687_1391840631_0850515cc6550676f67e9a6e409d7a3f_rle_crop_4017033893_0.png', 0, 154, 117, 0, 1762195272,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762195272), 0.0, 0.0, 14, '', 0, 0, '1762195230_2533687_1391840631_0850515cc6550676f67e9a6e409d7a3f_rle_crop_4017033894_0.png', 0, 157, 183, 0, 1762195272,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762195272), 0.0, 0.0, 14, '', 0, 0, '1762195230_2533687_1391840631_0850515cc6550676f67e9a6e409d7a3f_rle_crop_4017033896_0.png', 0, 92, 103, 0, 1762195272,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762195272), 0.0, 0.0, 14, '', 0, 0, '1762195230_2533687_1391840631_0850515cc6550676f67e9a6e409d7a3f_rle_crop_4017033897_0.png', 0, 72, 65, 0, 1762195272,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762195272), 0.0, 0.0, 14, '', 0, 0, '1762195230_2533687_1391840631_0850515cc6550676f67e9a6e409d7a3f_rle_crop_4017033898_0.png', 0, 143, 103, 0, 1762195272,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762195272), 0.0, 0.0, 14, '', 0, 0, '1762195230_2533687_1391840629_e57eb1458db406e6bb14cea995f797ac_rle_crop_4017033901_0.png', 0, 55, 195, 0, 1762195272,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762195272), 0.0, 0.0, 14, '', 0, 0, '1762195230_2533687_1391840628_f65a30326a94ca5f01a32f2daae61d91_rle_crop_4017033902_0.png', 0, 153, 199, 0, 1762195272,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762195272), 0.0, 0.0, 14, '', 0, 0, '1762195230_2533687_1391840626_689606cf13c93a91e8aeeaf4b49723d7_rle_crop_4017033904_0.png', 0, 96, 208, 0, 1762195272,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762195272), 0.0, 0.0, 14, '', 0, 0, '1762195230_2533687_1391840585_49aea56de6e7058e5ef12aecb60d0535_rle_crop_4017033909_0.png', 0, 57, 207, 0, 1762195272,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762195272), 0.0, 0.0, 14, '', 0, 0, '1762195230_2533687_1391840585_49aea56de6e7058e5ef12aecb60d0535_rle_crop_4017033910_0.png', 0, 118, 114, 0, 1762195272,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762195272), 0.0, 0.0, 14, '', 0, 0, '1762195230_2533687_1391840585_49aea56de6e7058e5ef12aecb60d0535_rle_crop_4017033911_0.png', 0, 77, 380, 0, 1762195272,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762195272), 0.0, 0.0, 14, '', 0, 0, '1762195230_2533687_1391840581_d1e079399b0fdd252574652715b3ada7_rle_crop_4017033913_0.png', 0, 118, 262, 0, 1762195272,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762195272), 0.0, 0.0, 14, '', 0, 0, '1762195230_2533687_1391840573_34dd0c59e72e13e1050c69f96a7382ed_rle_crop_4017033915_0.png', 0, 104, 246, 0, 1762195272,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762195272), 0.0, 0.0, 14, '', 0, 0, '1762195230_2533687_1391840573_34dd0c59e72e13e1050c69f96a7382ed_rle_crop_4017033916_0.png', 0, 174, 394, 0, 1762195272,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762195272), 0.0, 0.0, 14, '', 0, 0, '1762195230_2533687_1391840573_34dd0c59e72e13e1050c69f96a7382ed_rle_crop_4017033917_0.png', 0, 95, 218, 0, 1762195272,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762195272), 0.0, 0.0, 14, '', 0, 0, '1762195230_2533687_1391840573_34dd0c59e72e13e1050c69f96a7382ed_rle_crop_4017033918_0.png', 0, 106, 189, 0, 1762195272,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762195272), 0.0, 0.0, 14, '', 0, 0, '1762195230_2533687_1391840573_34dd0c59e72e13e1050c69f96a7382ed_rle_crop_4017033919_0.png', 0, 69, 102, 0, 1762195272,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762195272), 0.0, 0.0, 14, '', 0, 0, '1762195230_2533687_1391840573_34dd0c59e72e13e1050c69f96a7382ed_rle_crop_4017033920_0.png', 0, 69, 113, 0, 1762195272,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762195272), 0.0, 0.0, 14, '', 0, 0, '1762195230_2533687_1391840562_476ea9ef038b63320cdcabe9749f9f27_rle_crop_4017033922_0.png', 0, 152, 38, 0, 1762195272,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762195272), 0.0, 0.0, 14, '', 0, 0, '1762195230_2533687_1391840562_476ea9ef038b63320cdcabe9749f9f27_rle_crop_4017033923_0.png', 0, 148, 123, 0, 1762195272,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762195272), 0.0, 0.0, 14, '', 0, 0, '1762195230_2533687_1391840561_5181753e90c9fcc06975a97493d056da_rle_crop_4017033925_0.png', 0, 44, 50, 0, 1762195272,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762195272), 0.0, 0.0, 14, '', 0, 0, '1762195230_2533687_1391840559_88ee0890b5db670dd2fd5862be6a8dd5_rle_crop_4017033926_0.png', 0, 88, 252, 0, 1762195272,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762195272), 0.0, 0.0, 14, '', 0, 0, '1762195230_2533687_1391840559_88ee0890b5db670dd2fd5862be6a8dd5_rle_crop_4017033927_0.png', 0, 61, 110, 0, 1762195272,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762195272), 0.0, 0.0, 14, '', 0, 0, '1762195230_2533687_1391840554_6fbf435fda7fbe7370c621e21fb6344f_rle_crop_4017033933_0.png', 0, 103, 238, 0, 1762195272,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762195272), 0.0, 0.0, 14, '', 0, 0, '1762195230_2533687_1391840528_e4201672f34705c0f751e3a9cbdad678_rle_crop_4017033935_0.png', 0, 118, 450, 0, 1762195272,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762195272), 0.0, 0.0, 14, '', 0, 0, '1762195230_2533687_1391840528_e4201672f34705c0f751e3a9cbdad678_rle_crop_4017033936_0.png', 0, 74, 235, 0, 1762195272,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762195272), 0.0, 0.0, 14, '', 0, 0, '1762195230_2533687_1391840527_53c31d4317d04d8b609591cb9ba7f67f_rle_crop_4017033937_0.png', 0, 122, 104, 0, 1762195272,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762195272), 0.0, 0.0, 14, '', 0, 0, '1762195230_2533687_1391840526_8dbf33847ae0e8c81dd01fcbb611eaf8_rle_crop_4017033940_0.png', 0, 115, 85, 0, 1762195272,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762195272), 0.0, 0.0, 14, '', 0, 0, '1762195230_2533687_1391840524_cdc5c5a0ca0e2ae4cac9b2848cce2a21_rle_crop_4017033942_0.png', 0, 167, 187, 0, 1762195272,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762195272), 0.0, 0.0, 14, '', 0, 0, '1762195230_2533687_1391840524_cdc5c5a0ca0e2ae4cac9b2848cce2a21_rle_crop_4017033945_0.png', 0, 88, 156, 0, 1762195272,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 30 photos in the portfolio 3736932 time of upload the photos Elapsed time : 7.410891532897949 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3736932 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1762195275_2533687 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762195276), 0.0, 0.0, 14, '', 0, 0, '1762195230_2533687_1391840631_0850515cc6550676f67e9a6e409d7a3f_rle_crop_4017033895_0.png', 0, 76, 125, 0, 1762195276,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762195276), 0.0, 0.0, 14, '', 0, 0, '1762195230_2533687_1391840628_f65a30326a94ca5f01a32f2daae61d91_rle_crop_4017033903_0.png', 0, 295, 478, 0, 1762195276,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762195276), 0.0, 0.0, 14, '', 0, 0, '1762195230_2533687_1391840524_cdc5c5a0ca0e2ae4cac9b2848cce2a21_rle_crop_4017033943_0.png', 0, 732, 810, 0, 1762195276,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762195276), 0.0, 0.0, 14, '', 0, 0, '1762195230_2533687_1391840524_cdc5c5a0ca0e2ae4cac9b2848cce2a21_rle_crop_4017033944_0.png', 0, 135, 141, 0, 1762195276,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 4 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.247565507888794 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 18 About to insert : list_path_to_insert length 18 new photo from crops ! About to upload 18 photos upload in portfolio : 3736932 init cache_photo without model_param we have 18 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1762195287_2533687 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762195291), 0.0, 0.0, 14, '', 0, 0, '1762195230_2533687_1391840629_e57eb1458db406e6bb14cea995f797ac_rle_crop_4017033899_0.png', 0, 314, 196, 0, 1762195291,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762195291), 0.0, 0.0, 14, '', 0, 0, '1762195230_2533687_1391840629_e57eb1458db406e6bb14cea995f797ac_rle_crop_4017033900_0.png', 0, 160, 98, 0, 1762195291,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762195291), 0.0, 0.0, 14, '', 0, 0, '1762195230_2533687_1391840626_689606cf13c93a91e8aeeaf4b49723d7_rle_crop_4017033905_0.png', 0, 84, 83, 0, 1762195291,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762195291), 0.0, 0.0, 14, '', 0, 0, '1762195230_2533687_1391840591_0c6c0b77c8013e40b0399c54adf30151_rle_crop_4017033906_0.png', 0, 362, 545, 0, 1762195291,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762195291), 0.0, 0.0, 14, '', 0, 0, '1762195230_2533687_1391840588_6d6e4d57cc5b83f514b2bbf576fd4c33_rle_crop_4017033907_0.png', 0, 242, 144, 0, 1762195291,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762195291), 0.0, 0.0, 14, '', 0, 0, '1762195230_2533687_1391840588_6d6e4d57cc5b83f514b2bbf576fd4c33_rle_crop_4017033908_0.png', 0, 109, 146, 0, 1762195291,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762195291), 0.0, 0.0, 14, '', 0, 0, '1762195230_2533687_1391840585_49aea56de6e7058e5ef12aecb60d0535_rle_crop_4017033912_0.png', 0, 1304, 982, 0, 1762195291,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762195291), 0.0, 0.0, 14, '', 0, 0, '1762195230_2533687_1391840581_d1e079399b0fdd252574652715b3ada7_rle_crop_4017033914_0.png', 0, 345, 528, 0, 1762195291,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762195291), 0.0, 0.0, 14, '', 0, 0, '1762195230_2533687_1391840562_476ea9ef038b63320cdcabe9749f9f27_rle_crop_4017033921_0.png', 0, 310, 165, 0, 1762195291,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762195291), 0.0, 0.0, 14, '', 0, 0, '1762195230_2533687_1391840561_5181753e90c9fcc06975a97493d056da_rle_crop_4017033924_0.png', 0, 364, 139, 0, 1762195291,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762195291), 0.0, 0.0, 14, '', 0, 0, '1762195230_2533687_1391840559_88ee0890b5db670dd2fd5862be6a8dd5_rle_crop_4017033928_0.png', 0, 170, 132, 0, 1762195291,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762195291), 0.0, 0.0, 14, '', 0, 0, '1762195230_2533687_1391840559_88ee0890b5db670dd2fd5862be6a8dd5_rle_crop_4017033929_0.png', 0, 113, 142, 0, 1762195291,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762195291), 0.0, 0.0, 14, '', 0, 0, '1762195230_2533687_1391840559_88ee0890b5db670dd2fd5862be6a8dd5_rle_crop_4017033930_0.png', 0, 323, 53, 0, 1762195291,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762195291), 0.0, 0.0, 14, '', 0, 0, '1762195230_2533687_1391840557_bbd5f4c785e21ccfe06e7b175f980c10_rle_crop_4017033931_0.png', 0, 294, 477, 0, 1762195291,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762195291), 0.0, 0.0, 14, '', 0, 0, '1762195230_2533687_1391840554_6fbf435fda7fbe7370c621e21fb6344f_rle_crop_4017033932_0.png', 0, 158, 164, 0, 1762195291,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762195291), 0.0, 0.0, 14, '', 0, 0, '1762195230_2533687_1391840527_53c31d4317d04d8b609591cb9ba7f67f_rle_crop_4017033938_0.png', 0, 1242, 978, 0, 1762195291,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762195291), 0.0, 0.0, 14, '', 0, 0, '1762195230_2533687_1391840527_53c31d4317d04d8b609591cb9ba7f67f_rle_crop_4017033939_0.png', 0, 109, 65, 0, 1762195291,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762195291), 0.0, 0.0, 14, '', 0, 0, '1762195230_2533687_1391840524_cdc5c5a0ca0e2ae4cac9b2848cce2a21_rle_crop_4017033941_0.png', 0, 167, 131, 0, 1762195291,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 18 photos in the portfolio 3736932 time of upload the photos Elapsed time : 4.6912758350372314 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1762195293_2533687 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762195293), 0.0, 0.0, 14, '', 0, 0, '1762195230_2533687_1391840530_114795fd5617bdcc1918aa6893b816ea_rle_crop_4017033934_0.png', 0, 333, 525, 0, 1762195293,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.6567466259002686 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1391840631, 1391840629, 1391840628, 1391840626, 1391840591, 1391840588, 1391840585, 1391840581, 1391840573, 1391840562, 1391840561, 1391840559, 1391840557, 1391840554, 1391840552, 1391840530, 1391840528, 1391840527, 1391840526, 1391840524] Looping around the photos to save general results len do output : 53 /1392125875Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392125876Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392125877Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392125878Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392125879Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392125880Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392125881Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392125882Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392125883Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392125884Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392125885Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392125886Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392125887Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392125888Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392125889Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392125890Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392125892Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392125893Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392125894Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392125895Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392125896Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392125897Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392125898Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392125899Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392125900Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392125901Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392125902Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392125903Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392125904Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392125905Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392125907Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392125908Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392125909Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392125910Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392125916Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392125917Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392125918Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392125919Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392125920Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392125921Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392125922Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392125923Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392125924Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392125925Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392125926Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392125927Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392125928Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392125929Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392125930Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392125931Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392125932Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392125933Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392125935Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840631', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840629', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840628', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840626', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840591', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840588', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840585', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840581', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840573', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840562', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840561', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840559', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840557', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840554', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840552', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840530', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840528', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840527', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840526', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840524', None, None, None, None, None, '3988924') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 179 time used for this insertion : 0.02240300178527832 save_final save missing photos in datou_result : time spend for datou_step_exec : 29.39374566078186 time spend to save output : 0.0246121883392334 total time spend for step 2 : 29.418357849121094 step3:rle_unique_nms_with_priority Mon Nov 3 19:41:33 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 53 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 6 nb_hashtags : 2 time to prepare the origin masks : 0.6022448539733887 time for calcul the mask position with numpy : 0.17112255096435547 nb_pixel_total : 2019160 time to create 1 rle with new method : 0.19766569137573242 time for calcul the mask position with numpy : 0.006501436233520508 nb_pixel_total : 9408 time to create 1 rle with old method : 0.010695934295654297 time for calcul the mask position with numpy : 0.006165266036987305 nb_pixel_total : 2500 time to create 1 rle with old method : 0.003003835678100586 time for calcul the mask position with numpy : 0.0064907073974609375 nb_pixel_total : 7743 time to create 1 rle with old method : 0.00911569595336914 time for calcul the mask position with numpy : 0.00662541389465332 nb_pixel_total : 6305 time to create 1 rle with old method : 0.007444143295288086 time for calcul the mask position with numpy : 0.006211996078491211 nb_pixel_total : 14986 time to create 1 rle with old method : 0.01777482032775879 time for calcul the mask position with numpy : 0.006268501281738281 nb_pixel_total : 13498 time to create 1 rle with old method : 0.015917539596557617 create new chi : 0.48085546493530273 time to delete rle : 0.02738189697265625 batch 1 Loaded 13 chid ids of type : 3594 ++++++Number RLEs to save : 2425 TO DO : save crop sub photo not yet done ! save time : 0.18490242958068848 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.05037522315979004 time for calcul the mask position with numpy : 0.04118013381958008 nb_pixel_total : 2003033 time to create 1 rle with new method : 0.15361332893371582 time for calcul the mask position with numpy : 0.006189107894897461 nb_pixel_total : 8915 time to create 1 rle with old method : 0.010578632354736328 time for calcul the mask position with numpy : 0.00622248649597168 nb_pixel_total : 10984 time to create 1 rle with old method : 0.012906551361083984 time for calcul the mask position with numpy : 0.006384611129760742 nb_pixel_total : 50668 time to create 1 rle with old method : 0.062058448791503906 create new chi : 0.2995133399963379 time to delete rle : 0.0003674030303955078 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2062 TO DO : save crop sub photo not yet done ! save time : 0.17304468154907227 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.04858875274658203 time for calcul the mask position with numpy : 0.019748210906982422 nb_pixel_total : 1984600 time to create 1 rle with new method : 0.07404065132141113 time for calcul the mask position with numpy : 0.006627559661865234 nb_pixel_total : 74108 time to create 1 rle with old method : 0.08496570587158203 time for calcul the mask position with numpy : 0.006092548370361328 nb_pixel_total : 14892 time to create 1 rle with old method : 0.018815994262695312 create new chi : 0.21075224876403809 time to delete rle : 0.0004506111145019531 batch 1 Loaded 5 chid ids of type : 3594 ++++Number RLEs to save : 2622 TO DO : save crop sub photo not yet done ! save time : 0.19753289222717285 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.04724454879760742 time for calcul the mask position with numpy : 0.16969013214111328 nb_pixel_total : 2054682 time to create 1 rle with new method : 0.15935897827148438 time for calcul the mask position with numpy : 0.006115436553955078 nb_pixel_total : 4981 time to create 1 rle with old method : 0.0056819915771484375 time for calcul the mask position with numpy : 0.005957841873168945 nb_pixel_total : 13937 time to create 1 rle with old method : 0.016084671020507812 create new chi : 0.3666493892669678 time to delete rle : 0.00028061866760253906 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1664 TO DO : save crop sub photo not yet done ! save time : 0.13769173622131348 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.04436540603637695 time for calcul the mask position with numpy : 0.05800676345825195 nb_pixel_total : 1956250 time to create 1 rle with new method : 0.16629815101623535 time for calcul the mask position with numpy : 0.0067217350006103516 nb_pixel_total : 117350 time to create 1 rle with old method : 0.14354944229125977 create new chi : 0.38666653633117676 time to delete rle : 0.0003173351287841797 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 2174 TO DO : save crop sub photo not yet done ! save time : 0.1685009002685547 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.08054518699645996 time for calcul the mask position with numpy : 0.15035486221313477 nb_pixel_total : 2037908 time to create 1 rle with new method : 0.08071780204772949 time for calcul the mask position with numpy : 0.006398439407348633 nb_pixel_total : 12172 time to create 1 rle with old method : 0.01476430892944336 time for calcul the mask position with numpy : 0.00724339485168457 nb_pixel_total : 23520 time to create 1 rle with old method : 0.030611038208007812 create new chi : 0.30103135108947754 time to delete rle : 0.00042557716369628906 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1622 TO DO : save crop sub photo not yet done ! save time : 0.13358449935913086 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.14151954650878906 time for calcul the mask position with numpy : 0.18143773078918457 nb_pixel_total : 1087522 time to create 1 rle with new method : 0.11299777030944824 time for calcul the mask position with numpy : 0.013428688049316406 nb_pixel_total : 959893 time to create 1 rle with new method : 0.16527771949768066 time for calcul the mask position with numpy : 0.006115436553955078 nb_pixel_total : 10217 time to create 1 rle with old method : 0.011645078659057617 time for calcul the mask position with numpy : 0.005801677703857422 nb_pixel_total : 8395 time to create 1 rle with old method : 0.009618043899536133 time for calcul the mask position with numpy : 0.006048917770385742 nb_pixel_total : 7573 time to create 1 rle with old method : 0.00897669792175293 create new chi : 0.538050651550293 time to delete rle : 0.0008161067962646484 batch 1 Loaded 9 chid ids of type : 3594 ++++++Number RLEs to save : 5532 TO DO : save crop sub photo not yet done ! save time : 0.34243273735046387 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.03918313980102539 time for calcul the mask position with numpy : 0.018193483352661133 nb_pixel_total : 1949372 time to create 1 rle with new method : 0.14440631866455078 time for calcul the mask position with numpy : 0.006468296051025391 nb_pixel_total : 110650 time to create 1 rle with old method : 0.1283714771270752 time for calcul the mask position with numpy : 0.0062808990478515625 nb_pixel_total : 13578 time to create 1 rle with old method : 0.018988609313964844 create new chi : 0.32965660095214844 time to delete rle : 0.00046253204345703125 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2660 TO DO : save crop sub photo not yet done ! save time : 0.1835460662841797 nb_obj : 6 nb_hashtags : 1 time to prepare the origin masks : 0.10547089576721191 time for calcul the mask position with numpy : 0.16764307022094727 nb_pixel_total : 1999164 time to create 1 rle with new method : 0.21041488647460938 time for calcul the mask position with numpy : 0.0062258243560791016 nb_pixel_total : 197 time to create 1 rle with old method : 0.0003032684326171875 time for calcul the mask position with numpy : 0.006246328353881836 nb_pixel_total : 3713 time to create 1 rle with old method : 0.004372835159301758 time for calcul the mask position with numpy : 0.006394386291503906 nb_pixel_total : 8117 time to create 1 rle with old method : 0.009803056716918945 time for calcul the mask position with numpy : 0.006262779235839844 nb_pixel_total : 8606 time to create 1 rle with old method : 0.010195493698120117 time for calcul the mask position with numpy : 0.006438016891479492 nb_pixel_total : 41229 time to create 1 rle with old method : 0.04727792739868164 time for calcul the mask position with numpy : 0.006179094314575195 nb_pixel_total : 12574 time to create 1 rle with old method : 0.014260053634643555 create new chi : 0.5124640464782715 time to delete rle : 0.000598907470703125 batch 1 Loaded 13 chid ids of type : 3594 +++++++++++Number RLEs to save : 3756 TO DO : save crop sub photo not yet done ! save time : 0.2566835880279541 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.047281742095947266 time for calcul the mask position with numpy : 0.018796443939208984 nb_pixel_total : 2022234 time to create 1 rle with new method : 0.07688450813293457 time for calcul the mask position with numpy : 0.006107330322265625 nb_pixel_total : 8564 time to create 1 rle with old method : 0.009602546691894531 time for calcul the mask position with numpy : 0.0058972835540771484 nb_pixel_total : 4514 time to create 1 rle with old method : 0.005134105682373047 time for calcul the mask position with numpy : 0.006064653396606445 nb_pixel_total : 38288 time to create 1 rle with old method : 0.04281187057495117 create new chi : 0.17860960960388184 time to delete rle : 0.0002884864807128906 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1768 TO DO : save crop sub photo not yet done ! save time : 0.14589595794677734 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.14128947257995605 time for calcul the mask position with numpy : 0.19009613990783691 nb_pixel_total : 2038899 time to create 1 rle with new method : 0.08010530471801758 time for calcul the mask position with numpy : 0.006691694259643555 nb_pixel_total : 1662 time to create 1 rle with old method : 0.0018436908721923828 time for calcul the mask position with numpy : 0.00622248649597168 nb_pixel_total : 33039 time to create 1 rle with old method : 0.03832530975341797 create new chi : 0.333909273147583 time to delete rle : 0.0002620220184326172 batch 1 Loaded 5 chid ids of type : 3594 +++++Number RLEs to save : 1480 TO DO : save crop sub photo not yet done ! save time : 0.12092852592468262 nb_obj : 5 nb_hashtags : 2 time to prepare the origin masks : 0.14287948608398438 time for calcul the mask position with numpy : 0.2500624656677246 nb_pixel_total : 2019150 time to create 1 rle with new method : 0.0951998233795166 time for calcul the mask position with numpy : 0.006960153579711914 nb_pixel_total : 13588 time to create 1 rle with old method : 0.016061067581176758 time for calcul the mask position with numpy : 0.0062143802642822266 nb_pixel_total : 12627 time to create 1 rle with old method : 0.014994382858276367 time for calcul the mask position with numpy : 0.007066011428833008 nb_pixel_total : 16467 time to create 1 rle with old method : 0.019429445266723633 time for calcul the mask position with numpy : 0.007987260818481445 nb_pixel_total : 328 time to create 1 rle with old method : 0.0005538463592529297 time for calcul the mask position with numpy : 0.00825357437133789 nb_pixel_total : 11440 time to create 1 rle with old method : 0.01636528968811035 create new chi : 0.461986780166626 time to delete rle : 0.0005183219909667969 batch 1 Loaded 11 chid ids of type : 3594 +++++++Number RLEs to save : 2467 TO DO : save crop sub photo not yet done ! save time : 0.17696261405944824 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03303694725036621 time for calcul the mask position with numpy : 0.0255739688873291 nb_pixel_total : 1991547 time to create 1 rle with new method : 0.04880189895629883 time for calcul the mask position with numpy : 0.006641387939453125 nb_pixel_total : 82053 time to create 1 rle with old method : 0.09467768669128418 create new chi : 0.1760561466217041 time to delete rle : 0.0003650188446044922 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 2036 TO DO : save crop sub photo not yet done ! save time : 0.15661859512329102 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.1934809684753418 time for calcul the mask position with numpy : 0.14599370956420898 nb_pixel_total : 2047046 time to create 1 rle with new method : 0.08906054496765137 time for calcul the mask position with numpy : 0.0062847137451171875 nb_pixel_total : 11837 time to create 1 rle with old method : 0.013841629028320312 time for calcul the mask position with numpy : 0.005970001220703125 nb_pixel_total : 14717 time to create 1 rle with old method : 0.017228364944458008 create new chi : 0.2888755798339844 time to delete rle : 0.00039696693420410156 batch 1 Loaded 5 chid ids of type : 3594 +++Number RLEs to save : 1904 TO DO : save crop sub photo not yet done ! save time : 0.14534902572631836 No data in photo_id : 1391840552 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.046010732650756836 time for calcul the mask position with numpy : 0.04074692726135254 nb_pixel_total : 1975357 time to create 1 rle with new method : 0.18760967254638672 time for calcul the mask position with numpy : 0.00784921646118164 nb_pixel_total : 98243 time to create 1 rle with old method : 0.11430191993713379 create new chi : 0.35920095443725586 time to delete rle : 0.00037360191345214844 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 2142 TO DO : save crop sub photo not yet done ! save time : 0.16963648796081543 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.0442500114440918 time for calcul the mask position with numpy : 0.08571434020996094 nb_pixel_total : 2036134 time to create 1 rle with new method : 0.19551324844360352 time for calcul the mask position with numpy : 0.006293058395385742 nb_pixel_total : 10058 time to create 1 rle with old method : 0.012221813201904297 time for calcul the mask position with numpy : 0.006537914276123047 nb_pixel_total : 27408 time to create 1 rle with old method : 0.03238487243652344 create new chi : 0.34968996047973633 time to delete rle : 0.0004456043243408203 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2450 TO DO : save crop sub photo not yet done ! save time : 0.17225217819213867 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.09592413902282715 time for calcul the mask position with numpy : 0.053562164306640625 nb_pixel_total : 1069598 time to create 1 rle with new method : 0.08221054077148438 time for calcul the mask position with numpy : 0.006420135498046875 nb_pixel_total : 5851 time to create 1 rle with old method : 0.0076961517333984375 time for calcul the mask position with numpy : 0.013548135757446289 nb_pixel_total : 990351 time to create 1 rle with new method : 0.16843557357788086 time for calcul the mask position with numpy : 0.006119251251220703 nb_pixel_total : 7800 time to create 1 rle with old method : 0.008980512619018555 create new chi : 0.3642895221710205 time to delete rle : 0.0007238388061523438 batch 1 Loaded 7 chid ids of type : 3594 ++++++++Number RLEs to save : 4284 TO DO : save crop sub photo not yet done ! save time : 0.28314638137817383 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03340435028076172 time for calcul the mask position with numpy : 0.01898050308227539 nb_pixel_total : 2067717 time to create 1 rle with new method : 0.12171506881713867 time for calcul the mask position with numpy : 0.006113767623901367 nb_pixel_total : 5883 time to create 1 rle with old method : 0.009349822998046875 create new chi : 0.16340184211730957 time to delete rle : 0.00029754638671875 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1258 TO DO : save crop sub photo not yet done ! save time : 0.11337852478027344 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 0.48627138137817383 time for calcul the mask position with numpy : 0.07209515571594238 nb_pixel_total : 1833981 time to create 1 rle with new method : 0.25044703483581543 time for calcul the mask position with numpy : 0.006034135818481445 nb_pixel_total : 6656 time to create 1 rle with old method : 0.008461475372314453 time for calcul the mask position with numpy : 0.006865978240966797 nb_pixel_total : 11153 time to create 1 rle with old method : 0.012127161026000977 time for calcul the mask position with numpy : 0.007649898529052734 nb_pixel_total : 189851 time to create 1 rle with new method : 0.06856751441955566 time for calcul the mask position with numpy : 0.0066716670989990234 nb_pixel_total : 14071 time to create 1 rle with old method : 0.017000436782836914 time for calcul the mask position with numpy : 0.007135629653930664 nb_pixel_total : 17888 time to create 1 rle with old method : 0.021811246871948242 create new chi : 0.49553346633911133 time to delete rle : 0.0007205009460449219 batch 1 Loaded 11 chid ids of type : 3594 +++++++++Number RLEs to save : 4944 TO DO : save crop sub photo not yet done ! save time : 0.31676769256591797 map_output_result : {1391840631: (0.0, 'Should be the crop_list due to order', 0), 1391840629: (0.0, 'Should be the crop_list due to order', 0), 1391840628: (0.0, 'Should be the crop_list due to order', 0), 1391840626: (0.0, 'Should be the crop_list due to order', 0), 1391840591: (0.0, 'Should be the crop_list due to order', 0), 1391840588: (0.0, 'Should be the crop_list due to order', 0), 1391840585: (0.0, 'Should be the crop_list due to order', 0), 1391840581: (0.0, 'Should be the crop_list due to order', 0), 1391840573: (0.0, 'Should be the crop_list due to order', 0), 1391840562: (0.0, 'Should be the crop_list due to order', 0), 1391840561: (0.0, 'Should be the crop_list due to order', 0), 1391840559: (0.0, 'Should be the crop_list due to order', 0), 1391840557: (0.0, 'Should be the crop_list due to order', 0), 1391840554: (0.0, 'Should be the crop_list due to order', 0), 1391840552: (0.0, 'Should be the crop_list due to order', 0.0), 1391840530: (0.0, 'Should be the crop_list due to order', 0), 1391840528: (0.0, 'Should be the crop_list due to order', 0), 1391840527: (0.0, 'Should be the crop_list due to order', 0), 1391840526: (0.0, 'Should be the crop_list due to order', 0), 1391840524: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1391840631, 1391840629, 1391840628, 1391840626, 1391840591, 1391840588, 1391840585, 1391840581, 1391840573, 1391840562, 1391840561, 1391840559, 1391840557, 1391840554, 1391840552, 1391840530, 1391840528, 1391840527, 1391840526, 1391840524] Looping around the photos to save general results len do output : 20 /1391840631.Didn't retrieve data . /1391840629.Didn't retrieve data . /1391840628.Didn't retrieve data . /1391840626.Didn't retrieve data . /1391840591.Didn't retrieve data . /1391840588.Didn't retrieve data . /1391840585.Didn't retrieve data . /1391840581.Didn't retrieve data . /1391840573.Didn't retrieve data . /1391840562.Didn't retrieve data . /1391840561.Didn't retrieve data . /1391840559.Didn't retrieve data . /1391840557.Didn't retrieve data . /1391840554.Didn't retrieve data . /1391840552.Didn't retrieve data . /1391840530.Didn't retrieve data . /1391840528.Didn't retrieve data . /1391840527.Didn't retrieve data . /1391840526.Didn't retrieve data . /1391840524.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840631', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840629', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840628', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840626', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840591', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840588', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840585', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840581', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840573', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840562', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840561', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840559', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840557', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840554', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840552', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840530', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840528', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840527', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840526', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840524', None, None, None, None, None, '3988924') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 60 time used for this insertion : 0.015616893768310547 save_final save missing photos in datou_result : time spend for datou_step_exec : 13.268224716186523 time spend to save output : 0.01653599739074707 total time spend for step 3 : 13.28476071357727 step4:ventilate_hashtags_in_portfolio Mon Nov 3 19:41:46 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 28108358 get user id for portfolio 28108358 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28108358 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','carton','papier','flou','environnement','mal_croppe','metal','pehd','background','pet_fonce','autre')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28108358 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','carton','papier','flou','environnement','mal_croppe','metal','pehd','background','pet_fonce','autre')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28108358 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','carton','papier','flou','environnement','mal_croppe','metal','pehd','background','pet_fonce','autre')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/28113611,28113612,28113613,28113615,28113616,28113617,28113618,28113620,28113621,28113622,28113623?tags=pet_clair,carton,papier,flou,environnement,mal_croppe,metal,pehd,background,pet_fonce,autre Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1391840631, 1391840629, 1391840628, 1391840626, 1391840591, 1391840588, 1391840585, 1391840581, 1391840573, 1391840562, 1391840561, 1391840559, 1391840557, 1391840554, 1391840552, 1391840530, 1391840528, 1391840527, 1391840526, 1391840524] Looping around the photos to save general results len do output : 1 /28108358. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840631', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840629', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840628', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840626', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840591', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840588', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840585', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840581', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840573', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840562', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840561', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840559', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840557', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840554', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840552', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840530', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840528', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840527', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840526', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840524', None, None, None, None, None, '3988924') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 21 time used for this insertion : 0.016491174697875977 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.6986150741577148 time spend to save output : 0.016811609268188477 total time spend for step 4 : 1.7154266834259033 step5:final Mon Nov 3 19:41:48 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1391840631: ('0.07728216628086416',), 1391840629: ('0.07728216628086416',), 1391840628: ('0.07728216628086416',), 1391840626: ('0.07728216628086416',), 1391840591: ('0.07728216628086416',), 1391840588: ('0.07728216628086416',), 1391840585: ('0.07728216628086416',), 1391840581: ('0.07728216628086416',), 1391840573: ('0.07728216628086416',), 1391840562: ('0.07728216628086416',), 1391840561: ('0.07728216628086416',), 1391840559: ('0.07728216628086416',), 1391840557: ('0.07728216628086416',), 1391840554: ('0.07728216628086416',), 1391840552: ('0.07728216628086416',), 1391840530: ('0.07728216628086416',), 1391840528: ('0.07728216628086416',), 1391840527: ('0.07728216628086416',), 1391840526: ('0.07728216628086416',), 1391840524: ('0.07728216628086416',)} new output for save of step final : {1391840631: ('0.07728216628086416',), 1391840629: ('0.07728216628086416',), 1391840628: ('0.07728216628086416',), 1391840626: ('0.07728216628086416',), 1391840591: ('0.07728216628086416',), 1391840588: ('0.07728216628086416',), 1391840585: ('0.07728216628086416',), 1391840581: ('0.07728216628086416',), 1391840573: ('0.07728216628086416',), 1391840562: ('0.07728216628086416',), 1391840561: ('0.07728216628086416',), 1391840559: ('0.07728216628086416',), 1391840557: ('0.07728216628086416',), 1391840554: ('0.07728216628086416',), 1391840552: ('0.07728216628086416',), 1391840530: ('0.07728216628086416',), 1391840528: ('0.07728216628086416',), 1391840527: ('0.07728216628086416',), 1391840526: ('0.07728216628086416',), 1391840524: ('0.07728216628086416',)} [1391840631, 1391840629, 1391840628, 1391840626, 1391840591, 1391840588, 1391840585, 1391840581, 1391840573, 1391840562, 1391840561, 1391840559, 1391840557, 1391840554, 1391840552, 1391840530, 1391840528, 1391840527, 1391840526, 1391840524] Looping around the photos to save general results len do output : 20 /1391840631.Didn't retrieve data . /1391840629.Didn't retrieve data . /1391840628.Didn't retrieve data . /1391840626.Didn't retrieve data . /1391840591.Didn't retrieve data . /1391840588.Didn't retrieve data . /1391840585.Didn't retrieve data . /1391840581.Didn't retrieve data . /1391840573.Didn't retrieve data . /1391840562.Didn't retrieve data . /1391840561.Didn't retrieve data . /1391840559.Didn't retrieve data . /1391840557.Didn't retrieve data . /1391840554.Didn't retrieve data . /1391840552.Didn't retrieve data . /1391840530.Didn't retrieve data . /1391840528.Didn't retrieve data . /1391840527.Didn't retrieve data . /1391840526.Didn't retrieve data . /1391840524.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840631', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840629', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840628', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840626', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840591', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840588', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840585', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840581', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840573', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840562', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840561', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840559', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840557', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840554', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840552', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840530', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840528', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840527', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840526', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840524', None, None, None, None, None, '3988924') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 60 time used for this insertion : 0.01684856414794922 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.12438511848449707 time spend to save output : 0.017789602279663086 total time spend for step 5 : 0.14217472076416016 step6:blur_detection Mon Nov 3 19:41:48 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1762195230_2533687_1391840631_0850515cc6550676f67e9a6e409d7a3f.jpg resize: (1080, 1920) 1391840631 0.3110992500824 treat image : temp/1762195230_2533687_1391840629_e57eb1458db406e6bb14cea995f797ac.jpg resize: (1080, 1920) 1391840629 -3.2020531992278625 treat image : temp/1762195230_2533687_1391840628_f65a30326a94ca5f01a32f2daae61d91.jpg resize: (1080, 1920) 1391840628 -0.0628455720132207 treat image : temp/1762195230_2533687_1391840626_689606cf13c93a91e8aeeaf4b49723d7.jpg resize: (1080, 1920) 1391840626 1.1817773895725048 treat image : temp/1762195230_2533687_1391840591_0c6c0b77c8013e40b0399c54adf30151.jpg resize: (1080, 1920) 1391840591 -1.9944960109133725 treat image : temp/1762195230_2533687_1391840588_6d6e4d57cc5b83f514b2bbf576fd4c33.jpg resize: (1080, 1920) 1391840588 0.5713019609224471 treat image : temp/1762195230_2533687_1391840585_49aea56de6e7058e5ef12aecb60d0535.jpg resize: (1080, 1920) 1391840585 0.2881045059007376 treat image : temp/1762195230_2533687_1391840581_d1e079399b0fdd252574652715b3ada7.jpg resize: (1080, 1920) 1391840581 -3.893845742710129 treat image : temp/1762195230_2533687_1391840573_34dd0c59e72e13e1050c69f96a7382ed.jpg resize: (1080, 1920) 1391840573 -1.6164856415675295 treat image : temp/1762195230_2533687_1391840562_476ea9ef038b63320cdcabe9749f9f27.jpg resize: (1080, 1920) 1391840562 0.3499861002744458 treat image : temp/1762195230_2533687_1391840561_5181753e90c9fcc06975a97493d056da.jpg resize: (1080, 1920) 1391840561 0.020589398706848425 treat image : temp/1762195230_2533687_1391840559_88ee0890b5db670dd2fd5862be6a8dd5.jpg resize: (1080, 1920) 1391840559 -0.8618465925739196 treat image : temp/1762195230_2533687_1391840557_bbd5f4c785e21ccfe06e7b175f980c10.jpg resize: (1080, 1920) 1391840557 0.7979078057521949 treat image : temp/1762195230_2533687_1391840554_6fbf435fda7fbe7370c621e21fb6344f.jpg resize: (1080, 1920) 1391840554 1.1264872431001156 treat image : temp/1762195230_2533687_1391840552_58f6951685363f918c898659958cda60.jpg resize: (1080, 1920) 1391840552 2.3546219306639475 treat image : temp/1762195230_2533687_1391840530_114795fd5617bdcc1918aa6893b816ea.jpg resize: (1080, 1920) 1391840530 0.1313121812221558 treat image : temp/1762195230_2533687_1391840528_e4201672f34705c0f751e3a9cbdad678.jpg resize: (1080, 1920) 1391840528 1.1988293800246488 treat image : temp/1762195230_2533687_1391840527_53c31d4317d04d8b609591cb9ba7f67f.jpg resize: (1080, 1920) 1391840527 -2.3832432274329616 treat image : temp/1762195230_2533687_1391840526_8dbf33847ae0e8c81dd01fcbb611eaf8.jpg resize: (1080, 1920) 1391840526 -4.062088313847803 treat image : temp/1762195230_2533687_1391840524_cdc5c5a0ca0e2ae4cac9b2848cce2a21.jpg resize: (1080, 1920) 1391840524 -0.7036393878486165 treat image : temp/1762195230_2533687_1391840631_0850515cc6550676f67e9a6e409d7a3f_rle_crop_4017033893_0.png resize: (117, 154) 1392125875 4.4635702354444025 treat image : temp/1762195230_2533687_1391840631_0850515cc6550676f67e9a6e409d7a3f_rle_crop_4017033894_0.png resize: (183, 157) 1392125876 -0.49645262972937887 treat image : temp/1762195230_2533687_1391840631_0850515cc6550676f67e9a6e409d7a3f_rle_crop_4017033896_0.png resize: (103, 92) 1392125877 1.854154945925567 treat image : temp/1762195230_2533687_1391840631_0850515cc6550676f67e9a6e409d7a3f_rle_crop_4017033897_0.png resize: (65, 72) 1392125878 -0.05335893582985268 treat image : temp/1762195230_2533687_1391840631_0850515cc6550676f67e9a6e409d7a3f_rle_crop_4017033898_0.png resize: (103, 143) 1392125879 -0.9552622865178391 treat image : temp/1762195230_2533687_1391840629_e57eb1458db406e6bb14cea995f797ac_rle_crop_4017033901_0.png resize: (195, 55) 1392125880 -1.832949022629122 treat image : temp/1762195230_2533687_1391840628_f65a30326a94ca5f01a32f2daae61d91_rle_crop_4017033902_0.png resize: (199, 153) 1392125881 -1.2728831113132872 treat image : temp/1762195230_2533687_1391840626_689606cf13c93a91e8aeeaf4b49723d7_rle_crop_4017033904_0.png resize: (208, 96) 1392125882 -1.0930834562863145 treat image : temp/1762195230_2533687_1391840585_49aea56de6e7058e5ef12aecb60d0535_rle_crop_4017033909_0.png resize: (207, 57) 1392125883 -1.8039780809931854 treat image : temp/1762195230_2533687_1391840585_49aea56de6e7058e5ef12aecb60d0535_rle_crop_4017033910_0.png resize: (114, 118) 1392125884 0.4834334399124783 treat image : temp/1762195230_2533687_1391840585_49aea56de6e7058e5ef12aecb60d0535_rle_crop_4017033911_0.png resize: (380, 77) 1392125885 -2.3385839896798317 treat image : temp/1762195230_2533687_1391840581_d1e079399b0fdd252574652715b3ada7_rle_crop_4017033913_0.png resize: (262, 118) 1392125886 -3.343568431232531 treat image : temp/1762195230_2533687_1391840573_34dd0c59e72e13e1050c69f96a7382ed_rle_crop_4017033915_0.png resize: (246, 104) 1392125887 -1.6682526026807085 treat image : temp/1762195230_2533687_1391840573_34dd0c59e72e13e1050c69f96a7382ed_rle_crop_4017033916_0.png resize: (394, 174) 1392125888 -0.996404230906262 treat image : temp/1762195230_2533687_1391840573_34dd0c59e72e13e1050c69f96a7382ed_rle_crop_4017033917_0.png resize: (218, 95) 1392125889 -2.6172410886739885 treat image : temp/1762195230_2533687_1391840573_34dd0c59e72e13e1050c69f96a7382ed_rle_crop_4017033918_0.png resize: (189, 106) 1392125890 -1.3062224032967389 treat image : temp/1762195230_2533687_1391840573_34dd0c59e72e13e1050c69f96a7382ed_rle_crop_4017033919_0.png resize: (102, 69) 1392125892 -2.911053250058646 treat image : temp/1762195230_2533687_1391840573_34dd0c59e72e13e1050c69f96a7382ed_rle_crop_4017033920_0.png resize: (113, 69) 1392125893 -0.7132545207785899 treat image : temp/1762195230_2533687_1391840562_476ea9ef038b63320cdcabe9749f9f27_rle_crop_4017033922_0.png resize: (38, 152) 1392125894 -0.3199907657551018 treat image : temp/1762195230_2533687_1391840562_476ea9ef038b63320cdcabe9749f9f27_rle_crop_4017033923_0.png resize: (123, 148) 1392125895 -1.270028536322821 treat image : temp/1762195230_2533687_1391840561_5181753e90c9fcc06975a97493d056da_rle_crop_4017033925_0.png resize: (50, 44) 1392125896 -0.06703905235707831 treat image : temp/1762195230_2533687_1391840559_88ee0890b5db670dd2fd5862be6a8dd5_rle_crop_4017033926_0.png resize: (252, 88) 1392125897 -1.6533862308263092 treat image : temp/1762195230_2533687_1391840559_88ee0890b5db670dd2fd5862be6a8dd5_rle_crop_4017033927_0.png resize: (110, 61) 1392125898 0.8847588857567309 treat image : temp/1762195230_2533687_1391840554_6fbf435fda7fbe7370c621e21fb6344f_rle_crop_4017033933_0.png resize: (238, 103) 1392125899 -2.316561788561006 treat image : temp/1762195230_2533687_1391840528_e4201672f34705c0f751e3a9cbdad678_rle_crop_4017033935_0.png resize: (450, 118) 1392125900 -1.4523273177587954 treat image : temp/1762195230_2533687_1391840528_e4201672f34705c0f751e3a9cbdad678_rle_crop_4017033936_0.png resize: (235, 74) 1392125901 -2.784108359001871 treat image : temp/1762195230_2533687_1391840527_53c31d4317d04d8b609591cb9ba7f67f_rle_crop_4017033937_0.png resize: (104, 122) 1392125902 1.6980852240713133 treat image : temp/1762195230_2533687_1391840526_8dbf33847ae0e8c81dd01fcbb611eaf8_rle_crop_4017033940_0.png resize: (85, 115) 1392125903 -2.418098288603839 treat image : temp/1762195230_2533687_1391840524_cdc5c5a0ca0e2ae4cac9b2848cce2a21_rle_crop_4017033942_0.png resize: (187, 167) 1392125904 -1.589479396381649 treat image : temp/1762195230_2533687_1391840524_cdc5c5a0ca0e2ae4cac9b2848cce2a21_rle_crop_4017033945_0.png resize: (156, 88) 1392125905 -1.9715365549274246 treat image : temp/1762195230_2533687_1391840631_0850515cc6550676f67e9a6e409d7a3f_rle_crop_4017033895_0.png resize: (125, 76) 1392125907 -0.14310206262263428 treat image : temp/1762195230_2533687_1391840628_f65a30326a94ca5f01a32f2daae61d91_rle_crop_4017033903_0.png resize: (478, 295) 1392125908 -1.0348285052506434 treat image : temp/1762195230_2533687_1391840524_cdc5c5a0ca0e2ae4cac9b2848cce2a21_rle_crop_4017033943_0.png resize: (810, 732) 1392125909 -0.5532352321076748 treat image : temp/1762195230_2533687_1391840524_cdc5c5a0ca0e2ae4cac9b2848cce2a21_rle_crop_4017033944_0.png resize: (141, 135) 1392125910 -1.536251264531867 treat image : temp/1762195230_2533687_1391840629_e57eb1458db406e6bb14cea995f797ac_rle_crop_4017033899_0.png resize: (196, 314) 1392125916 -0.6469192290254526 treat image : temp/1762195230_2533687_1391840629_e57eb1458db406e6bb14cea995f797ac_rle_crop_4017033900_0.png resize: (98, 160) 1392125917 -1.824668626137668 treat image : temp/1762195230_2533687_1391840626_689606cf13c93a91e8aeeaf4b49723d7_rle_crop_4017033905_0.png resize: (83, 84) 1392125918 -1.9583262474738357 treat image : temp/1762195230_2533687_1391840591_0c6c0b77c8013e40b0399c54adf30151_rle_crop_4017033906_0.png resize: (545, 362) 1392125919 0.16763572333167448 treat image : temp/1762195230_2533687_1391840588_6d6e4d57cc5b83f514b2bbf576fd4c33_rle_crop_4017033907_0.png resize: (144, 242) 1392125920 -1.320883620284272 treat image : temp/1762195230_2533687_1391840588_6d6e4d57cc5b83f514b2bbf576fd4c33_rle_crop_4017033908_0.png resize: (146, 109) 1392125921 -1.8671258701009223 treat image : temp/1762195230_2533687_1391840585_49aea56de6e7058e5ef12aecb60d0535_rle_crop_4017033912_0.png resize: (982, 1304) 1392125922 -1.2226938256403816 treat image : temp/1762195230_2533687_1391840581_d1e079399b0fdd252574652715b3ada7_rle_crop_4017033914_0.png resize: (528, 345) 1392125923 0.3426976080527209 treat image : temp/1762195230_2533687_1391840562_476ea9ef038b63320cdcabe9749f9f27_rle_crop_4017033921_0.png resize: (165, 310) 1392125924 -0.2998690232764035 treat image : temp/1762195230_2533687_1391840561_5181753e90c9fcc06975a97493d056da_rle_crop_4017033924_0.png resize: (139, 364) 1392125925 -0.6457426634355321 treat image : temp/1762195230_2533687_1391840559_88ee0890b5db670dd2fd5862be6a8dd5_rle_crop_4017033928_0.png resize: (132, 170) 1392125926 -1.717632488549174 treat image : temp/1762195230_2533687_1391840559_88ee0890b5db670dd2fd5862be6a8dd5_rle_crop_4017033929_0.png resize: (142, 113) 1392125927 -4.990951666528449 treat image : temp/1762195230_2533687_1391840559_88ee0890b5db670dd2fd5862be6a8dd5_rle_crop_4017033930_0.png resize: (53, 323) 1392125928 -0.6222970183887437 treat image : temp/1762195230_2533687_1391840557_bbd5f4c785e21ccfe06e7b175f980c10_rle_crop_4017033931_0.png resize: (477, 294) 1392125929 0.044043348112661786 treat image : temp/1762195230_2533687_1391840554_6fbf435fda7fbe7370c621e21fb6344f_rle_crop_4017033932_0.png resize: (164, 158) 1392125930 -0.6203002868945783 treat image : temp/1762195230_2533687_1391840527_53c31d4317d04d8b609591cb9ba7f67f_rle_crop_4017033938_0.png resize: (978, 1242) 1392125931 -2.9089215273942255 treat image : temp/1762195230_2533687_1391840527_53c31d4317d04d8b609591cb9ba7f67f_rle_crop_4017033939_0.png resize: (65, 109) 1392125932 2.5375632487519204 treat image : temp/1762195230_2533687_1391840524_cdc5c5a0ca0e2ae4cac9b2848cce2a21_rle_crop_4017033941_0.png resize: (131, 167) 1392125933 -2.7690270633218055 treat image : temp/1762195230_2533687_1391840530_114795fd5617bdcc1918aa6893b816ea_rle_crop_4017033934_0.png resize: (525, 333) 1392125935 0.7893908022840131 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 73 time used for this insertion : 0.014376640319824219 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 73 time used for this insertion : 0.014992952346801758 save missing photos in datou_result : time spend for datou_step_exec : 17.297024965286255 time spend to save output : 0.03419661521911621 total time spend for step 6 : 17.33122158050537 step7:brightness Mon Nov 3 19:42:05 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1762195230_2533687_1391840631_0850515cc6550676f67e9a6e409d7a3f.jpg treat image : temp/1762195230_2533687_1391840629_e57eb1458db406e6bb14cea995f797ac.jpg treat image : temp/1762195230_2533687_1391840628_f65a30326a94ca5f01a32f2daae61d91.jpg treat image : temp/1762195230_2533687_1391840626_689606cf13c93a91e8aeeaf4b49723d7.jpg treat image : temp/1762195230_2533687_1391840591_0c6c0b77c8013e40b0399c54adf30151.jpg treat image : temp/1762195230_2533687_1391840588_6d6e4d57cc5b83f514b2bbf576fd4c33.jpg treat image : temp/1762195230_2533687_1391840585_49aea56de6e7058e5ef12aecb60d0535.jpg treat image : temp/1762195230_2533687_1391840581_d1e079399b0fdd252574652715b3ada7.jpg treat image : temp/1762195230_2533687_1391840573_34dd0c59e72e13e1050c69f96a7382ed.jpg treat image : temp/1762195230_2533687_1391840562_476ea9ef038b63320cdcabe9749f9f27.jpg treat image : temp/1762195230_2533687_1391840561_5181753e90c9fcc06975a97493d056da.jpg treat image : temp/1762195230_2533687_1391840559_88ee0890b5db670dd2fd5862be6a8dd5.jpg treat image : temp/1762195230_2533687_1391840557_bbd5f4c785e21ccfe06e7b175f980c10.jpg treat image : temp/1762195230_2533687_1391840554_6fbf435fda7fbe7370c621e21fb6344f.jpg treat image : temp/1762195230_2533687_1391840552_58f6951685363f918c898659958cda60.jpg treat image : temp/1762195230_2533687_1391840530_114795fd5617bdcc1918aa6893b816ea.jpg treat image : temp/1762195230_2533687_1391840528_e4201672f34705c0f751e3a9cbdad678.jpg treat image : temp/1762195230_2533687_1391840527_53c31d4317d04d8b609591cb9ba7f67f.jpg treat image : temp/1762195230_2533687_1391840526_8dbf33847ae0e8c81dd01fcbb611eaf8.jpg treat image : temp/1762195230_2533687_1391840524_cdc5c5a0ca0e2ae4cac9b2848cce2a21.jpg treat image : temp/1762195230_2533687_1391840631_0850515cc6550676f67e9a6e409d7a3f_rle_crop_4017033893_0.png treat image : temp/1762195230_2533687_1391840631_0850515cc6550676f67e9a6e409d7a3f_rle_crop_4017033894_0.png treat image : temp/1762195230_2533687_1391840631_0850515cc6550676f67e9a6e409d7a3f_rle_crop_4017033896_0.png treat image : temp/1762195230_2533687_1391840631_0850515cc6550676f67e9a6e409d7a3f_rle_crop_4017033897_0.png treat image : temp/1762195230_2533687_1391840631_0850515cc6550676f67e9a6e409d7a3f_rle_crop_4017033898_0.png treat image : temp/1762195230_2533687_1391840629_e57eb1458db406e6bb14cea995f797ac_rle_crop_4017033901_0.png treat image : temp/1762195230_2533687_1391840628_f65a30326a94ca5f01a32f2daae61d91_rle_crop_4017033902_0.png treat image : temp/1762195230_2533687_1391840626_689606cf13c93a91e8aeeaf4b49723d7_rle_crop_4017033904_0.png treat image : temp/1762195230_2533687_1391840585_49aea56de6e7058e5ef12aecb60d0535_rle_crop_4017033909_0.png treat image : temp/1762195230_2533687_1391840585_49aea56de6e7058e5ef12aecb60d0535_rle_crop_4017033910_0.png treat image : temp/1762195230_2533687_1391840585_49aea56de6e7058e5ef12aecb60d0535_rle_crop_4017033911_0.png treat image : temp/1762195230_2533687_1391840581_d1e079399b0fdd252574652715b3ada7_rle_crop_4017033913_0.png treat image : temp/1762195230_2533687_1391840573_34dd0c59e72e13e1050c69f96a7382ed_rle_crop_4017033915_0.png treat image : temp/1762195230_2533687_1391840573_34dd0c59e72e13e1050c69f96a7382ed_rle_crop_4017033916_0.png treat image : temp/1762195230_2533687_1391840573_34dd0c59e72e13e1050c69f96a7382ed_rle_crop_4017033917_0.png treat image : temp/1762195230_2533687_1391840573_34dd0c59e72e13e1050c69f96a7382ed_rle_crop_4017033918_0.png treat image : temp/1762195230_2533687_1391840573_34dd0c59e72e13e1050c69f96a7382ed_rle_crop_4017033919_0.png treat image : temp/1762195230_2533687_1391840573_34dd0c59e72e13e1050c69f96a7382ed_rle_crop_4017033920_0.png treat image : temp/1762195230_2533687_1391840562_476ea9ef038b63320cdcabe9749f9f27_rle_crop_4017033922_0.png treat image : temp/1762195230_2533687_1391840562_476ea9ef038b63320cdcabe9749f9f27_rle_crop_4017033923_0.png treat image : temp/1762195230_2533687_1391840561_5181753e90c9fcc06975a97493d056da_rle_crop_4017033925_0.png treat image : temp/1762195230_2533687_1391840559_88ee0890b5db670dd2fd5862be6a8dd5_rle_crop_4017033926_0.png treat image : temp/1762195230_2533687_1391840559_88ee0890b5db670dd2fd5862be6a8dd5_rle_crop_4017033927_0.png treat image : temp/1762195230_2533687_1391840554_6fbf435fda7fbe7370c621e21fb6344f_rle_crop_4017033933_0.png treat image : temp/1762195230_2533687_1391840528_e4201672f34705c0f751e3a9cbdad678_rle_crop_4017033935_0.png treat image : temp/1762195230_2533687_1391840528_e4201672f34705c0f751e3a9cbdad678_rle_crop_4017033936_0.png treat image : temp/1762195230_2533687_1391840527_53c31d4317d04d8b609591cb9ba7f67f_rle_crop_4017033937_0.png treat image : temp/1762195230_2533687_1391840526_8dbf33847ae0e8c81dd01fcbb611eaf8_rle_crop_4017033940_0.png treat image : temp/1762195230_2533687_1391840524_cdc5c5a0ca0e2ae4cac9b2848cce2a21_rle_crop_4017033942_0.png treat image : temp/1762195230_2533687_1391840524_cdc5c5a0ca0e2ae4cac9b2848cce2a21_rle_crop_4017033945_0.png treat image : temp/1762195230_2533687_1391840631_0850515cc6550676f67e9a6e409d7a3f_rle_crop_4017033895_0.png treat image : temp/1762195230_2533687_1391840628_f65a30326a94ca5f01a32f2daae61d91_rle_crop_4017033903_0.png treat image : temp/1762195230_2533687_1391840524_cdc5c5a0ca0e2ae4cac9b2848cce2a21_rle_crop_4017033943_0.png treat image : temp/1762195230_2533687_1391840524_cdc5c5a0ca0e2ae4cac9b2848cce2a21_rle_crop_4017033944_0.png treat image : temp/1762195230_2533687_1391840629_e57eb1458db406e6bb14cea995f797ac_rle_crop_4017033899_0.png treat image : temp/1762195230_2533687_1391840629_e57eb1458db406e6bb14cea995f797ac_rle_crop_4017033900_0.png treat image : temp/1762195230_2533687_1391840626_689606cf13c93a91e8aeeaf4b49723d7_rle_crop_4017033905_0.png treat image : temp/1762195230_2533687_1391840591_0c6c0b77c8013e40b0399c54adf30151_rle_crop_4017033906_0.png treat image : temp/1762195230_2533687_1391840588_6d6e4d57cc5b83f514b2bbf576fd4c33_rle_crop_4017033907_0.png treat image : temp/1762195230_2533687_1391840588_6d6e4d57cc5b83f514b2bbf576fd4c33_rle_crop_4017033908_0.png treat image : temp/1762195230_2533687_1391840585_49aea56de6e7058e5ef12aecb60d0535_rle_crop_4017033912_0.png treat image : temp/1762195230_2533687_1391840581_d1e079399b0fdd252574652715b3ada7_rle_crop_4017033914_0.png treat image : temp/1762195230_2533687_1391840562_476ea9ef038b63320cdcabe9749f9f27_rle_crop_4017033921_0.png treat image : temp/1762195230_2533687_1391840561_5181753e90c9fcc06975a97493d056da_rle_crop_4017033924_0.png treat image : temp/1762195230_2533687_1391840559_88ee0890b5db670dd2fd5862be6a8dd5_rle_crop_4017033928_0.png treat image : temp/1762195230_2533687_1391840559_88ee0890b5db670dd2fd5862be6a8dd5_rle_crop_4017033929_0.png treat image : temp/1762195230_2533687_1391840559_88ee0890b5db670dd2fd5862be6a8dd5_rle_crop_4017033930_0.png treat image : temp/1762195230_2533687_1391840557_bbd5f4c785e21ccfe06e7b175f980c10_rle_crop_4017033931_0.png treat image : temp/1762195230_2533687_1391840554_6fbf435fda7fbe7370c621e21fb6344f_rle_crop_4017033932_0.png treat image : temp/1762195230_2533687_1391840527_53c31d4317d04d8b609591cb9ba7f67f_rle_crop_4017033938_0.png treat image : temp/1762195230_2533687_1391840527_53c31d4317d04d8b609591cb9ba7f67f_rle_crop_4017033939_0.png treat image : temp/1762195230_2533687_1391840524_cdc5c5a0ca0e2ae4cac9b2848cce2a21_rle_crop_4017033941_0.png treat image : temp/1762195230_2533687_1391840530_114795fd5617bdcc1918aa6893b816ea_rle_crop_4017033934_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 73 time used for this insertion : 0.013303518295288086 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 73 time used for this insertion : 0.014889001846313477 save missing photos in datou_result : time spend for datou_step_exec : 5.079613208770752 time spend to save output : 0.033303022384643555 total time spend for step 7 : 5.1129162311553955 step8:velours_tree Mon Nov 3 19:42:11 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.08380675315856934 time spend to save output : 3.457069396972656e-05 total time spend for step 8 : 0.08384132385253906 step9:send_mail_cod Mon Nov 3 19:42:11 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P28108358_03-11-2025_19_42_11.pdf 28113611 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette281136111762195331 28113612 change filename to text .change filename to text .change filename to text .change filename to text .imagette281136121762195332 28113613 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette281136131762195333 28113615 imagette281136151762195334 28113617 imagette281136171762195334 28113618 imagette281136181762195334 28113620 imagette281136201762195334 28113621 imagette281136211762195334 28113622 imagette281136221762195334 28113623 change filename to text .imagette281136231762195334 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=28108358 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/28113611,28113612,28113613,28113615,28113616,28113617,28113618,28113620,28113621,28113622,28113623?tags=pet_clair,carton,papier,flou,environnement,mal_croppe,metal,pehd,background,pet_fonce,autre args[1391840631] : ((1391840631, 0.3110992500824, 492688767), (1391840631, 0.8532895638740831, 2107752395), '0.07728216628086416') We are sending mail with results at report@fotonower.com args[1391840629] : ((1391840629, -3.2020531992278625, 492609224), (1391840629, 0.5710371358824972, 2107752395), '0.07728216628086416') We are sending mail with results at report@fotonower.com args[1391840628] : ((1391840628, -0.0628455720132207, 492688767), (1391840628, 0.8324774259168995, 2107752395), '0.07728216628086416') We are sending mail with results at report@fotonower.com args[1391840626] : ((1391840626, 1.1817773895725048, 492688767), (1391840626, 0.6992377162862771, 2107752395), '0.07728216628086416') We are sending mail with results at report@fotonower.com args[1391840591] : ((1391840591, -1.9944960109133725, 492688767), (1391840591, 0.39116981594788913, 2107752395), '0.07728216628086416') We are sending mail with results at report@fotonower.com args[1391840588] : ((1391840588, 0.5713019609224471, 492688767), (1391840588, 0.8346907492276701, 2107752395), '0.07728216628086416') We are sending mail with results at report@fotonower.com args[1391840585] : ((1391840585, 0.2881045059007376, 492688767), (1391840585, 0.6217651826269297, 2107752395), '0.07728216628086416') We are sending mail with results at report@fotonower.com args[1391840581] : ((1391840581, -3.893845742710129, 492609224), (1391840581, 0.7470910290023475, 2107752395), '0.07728216628086416') We are sending mail with results at report@fotonower.com args[1391840573] : ((1391840573, -1.6164856415675295, 492688767), (1391840573, 0.6975408512822578, 2107752395), '0.07728216628086416') We are sending mail with results at report@fotonower.com args[1391840562] : ((1391840562, 0.3499861002744458, 492688767), (1391840562, 0.7569748097276076, 2107752395), '0.07728216628086416') We are sending mail with results at report@fotonower.com args[1391840561] : ((1391840561, 0.020589398706848425, 492688767), (1391840561, 0.660343243265457, 2107752395), '0.07728216628086416') We are sending mail with results at report@fotonower.com args[1391840559] : ((1391840559, -0.8618465925739196, 492688767), (1391840559, 0.7250905931250021, 2107752395), '0.07728216628086416') We are sending mail with results at report@fotonower.com args[1391840557] : ((1391840557, 0.7979078057521949, 492688767), (1391840557, 0.9255352731441816, 2107752395), '0.07728216628086416') We are sending mail with results at report@fotonower.com args[1391840554] : ((1391840554, 1.1264872431001156, 492688767), (1391840554, 0.43966577872851265, 2107752395), '0.07728216628086416') We are sending mail with results at report@fotonower.com args[1391840552] : ((1391840552, 2.3546219306639475, 492688767), (1391840552, 0.45794984752305806, 2107752395), '0.07728216628086416') We are sending mail with results at report@fotonower.com args[1391840530] : ((1391840530, 0.1313121812221558, 492688767), (1391840530, 1.099731116860914, 2107752395), '0.07728216628086416') We are sending mail with results at report@fotonower.com args[1391840528] : ((1391840528, 1.1988293800246488, 492688767), (1391840528, 0.40970542764985457, 2107752395), '0.07728216628086416') We are sending mail with results at report@fotonower.com args[1391840527] : ((1391840527, -2.3832432274329616, 492609224), (1391840527, 0.9682291422666026, 2107752395), '0.07728216628086416') We are sending mail with results at report@fotonower.com args[1391840526] : ((1391840526, -4.062088313847803, 492609224), (1391840526, 0.8455514664222611, 2107752395), '0.07728216628086416') We are sending mail with results at report@fotonower.com args[1391840524] : ((1391840524, -0.7036393878486165, 492688767), (1391840524, 0.6578395805697446, 2107752395), '0.07728216628086416') We are sending mail with results at report@fotonower.com refus_total : 0.07728216628086416 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos_view ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=28108358 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28108358_03-11-2025_19_42_11.pdf results_Auto_P28108358_03-11-2025_19_42_11.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28108358_03-11-2025_19_42_11.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','28108358','results_Auto_P28108358_03-11-2025_19_42_11.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28108358_03-11-2025_19_42_11.pdf','pdf','','0.53','0.07728216628086416') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/28108358

https://www.fotonower.com/image?json=false&list_photos_id=1391840631
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1391840629
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1391840628
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1391840626
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.1817773895725048)
https://www.fotonower.com/image?json=false&list_photos_id=1391840591
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1391840588
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1391840585
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1391840581
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1391840573
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1391840562
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1391840561
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1391840559
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1391840557
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1391840554
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.1264872431001156)
https://www.fotonower.com/image?json=false&list_photos_id=1391840552
La photo est trop floue, merci de reprendre une photo.(avec le score = 2.3546219306639475)
https://www.fotonower.com/image?json=false&list_photos_id=1391840530
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1391840528
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.1988293800246488)
https://www.fotonower.com/image?json=false&list_photos_id=1391840527
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1391840526
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1391840524
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 7.73%
Veuillez trouver les photos des contaminants.

exemples de contaminants: pet_clair: https://www.fotonower.com/view/28113611?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/28113612?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/28113613?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/28113623?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28108358_03-11-2025_19_42_11.pdf.

Lien vers velours :https://marlene.fotonower.com/velours/28113611,28113612,28113613,28113615,28113616,28113617,28113618,28113620,28113621,28113622,28113623?tags=pet_clair,carton,papier,flou,environnement,mal_croppe,metal,pehd,background,pet_fonce,autre.


L'équipe Fotonower 202 b'' Server: nginx Date: Mon, 03 Nov 2025 18:42:16 GMT Content-Length: 0 Connection: close X-Message-Id: Ky9kghuHRAG8pngeIYbzaA Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1391840631, 1391840629, 1391840628, 1391840626, 1391840591, 1391840588, 1391840585, 1391840581, 1391840573, 1391840562, 1391840561, 1391840559, 1391840557, 1391840554, 1391840552, 1391840530, 1391840528, 1391840527, 1391840526, 1391840524] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840631', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840629', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840628', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840626', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840591', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840588', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840585', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840581', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840573', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840562', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840561', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840559', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840557', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840554', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840552', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840530', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840528', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840527', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840526', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840524', None, None, None, None, None, '3988924') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 20 time used for this insertion : 0.015776395797729492 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.774632692337036 time spend to save output : 0.016129732131958008 total time spend for step 9 : 5.790762424468994 step10:split_time_score Mon Nov 3 19:42:16 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('07', 20),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 21102025 28108358 Nombre de photos uploadées : 20 / 23040 (0%) 21102025 28108358 Nombre de photos taguées (types de déchets): 0 / 20 (0%) 21102025 28108358 Nombre de photos taguées (volume) : 0 / 20 (0%) elapsed_time : load_data_split_time_score 3.337860107421875e-06 elapsed_time : order_list_meta_photo_and_scores 1.0967254638671875e-05 ???????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0012259483337402344 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.21021413803100586 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.04226717892661179 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28108357_03-11-2025_18_41_28.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28108357 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28108357 AND mptpi.`type`=3594 To do Qualite : 0.07728216628086416 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28108358_03-11-2025_19_42_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28108358 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28108358 AND mptpi.`type`=3594 To do Qualite : 0.11381578735853914 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28108372_03-11-2025_18_12_59.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28108372 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28108372 AND mptpi.`type`=3594 To do Qualite : 0.12619743441358028 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28108379_03-11-2025_18_21_41.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28108379 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28108379 AND mptpi.`type`=3594 To do Qualite : 0.17316694046196734 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28108413_03-11-2025_18_03_14.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28108413 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28108413 AND mptpi.`type`=3594 To do Qualite : 0.06758523823302467 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28108416_03-11-2025_17_52_07.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28108416 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28108416 AND mptpi.`type`=3594 To do Qualite : 0.14836776620370373 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28108438_03-11-2025_17_42_28.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28108438 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28108438 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'21102025': {'nb_upload': 20, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1391840631, 1391840629, 1391840628, 1391840626, 1391840591, 1391840588, 1391840585, 1391840581, 1391840573, 1391840562, 1391840561, 1391840559, 1391840557, 1391840554, 1391840552, 1391840530, 1391840528, 1391840527, 1391840526, 1391840524] Looping around the photos to save general results len do output : 1 /28108358Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840631', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840629', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840628', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840626', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840591', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840588', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840585', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840581', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840573', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840562', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840561', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840559', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840557', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840554', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840552', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840530', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840528', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840527', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840526', None, None, None, None, None, '3988924') ('3318', None, None, None, None, None, None, None, '3988924') ('3318', '28108358', '1391840524', None, None, None, None, None, '3988924') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 21 time used for this insertion : 0.015511751174926758 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.8055191040039062 time spend to save output : 0.015836000442504883 total time spend for step 10 : 0.8213551044464111 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 20 set_done_treatment 63.07user 25.22system 1:51.66elapsed 79%CPU (0avgtext+0avgdata 3016484maxresident)k 276616inputs+42264outputs (856major+2118430minor)pagefaults 0swaps