python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1347614 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3972368'] with mtr_portfolio_ids : ['28011793'] and first list_photo_ids : [] new path : /proc/1347614/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 7 ; length of list_pids : 7 ; length of list_args : 7 time to download the photos : 1.9173882007598877 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Fri Oct 31 12:20:32 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 4694 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-10-31 12:20:35.794873: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-10-31 12:20:35.822432: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493010000 Hz 2025-10-31 12:20:35.824644: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f027c000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-10-31 12:20:35.824705: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-10-31 12:20:35.828524: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-10-31 12:20:36.051470: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x219bb200 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-10-31 12:20:36.051516: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-10-31 12:20:36.052633: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-10-31 12:20:36.053047: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-31 12:20:36.056162: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-31 12:20:36.059194: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-10-31 12:20:36.059620: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-10-31 12:20:36.063282: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-10-31 12:20:36.065629: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-10-31 12:20:36.072832: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-10-31 12:20:36.073983: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-10-31 12:20:36.074070: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-31 12:20:36.074695: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-10-31 12:20:36.074712: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-10-31 12:20:36.074721: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-10-31 12:20:36.075714: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 4242 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-10-31 12:20:36.371108: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-10-31 12:20:36.371230: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-31 12:20:36.371265: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-31 12:20:36.371292: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-10-31 12:20:36.371318: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-10-31 12:20:36.371344: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-10-31 12:20:36.371370: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-10-31 12:20:36.371395: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-10-31 12:20:36.372738: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-10-31 12:20:36.374149: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-10-31 12:20:36.374237: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-31 12:20:36.374265: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-31 12:20:36.374305: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-10-31 12:20:36.374329: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-10-31 12:20:36.374351: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-10-31 12:20:36.374374: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-10-31 12:20:36.374397: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-10-31 12:20:36.375771: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-10-31 12:20:36.375830: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-10-31 12:20:36.375846: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-10-31 12:20:36.375859: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-10-31 12:20:36.377308: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 4242 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-10-31 12:20:47.146606: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-31 12:20:47.351061: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-10-31 12:20:48.829970: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.64G (3913154560 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-31 12:20:48.830627: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.28G (3521839104 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-31 12:20:48.831236: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.95G (3169655040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-31 12:20:48.831840: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2852689408 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-31 12:20:49.566723: W tensorflow/core/common_runtime/bfc_allocator.cc:311] Garbage collection: deallocate free memory regions (i.e., allocations) so that we can re-allocate a larger region to avoid OOM due to memory fragmentation. If you see this message frequently, you are running near the threshold of the available device memory and re-allocation may incur great performance overhead. You may try smaller batch sizes to observe the performance impact. Set TF_ENABLE_GPU_GARBAGE_COLLECTION=false if you'd like to disable this feature. 2025-10-31 12:20:49.628440: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.64G (3913154560 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-31 12:20:49.628481: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.67GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-31 12:20:49.629148: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.64G (3913154560 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-31 12:20:49.629164: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.67GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-31 12:20:49.637249: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.64G (3913154560 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-31 12:20:49.637285: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 3.29GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-31 12:20:49.638462: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.64G (3913154560 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-31 12:20:49.638493: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 3.29GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-31 12:20:49.644711: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.64G (3913154560 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-31 12:20:49.644732: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 1.78GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-31 12:20:49.645402: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.64G (3913154560 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-31 12:20:49.645419: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 1.78GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-31 12:20:49.673570: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.64G (3913154560 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-31 12:20:49.673667: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 19.91MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-31 12:20:49.673683: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-10-31 12:20:49.674708: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.64G (3913154560 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-31 12:20:49.674731: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 16.00MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-31 12:20:49.675701: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.64G (3913154560 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-31 12:20:49.675723: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 16.00MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-31 12:20:49.683396: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.64G (3913154560 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-31 12:20:49.683495: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 63.85MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-10-31 12:20:49.684674: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.64G (3913154560 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-31 12:20:49.685873: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.64G (3913154560 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-31 12:20:49.687098: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.64G (3913154560 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-31 12:20:49.696871: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.64G (3913154560 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-31 12:20:49.698489: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.64G (3913154560 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-31 12:20:49.715953: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.64G (3913154560 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-31 12:20:49.716896: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.64G (3913154560 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-31 12:20:49.717770: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.64G (3913154560 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-31 12:20:49.718653: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.64G (3913154560 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-31 12:20:49.722978: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.64G (3913154560 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-31 12:20:49.723679: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.64G (3913154560 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-31 12:20:49.724358: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.64G (3913154560 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-31 12:20:49.725036: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.64G (3913154560 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-31 12:20:49.726397: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.64G (3913154560 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-31 12:20:49.737388: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.64G (3913154560 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-31 12:20:49.738625: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.64G (3913154560 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-31 12:20:49.748197: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.64G (3913154560 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-31 12:20:49.749073: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.64G (3913154560 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-31 12:20:49.749948: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.64G (3913154560 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-31 12:20:49.750858: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.64G (3913154560 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-31 12:20:49.751610: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.64G (3913154560 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-10-31 12:20:49.752321: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.64G (3913154560 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 7 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 21 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 19 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 20 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 16 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 22 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 13 Detection mask done ! Trying to reset tf kernel 1348057 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 2308 tf kernel not reseted sub process len(results) : 7 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 7 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 4694 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.001020669937133789 nb_pixel_total : 34852 time to create 1 rle with old method : 0.03886103630065918 length of segment : 167 time for calcul the mask position with numpy : 0.0006859302520751953 nb_pixel_total : 35161 time to create 1 rle with old method : 0.03887629508972168 length of segment : 328 time for calcul the mask position with numpy : 0.002432584762573242 nb_pixel_total : 98070 time to create 1 rle with old method : 0.1075737476348877 length of segment : 508 time for calcul the mask position with numpy : 0.0007953643798828125 nb_pixel_total : 39576 time to create 1 rle with old method : 0.04716324806213379 length of segment : 328 time for calcul the mask position with numpy : 0.002050638198852539 nb_pixel_total : 118764 time to create 1 rle with old method : 0.14273905754089355 length of segment : 366 time for calcul the mask position with numpy : 0.000339508056640625 nb_pixel_total : 17182 time to create 1 rle with old method : 0.019114017486572266 length of segment : 132 time for calcul the mask position with numpy : 0.0003113746643066406 nb_pixel_total : 14827 time to create 1 rle with old method : 0.018569469451904297 length of segment : 147 time for calcul the mask position with numpy : 0.0010831356048583984 nb_pixel_total : 48602 time to create 1 rle with old method : 0.05592799186706543 length of segment : 277 time for calcul the mask position with numpy : 0.00037789344787597656 nb_pixel_total : 14742 time to create 1 rle with old method : 0.017083406448364258 length of segment : 168 time for calcul the mask position with numpy : 0.0012764930725097656 nb_pixel_total : 83176 time to create 1 rle with old method : 0.09128618240356445 length of segment : 363 time for calcul the mask position with numpy : 0.00035452842712402344 nb_pixel_total : 23033 time to create 1 rle with old method : 0.025357484817504883 length of segment : 139 time for calcul the mask position with numpy : 0.001653432846069336 nb_pixel_total : 87570 time to create 1 rle with old method : 0.09531235694885254 length of segment : 295 time for calcul the mask position with numpy : 0.0006062984466552734 nb_pixel_total : 32103 time to create 1 rle with old method : 0.04109644889831543 length of segment : 282 time for calcul the mask position with numpy : 0.0003845691680908203 nb_pixel_total : 17664 time to create 1 rle with old method : 0.01990818977355957 length of segment : 227 time for calcul the mask position with numpy : 0.002645730972290039 nb_pixel_total : 113005 time to create 1 rle with old method : 0.12528634071350098 length of segment : 376 time for calcul the mask position with numpy : 0.0008475780487060547 nb_pixel_total : 42067 time to create 1 rle with old method : 0.04990029335021973 length of segment : 244 time for calcul the mask position with numpy : 0.0012662410736083984 nb_pixel_total : 79332 time to create 1 rle with old method : 0.09287023544311523 length of segment : 405 time for calcul the mask position with numpy : 0.0008950233459472656 nb_pixel_total : 47868 time to create 1 rle with old method : 0.05363607406616211 length of segment : 231 time for calcul the mask position with numpy : 0.002182483673095703 nb_pixel_total : 138285 time to create 1 rle with old method : 0.15082001686096191 length of segment : 448 time for calcul the mask position with numpy : 0.0017769336700439453 nb_pixel_total : 53953 time to create 1 rle with old method : 0.06022143363952637 length of segment : 424 time for calcul the mask position with numpy : 0.0009131431579589844 nb_pixel_total : 57073 time to create 1 rle with old method : 0.06357169151306152 length of segment : 266 time for calcul the mask position with numpy : 0.001207113265991211 nb_pixel_total : 76020 time to create 1 rle with old method : 0.08464407920837402 length of segment : 371 time for calcul the mask position with numpy : 0.0006115436553955078 nb_pixel_total : 38526 time to create 1 rle with old method : 0.04910683631896973 length of segment : 195 time for calcul the mask position with numpy : 0.0003437995910644531 nb_pixel_total : 18170 time to create 1 rle with old method : 0.0206298828125 length of segment : 175 time for calcul the mask position with numpy : 0.0020835399627685547 nb_pixel_total : 104979 time to create 1 rle with old method : 0.11530256271362305 length of segment : 475 time for calcul the mask position with numpy : 0.00041294097900390625 nb_pixel_total : 14644 time to create 1 rle with old method : 0.016362428665161133 length of segment : 255 time for calcul the mask position with numpy : 0.00016045570373535156 nb_pixel_total : 6017 time to create 1 rle with old method : 0.007113456726074219 length of segment : 80 time for calcul the mask position with numpy : 0.0006093978881835938 nb_pixel_total : 40668 time to create 1 rle with old method : 0.04487895965576172 length of segment : 260 time for calcul the mask position with numpy : 0.0003032684326171875 nb_pixel_total : 16020 time to create 1 rle with old method : 0.01839160919189453 length of segment : 109 time for calcul the mask position with numpy : 0.005995512008666992 nb_pixel_total : 236749 time to create 1 rle with new method : 0.01891779899597168 length of segment : 1051 time for calcul the mask position with numpy : 0.003892660140991211 nb_pixel_total : 115789 time to create 1 rle with old method : 0.12787723541259766 length of segment : 448 time for calcul the mask position with numpy : 0.0011026859283447266 nb_pixel_total : 58210 time to create 1 rle with old method : 0.06817913055419922 length of segment : 354 time for calcul the mask position with numpy : 0.004603147506713867 nb_pixel_total : 218793 time to create 1 rle with new method : 0.017291784286499023 length of segment : 730 time for calcul the mask position with numpy : 0.003149271011352539 nb_pixel_total : 94899 time to create 1 rle with old method : 0.10887813568115234 length of segment : 623 time for calcul the mask position with numpy : 0.0005671977996826172 nb_pixel_total : 15551 time to create 1 rle with old method : 0.017930030822753906 length of segment : 105 time for calcul the mask position with numpy : 0.00038909912109375 nb_pixel_total : 10131 time to create 1 rle with old method : 0.011473655700683594 length of segment : 131 time for calcul the mask position with numpy : 0.0008065700531005859 nb_pixel_total : 22684 time to create 1 rle with old method : 0.02557063102722168 length of segment : 180 time for calcul the mask position with numpy : 0.0023021697998046875 nb_pixel_total : 104274 time to create 1 rle with old method : 0.11922621726989746 length of segment : 408 time for calcul the mask position with numpy : 0.0015587806701660156 nb_pixel_total : 61523 time to create 1 rle with old method : 0.06947660446166992 length of segment : 328 time for calcul the mask position with numpy : 0.0005385875701904297 nb_pixel_total : 18439 time to create 1 rle with old method : 0.02132582664489746 length of segment : 130 time for calcul the mask position with numpy : 0.0010221004486083984 nb_pixel_total : 34102 time to create 1 rle with old method : 0.040428876876831055 length of segment : 204 time for calcul the mask position with numpy : 0.0006496906280517578 nb_pixel_total : 30073 time to create 1 rle with old method : 0.03414607048034668 length of segment : 258 time for calcul the mask position with numpy : 0.0009753704071044922 nb_pixel_total : 24204 time to create 1 rle with old method : 0.02886652946472168 length of segment : 170 time for calcul the mask position with numpy : 0.0006113052368164062 nb_pixel_total : 16986 time to create 1 rle with old method : 0.019405364990234375 length of segment : 158 time for calcul the mask position with numpy : 0.0054743289947509766 nb_pixel_total : 143710 time to create 1 rle with old method : 0.15944314002990723 length of segment : 603 time for calcul the mask position with numpy : 0.0005049705505371094 nb_pixel_total : 5556 time to create 1 rle with old method : 0.006838798522949219 length of segment : 258 time for calcul the mask position with numpy : 0.002620697021484375 nb_pixel_total : 80336 time to create 1 rle with old method : 0.09010195732116699 length of segment : 461 time for calcul the mask position with numpy : 0.002608060836791992 nb_pixel_total : 80485 time to create 1 rle with old method : 0.08730626106262207 length of segment : 364 time for calcul the mask position with numpy : 0.0013682842254638672 nb_pixel_total : 35871 time to create 1 rle with old method : 0.04074287414550781 length of segment : 217 time for calcul the mask position with numpy : 0.0014998912811279297 nb_pixel_total : 44823 time to create 1 rle with old method : 0.05031752586364746 length of segment : 295 time for calcul the mask position with numpy : 0.000843048095703125 nb_pixel_total : 36905 time to create 1 rle with old method : 0.04249095916748047 length of segment : 320 time for calcul the mask position with numpy : 0.003324747085571289 nb_pixel_total : 93239 time to create 1 rle with old method : 0.10573077201843262 length of segment : 371 time for calcul the mask position with numpy : 0.0008752346038818359 nb_pixel_total : 25436 time to create 1 rle with old method : 0.02954244613647461 length of segment : 207 time for calcul the mask position with numpy : 0.0008981227874755859 nb_pixel_total : 32864 time to create 1 rle with old method : 0.03759646415710449 length of segment : 147 time for calcul the mask position with numpy : 0.0011112689971923828 nb_pixel_total : 30704 time to create 1 rle with old method : 0.03557157516479492 length of segment : 183 time for calcul the mask position with numpy : 0.0008533000946044922 nb_pixel_total : 30429 time to create 1 rle with old method : 0.03606915473937988 length of segment : 219 time for calcul the mask position with numpy : 0.0006794929504394531 nb_pixel_total : 24443 time to create 1 rle with old method : 0.0291750431060791 length of segment : 143 time for calcul the mask position with numpy : 0.0017476081848144531 nb_pixel_total : 75470 time to create 1 rle with old method : 0.0862431526184082 length of segment : 303 time for calcul the mask position with numpy : 0.002907991409301758 nb_pixel_total : 119573 time to create 1 rle with old method : 0.13635754585266113 length of segment : 404 time for calcul the mask position with numpy : 0.0007479190826416016 nb_pixel_total : 16812 time to create 1 rle with old method : 0.020095109939575195 length of segment : 201 time for calcul the mask position with numpy : 0.00044345855712890625 nb_pixel_total : 14908 time to create 1 rle with old method : 0.017412662506103516 length of segment : 102 time spent for convertir_results : 6.147078275680542 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 61 chid ids of type : 3594 Number RLEs to save : 18117 save missing photos in datou_result : time spend for datou_step_exec : 46.376996994018555 time spend to save output : 0.9993155002593994 total time spend for step 1 : 47.376312494277954 step2:crop_condition Fri Oct 31 12:21:20 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 7 ! batch 1 Loaded 61 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 38 About to insert : list_path_to_insert length 38 new photo from crops ! About to upload 38 photos upload in portfolio : 3736932 init cache_photo without model_param we have 38 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1761909692_1347614 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761909701), 0.0, 0.0, 14, '', 0, 0, '1761909630_1347614_1390391787_3524762efa0c42b4adfe38b3cd8c7164_58122654_rle_crop_4009600561_0.png', 0, 348, 167, 0, 1761909701,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761909701), 0.0, 0.0, 14, '', 0, 0, '1761909630_1347614_1390391787_3524762efa0c42b4adfe38b3cd8c7164_58122654_rle_crop_4009600562_0.png', 0, 129, 328, 0, 1761909701,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761909701), 0.0, 0.0, 14, '', 0, 0, '1761909630_1347614_1390391787_3524762efa0c42b4adfe38b3cd8c7164_58122654_rle_crop_4009600563_0.png', 0, 344, 445, 0, 1761909701,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761909701), 0.0, 0.0, 14, '', 0, 0, '1761909630_1347614_1390391787_3524762efa0c42b4adfe38b3cd8c7164_58122654_rle_crop_4009600568_0.png', 0, 278, 277, 0, 1761909701,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761909701), 0.0, 0.0, 14, '', 0, 0, '1761909630_1347614_1390391787_3524762efa0c42b4adfe38b3cd8c7164_58122654_rle_crop_4009600569_0.png', 0, 162, 152, 0, 1761909701,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761909701), 0.0, 0.0, 14, '', 0, 0, '1761909630_1347614_1390391786_10f70560e937598b970019006cc49ba5_83989849_rle_crop_4009600572_0.png', 0, 535, 283, 0, 1761909701,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761909701), 0.0, 0.0, 14, '', 0, 0, '1761909630_1347614_1390391786_10f70560e937598b970019006cc49ba5_83989849_rle_crop_4009600573_0.png', 0, 261, 235, 0, 1761909701,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761909701), 0.0, 0.0, 14, '', 0, 0, '1761909630_1347614_1390391786_10f70560e937598b970019006cc49ba5_83989849_rle_crop_4009600576_0.png', 0, 248, 237, 0, 1761909701,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761909701), 0.0, 0.0, 14, '', 0, 0, '1761909630_1347614_1390391784_96e480be1a348b18052f40b3060dbf6c_25830176_rle_crop_4009600577_0.png', 0, 275, 391, 0, 1761909701,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761909701), 0.0, 0.0, 14, '', 0, 0, '1761909630_1347614_1390391784_96e480be1a348b18052f40b3060dbf6c_25830176_rle_crop_4009600578_0.png', 0, 336, 231, 0, 1761909701,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761909701), 0.0, 0.0, 14, '', 0, 0, '1761909630_1347614_1390391784_96e480be1a348b18052f40b3060dbf6c_25830176_rle_crop_4009600579_0.png', 0, 466, 448, 0, 1761909701,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761909701), 0.0, 0.0, 14, '', 0, 0, '1761909630_1347614_1390391784_96e480be1a348b18052f40b3060dbf6c_25830176_rle_crop_4009600580_0.png', 0, 424, 410, 0, 1761909701,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761909701), 0.0, 0.0, 14, '', 0, 0, '1761909630_1347614_1390391784_96e480be1a348b18052f40b3060dbf6c_25830176_rle_crop_4009600581_0.png', 0, 313, 250, 0, 1761909701,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761909701), 0.0, 0.0, 14, '', 0, 0, '1761909630_1347614_1390391784_96e480be1a348b18052f40b3060dbf6c_25830176_rle_crop_4009600584_0.png', 0, 163, 173, 0, 1761909701,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761909701), 0.0, 0.0, 14, '', 0, 0, '1761909630_1347614_1390391784_96e480be1a348b18052f40b3060dbf6c_25830176_rle_crop_4009600585_0.png', 0, 439, 471, 0, 1761909701,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761909701), 0.0, 0.0, 14, '', 0, 0, '1761909630_1347614_1390391784_96e480be1a348b18052f40b3060dbf6c_25830176_rle_crop_4009600586_0.png', 0, 106, 254, 0, 1761909701,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761909701), 0.0, 0.0, 14, '', 0, 0, '1761909630_1347614_1390391784_96e480be1a348b18052f40b3060dbf6c_25830176_rle_crop_4009600587_0.png', 0, 119, 80, 0, 1761909701,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761909701), 0.0, 0.0, 14, '', 0, 0, '1761909630_1347614_1390391784_96e480be1a348b18052f40b3060dbf6c_25830176_rle_crop_4009600588_0.png', 0, 218, 242, 0, 1761909701,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761909701), 0.0, 0.0, 14, '', 0, 0, '1761909630_1347614_1390391784_96e480be1a348b18052f40b3060dbf6c_25830176_rle_crop_4009600589_0.png', 0, 228, 109, 0, 1761909701,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761909701), 0.0, 0.0, 14, '', 0, 0, '1761909630_1347614_1390391759_7d34300fa3f6707b3ac4b9ff757b0fad_19561572_rle_crop_4009600591_0.png', 0, 552, 442, 0, 1761909701,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761909701), 0.0, 0.0, 14, '', 0, 0, '1761909630_1347614_1390391759_7d34300fa3f6707b3ac4b9ff757b0fad_19561572_rle_crop_4009600592_0.png', 0, 264, 354, 0, 1761909701,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761909701), 0.0, 0.0, 14, '', 0, 0, '1761909630_1347614_1390391759_7d34300fa3f6707b3ac4b9ff757b0fad_19561572_rle_crop_4009600593_0.png', 0, 612, 646, 0, 1761909701,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761909701), 0.0, 0.0, 14, '', 0, 0, '1761909630_1347614_1390391759_7d34300fa3f6707b3ac4b9ff757b0fad_19561572_rle_crop_4009600594_0.png', 0, 429, 385, 0, 1761909701,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761909701), 0.0, 0.0, 14, '', 0, 0, '1761909630_1347614_1390391759_7d34300fa3f6707b3ac4b9ff757b0fad_19561572_rle_crop_4009600596_0.png', 0, 102, 130, 0, 1761909701,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761909701), 0.0, 0.0, 14, '', 0, 0, '1761909630_1347614_1390391759_7d34300fa3f6707b3ac4b9ff757b0fad_19561572_rle_crop_4009600597_0.png', 0, 180, 180, 0, 1761909701,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761909701), 0.0, 0.0, 14, '', 0, 0, '1761909630_1347614_1390391757_d8cf6f73ea6319b0dca320d0d157a942_47225835_rle_crop_4009600602_0.png', 0, 175, 256, 0, 1761909701,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761909701), 0.0, 0.0, 14, '', 0, 0, '1761909630_1347614_1390391755_98fff74656804c08078bed8d84d7399d_73529308_rle_crop_4009600603_0.png', 0, 255, 156, 0, 1761909701,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761909701), 0.0, 0.0, 14, '', 0, 0, '1761909630_1347614_1390391755_98fff74656804c08078bed8d84d7399d_73529308_rle_crop_4009600604_0.png', 0, 119, 157, 0, 1761909701,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761909701), 0.0, 0.0, 14, '', 0, 0, '1761909630_1347614_1390391755_98fff74656804c08078bed8d84d7399d_73529308_rle_crop_4009600605_0.png', 0, 464, 603, 0, 1761909701,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761909701), 0.0, 0.0, 14, '', 0, 0, '1761909630_1347614_1390391755_98fff74656804c08078bed8d84d7399d_73529308_rle_crop_4009600606_0.png', 0, 118, 157, 0, 1761909701,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761909701), 0.0, 0.0, 14, '', 0, 0, '1761909630_1347614_1390391755_98fff74656804c08078bed8d84d7399d_73529308_rle_crop_4009600607_0.png', 0, 244, 461, 0, 1761909701,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761909701), 0.0, 0.0, 14, '', 0, 0, '1761909630_1347614_1390391755_98fff74656804c08078bed8d84d7399d_73529308_rle_crop_4009600608_0.png', 0, 377, 320, 0, 1761909701,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761909701), 0.0, 0.0, 14, '', 0, 0, '1761909630_1347614_1390391755_98fff74656804c08078bed8d84d7399d_73529308_rle_crop_4009600609_0.png', 0, 323, 216, 0, 1761909701,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761909701), 0.0, 0.0, 14, '', 0, 0, '1761909630_1347614_1390391755_98fff74656804c08078bed8d84d7399d_73529308_rle_crop_4009600610_0.png', 0, 287, 260, 0, 1761909701,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761909701), 0.0, 0.0, 14, '', 0, 0, '1761909630_1347614_1390391755_98fff74656804c08078bed8d84d7399d_73529308_rle_crop_4009600611_0.png', 0, 276, 254, 0, 1761909701,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761909701), 0.0, 0.0, 14, '', 0, 0, '1761909630_1347614_1390391755_98fff74656804c08078bed8d84d7399d_73529308_rle_crop_4009600612_0.png', 0, 436, 357, 0, 1761909701,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761909701), 0.0, 0.0, 14, '', 0, 0, '1761909630_1347614_1390391755_98fff74656804c08078bed8d84d7399d_73529308_rle_crop_4009600615_0.png', 0, 246, 183, 0, 1761909701,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761909701), 0.0, 0.0, 14, '', 0, 0, '1761909630_1347614_1390391751_de789b99d190d475801e6946895f17ed_45007923_rle_crop_4009600616_0.png', 0, 343, 141, 0, 1761909701,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 38 photos in the portfolio 3736932 time of upload the photos Elapsed time : 10.09872579574585 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3736932 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1761909704_1347614 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761909704), 0.0, 0.0, 14, '', 0, 0, '1761909630_1347614_1390391787_3524762efa0c42b4adfe38b3cd8c7164_58122654_rle_crop_4009600567_0.png', 0, 157, 147, 0, 1761909704,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761909704), 0.0, 0.0, 14, '', 0, 0, '1761909630_1347614_1390391786_10f70560e937598b970019006cc49ba5_83989849_rle_crop_4009600574_0.png', 0, 140, 219, 0, 1761909704,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761909704), 0.0, 0.0, 14, '', 0, 0, '1761909630_1347614_1390391757_d8cf6f73ea6319b0dca320d0d157a942_47225835_rle_crop_4009600601_0.png', 0, 253, 198, 0, 1761909704,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761909704), 0.0, 0.0, 14, '', 0, 0, '1761909630_1347614_1390391751_de789b99d190d475801e6946895f17ed_45007923_rle_crop_4009600620_0.png', 0, 134, 200, 0, 1761909704,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 4 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.2720186710357666 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 14 About to insert : list_path_to_insert length 14 new photo from crops ! About to upload 14 photos upload in portfolio : 3736932 init cache_photo without model_param we have 14 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1761909710_1347614 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761909713), 0.0, 0.0, 14, '', 0, 0, '1761909630_1347614_1390391787_3524762efa0c42b4adfe38b3cd8c7164_58122654_rle_crop_4009600564_0.png', 0, 184, 314, 0, 1761909713,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761909713), 0.0, 0.0, 14, '', 0, 0, '1761909630_1347614_1390391787_3524762efa0c42b4adfe38b3cd8c7164_58122654_rle_crop_4009600565_0.png', 0, 438, 359, 0, 1761909713,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761909713), 0.0, 0.0, 14, '', 0, 0, '1761909630_1347614_1390391787_3524762efa0c42b4adfe38b3cd8c7164_58122654_rle_crop_4009600566_0.png', 0, 186, 132, 0, 1761909713,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761909713), 0.0, 0.0, 14, '', 0, 0, '1761909630_1347614_1390391786_10f70560e937598b970019006cc49ba5_83989849_rle_crop_4009600570_0.png', 0, 326, 320, 0, 1761909713,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761909713), 0.0, 0.0, 14, '', 0, 0, '1761909630_1347614_1390391786_10f70560e937598b970019006cc49ba5_83989849_rle_crop_4009600575_0.png', 0, 436, 366, 0, 1761909713,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761909713), 0.0, 0.0, 14, '', 0, 0, '1761909630_1347614_1390391784_96e480be1a348b18052f40b3060dbf6c_25830176_rle_crop_4009600582_0.png', 0, 289, 368, 0, 1761909713,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761909713), 0.0, 0.0, 14, '', 0, 0, '1761909630_1347614_1390391759_7d34300fa3f6707b3ac4b9ff757b0fad_19561572_rle_crop_4009600595_0.png', 0, 171, 103, 0, 1761909713,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761909713), 0.0, 0.0, 14, '', 0, 0, '1761909630_1347614_1390391757_d8cf6f73ea6319b0dca320d0d157a942_47225835_rle_crop_4009600598_0.png', 0, 341, 391, 0, 1761909713,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761909713), 0.0, 0.0, 14, '', 0, 0, '1761909630_1347614_1390391757_d8cf6f73ea6319b0dca320d0d157a942_47225835_rle_crop_4009600599_0.png', 0, 294, 325, 0, 1761909713,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761909713), 0.0, 0.0, 14, '', 0, 0, '1761909630_1347614_1390391755_98fff74656804c08078bed8d84d7399d_73529308_rle_crop_4009600613_0.png', 0, 154, 207, 0, 1761909713,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761909713), 0.0, 0.0, 14, '', 0, 0, '1761909630_1347614_1390391755_98fff74656804c08078bed8d84d7399d_73529308_rle_crop_4009600614_0.png', 0, 285, 145, 0, 1761909713,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761909713), 0.0, 0.0, 14, '', 0, 0, '1761909630_1347614_1390391751_de789b99d190d475801e6946895f17ed_45007923_rle_crop_4009600618_0.png', 0, 345, 282, 0, 1761909713,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761909713), 0.0, 0.0, 14, '', 0, 0, '1761909630_1347614_1390391751_de789b99d190d475801e6946895f17ed_45007923_rle_crop_4009600619_0.png', 0, 436, 396, 0, 1761909713,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761909713), 0.0, 0.0, 14, '', 0, 0, '1761909630_1347614_1390391751_de789b99d190d475801e6946895f17ed_45007923_rle_crop_4009600621_0.png', 0, 189, 101, 0, 1761909713,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 14 photos in the portfolio 3736932 time of upload the photos Elapsed time : 3.9866840839385986 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3736932 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1761909715_1347614 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761909716), 0.0, 0.0, 14, '', 0, 0, '1761909630_1347614_1390391786_10f70560e937598b970019006cc49ba5_83989849_rle_crop_4009600571_0.png', 0, 208, 139, 0, 1761909716,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761909716), 0.0, 0.0, 14, '', 0, 0, '1761909630_1347614_1390391784_96e480be1a348b18052f40b3060dbf6c_25830176_rle_crop_4009600583_0.png', 0, 291, 192, 0, 1761909716,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761909716), 0.0, 0.0, 14, '', 0, 0, '1761909630_1347614_1390391757_d8cf6f73ea6319b0dca320d0d157a942_47225835_rle_crop_4009600600_0.png', 0, 168, 130, 0, 1761909716,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761909716), 0.0, 0.0, 14, '', 0, 0, '1761909630_1347614_1390391751_de789b99d190d475801e6946895f17ed_45007923_rle_crop_4009600617_0.png', 0, 211, 143, 0, 1761909716,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 4 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.2974727153778076 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1761909719_1347614 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1761909719), 0.0, 0.0, 14, '', 0, 0, '1761909630_1347614_1390391784_96e480be1a348b18052f40b3060dbf6c_25830176_rle_crop_4009600590_0.png', 0, 562, 764, 0, 1761909719,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.6342592239379883 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1390391787, 1390391786, 1390391784, 1390391759, 1390391757, 1390391755, 1390391751] Looping around the photos to save general results len do output : 61 /1391153520Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391153521Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391153522Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391153523Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391153525Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391153526Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391153527Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391153528Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391153530Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391153531Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391153532Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391153533Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391153535Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391153536Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391153537Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391153539Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391153541Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391153542Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391153543Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391153544Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391153546Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391153547Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391153548Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391153549Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391153551Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391153552Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391153553Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391153555Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391153558Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391153559Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391153560Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391153561Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391153562Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391153564Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391153565Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391153566Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391153567Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391153569Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391153593Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391153594Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391153596Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391153597Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391153678Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391153680Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391153681Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391153682Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391153683Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391153685Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391153686Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391153687Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391153688Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391153690Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391153692Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391153693Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391153694Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391153696Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391153721Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391153722Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391153724Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391153725Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1391153753Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3972368') ('3318', '28011793', '1390391787', None, None, None, None, None, '3972368') ('3318', None, None, None, None, None, None, None, '3972368') ('3318', '28011793', '1390391786', None, None, None, None, None, '3972368') ('3318', None, None, None, None, None, None, None, '3972368') ('3318', '28011793', '1390391784', None, None, None, None, None, '3972368') ('3318', None, None, None, None, None, None, None, '3972368') ('3318', '28011793', '1390391759', None, None, None, None, None, '3972368') ('3318', None, None, None, None, None, None, None, '3972368') ('3318', '28011793', '1390391757', None, None, None, None, None, '3972368') ('3318', None, None, None, None, None, None, None, '3972368') ('3318', '28011793', '1390391755', None, None, None, None, None, '3972368') ('3318', None, None, None, None, None, None, None, '3972368') ('3318', '28011793', '1390391751', None, None, None, None, None, '3972368') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 190 time used for this insertion : 0.0181882381439209 save_final save missing photos in datou_result : time spend for datou_step_exec : 39.77135920524597 time spend to save output : 0.02060246467590332 total time spend for step 2 : 39.791961669921875 step3:rle_unique_nms_with_priority Fri Oct 31 12:22:00 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 61 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 9 nb_hashtags : 3 time to prepare the origin masks : 7.138435363769531 time for calcul the mask position with numpy : 0.6748266220092773 nb_pixel_total : 7872624 time to create 1 rle with new method : 0.5780060291290283 time for calcul the mask position with numpy : 0.03616213798522949 nb_pixel_total : 14742 time to create 1 rle with old method : 0.017534971237182617 time for calcul the mask position with numpy : 0.027124643325805664 nb_pixel_total : 48602 time to create 1 rle with old method : 0.055643558502197266 time for calcul the mask position with numpy : 0.02463817596435547 nb_pixel_total : 14827 time to create 1 rle with old method : 0.017063379287719727 time for calcul the mask position with numpy : 0.025049924850463867 nb_pixel_total : 17182 time to create 1 rle with old method : 0.028385639190673828 time for calcul the mask position with numpy : 0.02942514419555664 nb_pixel_total : 118764 time to create 1 rle with old method : 0.1369938850402832 time for calcul the mask position with numpy : 0.028277873992919922 nb_pixel_total : 39576 time to create 1 rle with old method : 0.04683804512023926 time for calcul the mask position with numpy : 0.02608013153076172 nb_pixel_total : 98070 time to create 1 rle with old method : 0.11599564552307129 time for calcul the mask position with numpy : 0.02643108367919922 nb_pixel_total : 35161 time to create 1 rle with old method : 0.04109907150268555 time for calcul the mask position with numpy : 0.025916099548339844 nb_pixel_total : 34852 time to create 1 rle with old method : 0.03993058204650879 create new chi : 2.043215751647949 time to delete rle : 0.024118900299072266 batch 1 Loaded 19 chid ids of type : 3594 +++++++++++++Number RLEs to save : 7002 TO DO : save crop sub photo not yet done ! save time : 0.38480639457702637 nb_obj : 7 nb_hashtags : 4 time to prepare the origin masks : 6.546172380447388 time for calcul the mask position with numpy : 1.5277581214904785 nb_pixel_total : 7895782 time to create 1 rle with new method : 1.5843870639801025 time for calcul the mask position with numpy : 0.02505779266357422 nb_pixel_total : 42067 time to create 1 rle with old method : 0.04928326606750488 time for calcul the mask position with numpy : 0.029574155807495117 nb_pixel_total : 113005 time to create 1 rle with old method : 0.13444304466247559 time for calcul the mask position with numpy : 0.02613043785095215 nb_pixel_total : 17664 time to create 1 rle with old method : 0.020856380462646484 time for calcul the mask position with numpy : 0.025528669357299805 nb_pixel_total : 32103 time to create 1 rle with old method : 0.0375974178314209 time for calcul the mask position with numpy : 0.028516769409179688 nb_pixel_total : 87570 time to create 1 rle with old method : 0.1000218391418457 time for calcul the mask position with numpy : 0.025465965270996094 nb_pixel_total : 23033 time to create 1 rle with old method : 0.02695155143737793 time for calcul the mask position with numpy : 0.025057554244995117 nb_pixel_total : 83176 time to create 1 rle with old method : 0.09696459770202637 create new chi : 3.8081698417663574 time to delete rle : 0.0010037422180175781 batch 1 Loaded 15 chid ids of type : 3594 ++++++++Number RLEs to save : 6012 TO DO : save crop sub photo not yet done ! save time : 0.3373546600341797 nb_obj : 14 nb_hashtags : 4 time to prepare the origin masks : 13.141717195510864 time for calcul the mask position with numpy : 0.570533275604248 nb_pixel_total : 7366096 time to create 1 rle with new method : 0.8929035663604736 time for calcul the mask position with numpy : 0.027004480361938477 nb_pixel_total : 236749 time to create 1 rle with new method : 1.2503979206085205 time for calcul the mask position with numpy : 0.026134252548217773 nb_pixel_total : 16020 time to create 1 rle with old method : 0.018721818923950195 time for calcul the mask position with numpy : 0.025508880615234375 nb_pixel_total : 40668 time to create 1 rle with old method : 0.04683041572570801 time for calcul the mask position with numpy : 0.023905277252197266 nb_pixel_total : 6017 time to create 1 rle with old method : 0.007081270217895508 time for calcul the mask position with numpy : 0.024972915649414062 nb_pixel_total : 14644 time to create 1 rle with old method : 0.016860485076904297 time for calcul the mask position with numpy : 0.02451014518737793 nb_pixel_total : 104979 time to create 1 rle with old method : 0.12012505531311035 time for calcul the mask position with numpy : 0.02443099021911621 nb_pixel_total : 18170 time to create 1 rle with old method : 0.01999211311340332 time for calcul the mask position with numpy : 0.024507522583007812 nb_pixel_total : 38526 time to create 1 rle with old method : 0.060213327407836914 time for calcul the mask position with numpy : 0.02730274200439453 nb_pixel_total : 76020 time to create 1 rle with old method : 0.08525466918945312 time for calcul the mask position with numpy : 0.024878263473510742 nb_pixel_total : 57073 time to create 1 rle with old method : 0.06497025489807129 time for calcul the mask position with numpy : 0.024816036224365234 nb_pixel_total : 53953 time to create 1 rle with old method : 0.05873513221740723 time for calcul the mask position with numpy : 0.025037527084350586 nb_pixel_total : 138285 time to create 1 rle with old method : 0.15700387954711914 time for calcul the mask position with numpy : 0.02340078353881836 nb_pixel_total : 47868 time to create 1 rle with old method : 0.05287790298461914 time for calcul the mask position with numpy : 0.02466416358947754 nb_pixel_total : 79332 time to create 1 rle with old method : 0.0914607048034668 create new chi : 3.934854745864868 time to delete rle : 0.0012776851654052734 batch 1 Loaded 29 chid ids of type : 3594 +++++++++++++++++++Number RLEs to save : 11650 TO DO : save crop sub photo not yet done ! save time : 0.5535316467285156 nb_obj : 7 nb_hashtags : 2 time to prepare the origin masks : 4.999750375747681 time for calcul the mask position with numpy : 1.3100664615631104 nb_pixel_total : 7758343 time to create 1 rle with new method : 1.900869607925415 time for calcul the mask position with numpy : 0.023871183395385742 nb_pixel_total : 22684 time to create 1 rle with old method : 0.025947093963623047 time for calcul the mask position with numpy : 0.02354288101196289 nb_pixel_total : 10131 time to create 1 rle with old method : 0.011635541915893555 time for calcul the mask position with numpy : 0.024465560913085938 nb_pixel_total : 15551 time to create 1 rle with old method : 0.018301725387573242 time for calcul the mask position with numpy : 0.025545358657836914 nb_pixel_total : 94899 time to create 1 rle with old method : 0.10567092895507812 time for calcul the mask position with numpy : 0.025019407272338867 nb_pixel_total : 218793 time to create 1 rle with new method : 0.425396203994751 time for calcul the mask position with numpy : 0.025892972946166992 nb_pixel_total : 58210 time to create 1 rle with old method : 0.06670713424682617 time for calcul the mask position with numpy : 0.02561020851135254 nb_pixel_total : 115789 time to create 1 rle with old method : 0.13463735580444336 create new chi : 4.2448179721832275 time to delete rle : 0.0009732246398925781 batch 1 Loaded 15 chid ids of type : 3594 ++++++++Number RLEs to save : 7296 TO DO : save crop sub photo not yet done ! save time : 0.43665003776550293 nb_obj : 5 nb_hashtags : 4 time to prepare the origin masks : 4.261974811553955 time for calcul the mask position with numpy : 1.043346643447876 nb_pixel_total : 8045989 time to create 1 rle with new method : 1.2084975242614746 time for calcul the mask position with numpy : 0.023500919342041016 nb_pixel_total : 30073 time to create 1 rle with old method : 0.03376603126525879 time for calcul the mask position with numpy : 0.02390265464782715 nb_pixel_total : 34102 time to create 1 rle with old method : 0.03898358345031738 time for calcul the mask position with numpy : 0.02308201789855957 nb_pixel_total : 18439 time to create 1 rle with old method : 0.020832300186157227 time for calcul the mask position with numpy : 0.024465560913085938 nb_pixel_total : 61523 time to create 1 rle with old method : 0.09351348876953125 time for calcul the mask position with numpy : 0.02626323699951172 nb_pixel_total : 104274 time to create 1 rle with old method : 0.13161301612854004 create new chi : 2.733710765838623 time to delete rle : 0.0006382465362548828 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 4816 TO DO : save crop sub photo not yet done ! save time : 0.28844523429870605 nb_obj : 13 nb_hashtags : 2 time to prepare the origin masks : 7.181412696838379 time for calcul the mask position with numpy : 1.2819316387176514 nb_pixel_total : 7677066 time to create 1 rle with new method : 2.932859182357788 time for calcul the mask position with numpy : 0.04041934013366699 nb_pixel_total : 30704 time to create 1 rle with old method : 0.03505754470825195 time for calcul the mask position with numpy : 0.03894805908203125 nb_pixel_total : 32864 time to create 1 rle with old method : 0.03735923767089844 time for calcul the mask position with numpy : 0.03966212272644043 nb_pixel_total : 25436 time to create 1 rle with old method : 0.030017852783203125 time for calcul the mask position with numpy : 0.0419926643371582 nb_pixel_total : 93239 time to create 1 rle with old method : 0.10701656341552734 time for calcul the mask position with numpy : 0.03930163383483887 nb_pixel_total : 3120 time to create 1 rle with old method : 0.0038836002349853516 time for calcul the mask position with numpy : 0.04027199745178223 nb_pixel_total : 44823 time to create 1 rle with old method : 0.05286002159118652 time for calcul the mask position with numpy : 0.040592193603515625 nb_pixel_total : 35871 time to create 1 rle with old method : 0.04254889488220215 time for calcul the mask position with numpy : 0.04153633117675781 nb_pixel_total : 80485 time to create 1 rle with old method : 0.09610676765441895 time for calcul the mask position with numpy : 0.04051041603088379 nb_pixel_total : 80336 time to create 1 rle with old method : 0.0938575267791748 time for calcul the mask position with numpy : 0.03753542900085449 nb_pixel_total : 5556 time to create 1 rle with old method : 0.0067636966705322266 time for calcul the mask position with numpy : 0.026437759399414062 nb_pixel_total : 143710 time to create 1 rle with old method : 0.16834521293640137 time for calcul the mask position with numpy : 0.02491617202758789 nb_pixel_total : 16986 time to create 1 rle with old method : 0.020166873931884766 time for calcul the mask position with numpy : 0.027332544326782227 nb_pixel_total : 24204 time to create 1 rle with old method : 0.028775453567504883 create new chi : 5.460192441940308 time to delete rle : 0.0013248920440673828 batch 1 Loaded 27 chid ids of type : 3594 +++++++++++++++++++++Number RLEs to save : 9249 TO DO : save crop sub photo not yet done ! save time : 0.5464651584625244 nb_obj : 6 nb_hashtags : 4 time to prepare the origin masks : 4.135813474655151 time for calcul the mask position with numpy : 1.4989094734191895 nb_pixel_total : 8012765 time to create 1 rle with new method : 2.1580121517181396 time for calcul the mask position with numpy : 0.03478598594665527 nb_pixel_total : 14908 time to create 1 rle with old method : 0.016257524490356445 time for calcul the mask position with numpy : 0.023145198822021484 nb_pixel_total : 16812 time to create 1 rle with old method : 0.0184323787689209 time for calcul the mask position with numpy : 0.02433013916015625 nb_pixel_total : 119573 time to create 1 rle with old method : 0.1582508087158203 time for calcul the mask position with numpy : 0.024283409118652344 nb_pixel_total : 75470 time to create 1 rle with old method : 0.08444762229919434 time for calcul the mask position with numpy : 0.023998498916625977 nb_pixel_total : 24443 time to create 1 rle with old method : 0.02738022804260254 time for calcul the mask position with numpy : 0.023944854736328125 nb_pixel_total : 30429 time to create 1 rle with old method : 0.03330349922180176 create new chi : 4.193298816680908 time to delete rle : 0.0007584095001220703 batch 1 Loaded 13 chid ids of type : 3594 ++++++++Number RLEs to save : 4904 TO DO : save crop sub photo not yet done ! save time : 0.2779512405395508 map_output_result : {1390391787: (0.0, 'Should be the crop_list due to order', 0), 1390391786: (0.0, 'Should be the crop_list due to order', 0), 1390391784: (0.0, 'Should be the crop_list due to order', 0), 1390391759: (0.0, 'Should be the crop_list due to order', 0), 1390391757: (0.0, 'Should be the crop_list due to order', 0), 1390391755: (0.0, 'Should be the crop_list due to order', 0), 1390391751: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1390391787, 1390391786, 1390391784, 1390391759, 1390391757, 1390391755, 1390391751] Looping around the photos to save general results len do output : 7 /1390391787.Didn't retrieve data . /1390391786.Didn't retrieve data . /1390391784.Didn't retrieve data . /1390391759.Didn't retrieve data . /1390391757.Didn't retrieve data . /1390391755.Didn't retrieve data . /1390391751.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3972368') ('3318', '28011793', '1390391787', None, None, None, None, None, '3972368') ('3318', None, None, None, None, None, None, None, '3972368') ('3318', '28011793', '1390391786', None, None, None, None, None, '3972368') ('3318', None, None, None, None, None, None, None, '3972368') ('3318', '28011793', '1390391784', None, None, None, None, None, '3972368') ('3318', None, None, None, None, None, None, None, '3972368') ('3318', '28011793', '1390391759', None, None, None, None, None, '3972368') ('3318', None, None, None, None, None, None, None, '3972368') ('3318', '28011793', '1390391757', None, None, None, None, None, '3972368') ('3318', None, None, None, None, None, None, None, '3972368') ('3318', '28011793', '1390391755', None, None, None, None, None, '3972368') ('3318', None, None, None, None, None, None, None, '3972368') ('3318', '28011793', '1390391751', None, None, None, None, None, '3972368') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 21 time used for this insertion : 0.009827375411987305 save_final save missing photos in datou_result : time spend for datou_step_exec : 77.81252098083496 time spend to save output : 0.010289430618286133 total time spend for step 3 : 77.82281041145325 step4:ventilate_hashtags_in_portfolio Fri Oct 31 12:23:17 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 28011793 get user id for portfolio 28011793 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28011793 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('flou','pehd','carton','autre','mal_croppe','environnement','pet_fonce','background','pet_clair','metal','papier')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28011793 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('flou','pehd','carton','autre','mal_croppe','environnement','pet_fonce','background','pet_clair','metal','papier')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28011793 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('flou','pehd','carton','autre','mal_croppe','environnement','pet_fonce','background','pet_clair','metal','papier')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/28021572,28021573,28021574,28021575,28021576,28021577,28021578,28021579,28021580,28021581,28021582?tags=flou,pehd,carton,autre,mal_croppe,environnement,pet_fonce,background,pet_clair,metal,papier Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1390391787, 1390391786, 1390391784, 1390391759, 1390391757, 1390391755, 1390391751] Looping around the photos to save general results len do output : 1 /28011793. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3972368') ('3318', '28011793', '1390391787', None, None, None, None, None, '3972368') ('3318', None, None, None, None, None, None, None, '3972368') ('3318', '28011793', '1390391786', None, None, None, None, None, '3972368') ('3318', None, None, None, None, None, None, None, '3972368') ('3318', '28011793', '1390391784', None, None, None, None, None, '3972368') ('3318', None, None, None, None, None, None, None, '3972368') ('3318', '28011793', '1390391759', None, None, None, None, None, '3972368') ('3318', None, None, None, None, None, None, None, '3972368') ('3318', '28011793', '1390391757', None, None, None, None, None, '3972368') ('3318', None, None, None, None, None, None, None, '3972368') ('3318', '28011793', '1390391755', None, None, None, None, None, '3972368') ('3318', None, None, None, None, None, None, None, '3972368') ('3318', '28011793', '1390391751', None, None, None, None, None, '3972368') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.00939321517944336 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.551560640335083 time spend to save output : 0.009623527526855469 total time spend for step 4 : 1.5611841678619385 step5:final Fri Oct 31 12:23:19 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1390391787: ('0.05911277488425925',), 1390391786: ('0.05911277488425925',), 1390391784: ('0.05911277488425925',), 1390391759: ('0.05911277488425925',), 1390391757: ('0.05911277488425925',), 1390391755: ('0.05911277488425925',), 1390391751: ('0.05911277488425925',)} new output for save of step final : {1390391787: ('0.05911277488425925',), 1390391786: ('0.05911277488425925',), 1390391784: ('0.05911277488425925',), 1390391759: ('0.05911277488425925',), 1390391757: ('0.05911277488425925',), 1390391755: ('0.05911277488425925',), 1390391751: ('0.05911277488425925',)} [1390391787, 1390391786, 1390391784, 1390391759, 1390391757, 1390391755, 1390391751] Looping around the photos to save general results len do output : 7 /1390391787.Didn't retrieve data . /1390391786.Didn't retrieve data . /1390391784.Didn't retrieve data . /1390391759.Didn't retrieve data . /1390391757.Didn't retrieve data . /1390391755.Didn't retrieve data . /1390391751.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3972368') ('3318', '28011793', '1390391787', None, None, None, None, None, '3972368') ('3318', None, None, None, None, None, None, None, '3972368') ('3318', '28011793', '1390391786', None, None, None, None, None, '3972368') ('3318', None, None, None, None, None, None, None, '3972368') ('3318', '28011793', '1390391784', None, None, None, None, None, '3972368') ('3318', None, None, None, None, None, None, None, '3972368') ('3318', '28011793', '1390391759', None, None, None, None, None, '3972368') ('3318', None, None, None, None, None, None, None, '3972368') ('3318', '28011793', '1390391757', None, None, None, None, None, '3972368') ('3318', None, None, None, None, None, None, None, '3972368') ('3318', '28011793', '1390391755', None, None, None, None, None, '3972368') ('3318', None, None, None, None, None, None, None, '3972368') ('3318', '28011793', '1390391751', None, None, None, None, None, '3972368') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 21 time used for this insertion : 0.010718822479248047 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11330246925354004 time spend to save output : 0.01110529899597168 total time spend for step 5 : 0.12440776824951172 step6:blur_detection Fri Oct 31 12:23:19 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1761909630_1347614_1390391787_3524762efa0c42b4adfe38b3cd8c7164_58122654.jpg resize: (2160, 3840) 1390391787 -6.809664794603794 treat image : temp/1761909630_1347614_1390391786_10f70560e937598b970019006cc49ba5_83989849.jpg resize: (2160, 3840) 1390391786 -7.115646372182405 treat image : temp/1761909630_1347614_1390391784_96e480be1a348b18052f40b3060dbf6c_25830176.jpg resize: (2160, 3840) 1390391784 -6.962495488044788 treat image : temp/1761909630_1347614_1390391759_7d34300fa3f6707b3ac4b9ff757b0fad_19561572.jpg resize: (2160, 3840) 1390391759 -6.817340543760342 treat image : temp/1761909630_1347614_1390391757_d8cf6f73ea6319b0dca320d0d157a942_47225835.jpg resize: (2160, 3840) 1390391757 -7.120342652930578 treat image : temp/1761909630_1347614_1390391755_98fff74656804c08078bed8d84d7399d_73529308.jpg resize: (2160, 3840) 1390391755 -7.0591338821958685 treat image : temp/1761909630_1347614_1390391751_de789b99d190d475801e6946895f17ed_45007923.jpg resize: (2160, 3840) 1390391751 -7.113702826140487 treat image : temp/1761909630_1347614_1390391787_3524762efa0c42b4adfe38b3cd8c7164_58122654_rle_crop_4009600561_0.png resize: (167, 348) 1391153520 1.380825395768171 treat image : temp/1761909630_1347614_1390391787_3524762efa0c42b4adfe38b3cd8c7164_58122654_rle_crop_4009600562_0.png resize: (328, 129) 1391153521 -4.651105552450857 treat image : temp/1761909630_1347614_1390391787_3524762efa0c42b4adfe38b3cd8c7164_58122654_rle_crop_4009600563_0.png resize: (445, 344) 1391153522 -4.3566237877060905 treat image : temp/1761909630_1347614_1390391787_3524762efa0c42b4adfe38b3cd8c7164_58122654_rle_crop_4009600568_0.png resize: (277, 278) 1391153523 -3.460060181473708 treat image : temp/1761909630_1347614_1390391787_3524762efa0c42b4adfe38b3cd8c7164_58122654_rle_crop_4009600569_0.png resize: (152, 162) 1391153525 -3.583079843771285 treat image : temp/1761909630_1347614_1390391786_10f70560e937598b970019006cc49ba5_83989849_rle_crop_4009600572_0.png resize: (283, 535) 1391153526 -4.460369917175735 treat image : temp/1761909630_1347614_1390391786_10f70560e937598b970019006cc49ba5_83989849_rle_crop_4009600573_0.png resize: (235, 261) 1391153527 -3.9622222639299416 treat image : temp/1761909630_1347614_1390391786_10f70560e937598b970019006cc49ba5_83989849_rle_crop_4009600576_0.png resize: (237, 248) 1391153528 -3.8000984763567005 treat image : temp/1761909630_1347614_1390391784_96e480be1a348b18052f40b3060dbf6c_25830176_rle_crop_4009600577_0.png resize: (391, 275) 1391153530 -1.387332133262556 treat image : temp/1761909630_1347614_1390391784_96e480be1a348b18052f40b3060dbf6c_25830176_rle_crop_4009600578_0.png resize: (231, 336) 1391153531 -0.11383437936042383 treat image : temp/1761909630_1347614_1390391784_96e480be1a348b18052f40b3060dbf6c_25830176_rle_crop_4009600579_0.png resize: (448, 466) 1391153532 -4.6090271986970075 treat image : temp/1761909630_1347614_1390391784_96e480be1a348b18052f40b3060dbf6c_25830176_rle_crop_4009600580_0.png resize: (410, 424) 1391153533 -3.5304381181171345 treat image : temp/1761909630_1347614_1390391784_96e480be1a348b18052f40b3060dbf6c_25830176_rle_crop_4009600581_0.png resize: (250, 313) 1391153535 -3.1087365911326126 treat image : temp/1761909630_1347614_1390391784_96e480be1a348b18052f40b3060dbf6c_25830176_rle_crop_4009600584_0.png resize: (173, 163) 1391153536 -4.10979916033271 treat image : temp/1761909630_1347614_1390391784_96e480be1a348b18052f40b3060dbf6c_25830176_rle_crop_4009600585_0.png resize: (471, 439) 1391153537 -3.9420349693559578 treat image : temp/1761909630_1347614_1390391784_96e480be1a348b18052f40b3060dbf6c_25830176_rle_crop_4009600586_0.png resize: (254, 106) 1391153539 -3.1321444974657147 treat image : temp/1761909630_1347614_1390391784_96e480be1a348b18052f40b3060dbf6c_25830176_rle_crop_4009600587_0.png resize: (80, 119) 1391153541 -2.8174117096908002 treat image : temp/1761909630_1347614_1390391784_96e480be1a348b18052f40b3060dbf6c_25830176_rle_crop_4009600588_0.png resize: (242, 218) 1391153542 -2.4490342244075927 treat image : temp/1761909630_1347614_1390391784_96e480be1a348b18052f40b3060dbf6c_25830176_rle_crop_4009600589_0.png resize: (109, 228) 1391153543 -2.517519455871646 treat image : temp/1761909630_1347614_1390391759_7d34300fa3f6707b3ac4b9ff757b0fad_19561572_rle_crop_4009600591_0.png resize: (442, 552) 1391153544 -3.8428888245396564 treat image : temp/1761909630_1347614_1390391759_7d34300fa3f6707b3ac4b9ff757b0fad_19561572_rle_crop_4009600592_0.png resize: (354, 264) 1391153546 -4.281938547893973 treat image : temp/1761909630_1347614_1390391759_7d34300fa3f6707b3ac4b9ff757b0fad_19561572_rle_crop_4009600593_0.png resize: (646, 612) 1391153547 -4.787267679472389 treat image : temp/1761909630_1347614_1390391759_7d34300fa3f6707b3ac4b9ff757b0fad_19561572_rle_crop_4009600594_0.png resize: (385, 429) 1391153548 -4.4726852698382835 treat image : temp/1761909630_1347614_1390391759_7d34300fa3f6707b3ac4b9ff757b0fad_19561572_rle_crop_4009600596_0.png resize: (130, 102) 1391153549 -3.429390817997849 treat image : temp/1761909630_1347614_1390391759_7d34300fa3f6707b3ac4b9ff757b0fad_19561572_rle_crop_4009600597_0.png resize: (180, 180) 1391153551 -4.684011837394429 treat image : temp/1761909630_1347614_1390391757_d8cf6f73ea6319b0dca320d0d157a942_47225835_rle_crop_4009600602_0.png resize: (256, 175) 1391153552 -4.645326989507254 treat image : temp/1761909630_1347614_1390391755_98fff74656804c08078bed8d84d7399d_73529308_rle_crop_4009600603_0.png resize: (156, 255) 1391153553 -4.2258092917887025 treat image : temp/1761909630_1347614_1390391755_98fff74656804c08078bed8d84d7399d_73529308_rle_crop_4009600604_0.png resize: (157, 119) 1391153555 0.475929731047295 treat image : temp/1761909630_1347614_1390391755_98fff74656804c08078bed8d84d7399d_73529308_rle_crop_4009600605_0.png resize: (603, 464) 1391153558 -4.047822868846947 treat image : temp/1761909630_1347614_1390391755_98fff74656804c08078bed8d84d7399d_73529308_rle_crop_4009600606_0.png resize: (157, 118) 1391153559 -2.335920449020098 treat image : temp/1761909630_1347614_1390391755_98fff74656804c08078bed8d84d7399d_73529308_rle_crop_4009600607_0.png resize: (461, 244) 1391153560 -4.356292354221114 treat image : temp/1761909630_1347614_1390391755_98fff74656804c08078bed8d84d7399d_73529308_rle_crop_4009600608_0.png resize: (320, 377) 1391153561 -0.7013233767663569 treat image : temp/1761909630_1347614_1390391755_98fff74656804c08078bed8d84d7399d_73529308_rle_crop_4009600609_0.png resize: (216, 323) 1391153562 -2.2774526940549378 treat image : temp/1761909630_1347614_1390391755_98fff74656804c08078bed8d84d7399d_73529308_rle_crop_4009600610_0.png resize: (260, 287) 1391153564 -3.1044817212991305 treat image : temp/1761909630_1347614_1390391755_98fff74656804c08078bed8d84d7399d_73529308_rle_crop_4009600611_0.png resize: (254, 276) 1391153565 -3.531577156864708 treat image : temp/1761909630_1347614_1390391755_98fff74656804c08078bed8d84d7399d_73529308_rle_crop_4009600612_0.png resize: (357, 436) 1391153566 -3.7269592677471604 treat image : temp/1761909630_1347614_1390391755_98fff74656804c08078bed8d84d7399d_73529308_rle_crop_4009600615_0.png resize: (183, 246) 1391153567 -3.399324072994868 treat image : temp/1761909630_1347614_1390391751_de789b99d190d475801e6946895f17ed_45007923_rle_crop_4009600616_0.png resize: (141, 343) 1391153569 -4.416026530719637 treat image : temp/1761909630_1347614_1390391787_3524762efa0c42b4adfe38b3cd8c7164_58122654_rle_crop_4009600567_0.png resize: (147, 157) 1391153593 -3.718619879504947 treat image : temp/1761909630_1347614_1390391786_10f70560e937598b970019006cc49ba5_83989849_rle_crop_4009600574_0.png resize: (219, 140) 1391153594 -3.797397493315276 treat image : temp/1761909630_1347614_1390391757_d8cf6f73ea6319b0dca320d0d157a942_47225835_rle_crop_4009600601_0.png resize: (198, 253) 1391153596 -2.3171573492045576 treat image : temp/1761909630_1347614_1390391751_de789b99d190d475801e6946895f17ed_45007923_rle_crop_4009600620_0.png resize: (200, 134) 1391153597 -3.6440082311851945 treat image : temp/1761909630_1347614_1390391787_3524762efa0c42b4adfe38b3cd8c7164_58122654_rle_crop_4009600564_0.png resize: (314, 184) 1391153678 -4.481342722181259 treat image : temp/1761909630_1347614_1390391787_3524762efa0c42b4adfe38b3cd8c7164_58122654_rle_crop_4009600565_0.png resize: (359, 438) 1391153680 -4.781814386654785 treat image : temp/1761909630_1347614_1390391787_3524762efa0c42b4adfe38b3cd8c7164_58122654_rle_crop_4009600566_0.png resize: (132, 186) 1391153681 -2.866086070871045 treat image : temp/1761909630_1347614_1390391786_10f70560e937598b970019006cc49ba5_83989849_rle_crop_4009600570_0.png resize: (320, 326) 1391153682 -4.825714545282263 treat image : temp/1761909630_1347614_1390391786_10f70560e937598b970019006cc49ba5_83989849_rle_crop_4009600575_0.png resize: (366, 436) 1391153683 -4.677970078622787 treat image : temp/1761909630_1347614_1390391784_96e480be1a348b18052f40b3060dbf6c_25830176_rle_crop_4009600582_0.png resize: (368, 289) 1391153685 -4.8850811498709685 treat image : temp/1761909630_1347614_1390391759_7d34300fa3f6707b3ac4b9ff757b0fad_19561572_rle_crop_4009600595_0.png resize: (103, 171) 1391153686 -3.5442089952006213 treat image : temp/1761909630_1347614_1390391757_d8cf6f73ea6319b0dca320d0d157a942_47225835_rle_crop_4009600598_0.png resize: (391, 341) 1391153687 -4.848572347621847 treat image : temp/1761909630_1347614_1390391757_d8cf6f73ea6319b0dca320d0d157a942_47225835_rle_crop_4009600599_0.png resize: (325, 294) 1391153688 -3.944376971279306 treat image : temp/1761909630_1347614_1390391755_98fff74656804c08078bed8d84d7399d_73529308_rle_crop_4009600613_0.png resize: (207, 154) 1391153690 -3.5657519125072126 treat image : temp/1761909630_1347614_1390391755_98fff74656804c08078bed8d84d7399d_73529308_rle_crop_4009600614_0.png resize: (145, 285) 1391153692 -3.7169090041525275 treat image : temp/1761909630_1347614_1390391751_de789b99d190d475801e6946895f17ed_45007923_rle_crop_4009600618_0.png resize: (282, 345) 1391153693 -4.518872120435645 treat image : temp/1761909630_1347614_1390391751_de789b99d190d475801e6946895f17ed_45007923_rle_crop_4009600619_0.png resize: (396, 436) 1391153694 -4.554500434394474 treat image : temp/1761909630_1347614_1390391751_de789b99d190d475801e6946895f17ed_45007923_rle_crop_4009600621_0.png resize: (101, 189) 1391153696 -2.7632222224246603 treat image : temp/1761909630_1347614_1390391786_10f70560e937598b970019006cc49ba5_83989849_rle_crop_4009600571_0.png resize: (139, 208) 1391153721 -1.2575275179444396 treat image : temp/1761909630_1347614_1390391784_96e480be1a348b18052f40b3060dbf6c_25830176_rle_crop_4009600583_0.png resize: (192, 291) 1391153722 -3.9133373594973584 treat image : temp/1761909630_1347614_1390391757_d8cf6f73ea6319b0dca320d0d157a942_47225835_rle_crop_4009600600_0.png resize: (130, 168) 1391153724 -0.3531558660788631 treat image : temp/1761909630_1347614_1390391751_de789b99d190d475801e6946895f17ed_45007923_rle_crop_4009600617_0.png resize: (143, 211) 1391153725 -1.3661421954205142 treat image : temp/1761909630_1347614_1390391784_96e480be1a348b18052f40b3060dbf6c_25830176_rle_crop_4009600590_0.png resize: (764, 562) 1391153753 -5.133792105708155 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 68 time used for this insertion : 0.012032032012939453 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 68 time used for this insertion : 0.012962818145751953 save missing photos in datou_result : time spend for datou_step_exec : 29.60674262046814 time spend to save output : 0.030014991760253906 total time spend for step 6 : 29.636757612228394 step7:brightness Fri Oct 31 12:23:49 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1761909630_1347614_1390391787_3524762efa0c42b4adfe38b3cd8c7164_58122654.jpg treat image : temp/1761909630_1347614_1390391786_10f70560e937598b970019006cc49ba5_83989849.jpg treat image : temp/1761909630_1347614_1390391784_96e480be1a348b18052f40b3060dbf6c_25830176.jpg treat image : temp/1761909630_1347614_1390391759_7d34300fa3f6707b3ac4b9ff757b0fad_19561572.jpg treat image : temp/1761909630_1347614_1390391757_d8cf6f73ea6319b0dca320d0d157a942_47225835.jpg treat image : temp/1761909630_1347614_1390391755_98fff74656804c08078bed8d84d7399d_73529308.jpg treat image : temp/1761909630_1347614_1390391751_de789b99d190d475801e6946895f17ed_45007923.jpg treat image : temp/1761909630_1347614_1390391787_3524762efa0c42b4adfe38b3cd8c7164_58122654_rle_crop_4009600561_0.png treat image : temp/1761909630_1347614_1390391787_3524762efa0c42b4adfe38b3cd8c7164_58122654_rle_crop_4009600562_0.png treat image : temp/1761909630_1347614_1390391787_3524762efa0c42b4adfe38b3cd8c7164_58122654_rle_crop_4009600563_0.png treat image : temp/1761909630_1347614_1390391787_3524762efa0c42b4adfe38b3cd8c7164_58122654_rle_crop_4009600568_0.png treat image : temp/1761909630_1347614_1390391787_3524762efa0c42b4adfe38b3cd8c7164_58122654_rle_crop_4009600569_0.png treat image : temp/1761909630_1347614_1390391786_10f70560e937598b970019006cc49ba5_83989849_rle_crop_4009600572_0.png treat image : temp/1761909630_1347614_1390391786_10f70560e937598b970019006cc49ba5_83989849_rle_crop_4009600573_0.png treat image : temp/1761909630_1347614_1390391786_10f70560e937598b970019006cc49ba5_83989849_rle_crop_4009600576_0.png treat image : temp/1761909630_1347614_1390391784_96e480be1a348b18052f40b3060dbf6c_25830176_rle_crop_4009600577_0.png treat image : temp/1761909630_1347614_1390391784_96e480be1a348b18052f40b3060dbf6c_25830176_rle_crop_4009600578_0.png treat image : temp/1761909630_1347614_1390391784_96e480be1a348b18052f40b3060dbf6c_25830176_rle_crop_4009600579_0.png treat image : temp/1761909630_1347614_1390391784_96e480be1a348b18052f40b3060dbf6c_25830176_rle_crop_4009600580_0.png treat image : temp/1761909630_1347614_1390391784_96e480be1a348b18052f40b3060dbf6c_25830176_rle_crop_4009600581_0.png treat image : temp/1761909630_1347614_1390391784_96e480be1a348b18052f40b3060dbf6c_25830176_rle_crop_4009600584_0.png treat image : temp/1761909630_1347614_1390391784_96e480be1a348b18052f40b3060dbf6c_25830176_rle_crop_4009600585_0.png treat image : temp/1761909630_1347614_1390391784_96e480be1a348b18052f40b3060dbf6c_25830176_rle_crop_4009600586_0.png treat image : temp/1761909630_1347614_1390391784_96e480be1a348b18052f40b3060dbf6c_25830176_rle_crop_4009600587_0.png treat image : temp/1761909630_1347614_1390391784_96e480be1a348b18052f40b3060dbf6c_25830176_rle_crop_4009600588_0.png treat image : temp/1761909630_1347614_1390391784_96e480be1a348b18052f40b3060dbf6c_25830176_rle_crop_4009600589_0.png treat image : temp/1761909630_1347614_1390391759_7d34300fa3f6707b3ac4b9ff757b0fad_19561572_rle_crop_4009600591_0.png treat image : temp/1761909630_1347614_1390391759_7d34300fa3f6707b3ac4b9ff757b0fad_19561572_rle_crop_4009600592_0.png treat image : temp/1761909630_1347614_1390391759_7d34300fa3f6707b3ac4b9ff757b0fad_19561572_rle_crop_4009600593_0.png treat image : temp/1761909630_1347614_1390391759_7d34300fa3f6707b3ac4b9ff757b0fad_19561572_rle_crop_4009600594_0.png treat image : temp/1761909630_1347614_1390391759_7d34300fa3f6707b3ac4b9ff757b0fad_19561572_rle_crop_4009600596_0.png treat image : temp/1761909630_1347614_1390391759_7d34300fa3f6707b3ac4b9ff757b0fad_19561572_rle_crop_4009600597_0.png treat image : temp/1761909630_1347614_1390391757_d8cf6f73ea6319b0dca320d0d157a942_47225835_rle_crop_4009600602_0.png treat image : temp/1761909630_1347614_1390391755_98fff74656804c08078bed8d84d7399d_73529308_rle_crop_4009600603_0.png treat image : temp/1761909630_1347614_1390391755_98fff74656804c08078bed8d84d7399d_73529308_rle_crop_4009600604_0.png treat image : temp/1761909630_1347614_1390391755_98fff74656804c08078bed8d84d7399d_73529308_rle_crop_4009600605_0.png treat image : temp/1761909630_1347614_1390391755_98fff74656804c08078bed8d84d7399d_73529308_rle_crop_4009600606_0.png treat image : temp/1761909630_1347614_1390391755_98fff74656804c08078bed8d84d7399d_73529308_rle_crop_4009600607_0.png treat image : temp/1761909630_1347614_1390391755_98fff74656804c08078bed8d84d7399d_73529308_rle_crop_4009600608_0.png treat image : temp/1761909630_1347614_1390391755_98fff74656804c08078bed8d84d7399d_73529308_rle_crop_4009600609_0.png treat image : temp/1761909630_1347614_1390391755_98fff74656804c08078bed8d84d7399d_73529308_rle_crop_4009600610_0.png treat image : temp/1761909630_1347614_1390391755_98fff74656804c08078bed8d84d7399d_73529308_rle_crop_4009600611_0.png treat image : temp/1761909630_1347614_1390391755_98fff74656804c08078bed8d84d7399d_73529308_rle_crop_4009600612_0.png treat image : temp/1761909630_1347614_1390391755_98fff74656804c08078bed8d84d7399d_73529308_rle_crop_4009600615_0.png treat image : temp/1761909630_1347614_1390391751_de789b99d190d475801e6946895f17ed_45007923_rle_crop_4009600616_0.png treat image : temp/1761909630_1347614_1390391787_3524762efa0c42b4adfe38b3cd8c7164_58122654_rle_crop_4009600567_0.png treat image : temp/1761909630_1347614_1390391786_10f70560e937598b970019006cc49ba5_83989849_rle_crop_4009600574_0.png treat image : temp/1761909630_1347614_1390391757_d8cf6f73ea6319b0dca320d0d157a942_47225835_rle_crop_4009600601_0.png treat image : temp/1761909630_1347614_1390391751_de789b99d190d475801e6946895f17ed_45007923_rle_crop_4009600620_0.png treat image : temp/1761909630_1347614_1390391787_3524762efa0c42b4adfe38b3cd8c7164_58122654_rle_crop_4009600564_0.png treat image : temp/1761909630_1347614_1390391787_3524762efa0c42b4adfe38b3cd8c7164_58122654_rle_crop_4009600565_0.png treat image : temp/1761909630_1347614_1390391787_3524762efa0c42b4adfe38b3cd8c7164_58122654_rle_crop_4009600566_0.png treat image : temp/1761909630_1347614_1390391786_10f70560e937598b970019006cc49ba5_83989849_rle_crop_4009600570_0.png treat image : temp/1761909630_1347614_1390391786_10f70560e937598b970019006cc49ba5_83989849_rle_crop_4009600575_0.png treat image : temp/1761909630_1347614_1390391784_96e480be1a348b18052f40b3060dbf6c_25830176_rle_crop_4009600582_0.png treat image : temp/1761909630_1347614_1390391759_7d34300fa3f6707b3ac4b9ff757b0fad_19561572_rle_crop_4009600595_0.png treat image : temp/1761909630_1347614_1390391757_d8cf6f73ea6319b0dca320d0d157a942_47225835_rle_crop_4009600598_0.png treat image : temp/1761909630_1347614_1390391757_d8cf6f73ea6319b0dca320d0d157a942_47225835_rle_crop_4009600599_0.png treat image : temp/1761909630_1347614_1390391755_98fff74656804c08078bed8d84d7399d_73529308_rle_crop_4009600613_0.png treat image : temp/1761909630_1347614_1390391755_98fff74656804c08078bed8d84d7399d_73529308_rle_crop_4009600614_0.png treat image : temp/1761909630_1347614_1390391751_de789b99d190d475801e6946895f17ed_45007923_rle_crop_4009600618_0.png treat image : temp/1761909630_1347614_1390391751_de789b99d190d475801e6946895f17ed_45007923_rle_crop_4009600619_0.png treat image : temp/1761909630_1347614_1390391751_de789b99d190d475801e6946895f17ed_45007923_rle_crop_4009600621_0.png treat image : temp/1761909630_1347614_1390391786_10f70560e937598b970019006cc49ba5_83989849_rle_crop_4009600571_0.png treat image : temp/1761909630_1347614_1390391784_96e480be1a348b18052f40b3060dbf6c_25830176_rle_crop_4009600583_0.png treat image : temp/1761909630_1347614_1390391757_d8cf6f73ea6319b0dca320d0d157a942_47225835_rle_crop_4009600600_0.png treat image : temp/1761909630_1347614_1390391751_de789b99d190d475801e6946895f17ed_45007923_rle_crop_4009600617_0.png treat image : temp/1761909630_1347614_1390391784_96e480be1a348b18052f40b3060dbf6c_25830176_rle_crop_4009600590_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 68 time used for this insertion : 0.012159109115600586 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 68 time used for this insertion : 0.01295018196105957 save missing photos in datou_result : time spend for datou_step_exec : 6.880540370941162 time spend to save output : 0.030428409576416016 total time spend for step 7 : 6.910968780517578 step8:velours_tree Fri Oct 31 12:23:56 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.09791803359985352 time spend to save output : 7.700920104980469e-05 total time spend for step 8 : 0.09799504280090332 step9:send_mail_cod Fri Oct 31 12:23:56 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P28011793_31-10-2025_12_23_56.pdf 28021572 imagette280215721761909836 28021573 imagette280215731761909836 28021574 change filename to text .change filename to text .change filename to text .change filename to text .imagette280215741761909836 28021575 change filename to text .change filename to text .change filename to text .change filename to text .imagette280215751761909836 28021576 imagette280215761761909836 28021578 change filename to text .imagette280215781761909836 28021579 imagette280215791761909837 28021580 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette280215801761909837 28021581 imagette280215811761909838 28021582 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette280215821761909838 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=28011793 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/28021572,28021573,28021574,28021575,28021576,28021577,28021578,28021579,28021580,28021581,28021582?tags=flou,pehd,carton,autre,mal_croppe,environnement,pet_fonce,background,pet_clair,metal,papier args[1390391787] : ((1390391787, -6.809664794603794, 492609224), (1390391787, 0.5512851082157737, 2107752395), '0.05911277488425925') We are sending mail with results at report@fotonower.com args[1390391786] : ((1390391786, -7.115646372182405, 492609224), (1390391786, 0.7855268174928473, 2107752395), '0.05911277488425925') We are sending mail with results at report@fotonower.com args[1390391784] : ((1390391784, -6.962495488044788, 492609224), (1390391784, 0.8129356721343919, 2107752395), '0.05911277488425925') We are sending mail with results at report@fotonower.com args[1390391759] : ((1390391759, -6.817340543760342, 492609224), (1390391759, 0.40617011031891903, 2107752395), '0.05911277488425925') We are sending mail with results at report@fotonower.com args[1390391757] : ((1390391757, -7.120342652930578, 492609224), (1390391757, 0.7680392413401969, 2107752395), '0.05911277488425925') We are sending mail with results at report@fotonower.com args[1390391755] : ((1390391755, -7.0591338821958685, 492609224), (1390391755, 0.6813097008877311, 2107752395), '0.05911277488425925') We are sending mail with results at report@fotonower.com args[1390391751] : ((1390391751, -7.113702826140487, 492609224), (1390391751, 0.7724524685132433, 2107752395), '0.05911277488425925') We are sending mail with results at report@fotonower.com refus_total : 0.05911277488425925 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos_view ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=28011793 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28011793_31-10-2025_12_23_56.pdf results_Auto_P28011793_31-10-2025_12_23_56.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28011793_31-10-2025_12_23_56.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','28011793','results_Auto_P28011793_31-10-2025_12_23_56.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28011793_31-10-2025_12_23_56.pdf','pdf','','0.6','0.05911277488425925') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/28011793

https://www.fotonower.com/image?json=false&list_photos_id=1390391787
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1390391786
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1390391784
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1390391759
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1390391757
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1390391755
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1390391751
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 5.91%
Veuillez trouver les photos des contaminants.

exemples de contaminants: carton: https://www.fotonower.com/view/28021574?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/28021575?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/28021578?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/28021580?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/28021582?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28011793_31-10-2025_12_23_56.pdf.

Lien vers velours :https://marlene.fotonower.com/velours/28021572,28021573,28021574,28021575,28021576,28021577,28021578,28021579,28021580,28021581,28021582?tags=flou,pehd,carton,autre,mal_croppe,environnement,pet_fonce,background,pet_clair,metal,papier.


L'équipe Fotonower 202 b'' Server: nginx Date: Fri, 31 Oct 2025 11:24:03 GMT Content-Length: 0 Connection: close X-Message-Id: MYxUh4AMRVGt3aJ_6ChWeg Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1390391787, 1390391786, 1390391784, 1390391759, 1390391757, 1390391755, 1390391751] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3972368') ('3318', '28011793', '1390391787', None, None, None, None, None, '3972368') ('3318', None, None, None, None, None, None, None, '3972368') ('3318', '28011793', '1390391786', None, None, None, None, None, '3972368') ('3318', None, None, None, None, None, None, None, '3972368') ('3318', '28011793', '1390391784', None, None, None, None, None, '3972368') ('3318', None, None, None, None, None, None, None, '3972368') ('3318', '28011793', '1390391759', None, None, None, None, None, '3972368') ('3318', None, None, None, None, None, None, None, '3972368') ('3318', '28011793', '1390391757', None, None, None, None, None, '3972368') ('3318', None, None, None, None, None, None, None, '3972368') ('3318', '28011793', '1390391755', None, None, None, None, None, '3972368') ('3318', None, None, None, None, None, None, None, '3972368') ('3318', '28011793', '1390391751', None, None, None, None, None, '3972368') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 7 time used for this insertion : 0.010511636734008789 save_final save missing photos in datou_result : time spend for datou_step_exec : 6.897287368774414 time spend to save output : 0.010694265365600586 total time spend for step 9 : 6.907981634140015 step10:split_time_score Fri Oct 31 12:24:03 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('19', 7),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 20102025 28011793 Nombre de photos uploadées : 7 / 23040 (0%) 20102025 28011793 Nombre de photos taguées (types de déchets): 0 / 7 (0%) 20102025 28011793 Nombre de photos taguées (volume) : 0 / 7 (0%) elapsed_time : load_data_split_time_score 4.0531158447265625e-06 elapsed_time : order_list_meta_photo_and_scores 1.2159347534179688e-05 ??????? elapsed_time : fill_and_build_computed_from_old_data 0.0005078315734863281 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.2014002799987793 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28011311 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28011425 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28011427 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28011434 order by id desc limit 1 Qualite : 0.02940841557649391 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28011523_31-10-2025_12_22_06.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28011523 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28011523 AND mptpi.`type`=3726 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28011645 order by id desc limit 1 Qualite : 0.013431677083724412 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28011719_31-10-2025_10_48_28.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28011719 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28011719 AND mptpi.`type`=3726 To do Qualite : 0.02064653862869566 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28011743_31-10-2025_10_36_40.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28011743 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28011743 AND mptpi.`type`=3726 To do Qualite : 0.05911277488425925 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28011793_31-10-2025_12_23_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28011793 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28011793 AND mptpi.`type`=3594 To do Qualite : 0.02073274526551839 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28011799_31-10-2025_09_57_57.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28011799 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28011799 AND mptpi.`type`=3726 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'20102025': {'nb_upload': 7, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1390391787, 1390391786, 1390391784, 1390391759, 1390391757, 1390391755, 1390391751] Looping around the photos to save general results len do output : 1 /28011793Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3972368') ('3318', '28011793', '1390391787', None, None, None, None, None, '3972368') ('3318', None, None, None, None, None, None, None, '3972368') ('3318', '28011793', '1390391786', None, None, None, None, None, '3972368') ('3318', None, None, None, None, None, None, None, '3972368') ('3318', '28011793', '1390391784', None, None, None, None, None, '3972368') ('3318', None, None, None, None, None, None, None, '3972368') ('3318', '28011793', '1390391759', None, None, None, None, None, '3972368') ('3318', None, None, None, None, None, None, None, '3972368') ('3318', '28011793', '1390391757', None, None, None, None, None, '3972368') ('3318', None, None, None, None, None, None, None, '3972368') ('3318', '28011793', '1390391755', None, None, None, None, None, '3972368') ('3318', None, None, None, None, None, None, None, '3972368') ('3318', '28011793', '1390391751', None, None, None, None, None, '3972368') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.01098489761352539 save_final save missing photos in datou_result : time spend for datou_step_exec : 6.879997968673706 time spend to save output : 0.011163473129272461 total time spend for step 10 : 6.8911614418029785 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 7 set_done_treatment 85.90user 103.11system 3:43.82elapsed 84%CPU (0avgtext+0avgdata 3781296maxresident)k 597880inputs+85072outputs (1566major+7712619minor)pagefaults 0swaps