python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 506697 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3670236'] with mtr_portfolio_ids : ['26579611'] and first list_photo_ids : [] new path : /proc/506697/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 13 ; length of list_pids : 13 ; length of list_args : 13 time to download the photos : 2.2755143642425537 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Fri Sep 5 15:00:32 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 6377 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-09-05 15:00:35.214606: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-09-05 15:00:35.240520: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3492910000 Hz 2025-09-05 15:00:35.242090: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fab90000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-09-05 15:00:35.242144: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-09-05 15:00:35.245177: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-09-05 15:00:35.430814: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x18e7c770 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-09-05 15:00:35.430874: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-09-05 15:00:35.433758: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-05 15:00:35.434198: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-05 15:00:35.436528: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-05 15:00:35.439103: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-05 15:00:35.439495: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-05 15:00:35.442068: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-05 15:00:35.443277: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-05 15:00:35.448390: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-05 15:00:35.450392: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-05 15:00:35.450499: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-05 15:00:35.451372: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-05 15:00:35.451394: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-05 15:00:35.451404: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-05 15:00:35.452979: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 5813 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-09-05 15:00:35.833984: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-05 15:00:35.834081: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-05 15:00:35.834102: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-05 15:00:35.834121: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-05 15:00:35.834138: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-05 15:00:35.834156: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-05 15:00:35.834173: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-05 15:00:35.834192: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-05 15:00:35.835454: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-05 15:00:35.837002: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-09-05 15:00:35.837079: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-09-05 15:00:35.837101: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-05 15:00:35.837121: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-09-05 15:00:35.837141: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-09-05 15:00:35.837161: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-09-05 15:00:35.837181: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-09-05 15:00:35.837201: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-09-05 15:00:35.838295: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-09-05 15:00:35.838329: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-09-05 15:00:35.838338: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-09-05 15:00:35.838347: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-09-05 15:00:35.839445: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 5813 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-09-05 15:00:50.108592: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-09-05 15:00:50.421007: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 13 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 33 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 19 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 34 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 20 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 21 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 15 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 16 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 20 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 18 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 35 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 25 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 7 Detection mask done ! Trying to reset tf kernel 507429 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 4712 tf kernel not reseted sub process len(results) : 13 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 13 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 6737 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0005762577056884766 nb_pixel_total : 19037 time to create 1 rle with old method : 0.023499727249145508 length of segment : 134 time for calcul the mask position with numpy : 0.0023055076599121094 nb_pixel_total : 105907 time to create 1 rle with old method : 0.12954306602478027 length of segment : 345 time for calcul the mask position with numpy : 0.0009944438934326172 nb_pixel_total : 64387 time to create 1 rle with old method : 0.07244753837585449 length of segment : 351 time for calcul the mask position with numpy : 0.00032901763916015625 nb_pixel_total : 16749 time to create 1 rle with old method : 0.019288301467895508 length of segment : 142 time for calcul the mask position with numpy : 0.00032520294189453125 nb_pixel_total : 19937 time to create 1 rle with old method : 0.023396968841552734 length of segment : 177 time for calcul the mask position with numpy : 0.0037996768951416016 nb_pixel_total : 172699 time to create 1 rle with new method : 0.008128881454467773 length of segment : 543 time for calcul the mask position with numpy : 0.0003643035888671875 nb_pixel_total : 20498 time to create 1 rle with old method : 0.023931264877319336 length of segment : 121 time for calcul the mask position with numpy : 0.0011515617370605469 nb_pixel_total : 62005 time to create 1 rle with old method : 0.06985974311828613 length of segment : 238 time for calcul the mask position with numpy : 0.0009248256683349609 nb_pixel_total : 53580 time to create 1 rle with old method : 0.06061053276062012 length of segment : 273 time for calcul the mask position with numpy : 0.0007889270782470703 nb_pixel_total : 44476 time to create 1 rle with old method : 0.05490994453430176 length of segment : 215 time for calcul the mask position with numpy : 0.00058746337890625 nb_pixel_total : 25510 time to create 1 rle with old method : 0.029060840606689453 length of segment : 293 time for calcul the mask position with numpy : 0.0008668899536132812 nb_pixel_total : 37754 time to create 1 rle with old method : 0.04290199279785156 length of segment : 255 time for calcul the mask position with numpy : 0.001283407211303711 nb_pixel_total : 51901 time to create 1 rle with old method : 0.059679508209228516 length of segment : 356 time for calcul the mask position with numpy : 0.0014190673828125 nb_pixel_total : 49139 time to create 1 rle with old method : 0.054813385009765625 length of segment : 438 time for calcul the mask position with numpy : 0.0009815692901611328 nb_pixel_total : 37558 time to create 1 rle with old method : 0.043648481369018555 length of segment : 218 time for calcul the mask position with numpy : 0.0003578662872314453 nb_pixel_total : 10895 time to create 1 rle with old method : 0.012826919555664062 length of segment : 152 time for calcul the mask position with numpy : 0.0002052783966064453 nb_pixel_total : 5577 time to create 1 rle with old method : 0.006827831268310547 length of segment : 72 time for calcul the mask position with numpy : 0.00046539306640625 nb_pixel_total : 26198 time to create 1 rle with old method : 0.0305941104888916 length of segment : 114 time for calcul the mask position with numpy : 0.00020003318786621094 nb_pixel_total : 3172 time to create 1 rle with old method : 0.003996849060058594 length of segment : 136 time for calcul the mask position with numpy : 0.001367807388305664 nb_pixel_total : 67160 time to create 1 rle with old method : 0.07681059837341309 length of segment : 410 time for calcul the mask position with numpy : 0.002390146255493164 nb_pixel_total : 122073 time to create 1 rle with old method : 0.1371908187866211 length of segment : 412 time for calcul the mask position with numpy : 0.0006275177001953125 nb_pixel_total : 32334 time to create 1 rle with old method : 0.03676438331604004 length of segment : 244 time for calcul the mask position with numpy : 0.0017428398132324219 nb_pixel_total : 97229 time to create 1 rle with old method : 0.11667919158935547 length of segment : 484 time for calcul the mask position with numpy : 0.0004315376281738281 nb_pixel_total : 24837 time to create 1 rle with old method : 0.028319120407104492 length of segment : 174 time for calcul the mask position with numpy : 0.0004956722259521484 nb_pixel_total : 21050 time to create 1 rle with old method : 0.027265548706054688 length of segment : 186 time for calcul the mask position with numpy : 0.006544351577758789 nb_pixel_total : 225232 time to create 1 rle with new method : 0.015893220901489258 length of segment : 908 time for calcul the mask position with numpy : 0.0007870197296142578 nb_pixel_total : 31241 time to create 1 rle with old method : 0.035912513732910156 length of segment : 359 time for calcul the mask position with numpy : 0.0023148059844970703 nb_pixel_total : 135321 time to create 1 rle with old method : 0.1528453826904297 length of segment : 779 time for calcul the mask position with numpy : 0.0003464221954345703 nb_pixel_total : 18786 time to create 1 rle with old method : 0.02169013023376465 length of segment : 106 time for calcul the mask position with numpy : 0.0004372596740722656 nb_pixel_total : 12503 time to create 1 rle with old method : 0.014490604400634766 length of segment : 329 time for calcul the mask position with numpy : 0.0005497932434082031 nb_pixel_total : 27856 time to create 1 rle with old method : 0.031351566314697266 length of segment : 332 time for calcul the mask position with numpy : 0.00012803077697753906 nb_pixel_total : 4540 time to create 1 rle with old method : 0.005480289459228516 length of segment : 73 time for calcul the mask position with numpy : 0.0019116401672363281 nb_pixel_total : 102142 time to create 1 rle with old method : 0.11584138870239258 length of segment : 401 time for calcul the mask position with numpy : 0.00038170814514160156 nb_pixel_total : 16936 time to create 1 rle with old method : 0.01921820640563965 length of segment : 164 time for calcul the mask position with numpy : 0.0003578662872314453 nb_pixel_total : 19199 time to create 1 rle with old method : 0.021914958953857422 length of segment : 112 time for calcul the mask position with numpy : 0.0007817745208740234 nb_pixel_total : 38472 time to create 1 rle with old method : 0.04302191734313965 length of segment : 373 time for calcul the mask position with numpy : 0.0005269050598144531 nb_pixel_total : 19943 time to create 1 rle with old method : 0.022534608840942383 length of segment : 187 time for calcul the mask position with numpy : 0.0005431175231933594 nb_pixel_total : 29169 time to create 1 rle with old method : 0.03225827217102051 length of segment : 163 time for calcul the mask position with numpy : 0.0027437210083007812 nb_pixel_total : 144885 time to create 1 rle with old method : 0.16370463371276855 length of segment : 431 time for calcul the mask position with numpy : 0.0008745193481445312 nb_pixel_total : 45980 time to create 1 rle with old method : 0.050594329833984375 length of segment : 279 time for calcul the mask position with numpy : 0.0002474784851074219 nb_pixel_total : 11132 time to create 1 rle with old method : 0.013161420822143555 length of segment : 93 time for calcul the mask position with numpy : 0.0004298686981201172 nb_pixel_total : 19608 time to create 1 rle with old method : 0.022509336471557617 length of segment : 172 time for calcul the mask position with numpy : 0.0016200542449951172 nb_pixel_total : 79871 time to create 1 rle with old method : 0.0914309024810791 length of segment : 465 time for calcul the mask position with numpy : 0.0026378631591796875 nb_pixel_total : 78054 time to create 1 rle with old method : 0.0886995792388916 length of segment : 358 time for calcul the mask position with numpy : 0.002453327178955078 nb_pixel_total : 86328 time to create 1 rle with old method : 0.09713172912597656 length of segment : 301 time for calcul the mask position with numpy : 0.0004634857177734375 nb_pixel_total : 13509 time to create 1 rle with old method : 0.015583992004394531 length of segment : 119 time for calcul the mask position with numpy : 0.005607128143310547 nb_pixel_total : 154730 time to create 1 rle with new method : 0.18244671821594238 length of segment : 509 time for calcul the mask position with numpy : 0.0014848709106445312 nb_pixel_total : 57326 time to create 1 rle with old method : 0.061635494232177734 length of segment : 292 time for calcul the mask position with numpy : 0.0013892650604248047 nb_pixel_total : 32477 time to create 1 rle with old method : 0.03663039207458496 length of segment : 308 time for calcul the mask position with numpy : 0.0006358623504638672 nb_pixel_total : 22331 time to create 1 rle with old method : 0.02488088607788086 length of segment : 177 time for calcul the mask position with numpy : 0.0040285587310791016 nb_pixel_total : 167619 time to create 1 rle with new method : 0.008141040802001953 length of segment : 424 time for calcul the mask position with numpy : 0.0010387897491455078 nb_pixel_total : 28638 time to create 1 rle with old method : 0.043654680252075195 length of segment : 178 time for calcul the mask position with numpy : 0.003021717071533203 nb_pixel_total : 71109 time to create 1 rle with old method : 0.09251904487609863 length of segment : 368 time for calcul the mask position with numpy : 0.0009434223175048828 nb_pixel_total : 25786 time to create 1 rle with old method : 0.0280303955078125 length of segment : 234 time for calcul the mask position with numpy : 0.0009768009185791016 nb_pixel_total : 29653 time to create 1 rle with old method : 0.03905320167541504 length of segment : 205 time for calcul the mask position with numpy : 0.001573324203491211 nb_pixel_total : 45809 time to create 1 rle with old method : 0.052233219146728516 length of segment : 258 time for calcul the mask position with numpy : 0.001972198486328125 nb_pixel_total : 62909 time to create 1 rle with old method : 0.07702350616455078 length of segment : 380 time for calcul the mask position with numpy : 0.0013310909271240234 nb_pixel_total : 34897 time to create 1 rle with old method : 0.03949427604675293 length of segment : 262 time for calcul the mask position with numpy : 0.0012786388397216797 nb_pixel_total : 53294 time to create 1 rle with old method : 0.061403751373291016 length of segment : 253 time for calcul the mask position with numpy : 0.0008063316345214844 nb_pixel_total : 25263 time to create 1 rle with old method : 0.028364181518554688 length of segment : 179 time for calcul the mask position with numpy : 0.002100706100463867 nb_pixel_total : 37513 time to create 1 rle with old method : 0.043967247009277344 length of segment : 170 time for calcul the mask position with numpy : 0.0009002685546875 nb_pixel_total : 23216 time to create 1 rle with old method : 0.02521371841430664 length of segment : 222 time for calcul the mask position with numpy : 0.0002586841583251953 nb_pixel_total : 7297 time to create 1 rle with old method : 0.008525848388671875 length of segment : 76 time for calcul the mask position with numpy : 0.0014715194702148438 nb_pixel_total : 49422 time to create 1 rle with old method : 0.054361820220947266 length of segment : 369 time for calcul the mask position with numpy : 0.012973546981811523 nb_pixel_total : 301818 time to create 1 rle with new method : 0.031411170959472656 length of segment : 634 time for calcul the mask position with numpy : 0.0021152496337890625 nb_pixel_total : 90866 time to create 1 rle with old method : 0.10374116897583008 length of segment : 365 time for calcul the mask position with numpy : 0.00023484230041503906 nb_pixel_total : 6281 time to create 1 rle with old method : 0.00748443603515625 length of segment : 67 time for calcul the mask position with numpy : 0.0005781650543212891 nb_pixel_total : 28481 time to create 1 rle with old method : 0.03248095512390137 length of segment : 155 time for calcul the mask position with numpy : 0.0013012886047363281 nb_pixel_total : 47782 time to create 1 rle with old method : 0.05336642265319824 length of segment : 310 time for calcul the mask position with numpy : 0.0008878707885742188 nb_pixel_total : 30680 time to create 1 rle with old method : 0.036841392517089844 length of segment : 170 time for calcul the mask position with numpy : 0.0009267330169677734 nb_pixel_total : 25048 time to create 1 rle with old method : 0.0273592472076416 length of segment : 375 time for calcul the mask position with numpy : 0.001543283462524414 nb_pixel_total : 68513 time to create 1 rle with old method : 0.07337284088134766 length of segment : 324 time for calcul the mask position with numpy : 0.0008640289306640625 nb_pixel_total : 37370 time to create 1 rle with old method : 0.040937185287475586 length of segment : 270 time for calcul the mask position with numpy : 0.0042798519134521484 nb_pixel_total : 139733 time to create 1 rle with old method : 0.17975497245788574 length of segment : 704 time for calcul the mask position with numpy : 0.0051419734954833984 nb_pixel_total : 190794 time to create 1 rle with new method : 0.012410640716552734 length of segment : 474 time for calcul the mask position with numpy : 0.0028181076049804688 nb_pixel_total : 97290 time to create 1 rle with old method : 0.10803890228271484 length of segment : 552 time for calcul the mask position with numpy : 0.0012583732604980469 nb_pixel_total : 55948 time to create 1 rle with old method : 0.06037259101867676 length of segment : 432 time for calcul the mask position with numpy : 0.001298666000366211 nb_pixel_total : 58282 time to create 1 rle with old method : 0.06392264366149902 length of segment : 249 time for calcul the mask position with numpy : 0.0012297630310058594 nb_pixel_total : 57965 time to create 1 rle with old method : 0.0647118091583252 length of segment : 435 time for calcul the mask position with numpy : 0.0007481575012207031 nb_pixel_total : 22976 time to create 1 rle with old method : 0.026510000228881836 length of segment : 182 time for calcul the mask position with numpy : 0.0007996559143066406 nb_pixel_total : 25507 time to create 1 rle with old method : 0.029447317123413086 length of segment : 218 time for calcul the mask position with numpy : 0.004019260406494141 nb_pixel_total : 150112 time to create 1 rle with new method : 0.008531808853149414 length of segment : 478 time for calcul the mask position with numpy : 0.0018465518951416016 nb_pixel_total : 67328 time to create 1 rle with old method : 0.07657241821289062 length of segment : 369 time for calcul the mask position with numpy : 0.0009257793426513672 nb_pixel_total : 28158 time to create 1 rle with old method : 0.03238344192504883 length of segment : 213 time for calcul the mask position with numpy : 0.0015981197357177734 nb_pixel_total : 65333 time to create 1 rle with old method : 0.07355690002441406 length of segment : 391 time for calcul the mask position with numpy : 0.0014238357543945312 nb_pixel_total : 49851 time to create 1 rle with old method : 0.05711078643798828 length of segment : 288 time for calcul the mask position with numpy : 0.0008220672607421875 nb_pixel_total : 24791 time to create 1 rle with old method : 0.028441667556762695 length of segment : 171 time for calcul the mask position with numpy : 0.0006155967712402344 nb_pixel_total : 22680 time to create 1 rle with old method : 0.025725603103637695 length of segment : 144 time for calcul the mask position with numpy : 0.0026252269744873047 nb_pixel_total : 117136 time to create 1 rle with old method : 0.13129782676696777 length of segment : 379 time for calcul the mask position with numpy : 0.0007448196411132812 nb_pixel_total : 22205 time to create 1 rle with old method : 0.02532339096069336 length of segment : 224 time for calcul the mask position with numpy : 0.0017688274383544922 nb_pixel_total : 65649 time to create 1 rle with old method : 0.0743410587310791 length of segment : 401 time for calcul the mask position with numpy : 0.0040895938873291016 nb_pixel_total : 119717 time to create 1 rle with old method : 0.16269636154174805 length of segment : 343 time for calcul the mask position with numpy : 0.0021462440490722656 nb_pixel_total : 65488 time to create 1 rle with old method : 0.08707022666931152 length of segment : 249 time for calcul the mask position with numpy : 0.0022306442260742188 nb_pixel_total : 89901 time to create 1 rle with old method : 0.09787940979003906 length of segment : 365 time for calcul the mask position with numpy : 0.00246429443359375 nb_pixel_total : 93976 time to create 1 rle with old method : 0.10406494140625 length of segment : 426 time for calcul the mask position with numpy : 0.003200531005859375 nb_pixel_total : 132126 time to create 1 rle with old method : 0.14786481857299805 length of segment : 261 time for calcul the mask position with numpy : 0.0009348392486572266 nb_pixel_total : 42928 time to create 1 rle with old method : 0.04764294624328613 length of segment : 139 time for calcul the mask position with numpy : 0.0014035701751708984 nb_pixel_total : 59059 time to create 1 rle with old method : 0.06551146507263184 length of segment : 282 time for calcul the mask position with numpy : 0.0013267993927001953 nb_pixel_total : 45183 time to create 1 rle with old method : 0.05037808418273926 length of segment : 242 time for calcul the mask position with numpy : 0.005062103271484375 nb_pixel_total : 150504 time to create 1 rle with new method : 0.009212493896484375 length of segment : 351 time for calcul the mask position with numpy : 0.0005717277526855469 nb_pixel_total : 12852 time to create 1 rle with old method : 0.014142751693725586 length of segment : 147 time for calcul the mask position with numpy : 0.0007815361022949219 nb_pixel_total : 18189 time to create 1 rle with old method : 0.019988059997558594 length of segment : 218 time for calcul the mask position with numpy : 0.0013949871063232422 nb_pixel_total : 36684 time to create 1 rle with old method : 0.041678667068481445 length of segment : 224 time for calcul the mask position with numpy : 0.0026693344116210938 nb_pixel_total : 85757 time to create 1 rle with old method : 0.09675097465515137 length of segment : 304 time for calcul the mask position with numpy : 0.000438690185546875 nb_pixel_total : 14167 time to create 1 rle with old method : 0.016170501708984375 length of segment : 133 time for calcul the mask position with numpy : 0.001535177230834961 nb_pixel_total : 50810 time to create 1 rle with old method : 0.05774211883544922 length of segment : 249 time for calcul the mask position with numpy : 0.001070261001586914 nb_pixel_total : 49620 time to create 1 rle with old method : 0.05527687072753906 length of segment : 286 time for calcul the mask position with numpy : 0.008464813232421875 nb_pixel_total : 220024 time to create 1 rle with new method : 0.015714168548583984 length of segment : 627 time for calcul the mask position with numpy : 0.003773212432861328 nb_pixel_total : 91403 time to create 1 rle with old method : 0.21885061264038086 length of segment : 359 time for calcul the mask position with numpy : 0.007401943206787109 nb_pixel_total : 191810 time to create 1 rle with new method : 0.0159454345703125 length of segment : 667 time for calcul the mask position with numpy : 0.0035181045532226562 nb_pixel_total : 67222 time to create 1 rle with old method : 0.07525777816772461 length of segment : 483 time for calcul the mask position with numpy : 0.001850128173828125 nb_pixel_total : 40539 time to create 1 rle with old method : 0.04627108573913574 length of segment : 260 time for calcul the mask position with numpy : 0.005111217498779297 nb_pixel_total : 145555 time to create 1 rle with old method : 0.1641833782196045 length of segment : 656 time for calcul the mask position with numpy : 0.0005440711975097656 nb_pixel_total : 19741 time to create 1 rle with old method : 0.022530555725097656 length of segment : 229 time for calcul the mask position with numpy : 0.0007698535919189453 nb_pixel_total : 18124 time to create 1 rle with old method : 0.020325422286987305 length of segment : 336 time for calcul the mask position with numpy : 0.0006506443023681641 nb_pixel_total : 16240 time to create 1 rle with old method : 0.01974654197692871 length of segment : 148 time for calcul the mask position with numpy : 0.0004849433898925781 nb_pixel_total : 12708 time to create 1 rle with old method : 0.01517343521118164 length of segment : 172 time for calcul the mask position with numpy : 0.003119230270385742 nb_pixel_total : 82229 time to create 1 rle with old method : 0.09809017181396484 length of segment : 421 time for calcul the mask position with numpy : 0.000499725341796875 nb_pixel_total : 11128 time to create 1 rle with old method : 0.012912750244140625 length of segment : 128 time for calcul the mask position with numpy : 0.0032317638397216797 nb_pixel_total : 67631 time to create 1 rle with old method : 0.0773618221282959 length of segment : 422 time for calcul the mask position with numpy : 0.0017476081848144531 nb_pixel_total : 41426 time to create 1 rle with old method : 0.04841971397399902 length of segment : 279 time for calcul the mask position with numpy : 0.0017459392547607422 nb_pixel_total : 52360 time to create 1 rle with old method : 0.0638267993927002 length of segment : 416 time for calcul the mask position with numpy : 0.0027899742126464844 nb_pixel_total : 97776 time to create 1 rle with old method : 0.10902595520019531 length of segment : 317 time for calcul the mask position with numpy : 0.003134012222290039 nb_pixel_total : 86556 time to create 1 rle with old method : 0.09982776641845703 length of segment : 528 time for calcul the mask position with numpy : 0.0011043548583984375 nb_pixel_total : 28526 time to create 1 rle with old method : 0.034349918365478516 length of segment : 232 time for calcul the mask position with numpy : 0.0009205341339111328 nb_pixel_total : 28355 time to create 1 rle with old method : 0.03266119956970215 length of segment : 129 time for calcul the mask position with numpy : 0.0010213851928710938 nb_pixel_total : 19408 time to create 1 rle with old method : 0.02256298065185547 length of segment : 200 time for calcul the mask position with numpy : 0.0010831356048583984 nb_pixel_total : 17152 time to create 1 rle with old method : 0.021741151809692383 length of segment : 314 time for calcul the mask position with numpy : 0.0010180473327636719 nb_pixel_total : 41841 time to create 1 rle with old method : 0.04724931716918945 length of segment : 328 time for calcul the mask position with numpy : 0.0006678104400634766 nb_pixel_total : 21900 time to create 1 rle with old method : 0.025327682495117188 length of segment : 194 time for calcul the mask position with numpy : 0.0035123825073242188 nb_pixel_total : 126547 time to create 1 rle with old method : 0.14413213729858398 length of segment : 402 time for calcul the mask position with numpy : 0.0019996166229248047 nb_pixel_total : 54336 time to create 1 rle with old method : 0.06696939468383789 length of segment : 279 time for calcul the mask position with numpy : 0.001425027847290039 nb_pixel_total : 54290 time to create 1 rle with old method : 0.0607297420501709 length of segment : 279 time for calcul the mask position with numpy : 0.0009195804595947266 nb_pixel_total : 34846 time to create 1 rle with old method : 0.03939080238342285 length of segment : 231 time for calcul the mask position with numpy : 0.0016450881958007812 nb_pixel_total : 41744 time to create 1 rle with old method : 0.04741334915161133 length of segment : 287 time for calcul the mask position with numpy : 0.00035881996154785156 nb_pixel_total : 9344 time to create 1 rle with old method : 0.01118326187133789 length of segment : 83 time for calcul the mask position with numpy : 0.00032782554626464844 nb_pixel_total : 10564 time to create 1 rle with old method : 0.012501001358032227 length of segment : 99 time for calcul the mask position with numpy : 0.0002567768096923828 nb_pixel_total : 6184 time to create 1 rle with old method : 0.007325172424316406 length of segment : 119 time for calcul the mask position with numpy : 0.0004994869232177734 nb_pixel_total : 19222 time to create 1 rle with old method : 0.023107290267944336 length of segment : 133 time spent for convertir_results : 14.52412486076355 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 139 chid ids of type : 3594 Number RLEs to save : 40801 save missing photos in datou_result : time spend for datou_step_exec : 116.64436340332031 time spend to save output : 2.6089389324188232 total time spend for step 1 : 119.25330233573914 step2:crop_condition Fri Sep 5 15:02:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 13 ! batch 1 Loaded 139 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 112 About to insert : list_path_to_insert length 112 new photo from crops ! About to upload 112 photos upload in portfolio : 3736932 init cache_photo without model_param we have 112 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757077384_506697 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 112 photos in the portfolio 3736932 time of upload the photos Elapsed time : 29.856163501739502 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757077417_506697 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.1573295593261719 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757077420_506697 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.7765915393829346 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 20 About to insert : list_path_to_insert length 20 new photo from crops ! About to upload 20 photos upload in portfolio : 3736932 init cache_photo without model_param we have 20 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757077430_506697 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 20 photos in the portfolio 3736932 time of upload the photos Elapsed time : 6.11762809753418 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1757077440_506697 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.2698633670806885 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1381742971, 1381742936, 1381742914, 1381742912, 1381742910, 1381742902, 1381742898, 1381742877, 1381742869, 1381742866, 1381742862, 1381742859, 1381742847] Looping around the photos to save general results len do output : 139 /1381766278Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766280Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766281Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766284Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766285Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766286Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766289Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766290Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766291Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766294Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766295Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766297Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766300Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766302Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766306Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766309Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766311Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766315Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766318Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766320Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766325Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766327Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766328Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766331Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766333Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766334Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766337Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766339Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766341Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766343Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766345Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766346Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766348Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766350Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766351Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766353Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766355Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766356Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766359Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766361Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766362Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766364Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766366Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766367Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766369Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766371Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766372Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766374Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766376Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766377Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766379Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766381Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766382Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766384Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766386Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766387Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766389Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766391Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766392Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766394Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766396Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766397Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766399Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766401Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766402Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766403Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766406Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766408Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766409Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766412Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766414Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766415Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766418Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766420Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766421Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766424Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766426Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766427Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766430Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766432Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766434Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766437Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766439Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766440Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766443Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766445Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766446Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766449Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766451Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766452Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766455Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766457Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766458Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766461Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766464Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766465Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766468Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766470Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766471Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766474Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766476Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766477Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766480Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766482Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766483Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766486Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766488Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766491Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766494Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766496Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766497Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766500Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766569Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766570Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766571Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766610Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766790Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766791Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766793Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766794Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766795Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766797Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766798Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766799Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766801Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766802Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766803Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766805Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766806Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766807Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766809Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766810Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766811Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766812Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766814Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766815Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766843Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766845Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1381766846Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742971', None, None, None, None, None, '3670236') ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742936', None, None, None, None, None, '3670236') ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742914', None, None, None, None, None, '3670236') ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742912', None, None, None, None, None, '3670236') ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742910', None, None, None, None, None, '3670236') ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742902', None, None, None, None, None, '3670236') ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742898', None, None, None, None, None, '3670236') ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742877', None, None, None, None, None, '3670236') ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742869', None, None, None, None, None, '3670236') ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742866', None, None, None, None, None, '3670236') ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742862', None, None, None, None, None, '3670236') ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742859', None, None, None, None, None, '3670236') ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742847', None, None, None, None, None, '3670236') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 430 time used for this insertion : 0.03049755096435547 save_final save missing photos in datou_result : time spend for datou_step_exec : 89.58582901954651 time spend to save output : 0.035286903381347656 total time spend for step 2 : 89.62111592292786 step3:rle_unique_nms_with_priority Fri Sep 5 15:04:01 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 139 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 7 nb_hashtags : 1 time to prepare the origin masks : 4.144690990447998 time for calcul the mask position with numpy : 1.0633559226989746 nb_pixel_total : 7875186 time to create 1 rle with new method : 0.9786083698272705 time for calcul the mask position with numpy : 0.025025129318237305 nb_pixel_total : 20498 time to create 1 rle with old method : 0.022791385650634766 time for calcul the mask position with numpy : 0.026677846908569336 nb_pixel_total : 172699 time to create 1 rle with new method : 1.1769495010375977 time for calcul the mask position with numpy : 0.02576422691345215 nb_pixel_total : 19937 time to create 1 rle with old method : 0.024163007736206055 time for calcul the mask position with numpy : 0.02487492561340332 nb_pixel_total : 16749 time to create 1 rle with old method : 0.01893138885498047 time for calcul the mask position with numpy : 0.025787353515625 nb_pixel_total : 64387 time to create 1 rle with old method : 0.07543420791625977 time for calcul the mask position with numpy : 0.02524709701538086 nb_pixel_total : 105907 time to create 1 rle with old method : 0.11950230598449707 time for calcul the mask position with numpy : 0.024990558624267578 nb_pixel_total : 19037 time to create 1 rle with old method : 0.021409988403320312 create new chi : 3.7405195236206055 time to delete rle : 0.021356821060180664 batch 1 Loaded 15 chid ids of type : 3594 ++++++++Number RLEs to save : 5786 TO DO : save crop sub photo not yet done ! save time : 0.35698914527893066 nb_obj : 14 nb_hashtags : 3 time to prepare the origin masks : 8.020548105239868 time for calcul the mask position with numpy : 1.078582763671875 nb_pixel_total : 7697402 time to create 1 rle with new method : 1.2271459102630615 time for calcul the mask position with numpy : 0.025794029235839844 nb_pixel_total : 122073 time to create 1 rle with old method : 0.1352977752685547 time for calcul the mask position with numpy : 0.023479938507080078 nb_pixel_total : 67160 time to create 1 rle with old method : 0.07634258270263672 time for calcul the mask position with numpy : 0.03350353240966797 nb_pixel_total : 3172 time to create 1 rle with old method : 0.0034155845642089844 time for calcul the mask position with numpy : 0.023616790771484375 nb_pixel_total : 26198 time to create 1 rle with old method : 0.02676844596862793 time for calcul the mask position with numpy : 0.02317070960998535 nb_pixel_total : 5577 time to create 1 rle with old method : 0.005942821502685547 time for calcul the mask position with numpy : 0.023554563522338867 nb_pixel_total : 10895 time to create 1 rle with old method : 0.011697053909301758 time for calcul the mask position with numpy : 0.023110628128051758 nb_pixel_total : 37558 time to create 1 rle with old method : 0.04034590721130371 time for calcul the mask position with numpy : 0.024333715438842773 nb_pixel_total : 49139 time to create 1 rle with old method : 0.05299806594848633 time for calcul the mask position with numpy : 0.023931503295898438 nb_pixel_total : 51901 time to create 1 rle with old method : 0.05494523048400879 time for calcul the mask position with numpy : 0.023708581924438477 nb_pixel_total : 37754 time to create 1 rle with old method : 0.040680646896362305 time for calcul the mask position with numpy : 0.02388167381286621 nb_pixel_total : 25510 time to create 1 rle with old method : 0.02621173858642578 time for calcul the mask position with numpy : 0.024453401565551758 nb_pixel_total : 44476 time to create 1 rle with old method : 0.04780840873718262 time for calcul the mask position with numpy : 0.024010658264160156 nb_pixel_total : 53580 time to create 1 rle with old method : 0.05708456039428711 time for calcul the mask position with numpy : 0.0236818790435791 nb_pixel_total : 62005 time to create 1 rle with old method : 0.06464529037475586 create new chi : 3.3375418186187744 time to delete rle : 0.0013015270233154297 batch 1 Loaded 29 chid ids of type : 3594 ++++++++++++++++++++Number RLEs to save : 9324 TO DO : save crop sub photo not yet done ! save time : 0.5577027797698975 nb_obj : 10 nb_hashtags : 1 time to prepare the origin masks : 5.224822282791138 time for calcul the mask position with numpy : 0.8066174983978271 nb_pixel_total : 7668447 time to create 1 rle with new method : 0.927478551864624 time for calcul the mask position with numpy : 0.024527549743652344 nb_pixel_total : 27856 time to create 1 rle with old method : 0.03092479705810547 time for calcul the mask position with numpy : 0.02548384666442871 nb_pixel_total : 12503 time to create 1 rle with old method : 0.014135599136352539 time for calcul the mask position with numpy : 0.027597427368164062 nb_pixel_total : 18786 time to create 1 rle with old method : 0.02108168601989746 time for calcul the mask position with numpy : 0.0291440486907959 nb_pixel_total : 135321 time to create 1 rle with old method : 0.15225934982299805 time for calcul the mask position with numpy : 0.025892257690429688 nb_pixel_total : 30805 time to create 1 rle with old method : 0.03430056571960449 time for calcul the mask position with numpy : 0.02522897720336914 nb_pixel_total : 225232 time to create 1 rle with new method : 1.0079362392425537 time for calcul the mask position with numpy : 0.025501251220703125 nb_pixel_total : 21050 time to create 1 rle with old method : 0.023307085037231445 time for calcul the mask position with numpy : 0.026465654373168945 nb_pixel_total : 24837 time to create 1 rle with old method : 0.034204959869384766 time for calcul the mask position with numpy : 0.0281679630279541 nb_pixel_total : 97229 time to create 1 rle with old method : 0.11136937141418457 time for calcul the mask position with numpy : 0.025444507598876953 nb_pixel_total : 32334 time to create 1 rle with old method : 0.03699898719787598 create new chi : 3.5438990592956543 time to delete rle : 0.0014569759368896484 batch 1 Loaded 21 chid ids of type : 3594 ++++++++++++++Number RLEs to save : 9848 TO DO : save crop sub photo not yet done ! save time : 0.6076505184173584 nb_obj : 12 nb_hashtags : 4 time to prepare the origin masks : 8.087524175643921 time for calcul the mask position with numpy : 0.6821932792663574 nb_pixel_total : 7762523 time to create 1 rle with new method : 0.7471256256103516 time for calcul the mask position with numpy : 0.024491548538208008 nb_pixel_total : 79871 time to create 1 rle with old method : 0.08880758285522461 time for calcul the mask position with numpy : 0.025199174880981445 nb_pixel_total : 19608 time to create 1 rle with old method : 0.02225351333618164 time for calcul the mask position with numpy : 0.024275541305541992 nb_pixel_total : 11132 time to create 1 rle with old method : 0.012763023376464844 time for calcul the mask position with numpy : 0.025011062622070312 nb_pixel_total : 45980 time to create 1 rle with old method : 0.051430702209472656 time for calcul the mask position with numpy : 0.026678800582885742 nb_pixel_total : 144885 time to create 1 rle with old method : 0.1707754135131836 time for calcul the mask position with numpy : 0.025404930114746094 nb_pixel_total : 29169 time to create 1 rle with old method : 0.032708168029785156 time for calcul the mask position with numpy : 0.02525639533996582 nb_pixel_total : 19943 time to create 1 rle with old method : 0.022523880004882812 time for calcul the mask position with numpy : 0.02534174919128418 nb_pixel_total : 38472 time to create 1 rle with old method : 0.043350934982299805 time for calcul the mask position with numpy : 0.026723146438598633 nb_pixel_total : 19199 time to create 1 rle with old method : 0.021523714065551758 time for calcul the mask position with numpy : 0.025380373001098633 nb_pixel_total : 16936 time to create 1 rle with old method : 0.019362449645996094 time for calcul the mask position with numpy : 0.026274681091308594 nb_pixel_total : 102142 time to create 1 rle with old method : 0.11452269554138184 time for calcul the mask position with numpy : 0.02468562126159668 nb_pixel_total : 4540 time to create 1 rle with old method : 0.005226612091064453 create new chi : 2.3854587078094482 time to delete rle : 0.0011453628540039062 batch 1 Loaded 25 chid ids of type : 3594 +++++++++++++++Number RLEs to save : 7986 TO DO : save crop sub photo not yet done ! save time : 0.48859310150146484 nb_obj : 7 nb_hashtags : 2 time to prepare the origin masks : 4.605664253234863 time for calcul the mask position with numpy : 1.7527556419372559 nb_pixel_total : 7849645 time to create 1 rle with new method : 1.5018610954284668 time for calcul the mask position with numpy : 0.025595903396606445 nb_pixel_total : 22331 time to create 1 rle with old method : 0.02723383903503418 time for calcul the mask position with numpy : 0.02464890480041504 nb_pixel_total : 32477 time to create 1 rle with old method : 0.039675235748291016 time for calcul the mask position with numpy : 0.02525639533996582 nb_pixel_total : 57326 time to create 1 rle with old method : 0.06759190559387207 time for calcul the mask position with numpy : 0.025798320770263672 nb_pixel_total : 154730 time to create 1 rle with new method : 0.8413877487182617 time for calcul the mask position with numpy : 0.026116371154785156 nb_pixel_total : 13509 time to create 1 rle with old method : 0.016629695892333984 time for calcul the mask position with numpy : 0.02620530128479004 nb_pixel_total : 86328 time to create 1 rle with old method : 0.10309028625488281 time for calcul the mask position with numpy : 0.025330305099487305 nb_pixel_total : 78054 time to create 1 rle with old method : 0.08592987060546875 create new chi : 4.686836004257202 time to delete rle : 0.0009119510650634766 batch 1 Loaded 15 chid ids of type : 3594 +++++++Number RLEs to save : 6288 TO DO : save crop sub photo not yet done ! save time : 0.40874481201171875 nb_obj : 13 nb_hashtags : 3 time to prepare the origin masks : 11.234725713729858 time for calcul the mask position with numpy : 0.7795224189758301 nb_pixel_total : 7681397 time to create 1 rle with new method : 1.0542197227478027 time for calcul the mask position with numpy : 0.04105210304260254 nb_pixel_total : 7297 time to create 1 rle with old method : 0.008549690246582031 time for calcul the mask position with numpy : 0.04018378257751465 nb_pixel_total : 23216 time to create 1 rle with old method : 0.025998592376708984 time for calcul the mask position with numpy : 0.04027271270751953 nb_pixel_total : 37513 time to create 1 rle with old method : 0.04263591766357422 time for calcul the mask position with numpy : 0.04072070121765137 nb_pixel_total : 25263 time to create 1 rle with old method : 0.029278993606567383 time for calcul the mask position with numpy : 0.043966054916381836 nb_pixel_total : 53294 time to create 1 rle with old method : 0.06064963340759277 time for calcul the mask position with numpy : 0.04362130165100098 nb_pixel_total : 34897 time to create 1 rle with old method : 0.041404008865356445 time for calcul the mask position with numpy : 0.040842533111572266 nb_pixel_total : 62909 time to create 1 rle with old method : 0.06985592842102051 time for calcul the mask position with numpy : 0.0404820442199707 nb_pixel_total : 45809 time to create 1 rle with old method : 0.054573774337768555 time for calcul the mask position with numpy : 0.03896832466125488 nb_pixel_total : 29653 time to create 1 rle with old method : 0.03375601768493652 time for calcul the mask position with numpy : 0.03359484672546387 nb_pixel_total : 25786 time to create 1 rle with old method : 0.03204751014709473 time for calcul the mask position with numpy : 0.025330305099487305 nb_pixel_total : 71109 time to create 1 rle with old method : 0.08544349670410156 time for calcul the mask position with numpy : 0.024880409240722656 nb_pixel_total : 28638 time to create 1 rle with old method : 0.032318115234375 time for calcul the mask position with numpy : 0.025959253311157227 nb_pixel_total : 167619 time to create 1 rle with new method : 1.1492819786071777 create new chi : 4.050162315368652 time to delete rle : 0.002185344696044922 batch 1 Loaded 27 chid ids of type : 3594 +++++++++++++++++Number RLEs to save : 8578 TO DO : save crop sub photo not yet done ! save time : 0.5319075584411621 nb_obj : 8 nb_hashtags : 2 time to prepare the origin masks : 6.366886138916016 time for calcul the mask position with numpy : 1.6471822261810303 nb_pixel_total : 7714022 time to create 1 rle with new method : 1.4350273609161377 time for calcul the mask position with numpy : 0.02520155906677246 nb_pixel_total : 25048 time to create 1 rle with old method : 0.028716325759887695 time for calcul the mask position with numpy : 0.025719881057739258 nb_pixel_total : 30680 time to create 1 rle with old method : 0.034323692321777344 time for calcul the mask position with numpy : 0.027848243713378906 nb_pixel_total : 47782 time to create 1 rle with old method : 0.05325126647949219 time for calcul the mask position with numpy : 0.024859189987182617 nb_pixel_total : 28481 time to create 1 rle with old method : 0.032486915588378906 time for calcul the mask position with numpy : 0.02459430694580078 nb_pixel_total : 6281 time to create 1 rle with old method : 0.00727534294128418 time for calcul the mask position with numpy : 0.025052785873413086 nb_pixel_total : 90866 time to create 1 rle with old method : 0.10301589965820312 time for calcul the mask position with numpy : 0.02738165855407715 nb_pixel_total : 301818 time to create 1 rle with new method : 1.0780696868896484 time for calcul the mask position with numpy : 0.026376008987426758 nb_pixel_total : 49422 time to create 1 rle with old method : 0.07956314086914062 create new chi : 4.77649188041687 time to delete rle : 0.001550912857055664 batch 1 Loaded 17 chid ids of type : 3594 +++++++++++Number RLEs to save : 7050 TO DO : save crop sub photo not yet done ! save time : 0.4797048568725586 nb_obj : 9 nb_hashtags : 2 time to prepare the origin masks : 8.71644401550293 time for calcul the mask position with numpy : 0.5636014938354492 nb_pixel_total : 7565529 time to create 1 rle with new method : 1.2773120403289795 time for calcul the mask position with numpy : 0.04648900032043457 nb_pixel_total : 22976 time to create 1 rle with old method : 0.02814459800720215 time for calcul the mask position with numpy : 0.04270672798156738 nb_pixel_total : 57965 time to create 1 rle with old method : 0.06649327278137207 time for calcul the mask position with numpy : 0.041834354400634766 nb_pixel_total : 58282 time to create 1 rle with old method : 0.06531381607055664 time for calcul the mask position with numpy : 0.04152321815490723 nb_pixel_total : 55948 time to create 1 rle with old method : 0.0640866756439209 time for calcul the mask position with numpy : 0.04254269599914551 nb_pixel_total : 97290 time to create 1 rle with old method : 0.11933326721191406 time for calcul the mask position with numpy : 0.044055938720703125 nb_pixel_total : 190794 time to create 1 rle with new method : 1.2837293148040771 time for calcul the mask position with numpy : 0.04228544235229492 nb_pixel_total : 139733 time to create 1 rle with old method : 0.15316534042358398 time for calcul the mask position with numpy : 0.046421051025390625 nb_pixel_total : 37370 time to create 1 rle with old method : 0.041658878326416016 time for calcul the mask position with numpy : 0.042740821838378906 nb_pixel_total : 68513 time to create 1 rle with old method : 0.07541656494140625 create new chi : 4.20391321182251 time to delete rle : 0.0016126632690429688 batch 1 Loaded 19 chid ids of type : 3594 ++++++++++Number RLEs to save : 9404 TO DO : save crop sub photo not yet done ! save time : 0.5686399936676025 nb_obj : 9 nb_hashtags : 1 time to prepare the origin masks : 5.1005635261535645 time for calcul the mask position with numpy : 1.0954041481018066 nb_pixel_total : 7743504 time to create 1 rle with new method : 1.0552937984466553 time for calcul the mask position with numpy : 0.04096269607543945 nb_pixel_total : 117136 time to create 1 rle with old method : 0.12979531288146973 time for calcul the mask position with numpy : 0.03206014633178711 nb_pixel_total : 22680 time to create 1 rle with old method : 0.025336265563964844 time for calcul the mask position with numpy : 0.025408029556274414 nb_pixel_total : 24791 time to create 1 rle with old method : 0.03139519691467285 time for calcul the mask position with numpy : 0.040884971618652344 nb_pixel_total : 49851 time to create 1 rle with old method : 0.05389237403869629 time for calcul the mask position with numpy : 0.04085969924926758 nb_pixel_total : 65333 time to create 1 rle with old method : 0.07009649276733398 time for calcul the mask position with numpy : 0.040560007095336914 nb_pixel_total : 28158 time to create 1 rle with old method : 0.030878067016601562 time for calcul the mask position with numpy : 0.04052019119262695 nb_pixel_total : 67328 time to create 1 rle with old method : 0.07292842864990234 time for calcul the mask position with numpy : 0.04169821739196777 nb_pixel_total : 150112 time to create 1 rle with new method : 0.6960952281951904 time for calcul the mask position with numpy : 0.03362226486206055 nb_pixel_total : 25507 time to create 1 rle with old method : 0.02806544303894043 create new chi : 3.699261426925659 time to delete rle : 0.001842498779296875 batch 1 Loaded 19 chid ids of type : 3594 +++++++++++Number RLEs to save : 7462 TO DO : save crop sub photo not yet done ! save time : 0.4566218852996826 nb_obj : 10 nb_hashtags : 2 time to prepare the origin masks : 5.976498365402222 time for calcul the mask position with numpy : 0.7428066730499268 nb_pixel_total : 7558168 time to create 1 rle with new method : 0.9134883880615234 time for calcul the mask position with numpy : 0.041649818420410156 nb_pixel_total : 45183 time to create 1 rle with old method : 0.05030512809753418 time for calcul the mask position with numpy : 0.04092144966125488 nb_pixel_total : 59059 time to create 1 rle with old method : 0.06564807891845703 time for calcul the mask position with numpy : 0.04135274887084961 nb_pixel_total : 42928 time to create 1 rle with old method : 0.0480198860168457 time for calcul the mask position with numpy : 0.03762674331665039 nb_pixel_total : 132126 time to create 1 rle with old method : 0.1458454132080078 time for calcul the mask position with numpy : 0.026221513748168945 nb_pixel_total : 93976 time to create 1 rle with old method : 0.10565781593322754 time for calcul the mask position with numpy : 0.027022123336791992 nb_pixel_total : 89901 time to create 1 rle with old method : 0.09957671165466309 time for calcul the mask position with numpy : 0.0270078182220459 nb_pixel_total : 65488 time to create 1 rle with old method : 0.07255911827087402 time for calcul the mask position with numpy : 0.027728796005249023 nb_pixel_total : 119717 time to create 1 rle with old method : 0.132110595703125 time for calcul the mask position with numpy : 0.02512526512145996 nb_pixel_total : 65649 time to create 1 rle with old method : 0.07317352294921875 time for calcul the mask position with numpy : 0.025858640670776367 nb_pixel_total : 22205 time to create 1 rle with old method : 0.024977445602416992 create new chi : 2.841123580932617 time to delete rle : 0.0013184547424316406 batch 1 Loaded 21 chid ids of type : 3594 +++++++++++Number RLEs to save : 8024 TO DO : save crop sub photo not yet done ! save time : 0.49474215507507324 nb_obj : 18 nb_hashtags : 2 time to prepare the origin masks : 8.020539283752441 time for calcul the mask position with numpy : 0.27199220657348633 nb_pixel_total : 7054026 time to create 1 rle with new method : 0.38861727714538574 time for calcul the mask position with numpy : 0.03202652931213379 nb_pixel_total : 12708 time to create 1 rle with old method : 0.01558232307434082 time for calcul the mask position with numpy : 0.03279685974121094 nb_pixel_total : 16240 time to create 1 rle with old method : 0.01883554458618164 time for calcul the mask position with numpy : 0.03302192687988281 nb_pixel_total : 18124 time to create 1 rle with old method : 0.020531177520751953 time for calcul the mask position with numpy : 0.03184008598327637 nb_pixel_total : 18229 time to create 1 rle with old method : 0.02057361602783203 time for calcul the mask position with numpy : 0.036473751068115234 nb_pixel_total : 145555 time to create 1 rle with old method : 0.16405963897705078 time for calcul the mask position with numpy : 0.04573845863342285 nb_pixel_total : 40539 time to create 1 rle with old method : 0.05289053916931152 time for calcul the mask position with numpy : 0.03718256950378418 nb_pixel_total : 67222 time to create 1 rle with old method : 0.0844871997833252 time for calcul the mask position with numpy : 0.052353620529174805 nb_pixel_total : 191810 time to create 1 rle with new method : 0.4669983386993408 time for calcul the mask position with numpy : 0.0333249568939209 nb_pixel_total : 91403 time to create 1 rle with old method : 0.10413670539855957 time for calcul the mask position with numpy : 0.03454303741455078 nb_pixel_total : 220024 time to create 1 rle with new method : 0.46674513816833496 time for calcul the mask position with numpy : 0.03367495536804199 nb_pixel_total : 49620 time to create 1 rle with old method : 0.05607151985168457 time for calcul the mask position with numpy : 0.03361153602600098 nb_pixel_total : 50810 time to create 1 rle with old method : 0.0570988655090332 time for calcul the mask position with numpy : 0.03108811378479004 nb_pixel_total : 14167 time to create 1 rle with old method : 0.016000747680664062 time for calcul the mask position with numpy : 0.03161048889160156 nb_pixel_total : 85694 time to create 1 rle with old method : 0.09700608253479004 time for calcul the mask position with numpy : 0.03188633918762207 nb_pixel_total : 36684 time to create 1 rle with old method : 0.06325840950012207 time for calcul the mask position with numpy : 0.03934335708618164 nb_pixel_total : 18189 time to create 1 rle with old method : 0.021404027938842773 time for calcul the mask position with numpy : 0.04401659965515137 nb_pixel_total : 12852 time to create 1 rle with old method : 0.014517545700073242 time for calcul the mask position with numpy : 0.05214428901672363 nb_pixel_total : 150504 time to create 1 rle with new method : 0.902169942855835 create new chi : 4.097180128097534 time to delete rle : 0.003014802932739258 batch 1 Loaded 37 chid ids of type : 3594 ++++++++++++++++++++++Number RLEs to save : 13655 TO DO : save crop sub photo not yet done ! save time : 0.8023436069488525 nb_obj : 18 nb_hashtags : 3 time to prepare the origin masks : 6.166383266448975 time for calcul the mask position with numpy : 0.34103941917419434 nb_pixel_total : 7386428 time to create 1 rle with new method : 0.4754304885864258 time for calcul the mask position with numpy : 0.03270149230957031 nb_pixel_total : 41744 time to create 1 rle with old method : 0.05110049247741699 time for calcul the mask position with numpy : 0.03489065170288086 nb_pixel_total : 34846 time to create 1 rle with old method : 0.038976192474365234 time for calcul the mask position with numpy : 0.03680157661437988 nb_pixel_total : 54290 time to create 1 rle with old method : 0.06052446365356445 time for calcul the mask position with numpy : 0.03439927101135254 nb_pixel_total : 54336 time to create 1 rle with old method : 0.06036210060119629 time for calcul the mask position with numpy : 0.033172607421875 nb_pixel_total : 126547 time to create 1 rle with old method : 0.14344048500061035 time for calcul the mask position with numpy : 0.030757904052734375 nb_pixel_total : 21821 time to create 1 rle with old method : 0.024430036544799805 time for calcul the mask position with numpy : 0.034629106521606445 nb_pixel_total : 41841 time to create 1 rle with old method : 0.051401376724243164 time for calcul the mask position with numpy : 0.03161978721618652 nb_pixel_total : 17152 time to create 1 rle with old method : 0.028153419494628906 time for calcul the mask position with numpy : 0.03274035453796387 nb_pixel_total : 19408 time to create 1 rle with old method : 0.021651268005371094 time for calcul the mask position with numpy : 0.03279280662536621 nb_pixel_total : 28355 time to create 1 rle with old method : 0.031699419021606445 time for calcul the mask position with numpy : 0.02586507797241211 nb_pixel_total : 28526 time to create 1 rle with old method : 0.03214836120605469 time for calcul the mask position with numpy : 0.0263669490814209 nb_pixel_total : 86556 time to create 1 rle with old method : 0.09776568412780762 time for calcul the mask position with numpy : 0.02759718894958496 nb_pixel_total : 97776 time to create 1 rle with old method : 0.11325693130493164 time for calcul the mask position with numpy : 0.024809837341308594 nb_pixel_total : 52360 time to create 1 rle with old method : 0.061598777770996094 time for calcul the mask position with numpy : 0.025727272033691406 nb_pixel_total : 41426 time to create 1 rle with old method : 0.045903682708740234 time for calcul the mask position with numpy : 0.025198936462402344 nb_pixel_total : 67631 time to create 1 rle with old method : 0.08076190948486328 time for calcul the mask position with numpy : 0.02559804916381836 nb_pixel_total : 11128 time to create 1 rle with old method : 0.012958049774169922 time for calcul the mask position with numpy : 0.025233745574951172 nb_pixel_total : 82229 time to create 1 rle with old method : 0.09313130378723145 create new chi : 2.449777126312256 time to delete rle : 0.0021038055419921875 batch 1 Loaded 37 chid ids of type : 3594 ++++++++++++++++++++Number RLEs to save : 12898 TO DO : save crop sub photo not yet done ! save time : 0.7630758285522461 nb_obj : 4 nb_hashtags : 1 time to prepare the origin masks : 2.215115547180176 time for calcul the mask position with numpy : 0.6709637641906738 nb_pixel_total : 8249086 time to create 1 rle with new method : 0.5314772129058838 time for calcul the mask position with numpy : 0.024964332580566406 nb_pixel_total : 19222 time to create 1 rle with old method : 0.022724390029907227 time for calcul the mask position with numpy : 0.028857946395874023 nb_pixel_total : 6184 time to create 1 rle with old method : 0.008024454116821289 time for calcul the mask position with numpy : 0.03110814094543457 nb_pixel_total : 10564 time to create 1 rle with old method : 0.01239156723022461 time for calcul the mask position with numpy : 0.02679300308227539 nb_pixel_total : 9344 time to create 1 rle with old method : 0.010566949844360352 create new chi : 1.412376880645752 time to delete rle : 0.0005996227264404297 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 3028 TO DO : save crop sub photo not yet done ! save time : 0.2227785587310791 map_output_result : {1381742971: (0.0, 'Should be the crop_list due to order', 0), 1381742936: (0.0, 'Should be the crop_list due to order', 0), 1381742914: (0.0, 'Should be the crop_list due to order', 0), 1381742912: (0.0, 'Should be the crop_list due to order', 0), 1381742910: (0.0, 'Should be the crop_list due to order', 0), 1381742902: (0.0, 'Should be the crop_list due to order', 0), 1381742898: (0.0, 'Should be the crop_list due to order', 0), 1381742877: (0.0, 'Should be the crop_list due to order', 0), 1381742869: (0.0, 'Should be the crop_list due to order', 0), 1381742866: (0.0, 'Should be the crop_list due to order', 0), 1381742862: (0.0, 'Should be the crop_list due to order', 0), 1381742859: (0.0, 'Should be the crop_list due to order', 0), 1381742847: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1381742971, 1381742936, 1381742914, 1381742912, 1381742910, 1381742902, 1381742898, 1381742877, 1381742869, 1381742866, 1381742862, 1381742859, 1381742847] Looping around the photos to save general results len do output : 13 /1381742971.Didn't retrieve data . /1381742936.Didn't retrieve data . /1381742914.Didn't retrieve data . /1381742912.Didn't retrieve data . /1381742910.Didn't retrieve data . /1381742902.Didn't retrieve data . /1381742898.Didn't retrieve data . /1381742877.Didn't retrieve data . /1381742869.Didn't retrieve data . /1381742866.Didn't retrieve data . /1381742862.Didn't retrieve data . /1381742859.Didn't retrieve data . /1381742847.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742971', None, None, None, None, None, '3670236') ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742936', None, None, None, None, None, '3670236') ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742914', None, None, None, None, None, '3670236') ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742912', None, None, None, None, None, '3670236') ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742910', None, None, None, None, None, '3670236') ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742902', None, None, None, None, None, '3670236') ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742898', None, None, None, None, None, '3670236') ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742877', None, None, None, None, None, '3670236') ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742869', None, None, None, None, None, '3670236') ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742866', None, None, None, None, None, '3670236') ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742862', None, None, None, None, None, '3670236') ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742859', None, None, None, None, None, '3670236') ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742847', None, None, None, None, None, '3670236') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 39 time used for this insertion : 0.020035505294799805 save_final save missing photos in datou_result : time spend for datou_step_exec : 137.81365585327148 time spend to save output : 0.02120232582092285 total time spend for step 3 : 137.8348581790924 step4:ventilate_hashtags_in_portfolio Fri Sep 5 15:06:19 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 26579611 get user id for portfolio 26579611 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26579611 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','environnement','metal','mal_croppe','pet_clair','background','carton','pet_fonce','pehd','autre','flou')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26579611 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','environnement','metal','mal_croppe','pet_clair','background','carton','pet_fonce','pehd','autre','flou')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26579611 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','environnement','metal','mal_croppe','pet_clair','background','carton','pet_fonce','pehd','autre','flou')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/26581007,26581008,26581009,26581010,26581011,26581012,26581013,26581014,26581015,26581016,26581017?tags=papier,environnement,metal,mal_croppe,pet_clair,background,carton,pet_fonce,pehd,autre,flou Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1381742971, 1381742936, 1381742914, 1381742912, 1381742910, 1381742902, 1381742898, 1381742877, 1381742869, 1381742866, 1381742862, 1381742859, 1381742847] Looping around the photos to save general results len do output : 1 /26579611. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742971', None, None, None, None, None, '3670236') ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742936', None, None, None, None, None, '3670236') ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742914', None, None, None, None, None, '3670236') ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742912', None, None, None, None, None, '3670236') ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742910', None, None, None, None, None, '3670236') ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742902', None, None, None, None, None, '3670236') ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742898', None, None, None, None, None, '3670236') ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742877', None, None, None, None, None, '3670236') ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742869', None, None, None, None, None, '3670236') ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742866', None, None, None, None, None, '3670236') ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742862', None, None, None, None, None, '3670236') ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742859', None, None, None, None, None, '3670236') ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742847', None, None, None, None, None, '3670236') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 14 time used for this insertion : 0.01949024200439453 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.7597324848175049 time spend to save output : 0.019842147827148438 total time spend for step 4 : 1.7795746326446533 step5:final Fri Sep 5 15:06:20 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1381742971: ('0.07439530100011871',), 1381742936: ('0.07439530100011871',), 1381742914: ('0.07439530100011871',), 1381742912: ('0.07439530100011871',), 1381742910: ('0.07439530100011871',), 1381742902: ('0.07439530100011871',), 1381742898: ('0.07439530100011871',), 1381742877: ('0.07439530100011871',), 1381742869: ('0.07439530100011871',), 1381742866: ('0.07439530100011871',), 1381742862: ('0.07439530100011871',), 1381742859: ('0.07439530100011871',), 1381742847: ('0.07439530100011871',)} new output for save of step final : {1381742971: ('0.07439530100011871',), 1381742936: ('0.07439530100011871',), 1381742914: ('0.07439530100011871',), 1381742912: ('0.07439530100011871',), 1381742910: ('0.07439530100011871',), 1381742902: ('0.07439530100011871',), 1381742898: ('0.07439530100011871',), 1381742877: ('0.07439530100011871',), 1381742869: ('0.07439530100011871',), 1381742866: ('0.07439530100011871',), 1381742862: ('0.07439530100011871',), 1381742859: ('0.07439530100011871',), 1381742847: ('0.07439530100011871',)} [1381742971, 1381742936, 1381742914, 1381742912, 1381742910, 1381742902, 1381742898, 1381742877, 1381742869, 1381742866, 1381742862, 1381742859, 1381742847] Looping around the photos to save general results len do output : 13 /1381742971.Didn't retrieve data . /1381742936.Didn't retrieve data . /1381742914.Didn't retrieve data . /1381742912.Didn't retrieve data . /1381742910.Didn't retrieve data . /1381742902.Didn't retrieve data . /1381742898.Didn't retrieve data . /1381742877.Didn't retrieve data . /1381742869.Didn't retrieve data . /1381742866.Didn't retrieve data . /1381742862.Didn't retrieve data . /1381742859.Didn't retrieve data . /1381742847.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742971', None, None, None, None, None, '3670236') ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742936', None, None, None, None, None, '3670236') ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742914', None, None, None, None, None, '3670236') ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742912', None, None, None, None, None, '3670236') ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742910', None, None, None, None, None, '3670236') ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742902', None, None, None, None, None, '3670236') ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742898', None, None, None, None, None, '3670236') ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742877', None, None, None, None, None, '3670236') ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742869', None, None, None, None, None, '3670236') ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742866', None, None, None, None, None, '3670236') ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742862', None, None, None, None, None, '3670236') ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742859', None, None, None, None, None, '3670236') ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742847', None, None, None, None, None, '3670236') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 39 time used for this insertion : 0.014026165008544922 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.1214151382446289 time spend to save output : 0.014979124069213867 total time spend for step 5 : 0.13639426231384277 step6:blur_detection Fri Sep 5 15:06:20 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1757077230_506697_1381742971_add53a70667167d1ec608452a82cf385.jpg resize: (2160, 3840) 1381742971 -6.7153844841224055 treat image : temp/1757077230_506697_1381742936_a84527bfc56914a614eaf1d787bf379d.jpg resize: (2160, 3840) 1381742936 -6.745121826048445 treat image : temp/1757077230_506697_1381742914_d1df301a2e5831f830ea2521b4a7352f.jpg resize: (2160, 3840) 1381742914 -6.8472378259383655 treat image : temp/1757077230_506697_1381742912_05a2f055fa081b3a93f9269f120a5727.jpg resize: (2160, 3840) 1381742912 -6.660645167772621 treat image : temp/1757077230_506697_1381742910_9e7af758f242406fc100717d78c11610.jpg resize: (2160, 3840) 1381742910 -6.804736597397484 treat image : temp/1757077230_506697_1381742902_c23f53ca966ccba59485d9b7a7285bf7.jpg resize: (2160, 3840) 1381742902 -6.2246737567788255 treat image : temp/1757077230_506697_1381742898_98180948fcb8cfd8777eefb0d306230a.jpg resize: (2160, 3840) 1381742898 -6.730245609840253 treat image : temp/1757077230_506697_1381742877_0a6388b34b81b5ce85ce58dafb7be3f7.jpg resize: (2160, 3840) 1381742877 -6.720945811793328 treat image : temp/1757077230_506697_1381742869_7d10f9f01ad361a0c5439e0fc302150c.jpg resize: (2160, 3840) 1381742869 -6.374817023282387 treat image : temp/1757077230_506697_1381742866_0d5c392f1c2208b08e0acf816f81f186.jpg resize: (2160, 3840) 1381742866 -6.639856926362364 treat image : temp/1757077230_506697_1381742862_0ce7071c7eca7579b434173e5fb75128.jpg resize: (2160, 3840) 1381742862 -6.570761175831101 treat image : temp/1757077230_506697_1381742859_fb7fc79aec5eab5bc2906ee9d878608f.jpg resize: (2160, 3840) 1381742859 -6.6232983735442605 treat image : temp/1757077230_506697_1381742847_9ffdaf6ce647d200a0c4aed137130126.jpg resize: (2160, 3840) 1381742847 -4.924057125431913 treat image : temp/1757077230_506697_1381742971_add53a70667167d1ec608452a82cf385_rle_crop_3946263124_0.png resize: (133, 181) 1381766278 5.476851352934229 treat image : temp/1757077230_506697_1381742971_add53a70667167d1ec608452a82cf385_rle_crop_3946263125_0.png resize: (340, 391) 1381766280 -1.3626372893759633 treat image : temp/1757077230_506697_1381742971_add53a70667167d1ec608452a82cf385_rle_crop_3946263126_0.png resize: (348, 279) 1381766281 -0.6157490813661123 treat image : temp/1757077230_506697_1381742971_add53a70667167d1ec608452a82cf385_rle_crop_3946263127_0.png resize: (142, 149) 1381766284 -0.9389720751760867 treat image : temp/1757077230_506697_1381742971_add53a70667167d1ec608452a82cf385_rle_crop_3946263128_0.png resize: (177, 143) 1381766285 -1.0235658337220148 treat image : temp/1757077230_506697_1381742971_add53a70667167d1ec608452a82cf385_rle_crop_3946263129_0.png resize: (496, 432) 1381766286 -4.372848626187264 treat image : temp/1757077230_506697_1381742971_add53a70667167d1ec608452a82cf385_rle_crop_3946263130_0.png resize: (112, 237) 1381766289 -3.2905837887536893 treat image : temp/1757077230_506697_1381742936_a84527bfc56914a614eaf1d787bf379d_rle_crop_3946263131_0.png resize: (238, 419) 1381766290 1.3389079935579653 treat image : temp/1757077230_506697_1381742936_a84527bfc56914a614eaf1d787bf379d_rle_crop_3946263132_0.png resize: (260, 311) 1381766291 0.6914720332421161 treat image : temp/1757077230_506697_1381742936_a84527bfc56914a614eaf1d787bf379d_rle_crop_3946263134_0.png resize: (287, 147) 1381766294 -4.488861514573176 treat image : temp/1757077230_506697_1381742936_a84527bfc56914a614eaf1d787bf379d_rle_crop_3946263135_0.png resize: (255, 225) 1381766295 -3.4527450005871905 treat image : temp/1757077230_506697_1381742936_a84527bfc56914a614eaf1d787bf379d_rle_crop_3946263137_0.png resize: (464, 229) 1381766297 -3.501989088114235 treat image : temp/1757077230_506697_1381742936_a84527bfc56914a614eaf1d787bf379d_rle_crop_3946263139_0.png resize: (139, 124) 1381766300 -1.3039304899169706 treat image : temp/1757077230_506697_1381742936_a84527bfc56914a614eaf1d787bf379d_rle_crop_3946263140_0.png resize: (66, 121) 1381766302 -3.0491968253480546 treat image : temp/1757077230_506697_1381742936_a84527bfc56914a614eaf1d787bf379d_rle_crop_3946263141_0.png resize: (111, 326) 1381766306 -4.337321061264762 treat image : temp/1757077230_506697_1381742936_a84527bfc56914a614eaf1d787bf379d_rle_crop_3946263142_0.png resize: (128, 94) 1381766309 -0.9992586679014263 treat image : temp/1757077230_506697_1381742936_a84527bfc56914a614eaf1d787bf379d_rle_crop_3946263143_0.png resize: (320, 362) 1381766311 -3.42704056012195 treat image : temp/1757077230_506697_1381742914_d1df301a2e5831f830ea2521b4a7352f_rle_crop_3946263145_0.png resize: (240, 200) 1381766315 6.775630131388415 treat image : temp/1757077230_506697_1381742914_d1df301a2e5831f830ea2521b4a7352f_rle_crop_3946263146_0.png resize: (484, 315) 1381766318 -2.750968898963973 treat image : temp/1757077230_506697_1381742914_d1df301a2e5831f830ea2521b4a7352f_rle_crop_3946263147_0.png resize: (172, 186) 1381766320 0.9584045336368627 treat image : temp/1757077230_506697_1381742914_d1df301a2e5831f830ea2521b4a7352f_rle_crop_3946263148_0.png resize: (186, 188) 1381766325 -1.4821015360132488 treat image : temp/1757077230_506697_1381742914_d1df301a2e5831f830ea2521b4a7352f_rle_crop_3946263149_0.png resize: (866, 482) 1381766327 -4.265879257722971 treat image : temp/1757077230_506697_1381742914_d1df301a2e5831f830ea2521b4a7352f_rle_crop_3946263150_0.png resize: (359, 182) 1381766328 -0.5332823868357224 treat image : temp/1757077230_506697_1381742914_d1df301a2e5831f830ea2521b4a7352f_rle_crop_3946263151_0.png resize: (685, 264) 1381766331 -4.786706376041713 treat image : temp/1757077230_506697_1381742914_d1df301a2e5831f830ea2521b4a7352f_rle_crop_3946263152_0.png resize: (104, 215) 1381766333 -4.613651072410655 treat image : temp/1757077230_506697_1381742914_d1df301a2e5831f830ea2521b4a7352f_rle_crop_3946263153_0.png resize: (324, 110) 1381766334 -3.508898045283647 treat image : temp/1757077230_506697_1381742914_d1df301a2e5831f830ea2521b4a7352f_rle_crop_3946263154_0.png resize: (302, 127) 1381766337 -4.318682053360816 treat image : temp/1757077230_506697_1381742912_05a2f055fa081b3a93f9269f120a5727_rle_crop_3946263155_0.png resize: (73, 78) 1381766339 -0.8391626830416263 treat image : temp/1757077230_506697_1381742912_05a2f055fa081b3a93f9269f120a5727_rle_crop_3946263157_0.png resize: (164, 166) 1381766341 -3.3465988170669165 treat image : temp/1757077230_506697_1381742912_05a2f055fa081b3a93f9269f120a5727_rle_crop_3946263158_0.png resize: (112, 215) 1381766343 -2.418541216170651 treat image : temp/1757077230_506697_1381742912_05a2f055fa081b3a93f9269f120a5727_rle_crop_3946263159_0.png resize: (355, 147) 1381766345 -4.560085444097826 treat image : temp/1757077230_506697_1381742912_05a2f055fa081b3a93f9269f120a5727_rle_crop_3946263160_0.png resize: (168, 226) 1381766346 -3.4307899917833695 treat image : temp/1757077230_506697_1381742912_05a2f055fa081b3a93f9269f120a5727_rle_crop_3946263161_0.png resize: (147, 243) 1381766348 1.8769542146617215 treat image : temp/1757077230_506697_1381742912_05a2f055fa081b3a93f9269f120a5727_rle_crop_3946263162_0.png resize: (380, 580) 1381766350 -1.7612272493317975 treat image : temp/1757077230_506697_1381742912_05a2f055fa081b3a93f9269f120a5727_rle_crop_3946263163_0.png resize: (279, 264) 1381766351 -3.126620759935647 treat image : temp/1757077230_506697_1381742912_05a2f055fa081b3a93f9269f120a5727_rle_crop_3946263164_0.png resize: (72, 210) 1381766353 -4.7669043325596565 treat image : temp/1757077230_506697_1381742910_9e7af758f242406fc100717d78c11610_rle_crop_3946263167_0.png resize: (356, 423) 1381766355 -3.590890440392232 treat image : temp/1757077230_506697_1381742910_9e7af758f242406fc100717d78c11610_rle_crop_3946263168_0.png resize: (299, 438) 1381766356 3.3625501830892355 treat image : temp/1757077230_506697_1381742910_9e7af758f242406fc100717d78c11610_rle_crop_3946263169_0.png resize: (118, 197) 1381766359 -0.6079520304932124 treat image : temp/1757077230_506697_1381742910_9e7af758f242406fc100717d78c11610_rle_crop_3946263170_0.png resize: (506, 458) 1381766361 -4.762089952803269 treat image : temp/1757077230_506697_1381742910_9e7af758f242406fc100717d78c11610_rle_crop_3946263171_0.png resize: (292, 272) 1381766362 -3.9385603455258282 treat image : temp/1757077230_506697_1381742910_9e7af758f242406fc100717d78c11610_rle_crop_3946263172_0.png resize: (308, 232) 1381766364 -2.109537134874756 treat image : temp/1757077230_506697_1381742902_c23f53ca966ccba59485d9b7a7285bf7_rle_crop_3946263175_0.png resize: (178, 232) 1381766366 -0.8589142586050903 treat image : temp/1757077230_506697_1381742902_c23f53ca966ccba59485d9b7a7285bf7_rle_crop_3946263176_0.png resize: (368, 304) 1381766367 -2.7227775056188386 treat image : temp/1757077230_506697_1381742902_c23f53ca966ccba59485d9b7a7285bf7_rle_crop_3946263177_0.png resize: (232, 153) 1381766369 -3.0243954007452984 treat image : temp/1757077230_506697_1381742902_c23f53ca966ccba59485d9b7a7285bf7_rle_crop_3946263178_0.png resize: (202, 217) 1381766371 -1.9622278647802824 treat image : temp/1757077230_506697_1381742902_c23f53ca966ccba59485d9b7a7285bf7_rle_crop_3946263179_0.png resize: (258, 275) 1381766372 -3.4625578283624763 treat image : temp/1757077230_506697_1381742902_c23f53ca966ccba59485d9b7a7285bf7_rle_crop_3946263180_0.png resize: (377, 235) 1381766374 -4.821974089872817 treat image : temp/1757077230_506697_1381742902_c23f53ca966ccba59485d9b7a7285bf7_rle_crop_3946263181_0.png resize: (244, 303) 1381766376 -2.0008476491861944 treat image : temp/1757077230_506697_1381742902_c23f53ca966ccba59485d9b7a7285bf7_rle_crop_3946263184_0.png resize: (124, 763) 1381766377 -1.914873515902568 treat image : temp/1757077230_506697_1381742902_c23f53ca966ccba59485d9b7a7285bf7_rle_crop_3946263185_0.png resize: (221, 142) 1381766379 -3.6471515347930206 treat image : temp/1757077230_506697_1381742898_98180948fcb8cfd8777eefb0d306230a_rle_crop_3946263187_0.png resize: (238, 383) 1381766381 -1.5161632819600375 treat image : temp/1757077230_506697_1381742898_98180948fcb8cfd8777eefb0d306230a_rle_crop_3946263188_0.png resize: (613, 724) 1381766382 -3.987105693503278 treat image : temp/1757077230_506697_1381742898_98180948fcb8cfd8777eefb0d306230a_rle_crop_3946263189_0.png resize: (363, 361) 1381766384 1.5833030196027036 treat image : temp/1757077230_506697_1381742898_98180948fcb8cfd8777eefb0d306230a_rle_crop_3946263190_0.png resize: (63, 152) 1381766386 -1.1138257965217617 treat image : temp/1757077230_506697_1381742898_98180948fcb8cfd8777eefb0d306230a_rle_crop_3946263192_0.png resize: (310, 233) 1381766387 -1.3309383581157852 treat image : temp/1757077230_506697_1381742898_98180948fcb8cfd8777eefb0d306230a_rle_crop_3946263193_0.png resize: (170, 310) 1381766389 -3.496373607997783 treat image : temp/1757077230_506697_1381742898_98180948fcb8cfd8777eefb0d306230a_rle_crop_3946263194_0.png resize: (318, 151) 1381766391 -1.6564521616644126 treat image : temp/1757077230_506697_1381742877_0a6388b34b81b5ce85ce58dafb7be3f7_rle_crop_3946263197_0.png resize: (704, 363) 1381766392 -3.3733811955738506 treat image : temp/1757077230_506697_1381742877_0a6388b34b81b5ce85ce58dafb7be3f7_rle_crop_3946263199_0.png resize: (411, 449) 1381766394 -2.3038942547076964 treat image : temp/1757077230_506697_1381742877_0a6388b34b81b5ce85ce58dafb7be3f7_rle_crop_3946263200_0.png resize: (431, 209) 1381766396 0.3815042006949446 treat image : temp/1757077230_506697_1381742877_0a6388b34b81b5ce85ce58dafb7be3f7_rle_crop_3946263201_0.png resize: (233, 306) 1381766397 -3.8539113318338196 treat image : temp/1757077230_506697_1381742877_0a6388b34b81b5ce85ce58dafb7be3f7_rle_crop_3946263203_0.png resize: (182, 209) 1381766399 -1.1548136497991015 treat image : temp/1757077230_506697_1381742869_7d10f9f01ad361a0c5439e0fc302150c_rle_crop_3946263204_0.png resize: (193, 195) 1381766401 -3.0991474351589288 treat image : temp/1757077230_506697_1381742869_7d10f9f01ad361a0c5439e0fc302150c_rle_crop_3946263205_0.png resize: (478, 516) 1381766402 -3.285811412759332 treat image : temp/1757077230_506697_1381742869_7d10f9f01ad361a0c5439e0fc302150c_rle_crop_3946263206_0.png resize: (369, 385) 1381766403 -1.7401069282643904 treat image : temp/1757077230_506697_1381742869_7d10f9f01ad361a0c5439e0fc302150c_rle_crop_3946263207_0.png resize: (208, 178) 1381766406 -3.936600021081975 treat image : temp/1757077230_506697_1381742869_7d10f9f01ad361a0c5439e0fc302150c_rle_crop_3946263208_0.png resize: (391, 203) 1381766408 -2.749970993475092 treat image : temp/1757077230_506697_1381742869_7d10f9f01ad361a0c5439e0fc302150c_rle_crop_3946263209_0.png resize: (248, 367) 1381766409 -0.4075330002047505 treat image : temp/1757077230_506697_1381742869_7d10f9f01ad361a0c5439e0fc302150c_rle_crop_3946263210_0.png resize: (169, 234) 1381766412 4.722662034103255 treat image : temp/1757077230_506697_1381742869_7d10f9f01ad361a0c5439e0fc302150c_rle_crop_3946263211_0.png resize: (144, 202) 1381766414 0.4163190957586928 treat image : temp/1757077230_506697_1381742869_7d10f9f01ad361a0c5439e0fc302150c_rle_crop_3946263212_0.png resize: (359, 417) 1381766415 -2.9750829359690742 treat image : temp/1757077230_506697_1381742866_0d5c392f1c2208b08e0acf816f81f186_rle_crop_3946263213_0.png resize: (224, 154) 1381766418 -1.8354713198749955 treat image : temp/1757077230_506697_1381742866_0d5c392f1c2208b08e0acf816f81f186_rle_crop_3946263214_0.png resize: (401, 231) 1381766420 -0.5306718214562635 treat image : temp/1757077230_506697_1381742866_0d5c392f1c2208b08e0acf816f81f186_rle_crop_3946263215_0.png resize: (286, 794) 1381766421 -4.129429708145317 treat image : temp/1757077230_506697_1381742862_0ce7071c7eca7579b434173e5fb75128_rle_crop_3946263223_0.png resize: (343, 711) 1381766424 -1.9577898254011727 treat image : temp/1757077230_506697_1381742862_0ce7071c7eca7579b434173e5fb75128_rle_crop_3946263224_0.png resize: (145, 128) 1381766426 -0.40495563029475484 treat image : temp/1757077230_506697_1381742862_0ce7071c7eca7579b434173e5fb75128_rle_crop_3946263225_0.png resize: (218, 120) 1381766427 -0.04585308165924795 treat image : temp/1757077230_506697_1381742862_0ce7071c7eca7579b434173e5fb75128_rle_crop_3946263226_0.png resize: (224, 221) 1381766430 -4.535919508272047 treat image : temp/1757077230_506697_1381742862_0ce7071c7eca7579b434173e5fb75128_rle_crop_3946263227_0.png resize: (302, 460) 1381766432 -3.7380962395501762 treat image : temp/1757077230_506697_1381742862_0ce7071c7eca7579b434173e5fb75128_rle_crop_3946263228_0.png resize: (132, 125) 1381766434 -3.4987679613199987 treat image : temp/1757077230_506697_1381742862_0ce7071c7eca7579b434173e5fb75128_rle_crop_3946263229_0.png resize: (213, 291) 1381766437 -0.8622614639352161 treat image : temp/1757077230_506697_1381742862_0ce7071c7eca7579b434173e5fb75128_rle_crop_3946263230_0.png resize: (286, 215) 1381766439 -4.242973187923245 treat image : temp/1757077230_506697_1381742862_0ce7071c7eca7579b434173e5fb75128_rle_crop_3946263231_0.png resize: (625, 509) 1381766440 -4.403030987193314 treat image : temp/1757077230_506697_1381742862_0ce7071c7eca7579b434173e5fb75128_rle_crop_3946263232_0.png resize: (330, 374) 1381766443 -3.822862900668949 treat image : temp/1757077230_506697_1381742862_0ce7071c7eca7579b434173e5fb75128_rle_crop_3946263233_0.png resize: (579, 629) 1381766445 -4.011370710245422 treat image : temp/1757077230_506697_1381742862_0ce7071c7eca7579b434173e5fb75128_rle_crop_3946263234_0.png resize: (471, 255) 1381766446 -2.846382427962491 treat image : temp/1757077230_506697_1381742862_0ce7071c7eca7579b434173e5fb75128_rle_crop_3946263236_0.png resize: (638, 272) 1381766449 -4.151048987418495 treat image : temp/1757077230_506697_1381742862_0ce7071c7eca7579b434173e5fb75128_rle_crop_3946263237_0.png resize: (148, 188) 1381766451 -0.9021427622427096 treat image : temp/1757077230_506697_1381742862_0ce7071c7eca7579b434173e5fb75128_rle_crop_3946263238_0.png resize: (319, 80) 1381766452 -4.306035471797843 treat image : temp/1757077230_506697_1381742862_0ce7071c7eca7579b434173e5fb75128_rle_crop_3946263239_0.png resize: (141, 171) 1381766455 -2.649455452168447 treat image : temp/1757077230_506697_1381742862_0ce7071c7eca7579b434173e5fb75128_rle_crop_3946263240_0.png resize: (150, 130) 1381766457 -2.2604276177373417 treat image : temp/1757077230_506697_1381742859_fb7fc79aec5eab5bc2906ee9d878608f_rle_crop_3946263241_0.png resize: (368, 379) 1381766458 -2.6373849858136778 treat image : temp/1757077230_506697_1381742859_fb7fc79aec5eab5bc2906ee9d878608f_rle_crop_3946263242_0.png resize: (127, 126) 1381766461 -4.4032470598596 treat image : temp/1757077230_506697_1381742859_fb7fc79aec5eab5bc2906ee9d878608f_rle_crop_3946263243_0.png resize: (353, 511) 1381766464 -3.2891145428582713 treat image : temp/1757077230_506697_1381742859_fb7fc79aec5eab5bc2906ee9d878608f_rle_crop_3946263244_0.png resize: (243, 263) 1381766465 -4.730981355016006 treat image : temp/1757077230_506697_1381742859_fb7fc79aec5eab5bc2906ee9d878608f_rle_crop_3946263245_0.png resize: (416, 191) 1381766468 -1.9546360660201036 treat image : temp/1757077230_506697_1381742859_fb7fc79aec5eab5bc2906ee9d878608f_rle_crop_3946263246_0.png resize: (303, 455) 1381766470 -4.458234391625471 treat image : temp/1757077230_506697_1381742859_fb7fc79aec5eab5bc2906ee9d878608f_rle_crop_3946263247_0.png resize: (528, 402) 1381766471 -3.2632946630509276 treat image : temp/1757077230_506697_1381742859_fb7fc79aec5eab5bc2906ee9d878608f_rle_crop_3946263248_0.png resize: (231, 158) 1381766474 -2.8986265767506727 treat image : temp/1757077230_506697_1381742859_fb7fc79aec5eab5bc2906ee9d878608f_rle_crop_3946263249_0.png resize: (128, 296) 1381766476 -3.306390510358166 treat image : temp/1757077230_506697_1381742859_fb7fc79aec5eab5bc2906ee9d878608f_rle_crop_3946263250_0.png resize: (195, 184) 1381766477 -1.0767746386361723 treat image : temp/1757077230_506697_1381742859_fb7fc79aec5eab5bc2906ee9d878608f_rle_crop_3946263251_0.png resize: (313, 107) 1381766480 -4.246919200722833 treat image : temp/1757077230_506697_1381742859_fb7fc79aec5eab5bc2906ee9d878608f_rle_crop_3946263252_0.png resize: (324, 186) 1381766482 -2.5553553611779516 treat image : temp/1757077230_506697_1381742859_fb7fc79aec5eab5bc2906ee9d878608f_rle_crop_3946263253_0.png resize: (186, 200) 1381766483 -2.824545529710432 treat image : temp/1757077230_506697_1381742859_fb7fc79aec5eab5bc2906ee9d878608f_rle_crop_3946263256_0.png resize: (279, 244) 1381766486 -1.1331906600579107 treat image : temp/1757077230_506697_1381742859_fb7fc79aec5eab5bc2906ee9d878608f_rle_crop_3946263257_0.png resize: (231, 192) 1381766488 -4.704229332015695 treat image : temp/1757077230_506697_1381742859_fb7fc79aec5eab5bc2906ee9d878608f_rle_crop_3946263258_0.png resize: (219, 360) 1381766491 -3.962307968628858 treat image : temp/1757077230_506697_1381742847_9ffdaf6ce647d200a0c4aed137130126_rle_crop_3946263259_0.png resize: (82, 162) 1381766494 -3.390116781645314 treat image : temp/1757077230_506697_1381742847_9ffdaf6ce647d200a0c4aed137130126_rle_crop_3946263260_0.png resize: (98, 138) 1381766496 -3.2333352278118883 treat image : temp/1757077230_506697_1381742847_9ffdaf6ce647d200a0c4aed137130126_rle_crop_3946263261_0.png resize: (119, 97) 1381766497 -4.980638864282465 treat image : temp/1757077230_506697_1381742847_9ffdaf6ce647d200a0c4aed137130126_rle_crop_3946263262_0.png resize: (129, 191) 1381766500 -3.9720250116140643 treat image : temp/1757077230_506697_1381742936_a84527bfc56914a614eaf1d787bf379d_rle_crop_3946263138_0.png resize: (185, 304) 1381766569 -3.8514258401930728 treat image : temp/1757077230_506697_1381742912_05a2f055fa081b3a93f9269f120a5727_rle_crop_3946263166_0.png resize: (465, 280) 1381766570 -3.763615444614396 treat image : temp/1757077230_506697_1381742862_0ce7071c7eca7579b434173e5fb75128_rle_crop_3946263235_0.png resize: (250, 247) 1381766571 -4.138403827088639 treat image : temp/1757077230_506697_1381742912_05a2f055fa081b3a93f9269f120a5727_rle_crop_3946263165_0.png resize: (172, 153) 1381766610 -4.769610469399965 treat image : temp/1757077230_506697_1381742936_a84527bfc56914a614eaf1d787bf379d_rle_crop_3946263133_0.png resize: (198, 300) 1381766790 -3.904462006319958 treat image : temp/1757077230_506697_1381742936_a84527bfc56914a614eaf1d787bf379d_rle_crop_3946263136_0.png resize: (267, 329) 1381766791 -4.452069287378589 treat image : temp/1757077230_506697_1381742936_a84527bfc56914a614eaf1d787bf379d_rle_crop_3946263144_0.png resize: (391, 485) 1381766793 -4.482410065577702 treat image : temp/1757077230_506697_1381742912_05a2f055fa081b3a93f9269f120a5727_rle_crop_3946263156_0.png resize: (287, 531) 1381766794 -4.415948940688378 treat image : temp/1757077230_506697_1381742902_c23f53ca966ccba59485d9b7a7285bf7_rle_crop_3946263174_0.png resize: (422, 536) 1381766795 -4.904586750056932 treat image : temp/1757077230_506697_1381742902_c23f53ca966ccba59485d9b7a7285bf7_rle_crop_3946263183_0.png resize: (176, 169) 1381766797 -3.4342180822390658 treat image : temp/1757077230_506697_1381742902_c23f53ca966ccba59485d9b7a7285bf7_rle_crop_3946263186_0.png resize: (76, 142) 1381766798 1.3534883632456851 treat image : temp/1757077230_506697_1381742898_98180948fcb8cfd8777eefb0d306230a_rle_crop_3946263191_0.png resize: (129, 301) 1381766799 -4.794363169649465 treat image : temp/1757077230_506697_1381742877_0a6388b34b81b5ce85ce58dafb7be3f7_rle_crop_3946263195_0.png resize: (324, 291) 1381766801 -5.1858724966477 treat image : temp/1757077230_506697_1381742877_0a6388b34b81b5ce85ce58dafb7be3f7_rle_crop_3946263196_0.png resize: (267, 218) 1381766802 -4.412958292521141 treat image : temp/1757077230_506697_1381742877_0a6388b34b81b5ce85ce58dafb7be3f7_rle_crop_3946263198_0.png resize: (459, 571) 1381766803 -4.821945341129094 treat image : temp/1757077230_506697_1381742877_0a6388b34b81b5ce85ce58dafb7be3f7_rle_crop_3946263202_0.png resize: (425, 163) 1381766805 -4.72541103081403 treat image : temp/1757077230_506697_1381742866_0d5c392f1c2208b08e0acf816f81f186_rle_crop_3946263216_0.png resize: (247, 333) 1381766806 -3.9052683907389896 treat image : temp/1757077230_506697_1381742866_0d5c392f1c2208b08e0acf816f81f186_rle_crop_3946263217_0.png resize: (361, 334) 1381766807 -4.90760271042047 treat image : temp/1757077230_506697_1381742866_0d5c392f1c2208b08e0acf816f81f186_rle_crop_3946263218_0.png resize: (422, 332) 1381766809 -3.915518709958293 treat image : temp/1757077230_506697_1381742866_0d5c392f1c2208b08e0acf816f81f186_rle_crop_3946263219_0.png resize: (253, 654) 1381766810 -3.3472368334913694 treat image : temp/1757077230_506697_1381742866_0d5c392f1c2208b08e0acf816f81f186_rle_crop_3946263220_0.png resize: (138, 344) 1381766811 -4.043250219998521 treat image : temp/1757077230_506697_1381742866_0d5c392f1c2208b08e0acf816f81f186_rle_crop_3946263221_0.png resize: (280, 268) 1381766812 -3.5902773908170134 treat image : temp/1757077230_506697_1381742866_0d5c392f1c2208b08e0acf816f81f186_rle_crop_3946263222_0.png resize: (167, 391) 1381766814 -3.632858398155795 treat image : temp/1757077230_506697_1381742859_fb7fc79aec5eab5bc2906ee9d878608f_rle_crop_3946263255_0.png resize: (276, 263) 1381766815 -3.609643785664506 treat image : temp/1757077230_506697_1381742910_9e7af758f242406fc100717d78c11610_rle_crop_3946263173_0.png resize: (177, 159) 1381766843 -3.467619922272947 treat image : temp/1757077230_506697_1381742902_c23f53ca966ccba59485d9b7a7285bf7_rle_crop_3946263182_0.png resize: (253, 274) 1381766845 -4.066275363590189 treat image : temp/1757077230_506697_1381742859_fb7fc79aec5eab5bc2906ee9d878608f_rle_crop_3946263254_0.png resize: (327, 554) 1381766846 -2.9295886275564267 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 152 time used for this insertion : 0.018320322036743164 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 152 time used for this insertion : 0.034098148345947266 save missing photos in datou_result : time spend for datou_step_exec : 58.820232629776 time spend to save output : 0.05909442901611328 total time spend for step 6 : 58.879327058792114 step7:brightness Fri Sep 5 15:07:19 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1757077230_506697_1381742971_add53a70667167d1ec608452a82cf385.jpg treat image : temp/1757077230_506697_1381742936_a84527bfc56914a614eaf1d787bf379d.jpg treat image : temp/1757077230_506697_1381742914_d1df301a2e5831f830ea2521b4a7352f.jpg treat image : temp/1757077230_506697_1381742912_05a2f055fa081b3a93f9269f120a5727.jpg treat image : temp/1757077230_506697_1381742910_9e7af758f242406fc100717d78c11610.jpg treat image : temp/1757077230_506697_1381742902_c23f53ca966ccba59485d9b7a7285bf7.jpg treat image : temp/1757077230_506697_1381742898_98180948fcb8cfd8777eefb0d306230a.jpg treat image : temp/1757077230_506697_1381742877_0a6388b34b81b5ce85ce58dafb7be3f7.jpg treat image : temp/1757077230_506697_1381742869_7d10f9f01ad361a0c5439e0fc302150c.jpg treat image : temp/1757077230_506697_1381742866_0d5c392f1c2208b08e0acf816f81f186.jpg treat image : temp/1757077230_506697_1381742862_0ce7071c7eca7579b434173e5fb75128.jpg treat image : temp/1757077230_506697_1381742859_fb7fc79aec5eab5bc2906ee9d878608f.jpg treat image : temp/1757077230_506697_1381742847_9ffdaf6ce647d200a0c4aed137130126.jpg treat image : temp/1757077230_506697_1381742971_add53a70667167d1ec608452a82cf385_rle_crop_3946263124_0.png treat image : temp/1757077230_506697_1381742971_add53a70667167d1ec608452a82cf385_rle_crop_3946263125_0.png treat image : temp/1757077230_506697_1381742971_add53a70667167d1ec608452a82cf385_rle_crop_3946263126_0.png treat image : temp/1757077230_506697_1381742971_add53a70667167d1ec608452a82cf385_rle_crop_3946263127_0.png treat image : temp/1757077230_506697_1381742971_add53a70667167d1ec608452a82cf385_rle_crop_3946263128_0.png treat image : temp/1757077230_506697_1381742971_add53a70667167d1ec608452a82cf385_rle_crop_3946263129_0.png treat image : temp/1757077230_506697_1381742971_add53a70667167d1ec608452a82cf385_rle_crop_3946263130_0.png treat image : temp/1757077230_506697_1381742936_a84527bfc56914a614eaf1d787bf379d_rle_crop_3946263131_0.png treat image : temp/1757077230_506697_1381742936_a84527bfc56914a614eaf1d787bf379d_rle_crop_3946263132_0.png treat image : temp/1757077230_506697_1381742936_a84527bfc56914a614eaf1d787bf379d_rle_crop_3946263134_0.png treat image : temp/1757077230_506697_1381742936_a84527bfc56914a614eaf1d787bf379d_rle_crop_3946263135_0.png treat image : temp/1757077230_506697_1381742936_a84527bfc56914a614eaf1d787bf379d_rle_crop_3946263137_0.png treat image : temp/1757077230_506697_1381742936_a84527bfc56914a614eaf1d787bf379d_rle_crop_3946263139_0.png treat image : temp/1757077230_506697_1381742936_a84527bfc56914a614eaf1d787bf379d_rle_crop_3946263140_0.png treat image : temp/1757077230_506697_1381742936_a84527bfc56914a614eaf1d787bf379d_rle_crop_3946263141_0.png treat image : temp/1757077230_506697_1381742936_a84527bfc56914a614eaf1d787bf379d_rle_crop_3946263142_0.png treat image : temp/1757077230_506697_1381742936_a84527bfc56914a614eaf1d787bf379d_rle_crop_3946263143_0.png treat image : temp/1757077230_506697_1381742914_d1df301a2e5831f830ea2521b4a7352f_rle_crop_3946263145_0.png treat image : temp/1757077230_506697_1381742914_d1df301a2e5831f830ea2521b4a7352f_rle_crop_3946263146_0.png treat image : temp/1757077230_506697_1381742914_d1df301a2e5831f830ea2521b4a7352f_rle_crop_3946263147_0.png treat image : temp/1757077230_506697_1381742914_d1df301a2e5831f830ea2521b4a7352f_rle_crop_3946263148_0.png treat image : temp/1757077230_506697_1381742914_d1df301a2e5831f830ea2521b4a7352f_rle_crop_3946263149_0.png treat image : temp/1757077230_506697_1381742914_d1df301a2e5831f830ea2521b4a7352f_rle_crop_3946263150_0.png treat image : temp/1757077230_506697_1381742914_d1df301a2e5831f830ea2521b4a7352f_rle_crop_3946263151_0.png treat image : temp/1757077230_506697_1381742914_d1df301a2e5831f830ea2521b4a7352f_rle_crop_3946263152_0.png treat image : temp/1757077230_506697_1381742914_d1df301a2e5831f830ea2521b4a7352f_rle_crop_3946263153_0.png treat image : temp/1757077230_506697_1381742914_d1df301a2e5831f830ea2521b4a7352f_rle_crop_3946263154_0.png treat image : temp/1757077230_506697_1381742912_05a2f055fa081b3a93f9269f120a5727_rle_crop_3946263155_0.png treat image : temp/1757077230_506697_1381742912_05a2f055fa081b3a93f9269f120a5727_rle_crop_3946263157_0.png treat image : temp/1757077230_506697_1381742912_05a2f055fa081b3a93f9269f120a5727_rle_crop_3946263158_0.png treat image : temp/1757077230_506697_1381742912_05a2f055fa081b3a93f9269f120a5727_rle_crop_3946263159_0.png treat image : temp/1757077230_506697_1381742912_05a2f055fa081b3a93f9269f120a5727_rle_crop_3946263160_0.png treat image : temp/1757077230_506697_1381742912_05a2f055fa081b3a93f9269f120a5727_rle_crop_3946263161_0.png treat image : temp/1757077230_506697_1381742912_05a2f055fa081b3a93f9269f120a5727_rle_crop_3946263162_0.png treat image : temp/1757077230_506697_1381742912_05a2f055fa081b3a93f9269f120a5727_rle_crop_3946263163_0.png treat image : temp/1757077230_506697_1381742912_05a2f055fa081b3a93f9269f120a5727_rle_crop_3946263164_0.png treat image : temp/1757077230_506697_1381742910_9e7af758f242406fc100717d78c11610_rle_crop_3946263167_0.png treat image : temp/1757077230_506697_1381742910_9e7af758f242406fc100717d78c11610_rle_crop_3946263168_0.png treat image : temp/1757077230_506697_1381742910_9e7af758f242406fc100717d78c11610_rle_crop_3946263169_0.png treat image : temp/1757077230_506697_1381742910_9e7af758f242406fc100717d78c11610_rle_crop_3946263170_0.png treat image : temp/1757077230_506697_1381742910_9e7af758f242406fc100717d78c11610_rle_crop_3946263171_0.png treat image : temp/1757077230_506697_1381742910_9e7af758f242406fc100717d78c11610_rle_crop_3946263172_0.png treat image : temp/1757077230_506697_1381742902_c23f53ca966ccba59485d9b7a7285bf7_rle_crop_3946263175_0.png treat image : temp/1757077230_506697_1381742902_c23f53ca966ccba59485d9b7a7285bf7_rle_crop_3946263176_0.png treat image : temp/1757077230_506697_1381742902_c23f53ca966ccba59485d9b7a7285bf7_rle_crop_3946263177_0.png treat image : temp/1757077230_506697_1381742902_c23f53ca966ccba59485d9b7a7285bf7_rle_crop_3946263178_0.png treat image : temp/1757077230_506697_1381742902_c23f53ca966ccba59485d9b7a7285bf7_rle_crop_3946263179_0.png treat image : temp/1757077230_506697_1381742902_c23f53ca966ccba59485d9b7a7285bf7_rle_crop_3946263180_0.png treat image : temp/1757077230_506697_1381742902_c23f53ca966ccba59485d9b7a7285bf7_rle_crop_3946263181_0.png treat image : temp/1757077230_506697_1381742902_c23f53ca966ccba59485d9b7a7285bf7_rle_crop_3946263184_0.png treat image : temp/1757077230_506697_1381742902_c23f53ca966ccba59485d9b7a7285bf7_rle_crop_3946263185_0.png treat image : temp/1757077230_506697_1381742898_98180948fcb8cfd8777eefb0d306230a_rle_crop_3946263187_0.png treat image : temp/1757077230_506697_1381742898_98180948fcb8cfd8777eefb0d306230a_rle_crop_3946263188_0.png treat image : temp/1757077230_506697_1381742898_98180948fcb8cfd8777eefb0d306230a_rle_crop_3946263189_0.png treat image : temp/1757077230_506697_1381742898_98180948fcb8cfd8777eefb0d306230a_rle_crop_3946263190_0.png treat image : temp/1757077230_506697_1381742898_98180948fcb8cfd8777eefb0d306230a_rle_crop_3946263192_0.png treat image : temp/1757077230_506697_1381742898_98180948fcb8cfd8777eefb0d306230a_rle_crop_3946263193_0.png treat image : temp/1757077230_506697_1381742898_98180948fcb8cfd8777eefb0d306230a_rle_crop_3946263194_0.png treat image : temp/1757077230_506697_1381742877_0a6388b34b81b5ce85ce58dafb7be3f7_rle_crop_3946263197_0.png treat image : temp/1757077230_506697_1381742877_0a6388b34b81b5ce85ce58dafb7be3f7_rle_crop_3946263199_0.png treat image : temp/1757077230_506697_1381742877_0a6388b34b81b5ce85ce58dafb7be3f7_rle_crop_3946263200_0.png treat image : temp/1757077230_506697_1381742877_0a6388b34b81b5ce85ce58dafb7be3f7_rle_crop_3946263201_0.png treat image : temp/1757077230_506697_1381742877_0a6388b34b81b5ce85ce58dafb7be3f7_rle_crop_3946263203_0.png treat image : temp/1757077230_506697_1381742869_7d10f9f01ad361a0c5439e0fc302150c_rle_crop_3946263204_0.png treat image : temp/1757077230_506697_1381742869_7d10f9f01ad361a0c5439e0fc302150c_rle_crop_3946263205_0.png treat image : temp/1757077230_506697_1381742869_7d10f9f01ad361a0c5439e0fc302150c_rle_crop_3946263206_0.png treat image : temp/1757077230_506697_1381742869_7d10f9f01ad361a0c5439e0fc302150c_rle_crop_3946263207_0.png treat image : temp/1757077230_506697_1381742869_7d10f9f01ad361a0c5439e0fc302150c_rle_crop_3946263208_0.png treat image : temp/1757077230_506697_1381742869_7d10f9f01ad361a0c5439e0fc302150c_rle_crop_3946263209_0.png treat image : temp/1757077230_506697_1381742869_7d10f9f01ad361a0c5439e0fc302150c_rle_crop_3946263210_0.png treat image : temp/1757077230_506697_1381742869_7d10f9f01ad361a0c5439e0fc302150c_rle_crop_3946263211_0.png treat image : temp/1757077230_506697_1381742869_7d10f9f01ad361a0c5439e0fc302150c_rle_crop_3946263212_0.png treat image : temp/1757077230_506697_1381742866_0d5c392f1c2208b08e0acf816f81f186_rle_crop_3946263213_0.png treat image : temp/1757077230_506697_1381742866_0d5c392f1c2208b08e0acf816f81f186_rle_crop_3946263214_0.png treat image : temp/1757077230_506697_1381742866_0d5c392f1c2208b08e0acf816f81f186_rle_crop_3946263215_0.png treat image : temp/1757077230_506697_1381742862_0ce7071c7eca7579b434173e5fb75128_rle_crop_3946263223_0.png treat image : temp/1757077230_506697_1381742862_0ce7071c7eca7579b434173e5fb75128_rle_crop_3946263224_0.png treat image : temp/1757077230_506697_1381742862_0ce7071c7eca7579b434173e5fb75128_rle_crop_3946263225_0.png treat image : temp/1757077230_506697_1381742862_0ce7071c7eca7579b434173e5fb75128_rle_crop_3946263226_0.png treat image : temp/1757077230_506697_1381742862_0ce7071c7eca7579b434173e5fb75128_rle_crop_3946263227_0.png treat image : temp/1757077230_506697_1381742862_0ce7071c7eca7579b434173e5fb75128_rle_crop_3946263228_0.png treat image : temp/1757077230_506697_1381742862_0ce7071c7eca7579b434173e5fb75128_rle_crop_3946263229_0.png treat image : temp/1757077230_506697_1381742862_0ce7071c7eca7579b434173e5fb75128_rle_crop_3946263230_0.png treat image : temp/1757077230_506697_1381742862_0ce7071c7eca7579b434173e5fb75128_rle_crop_3946263231_0.png treat image : temp/1757077230_506697_1381742862_0ce7071c7eca7579b434173e5fb75128_rle_crop_3946263232_0.png treat image : temp/1757077230_506697_1381742862_0ce7071c7eca7579b434173e5fb75128_rle_crop_3946263233_0.png treat image : temp/1757077230_506697_1381742862_0ce7071c7eca7579b434173e5fb75128_rle_crop_3946263234_0.png treat image : temp/1757077230_506697_1381742862_0ce7071c7eca7579b434173e5fb75128_rle_crop_3946263236_0.png treat image : temp/1757077230_506697_1381742862_0ce7071c7eca7579b434173e5fb75128_rle_crop_3946263237_0.png treat image : temp/1757077230_506697_1381742862_0ce7071c7eca7579b434173e5fb75128_rle_crop_3946263238_0.png treat image : temp/1757077230_506697_1381742862_0ce7071c7eca7579b434173e5fb75128_rle_crop_3946263239_0.png treat image : temp/1757077230_506697_1381742862_0ce7071c7eca7579b434173e5fb75128_rle_crop_3946263240_0.png treat image : temp/1757077230_506697_1381742859_fb7fc79aec5eab5bc2906ee9d878608f_rle_crop_3946263241_0.png treat image : temp/1757077230_506697_1381742859_fb7fc79aec5eab5bc2906ee9d878608f_rle_crop_3946263242_0.png treat image : temp/1757077230_506697_1381742859_fb7fc79aec5eab5bc2906ee9d878608f_rle_crop_3946263243_0.png treat image : temp/1757077230_506697_1381742859_fb7fc79aec5eab5bc2906ee9d878608f_rle_crop_3946263244_0.png treat image : temp/1757077230_506697_1381742859_fb7fc79aec5eab5bc2906ee9d878608f_rle_crop_3946263245_0.png treat image : temp/1757077230_506697_1381742859_fb7fc79aec5eab5bc2906ee9d878608f_rle_crop_3946263246_0.png treat image : temp/1757077230_506697_1381742859_fb7fc79aec5eab5bc2906ee9d878608f_rle_crop_3946263247_0.png treat image : temp/1757077230_506697_1381742859_fb7fc79aec5eab5bc2906ee9d878608f_rle_crop_3946263248_0.png treat image : temp/1757077230_506697_1381742859_fb7fc79aec5eab5bc2906ee9d878608f_rle_crop_3946263249_0.png treat image : temp/1757077230_506697_1381742859_fb7fc79aec5eab5bc2906ee9d878608f_rle_crop_3946263250_0.png treat image : temp/1757077230_506697_1381742859_fb7fc79aec5eab5bc2906ee9d878608f_rle_crop_3946263251_0.png treat image : temp/1757077230_506697_1381742859_fb7fc79aec5eab5bc2906ee9d878608f_rle_crop_3946263252_0.png treat image : temp/1757077230_506697_1381742859_fb7fc79aec5eab5bc2906ee9d878608f_rle_crop_3946263253_0.png treat image : temp/1757077230_506697_1381742859_fb7fc79aec5eab5bc2906ee9d878608f_rle_crop_3946263256_0.png treat image : temp/1757077230_506697_1381742859_fb7fc79aec5eab5bc2906ee9d878608f_rle_crop_3946263257_0.png treat image : temp/1757077230_506697_1381742859_fb7fc79aec5eab5bc2906ee9d878608f_rle_crop_3946263258_0.png treat image : temp/1757077230_506697_1381742847_9ffdaf6ce647d200a0c4aed137130126_rle_crop_3946263259_0.png treat image : temp/1757077230_506697_1381742847_9ffdaf6ce647d200a0c4aed137130126_rle_crop_3946263260_0.png treat image : temp/1757077230_506697_1381742847_9ffdaf6ce647d200a0c4aed137130126_rle_crop_3946263261_0.png treat image : temp/1757077230_506697_1381742847_9ffdaf6ce647d200a0c4aed137130126_rle_crop_3946263262_0.png treat image : temp/1757077230_506697_1381742936_a84527bfc56914a614eaf1d787bf379d_rle_crop_3946263138_0.png treat image : temp/1757077230_506697_1381742912_05a2f055fa081b3a93f9269f120a5727_rle_crop_3946263166_0.png treat image : temp/1757077230_506697_1381742862_0ce7071c7eca7579b434173e5fb75128_rle_crop_3946263235_0.png treat image : temp/1757077230_506697_1381742912_05a2f055fa081b3a93f9269f120a5727_rle_crop_3946263165_0.png treat image : temp/1757077230_506697_1381742936_a84527bfc56914a614eaf1d787bf379d_rle_crop_3946263133_0.png treat image : temp/1757077230_506697_1381742936_a84527bfc56914a614eaf1d787bf379d_rle_crop_3946263136_0.png treat image : temp/1757077230_506697_1381742936_a84527bfc56914a614eaf1d787bf379d_rle_crop_3946263144_0.png treat image : temp/1757077230_506697_1381742912_05a2f055fa081b3a93f9269f120a5727_rle_crop_3946263156_0.png treat image : temp/1757077230_506697_1381742902_c23f53ca966ccba59485d9b7a7285bf7_rle_crop_3946263174_0.png treat image : temp/1757077230_506697_1381742902_c23f53ca966ccba59485d9b7a7285bf7_rle_crop_3946263183_0.png treat image : temp/1757077230_506697_1381742902_c23f53ca966ccba59485d9b7a7285bf7_rle_crop_3946263186_0.png treat image : temp/1757077230_506697_1381742898_98180948fcb8cfd8777eefb0d306230a_rle_crop_3946263191_0.png treat image : temp/1757077230_506697_1381742877_0a6388b34b81b5ce85ce58dafb7be3f7_rle_crop_3946263195_0.png treat image : temp/1757077230_506697_1381742877_0a6388b34b81b5ce85ce58dafb7be3f7_rle_crop_3946263196_0.png treat image : temp/1757077230_506697_1381742877_0a6388b34b81b5ce85ce58dafb7be3f7_rle_crop_3946263198_0.png treat image : temp/1757077230_506697_1381742877_0a6388b34b81b5ce85ce58dafb7be3f7_rle_crop_3946263202_0.png treat image : temp/1757077230_506697_1381742866_0d5c392f1c2208b08e0acf816f81f186_rle_crop_3946263216_0.png treat image : temp/1757077230_506697_1381742866_0d5c392f1c2208b08e0acf816f81f186_rle_crop_3946263217_0.png treat image : temp/1757077230_506697_1381742866_0d5c392f1c2208b08e0acf816f81f186_rle_crop_3946263218_0.png treat image : temp/1757077230_506697_1381742866_0d5c392f1c2208b08e0acf816f81f186_rle_crop_3946263219_0.png treat image : temp/1757077230_506697_1381742866_0d5c392f1c2208b08e0acf816f81f186_rle_crop_3946263220_0.png treat image : temp/1757077230_506697_1381742866_0d5c392f1c2208b08e0acf816f81f186_rle_crop_3946263221_0.png treat image : temp/1757077230_506697_1381742866_0d5c392f1c2208b08e0acf816f81f186_rle_crop_3946263222_0.png treat image : temp/1757077230_506697_1381742859_fb7fc79aec5eab5bc2906ee9d878608f_rle_crop_3946263255_0.png treat image : temp/1757077230_506697_1381742910_9e7af758f242406fc100717d78c11610_rle_crop_3946263173_0.png treat image : temp/1757077230_506697_1381742902_c23f53ca966ccba59485d9b7a7285bf7_rle_crop_3946263182_0.png treat image : temp/1757077230_506697_1381742859_fb7fc79aec5eab5bc2906ee9d878608f_rle_crop_3946263254_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 152 time used for this insertion : 0.01939702033996582 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 152 time used for this insertion : 0.02686285972595215 save missing photos in datou_result : time spend for datou_step_exec : 15.108063220977783 time spend to save output : 0.052048683166503906 total time spend for step 7 : 15.160111904144287 step8:velours_tree Fri Sep 5 15:07:34 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.372607946395874 time spend to save output : 0.00035762786865234375 total time spend for step 8 : 0.37296557426452637 step9:send_mail_cod Fri Sep 5 15:07:35 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P26579611_05-09-2025_15_07_35.pdf 26581007 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette265810071757077655 26581009 change filename to text .imagette265810091757077656 26581010 imagette265810101757077656 26581011 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette265810111757077656 26581012 imagette265810121757077658 26581013 change filename to text .change filename to text .change filename to text .imagette265810131757077658 26581014 imagette265810141757077658 26581015 imagette265810151757077658 26581016 change filename to text .change filename to text .change filename to text .imagette265810161757077658 26581017 imagette265810171757077659 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=26579611 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/26581007,26581008,26581009,26581010,26581011,26581012,26581013,26581014,26581015,26581016,26581017?tags=papier,environnement,metal,mal_croppe,pet_clair,background,carton,pet_fonce,pehd,autre,flou args[1381742971] : ((1381742971, -6.7153844841224055, 492609224), (1381742971, 1.2656179418853035, 2107752395), '0.07439530100011871') We are sending mail with results at report@fotonower.com args[1381742936] : ((1381742936, -6.745121826048445, 492609224), (1381742936, 1.3682269021812077, 2107752395), '0.07439530100011871') We are sending mail with results at report@fotonower.com args[1381742914] : ((1381742914, -6.8472378259383655, 492609224), (1381742914, 1.4971329915018934, 2107752395), '0.07439530100011871') We are sending mail with results at report@fotonower.com args[1381742912] : ((1381742912, -6.660645167772621, 492609224), (1381742912, 1.3808480197969708, 2107752395), '0.07439530100011871') We are sending mail with results at report@fotonower.com args[1381742910] : ((1381742910, -6.804736597397484, 492609224), (1381742910, 1.4512469616787884, 2107752395), '0.07439530100011871') We are sending mail with results at report@fotonower.com args[1381742902] : ((1381742902, -6.2246737567788255, 492609224), (1381742902, 0.906334758579075, 2107752395), '0.07439530100011871') We are sending mail with results at report@fotonower.com args[1381742898] : ((1381742898, -6.730245609840253, 492609224), (1381742898, 1.2309223619343557, 2107752395), '0.07439530100011871') We are sending mail with results at report@fotonower.com args[1381742877] : ((1381742877, -6.720945811793328, 492609224), (1381742877, 1.070338288638667, 2107752395), '0.07439530100011871') We are sending mail with results at report@fotonower.com args[1381742869] : ((1381742869, -6.374817023282387, 492609224), (1381742869, 1.4981206005465462, 2107752395), '0.07439530100011871') We are sending mail with results at report@fotonower.com args[1381742866] : ((1381742866, -6.639856926362364, 492609224), (1381742866, 1.4364117159961085, 2107752395), '0.07439530100011871') We are sending mail with results at report@fotonower.com args[1381742862] : ((1381742862, -6.570761175831101, 492609224), (1381742862, 1.213075192606317, 2107752395), '0.07439530100011871') We are sending mail with results at report@fotonower.com args[1381742859] : ((1381742859, -6.6232983735442605, 492609224), (1381742859, 1.3467415347733278, 2107752395), '0.07439530100011871') We are sending mail with results at report@fotonower.com args[1381742847] : ((1381742847, -4.924057125431913, 492609224), (1381742847, 0.3485442931123786, 2107752395), '0.07439530100011871') We are sending mail with results at report@fotonower.com refus_total : 0.07439530100011871 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=26579611 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26579611_05-09-2025_15_07_35.pdf results_Auto_P26579611_05-09-2025_15_07_35.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26579611_05-09-2025_15_07_35.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','26579611','results_Auto_P26579611_05-09-2025_15_07_35.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26579611_05-09-2025_15_07_35.pdf','pdf','','0.68','0.07439530100011871') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/26579611

https://www.fotonower.com/image?json=false&list_photos_id=1381742971
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381742936
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381742914
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381742912
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381742910
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381742902
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381742898
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381742877
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381742869
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381742866
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381742862
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381742859
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1381742847
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 7.44%
Veuillez trouver les photos des contaminants.

exemples de contaminants: papier: https://www.fotonower.com/view/26581007?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/26581009?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/26581011?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/26581013?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/26581016?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26579611_05-09-2025_15_07_35.pdf.

Lien vers velours :https://marlene.fotonower.com/velours/26581007,26581008,26581009,26581010,26581011,26581012,26581013,26581014,26581015,26581016,26581017?tags=papier,environnement,metal,mal_croppe,pet_clair,background,carton,pet_fonce,pehd,autre,flou.


L'équipe Fotonower 202 b'' Server: nginx Date: Fri, 05 Sep 2025 13:07:43 GMT Content-Length: 0 Connection: close X-Message-Id: CAGKLO8ZQPi-PuWrA1CWJg Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1381742971, 1381742936, 1381742914, 1381742912, 1381742910, 1381742902, 1381742898, 1381742877, 1381742869, 1381742866, 1381742862, 1381742859, 1381742847] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742971', None, None, None, None, None, '3670236') ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742936', None, None, None, None, None, '3670236') ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742914', None, None, None, None, None, '3670236') ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742912', None, None, None, None, None, '3670236') ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742910', None, None, None, None, None, '3670236') ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742902', None, None, None, None, None, '3670236') ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742898', None, None, None, None, None, '3670236') ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742877', None, None, None, None, None, '3670236') ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742869', None, None, None, None, None, '3670236') ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742866', None, None, None, None, None, '3670236') ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742862', None, None, None, None, None, '3670236') ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742859', None, None, None, None, None, '3670236') ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742847', None, None, None, None, None, '3670236') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 13 time used for this insertion : 0.013730049133300781 save_final save missing photos in datou_result : time spend for datou_step_exec : 8.155053853988647 time spend to save output : 0.014080524444580078 total time spend for step 9 : 8.169134378433228 step10:split_time_score Fri Sep 5 15:07:43 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('13', 13),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 05092025 26579611 Nombre de photos uploadées : 13 / 23040 (0%) 05092025 26579611 Nombre de photos taguées (types de déchets): 0 / 13 (0%) 05092025 26579611 Nombre de photos taguées (volume) : 0 / 13 (0%) elapsed_time : load_data_split_time_score 1.1920928955078125e-06 elapsed_time : order_list_meta_photo_and_scores 4.291534423828125e-06 ????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0005052089691162109 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.20510005950927734 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.039801469434054416 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26567363_05-09-2025_08_43_15.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26567363 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26567363 AND mptpi.`type`=3726 To do Qualite : 0.03246848149762702 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26569619_05-09-2025_09_47_19.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26569619 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26569619 AND mptpi.`type`=3726 To do Qualite : 0.08177850919495884 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26573164_05-09-2025_11_21_02.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26573164 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26573164 AND mptpi.`type`=3594 To do Qualite : 0.02766889116869236 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26573999_05-09-2025_11_38_42.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26573999 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26573999 AND mptpi.`type`=3726 To do Qualite : 0.020968054637391136 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26574000_05-09-2025_11_36_44.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26574000 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26574000 AND mptpi.`type`=3726 To do Qualite : 0.06326802484187678 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26579608_05-09-2025_14_38_46.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26579608 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26579608 AND mptpi.`type`=3726 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26579609 order by id desc limit 1 Qualite : 0.07439530100011871 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26579611_05-09-2025_15_07_35.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26579611 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26579611 AND mptpi.`type`=3594 To do Qualite : 0.09124505690586421 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26579614_05-09-2025_14_56_02.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26579614 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26579614 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26579639 order by id desc limit 1 NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'05092025': {'nb_upload': 13, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1381742971, 1381742936, 1381742914, 1381742912, 1381742910, 1381742902, 1381742898, 1381742877, 1381742869, 1381742866, 1381742862, 1381742859, 1381742847] Looping around the photos to save general results len do output : 1 /26579611Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742971', None, None, None, None, None, '3670236') ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742936', None, None, None, None, None, '3670236') ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742914', None, None, None, None, None, '3670236') ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742912', None, None, None, None, None, '3670236') ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742910', None, None, None, None, None, '3670236') ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742902', None, None, None, None, None, '3670236') ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742898', None, None, None, None, None, '3670236') ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742877', None, None, None, None, None, '3670236') ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742869', None, None, None, None, None, '3670236') ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742866', None, None, None, None, None, '3670236') ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742862', None, None, None, None, None, '3670236') ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742859', None, None, None, None, None, '3670236') ('3318', None, None, None, None, None, None, None, '3670236') ('3318', '26579611', '1381742847', None, None, None, None, None, '3670236') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 14 time used for this insertion : 0.016901254653930664 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.7320973873138428 time spend to save output : 0.017133474349975586 total time spend for step 10 : 2.7492308616638184 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 13 set_done_treatment 170.54user 210.78system 7:20.76elapsed 86%CPU (0avgtext+0avgdata 3727812maxresident)k 1398192inputs+134776outputs (42369major+16115821minor)pagefaults 0swaps