python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3695433 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2740447'] with mtr_portfolio_ids : ['22234353'] and first list_photo_ids : [] new path : /proc/3695433/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 11 ; length of list_pids : 11 ; length of list_args : 11 time to download the photos : 4.831086158752441 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Thu Apr 10 18:30:33 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 2964 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-04-10 18:30:36.198131: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-04-10 18:30:36.223157: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-04-10 18:30:36.225314: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f63e8000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-04-10 18:30:36.225363: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-04-10 18:30:36.229380: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-04-10 18:30:36.479127: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x3facd9c0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-04-10 18:30:36.479180: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-04-10 18:30:36.480192: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-04-10 18:30:36.480578: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-10 18:30:36.483451: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-10 18:30:36.485583: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-04-10 18:30:36.485917: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-04-10 18:30:36.488321: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-04-10 18:30:36.489524: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-04-10 18:30:36.495707: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-04-10 18:30:36.496638: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-04-10 18:30:36.496692: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-10 18:30:36.497181: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-04-10 18:30:36.497195: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-04-10 18:30:36.497203: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-04-10 18:30:36.498583: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 2512 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-04-10 18:30:36.769629: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-04-10 18:30:36.769727: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-10 18:30:36.769758: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-10 18:30:36.769787: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-04-10 18:30:36.769813: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-04-10 18:30:36.769840: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-04-10 18:30:36.769867: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-04-10 18:30:36.769893: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-04-10 18:30:36.771214: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-04-10 18:30:36.772526: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-04-10 18:30:36.772576: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-04-10 18:30:36.772604: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-10 18:30:36.772628: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-04-10 18:30:36.772646: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-04-10 18:30:36.772663: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-04-10 18:30:36.772679: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-04-10 18:30:36.772693: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-04-10 18:30:36.773456: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-04-10 18:30:36.773480: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-04-10 18:30:36.773488: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-04-10 18:30:36.773494: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-04-10 18:30:36.774305: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 2512 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-04-10 18:30:45.876862: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-04-10 18:30:46.062324: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-04-10 18:30:47.338450: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-10 18:30:47.338527: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-10 18:30:47.345043: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-10 18:30:47.345066: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-10 18:30:47.396238: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-10 18:30:47.396302: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-10 18:30:47.438117: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.09GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-10 18:30:47.438158: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.09GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-10 18:30:47.488713: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.15GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-10 18:30:47.488750: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.15GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-04-10 18:30:47.490856: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.45G (1562247168 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-10 18:30:47.491416: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.31G (1406022400 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-10 18:30:47.805071: W tensorflow/core/common_runtime/bfc_allocator.cc:311] Garbage collection: deallocate free memory regions (i.e., allocations) so that we can re-allocate a larger region to avoid OOM due to memory fragmentation. If you see this message frequently, you are running near the threshold of the available device memory and re-allocation may incur great performance overhead. You may try smaller batch sizes to observe the performance impact. Set TF_ENABLE_GPU_GARBAGE_COLLECTION=false if you'd like to disable this feature. 2025-04-10 18:30:47.849206: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-10 18:30:47.850230: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-10 18:30:47.851689: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-10 18:30:47.852426: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-10 18:30:47.862519: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-10 18:30:47.863043: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-10 18:30:47.863577: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-10 18:30:47.864087: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-10 18:30:47.864597: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-10 18:30:47.865106: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-10 18:30:47.879462: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-10 18:30:47.879983: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-10 18:30:47.931021: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-10 18:30:47.931620: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-10 18:30:47.939910: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-10 18:30:47.940817: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-10 18:30:47.961023: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-10 18:30:47.962141: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-10 18:30:47.963248: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-10 18:30:47.964276: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-10 18:30:47.968654: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-10 18:30:47.969524: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-10 18:30:47.970388: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-10 18:30:47.971268: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-10 18:30:47.972588: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-10 18:30:47.972607: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-04-10 18:30:47.982618: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-10 18:30:47.983351: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-10 18:30:47.993053: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-10 18:30:47.994042: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-10 18:30:47.995039: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-10 18:30:47.996009: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-10 18:30:47.996988: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-04-10 18:30:47.997951: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.95G (2099118080 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 11 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 20 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 52 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 41 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 46 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 39 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 21 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 35 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 52 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 28 Detection mask done ! Trying to reset tf kernel 3696064 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 578 tf kernel not reseted sub process len(results) : 11 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 11 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 3185 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0007476806640625 nb_pixel_total : 26296 time to create 1 rle with old method : 0.037731170654296875 length of segment : 214 time for calcul the mask position with numpy : 0.0010712146759033203 nb_pixel_total : 45783 time to create 1 rle with old method : 0.07555794715881348 length of segment : 229 time for calcul the mask position with numpy : 0.00027251243591308594 nb_pixel_total : 13991 time to create 1 rle with old method : 0.016618013381958008 length of segment : 150 time for calcul the mask position with numpy : 0.0005865097045898438 nb_pixel_total : 34781 time to create 1 rle with old method : 0.0454564094543457 length of segment : 217 time for calcul the mask position with numpy : 0.0006062984466552734 nb_pixel_total : 30135 time to create 1 rle with old method : 0.04634428024291992 length of segment : 224 time for calcul the mask position with numpy : 0.0009086132049560547 nb_pixel_total : 35741 time to create 1 rle with old method : 0.04596972465515137 length of segment : 205 time for calcul the mask position with numpy : 0.005339860916137695 nb_pixel_total : 189786 time to create 1 rle with new method : 0.016360044479370117 length of segment : 572 time for calcul the mask position with numpy : 0.0003974437713623047 nb_pixel_total : 24248 time to create 1 rle with old method : 0.0296633243560791 length of segment : 156 time for calcul the mask position with numpy : 0.0007445812225341797 nb_pixel_total : 45054 time to create 1 rle with old method : 0.06161022186279297 length of segment : 252 time for calcul the mask position with numpy : 0.0017430782318115234 nb_pixel_total : 79838 time to create 1 rle with old method : 0.11075830459594727 length of segment : 405 time for calcul the mask position with numpy : 0.0012068748474121094 nb_pixel_total : 46781 time to create 1 rle with old method : 0.06700634956359863 length of segment : 464 time for calcul the mask position with numpy : 0.0002357959747314453 nb_pixel_total : 6691 time to create 1 rle with old method : 0.010126590728759766 length of segment : 68 time for calcul the mask position with numpy : 0.0005116462707519531 nb_pixel_total : 19198 time to create 1 rle with old method : 0.028755664825439453 length of segment : 158 time for calcul the mask position with numpy : 0.0022428035736083984 nb_pixel_total : 47010 time to create 1 rle with old method : 0.08120059967041016 length of segment : 238 time for calcul the mask position with numpy : 0.003037691116333008 nb_pixel_total : 82330 time to create 1 rle with old method : 0.14957022666931152 length of segment : 257 time for calcul the mask position with numpy : 0.0032329559326171875 nb_pixel_total : 80530 time to create 1 rle with old method : 0.11848092079162598 length of segment : 449 time for calcul the mask position with numpy : 0.0007021427154541016 nb_pixel_total : 23286 time to create 1 rle with old method : 0.02962970733642578 length of segment : 150 time for calcul the mask position with numpy : 0.0013451576232910156 nb_pixel_total : 48603 time to create 1 rle with old method : 0.06895828247070312 length of segment : 301 time for calcul the mask position with numpy : 0.005326032638549805 nb_pixel_total : 122821 time to create 1 rle with old method : 0.14346551895141602 length of segment : 1147 time for calcul the mask position with numpy : 0.002161264419555664 nb_pixel_total : 65859 time to create 1 rle with old method : 0.08304643630981445 length of segment : 368 time for calcul the mask position with numpy : 0.002798318862915039 nb_pixel_total : 82498 time to create 1 rle with old method : 0.10113120079040527 length of segment : 320 time for calcul the mask position with numpy : 0.001222372055053711 nb_pixel_total : 37707 time to create 1 rle with old method : 0.045256853103637695 length of segment : 299 time for calcul the mask position with numpy : 0.0016393661499023438 nb_pixel_total : 65661 time to create 1 rle with old method : 0.09058523178100586 length of segment : 374 time for calcul the mask position with numpy : 0.0033745765686035156 nb_pixel_total : 77027 time to create 1 rle with old method : 0.09359502792358398 length of segment : 824 time for calcul the mask position with numpy : 0.0034914016723632812 nb_pixel_total : 102364 time to create 1 rle with old method : 0.14678478240966797 length of segment : 481 time for calcul the mask position with numpy : 0.029648303985595703 nb_pixel_total : 246304 time to create 1 rle with new method : 0.5606582164764404 length of segment : 611 time for calcul the mask position with numpy : 0.0007097721099853516 nb_pixel_total : 27351 time to create 1 rle with old method : 0.03146028518676758 length of segment : 291 time for calcul the mask position with numpy : 0.0002448558807373047 nb_pixel_total : 9284 time to create 1 rle with old method : 0.01112222671508789 length of segment : 82 time for calcul the mask position with numpy : 0.0007731914520263672 nb_pixel_total : 33782 time to create 1 rle with old method : 0.03903007507324219 length of segment : 277 time for calcul the mask position with numpy : 0.001971721649169922 nb_pixel_total : 103977 time to create 1 rle with old method : 0.11996579170227051 length of segment : 388 time for calcul the mask position with numpy : 0.016069650650024414 nb_pixel_total : 469450 time to create 1 rle with new method : 0.49150896072387695 length of segment : 1109 time for calcul the mask position with numpy : 0.0007154941558837891 nb_pixel_total : 33133 time to create 1 rle with old method : 0.03690457344055176 length of segment : 255 time for calcul the mask position with numpy : 0.002645730972290039 nb_pixel_total : 105543 time to create 1 rle with old method : 0.1119530200958252 length of segment : 429 time for calcul the mask position with numpy : 0.0006306171417236328 nb_pixel_total : 27189 time to create 1 rle with old method : 0.030036211013793945 length of segment : 304 time for calcul the mask position with numpy : 0.0007841587066650391 nb_pixel_total : 42671 time to create 1 rle with old method : 0.04861855506896973 length of segment : 224 time for calcul the mask position with numpy : 0.0012454986572265625 nb_pixel_total : 69317 time to create 1 rle with old method : 0.07733154296875 length of segment : 289 time for calcul the mask position with numpy : 0.0008156299591064453 nb_pixel_total : 19574 time to create 1 rle with old method : 0.02245473861694336 length of segment : 273 time for calcul the mask position with numpy : 0.0009284019470214844 nb_pixel_total : 40325 time to create 1 rle with old method : 0.051039695739746094 length of segment : 304 time for calcul the mask position with numpy : 0.007221698760986328 nb_pixel_total : 111623 time to create 1 rle with old method : 0.1281752586364746 length of segment : 429 time for calcul the mask position with numpy : 0.0018923282623291016 nb_pixel_total : 92513 time to create 1 rle with old method : 0.10579323768615723 length of segment : 402 time for calcul the mask position with numpy : 0.0007264614105224609 nb_pixel_total : 15486 time to create 1 rle with old method : 0.017298460006713867 length of segment : 128 time for calcul the mask position with numpy : 0.00321197509765625 nb_pixel_total : 37169 time to create 1 rle with old method : 0.04220247268676758 length of segment : 273 time for calcul the mask position with numpy : 0.0009467601776123047 nb_pixel_total : 21335 time to create 1 rle with old method : 0.024291276931762695 length of segment : 119 time for calcul the mask position with numpy : 0.0031456947326660156 nb_pixel_total : 207629 time to create 1 rle with new method : 0.004917621612548828 length of segment : 350 time for calcul the mask position with numpy : 0.003642559051513672 nb_pixel_total : 125993 time to create 1 rle with old method : 0.1750049591064453 length of segment : 567 time for calcul the mask position with numpy : 0.0013849735260009766 nb_pixel_total : 44656 time to create 1 rle with old method : 0.050397396087646484 length of segment : 282 time for calcul the mask position with numpy : 0.0003936290740966797 nb_pixel_total : 16105 time to create 1 rle with old method : 0.0185391902923584 length of segment : 181 time for calcul the mask position with numpy : 0.0008232593536376953 nb_pixel_total : 49331 time to create 1 rle with old method : 0.054463863372802734 length of segment : 524 time for calcul the mask position with numpy : 0.0006072521209716797 nb_pixel_total : 23574 time to create 1 rle with old method : 0.029649019241333008 length of segment : 191 time for calcul the mask position with numpy : 0.0014011859893798828 nb_pixel_total : 47876 time to create 1 rle with old method : 0.0712587833404541 length of segment : 243 time for calcul the mask position with numpy : 0.00020456314086914062 nb_pixel_total : 3946 time to create 1 rle with old method : 0.004595041275024414 length of segment : 86 time for calcul the mask position with numpy : 0.001608133316040039 nb_pixel_total : 80606 time to create 1 rle with old method : 0.11544585227966309 length of segment : 299 time for calcul the mask position with numpy : 0.002263307571411133 nb_pixel_total : 88973 time to create 1 rle with old method : 0.10044312477111816 length of segment : 408 time for calcul the mask position with numpy : 0.00032973289489746094 nb_pixel_total : 9390 time to create 1 rle with old method : 0.010922908782958984 length of segment : 114 time for calcul the mask position with numpy : 0.0017011165618896484 nb_pixel_total : 30003 time to create 1 rle with old method : 0.03449201583862305 length of segment : 243 time for calcul the mask position with numpy : 0.002080202102661133 nb_pixel_total : 56824 time to create 1 rle with old method : 0.07235574722290039 length of segment : 327 time for calcul the mask position with numpy : 0.0010323524475097656 nb_pixel_total : 11949 time to create 1 rle with old method : 0.013744354248046875 length of segment : 220 time for calcul the mask position with numpy : 0.0006239414215087891 nb_pixel_total : 14916 time to create 1 rle with old method : 0.01735973358154297 length of segment : 153 time for calcul the mask position with numpy : 0.0011036396026611328 nb_pixel_total : 23258 time to create 1 rle with old method : 0.026742935180664062 length of segment : 201 time for calcul the mask position with numpy : 0.00019311904907226562 nb_pixel_total : 6739 time to create 1 rle with old method : 0.011427164077758789 length of segment : 95 time for calcul the mask position with numpy : 0.0002791881561279297 nb_pixel_total : 8124 time to create 1 rle with old method : 0.009480714797973633 length of segment : 111 time for calcul the mask position with numpy : 0.0004646778106689453 nb_pixel_total : 11245 time to create 1 rle with old method : 0.015197992324829102 length of segment : 95 time for calcul the mask position with numpy : 0.0011565685272216797 nb_pixel_total : 20520 time to create 1 rle with old method : 0.024696826934814453 length of segment : 205 time for calcul the mask position with numpy : 0.00041484832763671875 nb_pixel_total : 8709 time to create 1 rle with old method : 0.01019597053527832 length of segment : 106 time for calcul the mask position with numpy : 0.0007543563842773438 nb_pixel_total : 11394 time to create 1 rle with old method : 0.013402938842773438 length of segment : 148 time for calcul the mask position with numpy : 0.0007491111755371094 nb_pixel_total : 16744 time to create 1 rle with old method : 0.0194551944732666 length of segment : 143 time for calcul the mask position with numpy : 0.0020072460174560547 nb_pixel_total : 51953 time to create 1 rle with old method : 0.05900454521179199 length of segment : 275 time for calcul the mask position with numpy : 0.00972294807434082 nb_pixel_total : 240126 time to create 1 rle with new method : 0.014107942581176758 length of segment : 616 time for calcul the mask position with numpy : 0.0024471282958984375 nb_pixel_total : 42212 time to create 1 rle with old method : 0.047287702560424805 length of segment : 418 time for calcul the mask position with numpy : 0.0017616748809814453 nb_pixel_total : 27423 time to create 1 rle with old method : 0.03110957145690918 length of segment : 200 time for calcul the mask position with numpy : 0.17448735237121582 nb_pixel_total : 1425852 time to create 1 rle with new method : 0.15131855010986328 length of segment : 1675 time for calcul the mask position with numpy : 0.0008513927459716797 nb_pixel_total : 14899 time to create 1 rle with old method : 0.017451763153076172 length of segment : 174 time for calcul the mask position with numpy : 0.0013222694396972656 nb_pixel_total : 26892 time to create 1 rle with old method : 0.030559539794921875 length of segment : 138 time for calcul the mask position with numpy : 0.0007245540618896484 nb_pixel_total : 19651 time to create 1 rle with old method : 0.023143529891967773 length of segment : 137 time for calcul the mask position with numpy : 0.0013127326965332031 nb_pixel_total : 34515 time to create 1 rle with old method : 0.0395052433013916 length of segment : 242 time for calcul the mask position with numpy : 0.0006606578826904297 nb_pixel_total : 20185 time to create 1 rle with old method : 0.022721052169799805 length of segment : 156 time for calcul the mask position with numpy : 0.006937742233276367 nb_pixel_total : 329140 time to create 1 rle with new method : 0.020763635635375977 length of segment : 1129 time for calcul the mask position with numpy : 0.0019576549530029297 nb_pixel_total : 118086 time to create 1 rle with old method : 0.13292765617370605 length of segment : 357 time for calcul the mask position with numpy : 0.0030472278594970703 nb_pixel_total : 75502 time to create 1 rle with old method : 0.08461999893188477 length of segment : 509 time for calcul the mask position with numpy : 0.002364635467529297 nb_pixel_total : 76731 time to create 1 rle with old method : 0.0902245044708252 length of segment : 331 time for calcul the mask position with numpy : 0.0035774707794189453 nb_pixel_total : 91559 time to create 1 rle with old method : 0.10506081581115723 length of segment : 393 time for calcul the mask position with numpy : 0.0005948543548583984 nb_pixel_total : 12849 time to create 1 rle with old method : 0.014539241790771484 length of segment : 135 time for calcul the mask position with numpy : 0.00044918060302734375 nb_pixel_total : 5334 time to create 1 rle with old method : 0.006407499313354492 length of segment : 169 time for calcul the mask position with numpy : 0.011491537094116211 nb_pixel_total : 321231 time to create 1 rle with new method : 0.01597738265991211 length of segment : 570 time for calcul the mask position with numpy : 0.0030279159545898438 nb_pixel_total : 117233 time to create 1 rle with old method : 0.1308450698852539 length of segment : 434 time for calcul the mask position with numpy : 0.0015499591827392578 nb_pixel_total : 59834 time to create 1 rle with old method : 0.0717475414276123 length of segment : 273 time for calcul the mask position with numpy : 0.009548187255859375 nb_pixel_total : 234207 time to create 1 rle with new method : 0.012174844741821289 length of segment : 650 time for calcul the mask position with numpy : 0.0015399456024169922 nb_pixel_total : 36190 time to create 1 rle with old method : 0.04029035568237305 length of segment : 276 time for calcul the mask position with numpy : 0.002046823501586914 nb_pixel_total : 50817 time to create 1 rle with old method : 0.08333683013916016 length of segment : 246 time for calcul the mask position with numpy : 0.002899646759033203 nb_pixel_total : 39719 time to create 1 rle with old method : 0.04434370994567871 length of segment : 257 time for calcul the mask position with numpy : 0.002711772918701172 nb_pixel_total : 33683 time to create 1 rle with old method : 0.03787350654602051 length of segment : 416 time for calcul the mask position with numpy : 0.0029158592224121094 nb_pixel_total : 96798 time to create 1 rle with old method : 0.10669112205505371 length of segment : 264 time for calcul the mask position with numpy : 0.0021238327026367188 nb_pixel_total : 51320 time to create 1 rle with old method : 0.0565643310546875 length of segment : 718 time for calcul the mask position with numpy : 0.000560760498046875 nb_pixel_total : 10932 time to create 1 rle with old method : 0.01235342025756836 length of segment : 140 time for calcul the mask position with numpy : 0.0008940696716308594 nb_pixel_total : 21627 time to create 1 rle with old method : 0.02447199821472168 length of segment : 217 time for calcul the mask position with numpy : 0.0003113746643066406 nb_pixel_total : 8587 time to create 1 rle with old method : 0.009752273559570312 length of segment : 72 time for calcul the mask position with numpy : 0.0023107528686523438 nb_pixel_total : 65477 time to create 1 rle with old method : 0.07370638847351074 length of segment : 267 time for calcul the mask position with numpy : 0.01731085777282715 nb_pixel_total : 407021 time to create 1 rle with new method : 0.023005247116088867 length of segment : 1127 time for calcul the mask position with numpy : 0.002087116241455078 nb_pixel_total : 48094 time to create 1 rle with old method : 0.05479097366333008 length of segment : 248 time for calcul the mask position with numpy : 0.000347137451171875 nb_pixel_total : 7332 time to create 1 rle with old method : 0.008295059204101562 length of segment : 81 time for calcul the mask position with numpy : 0.0009605884552001953 nb_pixel_total : 24143 time to create 1 rle with old method : 0.02758646011352539 length of segment : 212 time for calcul the mask position with numpy : 0.0002493858337402344 nb_pixel_total : 4546 time to create 1 rle with old method : 0.005239248275756836 length of segment : 74 time for calcul the mask position with numpy : 0.0011572837829589844 nb_pixel_total : 25003 time to create 1 rle with old method : 0.027786970138549805 length of segment : 183 time for calcul the mask position with numpy : 0.002465963363647461 nb_pixel_total : 65129 time to create 1 rle with old method : 0.07063674926757812 length of segment : 344 time for calcul the mask position with numpy : 0.0016171932220458984 nb_pixel_total : 26732 time to create 1 rle with old method : 0.029133081436157227 length of segment : 233 time for calcul the mask position with numpy : 0.006722211837768555 nb_pixel_total : 268202 time to create 1 rle with new method : 0.007865190505981445 length of segment : 468 time for calcul the mask position with numpy : 0.0008041858673095703 nb_pixel_total : 20671 time to create 1 rle with old method : 0.025443553924560547 length of segment : 166 time for calcul the mask position with numpy : 0.025313854217529297 nb_pixel_total : 498923 time to create 1 rle with new method : 0.06442523002624512 length of segment : 1349 time for calcul the mask position with numpy : 0.003200531005859375 nb_pixel_total : 72619 time to create 1 rle with old method : 0.07975125312805176 length of segment : 562 time for calcul the mask position with numpy : 0.0010800361633300781 nb_pixel_total : 22277 time to create 1 rle with old method : 0.02550959587097168 length of segment : 216 time for calcul the mask position with numpy : 0.00075531005859375 nb_pixel_total : 20895 time to create 1 rle with old method : 0.023987293243408203 length of segment : 127 time for calcul the mask position with numpy : 0.00042939186096191406 nb_pixel_total : 10158 time to create 1 rle with old method : 0.01175236701965332 length of segment : 200 time for calcul the mask position with numpy : 0.0003864765167236328 nb_pixel_total : 8219 time to create 1 rle with old method : 0.009700298309326172 length of segment : 119 time for calcul the mask position with numpy : 0.0013539791107177734 nb_pixel_total : 50855 time to create 1 rle with old method : 0.07066059112548828 length of segment : 275 time for calcul the mask position with numpy : 0.0002834796905517578 nb_pixel_total : 6709 time to create 1 rle with old method : 0.008091926574707031 length of segment : 85 time for calcul the mask position with numpy : 0.0009951591491699219 nb_pixel_total : 20207 time to create 1 rle with old method : 0.023267507553100586 length of segment : 366 time for calcul the mask position with numpy : 0.005734443664550781 nb_pixel_total : 196776 time to create 1 rle with new method : 0.009100675582885742 length of segment : 586 time for calcul the mask position with numpy : 0.005316734313964844 nb_pixel_total : 222749 time to create 1 rle with new method : 0.007146120071411133 length of segment : 622 time for calcul the mask position with numpy : 0.0026197433471679688 nb_pixel_total : 104051 time to create 1 rle with old method : 0.11828231811523438 length of segment : 392 time for calcul the mask position with numpy : 0.0022881031036376953 nb_pixel_total : 89747 time to create 1 rle with old method : 0.1049659252166748 length of segment : 341 time for calcul the mask position with numpy : 0.005114316940307617 nb_pixel_total : 222744 time to create 1 rle with new method : 0.009357690811157227 length of segment : 600 time for calcul the mask position with numpy : 0.004616737365722656 nb_pixel_total : 185823 time to create 1 rle with new method : 0.008651256561279297 length of segment : 600 time for calcul the mask position with numpy : 0.000438690185546875 nb_pixel_total : 10920 time to create 1 rle with old method : 0.013890743255615234 length of segment : 151 time for calcul the mask position with numpy : 0.0002803802490234375 nb_pixel_total : 3388 time to create 1 rle with old method : 0.003919363021850586 length of segment : 127 time for calcul the mask position with numpy : 0.0005466938018798828 nb_pixel_total : 16145 time to create 1 rle with old method : 0.018379926681518555 length of segment : 117 time for calcul the mask position with numpy : 0.0021944046020507812 nb_pixel_total : 75410 time to create 1 rle with old method : 0.08440899848937988 length of segment : 282 time for calcul the mask position with numpy : 0.002207517623901367 nb_pixel_total : 46840 time to create 1 rle with old method : 0.062102556228637695 length of segment : 256 time for calcul the mask position with numpy : 0.0006737709045410156 nb_pixel_total : 13813 time to create 1 rle with old method : 0.018538713455200195 length of segment : 139 time for calcul the mask position with numpy : 0.003540515899658203 nb_pixel_total : 101222 time to create 1 rle with old method : 0.12195634841918945 length of segment : 400 time for calcul the mask position with numpy : 0.001220703125 nb_pixel_total : 43837 time to create 1 rle with old method : 0.050061941146850586 length of segment : 139 time for calcul the mask position with numpy : 0.0026578903198242188 nb_pixel_total : 75599 time to create 1 rle with old method : 0.08488225936889648 length of segment : 339 time for calcul the mask position with numpy : 0.01407313346862793 nb_pixel_total : 457942 time to create 1 rle with new method : 0.03467845916748047 length of segment : 801 time for calcul the mask position with numpy : 0.0007495880126953125 nb_pixel_total : 9878 time to create 1 rle with old method : 0.01105642318725586 length of segment : 335 time for calcul the mask position with numpy : 0.002276182174682617 nb_pixel_total : 80512 time to create 1 rle with old method : 0.08890557289123535 length of segment : 262 time for calcul the mask position with numpy : 0.0003628730773925781 nb_pixel_total : 7915 time to create 1 rle with old method : 0.008988618850708008 length of segment : 128 time for calcul the mask position with numpy : 0.00179290771484375 nb_pixel_total : 40056 time to create 1 rle with old method : 0.0442807674407959 length of segment : 600 time for calcul the mask position with numpy : 0.004227399826049805 nb_pixel_total : 144005 time to create 1 rle with old method : 0.1609635353088379 length of segment : 735 time for calcul the mask position with numpy : 0.007926702499389648 nb_pixel_total : 334816 time to create 1 rle with new method : 0.012723207473754883 length of segment : 482 time for calcul the mask position with numpy : 0.004717826843261719 nb_pixel_total : 102309 time to create 1 rle with old method : 0.11391806602478027 length of segment : 421 time for calcul the mask position with numpy : 0.006613969802856445 nb_pixel_total : 174621 time to create 1 rle with new method : 0.007776975631713867 length of segment : 625 time for calcul the mask position with numpy : 0.0013425350189208984 nb_pixel_total : 27018 time to create 1 rle with old method : 0.04447293281555176 length of segment : 214 time for calcul the mask position with numpy : 0.004721879959106445 nb_pixel_total : 118380 time to create 1 rle with old method : 0.13610243797302246 length of segment : 728 time for calcul the mask position with numpy : 0.006582736968994141 nb_pixel_total : 169031 time to create 1 rle with new method : 0.008169412612915039 length of segment : 613 time for calcul the mask position with numpy : 0.005120515823364258 nb_pixel_total : 90069 time to create 1 rle with old method : 0.12117815017700195 length of segment : 413 time for calcul the mask position with numpy : 0.00045680999755859375 nb_pixel_total : 9916 time to create 1 rle with old method : 0.011406660079956055 length of segment : 136 time for calcul the mask position with numpy : 0.0007712841033935547 nb_pixel_total : 12498 time to create 1 rle with old method : 0.014752864837646484 length of segment : 156 time for calcul the mask position with numpy : 0.001756906509399414 nb_pixel_total : 46478 time to create 1 rle with old method : 0.05354595184326172 length of segment : 195 time for calcul the mask position with numpy : 0.0016722679138183594 nb_pixel_total : 37699 time to create 1 rle with old method : 0.043512821197509766 length of segment : 188 time for calcul the mask position with numpy : 0.0057489871978759766 nb_pixel_total : 91403 time to create 1 rle with old method : 0.10314631462097168 length of segment : 483 time for calcul the mask position with numpy : 0.00503087043762207 nb_pixel_total : 153736 time to create 1 rle with new method : 0.005482673645019531 length of segment : 358 time for calcul the mask position with numpy : 0.0006854534149169922 nb_pixel_total : 7096 time to create 1 rle with old method : 0.0081939697265625 length of segment : 273 time for calcul the mask position with numpy : 0.0006670951843261719 nb_pixel_total : 14314 time to create 1 rle with old method : 0.01701188087463379 length of segment : 125 time for calcul the mask position with numpy : 0.0005917549133300781 nb_pixel_total : 11451 time to create 1 rle with old method : 0.013561725616455078 length of segment : 106 time for calcul the mask position with numpy : 0.0045506954193115234 nb_pixel_total : 65741 time to create 1 rle with old method : 0.07514023780822754 length of segment : 319 time for calcul the mask position with numpy : 0.0004918575286865234 nb_pixel_total : 12001 time to create 1 rle with old method : 0.013716459274291992 length of segment : 175 time for calcul the mask position with numpy : 0.0009734630584716797 nb_pixel_total : 22925 time to create 1 rle with old method : 0.025800228118896484 length of segment : 182 time for calcul the mask position with numpy : 0.001554727554321289 nb_pixel_total : 44117 time to create 1 rle with old method : 0.05047106742858887 length of segment : 269 time for calcul the mask position with numpy : 0.0013763904571533203 nb_pixel_total : 26442 time to create 1 rle with old method : 0.030536651611328125 length of segment : 223 time for calcul the mask position with numpy : 0.0008740425109863281 nb_pixel_total : 9199 time to create 1 rle with old method : 0.01103973388671875 length of segment : 165 time for calcul the mask position with numpy : 0.006269693374633789 nb_pixel_total : 115833 time to create 1 rle with old method : 0.13264942169189453 length of segment : 693 time for calcul the mask position with numpy : 0.0006303787231445312 nb_pixel_total : 8159 time to create 1 rle with old method : 0.009487628936767578 length of segment : 122 time for calcul the mask position with numpy : 0.002350330352783203 nb_pixel_total : 49851 time to create 1 rle with old method : 0.05644679069519043 length of segment : 292 time for calcul the mask position with numpy : 0.0007824897766113281 nb_pixel_total : 21877 time to create 1 rle with old method : 0.024842023849487305 length of segment : 193 time for calcul the mask position with numpy : 0.0021092891693115234 nb_pixel_total : 51316 time to create 1 rle with old method : 0.0591738224029541 length of segment : 331 time for calcul the mask position with numpy : 0.0006866455078125 nb_pixel_total : 9807 time to create 1 rle with old method : 0.01614665985107422 length of segment : 167 time for calcul the mask position with numpy : 0.005193471908569336 nb_pixel_total : 161266 time to create 1 rle with new method : 0.0060825347900390625 length of segment : 520 time for calcul the mask position with numpy : 0.00146484375 nb_pixel_total : 46808 time to create 1 rle with old method : 0.06231951713562012 length of segment : 358 time for calcul the mask position with numpy : 0.008583784103393555 nb_pixel_total : 178976 time to create 1 rle with new method : 0.011184215545654297 length of segment : 936 time for calcul the mask position with numpy : 0.0020787715911865234 nb_pixel_total : 52264 time to create 1 rle with old method : 0.05944347381591797 length of segment : 370 time for calcul the mask position with numpy : 0.0034437179565429688 nb_pixel_total : 151818 time to create 1 rle with new method : 0.0044176578521728516 length of segment : 413 time for calcul the mask position with numpy : 0.0007038116455078125 nb_pixel_total : 20887 time to create 1 rle with old method : 0.024158239364624023 length of segment : 126 time for calcul the mask position with numpy : 0.0013544559478759766 nb_pixel_total : 50322 time to create 1 rle with old method : 0.057901859283447266 length of segment : 240 time for calcul the mask position with numpy : 0.00042319297790527344 nb_pixel_total : 6755 time to create 1 rle with old method : 0.011457681655883789 length of segment : 95 time for calcul the mask position with numpy : 0.0020139217376708984 nb_pixel_total : 57288 time to create 1 rle with old method : 0.07598614692687988 length of segment : 362 time for calcul the mask position with numpy : 0.0008382797241210938 nb_pixel_total : 16477 time to create 1 rle with old method : 0.018663883209228516 length of segment : 174 time spent for convertir_results : 19.70418930053711 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 175 chid ids of type : 3594 Number RLEs to save : 58483 save missing photos in datou_result : time spend for datou_step_exec : 93.09108328819275 time spend to save output : 25.27311658859253 total time spend for step 1 : 118.36419987678528 step2:crop_condition Thu Apr 10 18:32:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 11 ! batch 1 Loaded 175 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 102 About to insert : list_path_to_insert length 102 new photo from crops ! About to upload 102 photos upload in portfolio : 3736932 init cache_photo without model_param we have 102 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1744302788_3695433 we have uploaded 102 photos in the portfolio 3736932 time of upload the photos Elapsed time : 35.68663144111633 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 42 About to insert : list_path_to_insert length 42 new photo from crops ! About to upload 42 photos upload in portfolio : 3736932 init cache_photo without model_param we have 42 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1744302838_3695433 we have uploaded 42 photos in the portfolio 3736932 time of upload the photos Elapsed time : 14.414706707000732 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1744302854_3695433 we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.7079117298126221 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 19 About to insert : list_path_to_insert length 19 new photo from crops ! About to upload 19 photos upload in portfolio : 3736932 init cache_photo without model_param we have 19 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1744302866_3695433 we have uploaded 19 photos in the portfolio 3736932 time of upload the photos Elapsed time : 9.750839471817017 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 6 About to insert : list_path_to_insert length 6 new photo from crops ! About to upload 6 photos upload in portfolio : 3736932 init cache_photo without model_param we have 6 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1744302882_3695433 we have uploaded 6 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.3204545974731445 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1744302888_3695433 we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.5376665592193604 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1744302893_3695433 we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.8916199207305908 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1351145984, 1351145980, 1351145976, 1351145908, 1351145902, 1351145862, 1351145861, 1351145793, 1351145763, 1351145750, 1351145722] Looping around the photos to save general results len do output : 175 /1351252070Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252071Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252072Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252073Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252074Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252075Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252076Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252077Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252078Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252079Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252080Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252081Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252082Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252083Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252085Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252086Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252087Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252088Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252090Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252091Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252092Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252093Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252094Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252095Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252096Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252097Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252098Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252099Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252100Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252101Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252102Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252103Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252104Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252105Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252106Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252107Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252108Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252109Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252110Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252111Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252112Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252113Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252114Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252115Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252116Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252117Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252118Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252120Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252122Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252123Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252124Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252125Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252126Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252128Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252129Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252130Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252131Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252132Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252133Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252134Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252135Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252136Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252137Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252138Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252139Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252140Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252141Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252142Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252144Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252145Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252146Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252147Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252149Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252150Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252151Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252152Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252153Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252154Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252155Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252156Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252157Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252158Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252159Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252160Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252161Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252163Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252164Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252165Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252166Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252167Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252168Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252169Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252170Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252171Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252172Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252173Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252174Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252175Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252176Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252177Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252178Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252179Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252262Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252264Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252266Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252267Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252268Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252270Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252271Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252272Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252274Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252275Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252276Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252278Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252279Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252283Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252284Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252285Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252287Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252288Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252289Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252291Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252292Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252293Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252295Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252296Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252297Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252299Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252300Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252301Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252303Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252304Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252305Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252307Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252308Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252309Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252311Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252312Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252313Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252316Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252317Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252318Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252320Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252321Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252331Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252333Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252397Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252399Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252400Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252401Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252402Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252403Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252404Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252405Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252406Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252407Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252408Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252409Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252410Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252411Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252415Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252416Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252417Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252418Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252419Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252428Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252429Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252430Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252431Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252432Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252433Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252457Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252460Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252514Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1351252515Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2740447') ('3318', '22234353', '1351145984', None, None, None, None, None, '2740447') ('3318', None, None, None, None, None, None, None, '2740447') ('3318', '22234353', '1351145980', None, None, None, None, None, '2740447') ('3318', None, None, None, None, None, None, None, '2740447') ('3318', '22234353', '1351145976', None, None, None, None, None, '2740447') ('3318', None, None, None, None, None, None, None, '2740447') ('3318', '22234353', '1351145908', None, None, None, None, None, '2740447') ('3318', None, None, None, None, None, None, None, '2740447') ('3318', '22234353', '1351145902', None, None, None, None, None, '2740447') ('3318', None, None, None, None, None, None, None, '2740447') ('3318', '22234353', '1351145862', None, None, None, None, None, '2740447') ('3318', None, None, None, None, None, None, None, '2740447') ('3318', '22234353', '1351145861', None, None, None, None, None, '2740447') ('3318', None, None, None, None, None, None, None, '2740447') ('3318', '22234353', '1351145793', None, None, None, None, None, '2740447') ('3318', None, None, None, None, None, None, None, '2740447') ('3318', '22234353', '1351145763', None, None, None, None, None, '2740447') ('3318', None, None, None, None, None, None, None, '2740447') ('3318', '22234353', '1351145750', None, None, None, None, None, '2740447') ('3318', None, None, None, None, None, None, None, '2740447') ('3318', '22234353', '1351145722', None, None, None, None, None, '2740447') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 536 time used for this insertion : 0.0394587516784668 save_final save missing photos in datou_result : time spend for datou_step_exec : 143.0723695755005 time spend to save output : 0.044587135314941406 total time spend for step 2 : 143.11695671081543 step3:rle_unique_nms_with_priority Thu Apr 10 18:34:54 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 175 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 12 nb_hashtags : 4 time to prepare the origin masks : 11.284310340881348 time for calcul the mask position with numpy : 0.5736773014068604 nb_pixel_total : 6515527 time to create 1 rle with new method : 1.4211227893829346 time for calcul the mask position with numpy : 0.021724224090576172 nb_pixel_total : 6691 time to create 1 rle with old method : 0.0075550079345703125 time for calcul the mask position with numpy : 0.021918296813964844 nb_pixel_total : 46017 time to create 1 rle with old method : 0.0512087345123291 time for calcul the mask position with numpy : 0.021623611450195312 nb_pixel_total : 79838 time to create 1 rle with old method : 0.08904528617858887 time for calcul the mask position with numpy : 0.023226499557495117 nb_pixel_total : 1406 time to create 1 rle with old method : 0.0018067359924316406 time for calcul the mask position with numpy : 0.021657228469848633 nb_pixel_total : 24248 time to create 1 rle with old method : 0.02745819091796875 time for calcul the mask position with numpy : 0.02224445343017578 nb_pixel_total : 189786 time to create 1 rle with new method : 1.076188564300537 time for calcul the mask position with numpy : 0.021065950393676758 nb_pixel_total : 35741 time to create 1 rle with old method : 0.04060983657836914 time for calcul the mask position with numpy : 0.02423381805419922 nb_pixel_total : 30135 time to create 1 rle with old method : 0.051808834075927734 time for calcul the mask position with numpy : 0.025014400482177734 nb_pixel_total : 34781 time to create 1 rle with old method : 0.03837418556213379 time for calcul the mask position with numpy : 0.02099919319152832 nb_pixel_total : 13991 time to create 1 rle with old method : 0.015470266342163086 time for calcul the mask position with numpy : 0.0216214656829834 nb_pixel_total : 45783 time to create 1 rle with old method : 0.05064201354980469 time for calcul the mask position with numpy : 0.021001100540161133 nb_pixel_total : 26296 time to create 1 rle with old method : 0.028673887252807617 create new chi : 3.796985149383545 time to delete rle : 0.013401031494140625 batch 1 Loaded 25 chid ids of type : 3594 ++++++++++++Number RLEs to save : 7989 TO DO : save crop sub photo not yet done ! save time : 3.643406867980957 nb_obj : 31 nb_hashtags : 5 time to prepare the origin masks : 4.743645191192627 time for calcul the mask position with numpy : 0.9170899391174316 nb_pixel_total : 4803844 time to create 1 rle with new method : 0.811349630355835 time for calcul the mask position with numpy : 0.027788162231445312 nb_pixel_total : 9284 time to create 1 rle with old method : 0.010248422622680664 time for calcul the mask position with numpy : 0.02779245376586914 nb_pixel_total : 19198 time to create 1 rle with old method : 0.020644664764404297 time for calcul the mask position with numpy : 0.028676271438598633 nb_pixel_total : 33782 time to create 1 rle with old method : 0.03766274452209473 time for calcul the mask position with numpy : 0.028635025024414062 nb_pixel_total : 105543 time to create 1 rle with old method : 0.1136777400970459 time for calcul the mask position with numpy : 0.027253389358520508 nb_pixel_total : 37707 time to create 1 rle with old method : 0.0394742488861084 time for calcul the mask position with numpy : 0.032102108001708984 nb_pixel_total : 469144 time to create 1 rle with new method : 1.459501028060913 time for calcul the mask position with numpy : 0.028436660766601562 nb_pixel_total : 69546 time to create 1 rle with old method : 0.08079075813293457 time for calcul the mask position with numpy : 0.02939891815185547 nb_pixel_total : 8246 time to create 1 rle with old method : 0.009909629821777344 time for calcul the mask position with numpy : 0.02924823760986328 nb_pixel_total : 122821 time to create 1 rle with old method : 0.14024806022644043 time for calcul the mask position with numpy : 0.02987194061279297 nb_pixel_total : 103977 time to create 1 rle with old method : 0.1135401725769043 time for calcul the mask position with numpy : 0.0276641845703125 nb_pixel_total : 65661 time to create 1 rle with old method : 0.0707554817199707 time for calcul the mask position with numpy : 0.02776193618774414 nb_pixel_total : 18681 time to create 1 rle with old method : 0.0199587345123291 time for calcul the mask position with numpy : 0.027769804000854492 nb_pixel_total : 27351 time to create 1 rle with old method : 0.029219627380371094 time for calcul the mask position with numpy : 0.028304338455200195 nb_pixel_total : 69317 time to create 1 rle with old method : 0.07425355911254883 time for calcul the mask position with numpy : 0.02791309356689453 nb_pixel_total : 47010 time to create 1 rle with old method : 0.050905466079711914 time for calcul the mask position with numpy : 0.02901482582092285 nb_pixel_total : 33133 time to create 1 rle with old method : 0.03713726997375488 time for calcul the mask position with numpy : 0.02895975112915039 nb_pixel_total : 37169 time to create 1 rle with old method : 0.041778564453125 time for calcul the mask position with numpy : 0.029224157333374023 nb_pixel_total : 82330 time to create 1 rle with old method : 0.11578798294067383 time for calcul the mask position with numpy : 0.02862095832824707 nb_pixel_total : 80530 time to create 1 rle with old method : 0.08694767951965332 time for calcul the mask position with numpy : 0.029230594635009766 nb_pixel_total : 243837 time to create 1 rle with new method : 0.7621438503265381 time for calcul the mask position with numpy : 0.028593778610229492 nb_pixel_total : 48603 time to create 1 rle with old method : 0.053691864013671875 time for calcul the mask position with numpy : 0.02864980697631836 nb_pixel_total : 65859 time to create 1 rle with old method : 0.07193303108215332 time for calcul the mask position with numpy : 0.028517484664916992 nb_pixel_total : 40325 time to create 1 rle with old method : 0.0445103645324707 time for calcul the mask position with numpy : 0.029407024383544922 nb_pixel_total : 82498 time to create 1 rle with old method : 0.09048080444335938 time for calcul the mask position with numpy : 0.035427093505859375 nb_pixel_total : 23286 time to create 1 rle with old method : 0.024979829788208008 time for calcul the mask position with numpy : 0.027837276458740234 nb_pixel_total : 102364 time to create 1 rle with old method : 0.11074709892272949 time for calcul the mask position with numpy : 0.03173041343688965 nb_pixel_total : 21335 time to create 1 rle with old method : 0.02606678009033203 time for calcul the mask position with numpy : 0.031239986419677734 nb_pixel_total : 42671 time to create 1 rle with old method : 0.049951791763305664 time for calcul the mask position with numpy : 0.028444766998291016 nb_pixel_total : 92513 time to create 1 rle with old method : 0.127211332321167 time for calcul the mask position with numpy : 0.02995467185974121 nb_pixel_total : 27189 time to create 1 rle with old method : 0.029936552047729492 time for calcul the mask position with numpy : 0.029538631439208984 nb_pixel_total : 15486 time to create 1 rle with old method : 0.017778873443603516 create new chi : 6.677148103713989 time to delete rle : 0.0031664371490478516 batch 1 Loaded 63 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 24433 TO DO : save crop sub photo not yet done ! save time : 15.577377319335938 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 5.270555734634399 time for calcul the mask position with numpy : 1.1131739616394043 nb_pixel_total : 6606526 time to create 1 rle with new method : 1.2192578315734863 time for calcul the mask position with numpy : 0.02447795867919922 nb_pixel_total : 49331 time to create 1 rle with old method : 0.07967114448547363 time for calcul the mask position with numpy : 0.024360179901123047 nb_pixel_total : 16105 time to create 1 rle with old method : 0.02634906768798828 time for calcul the mask position with numpy : 0.025356292724609375 nb_pixel_total : 44656 time to create 1 rle with old method : 0.050005435943603516 time for calcul the mask position with numpy : 0.029793739318847656 nb_pixel_total : 125993 time to create 1 rle with old method : 0.13977265357971191 time for calcul the mask position with numpy : 0.0345761775970459 nb_pixel_total : 207629 time to create 1 rle with new method : 0.7954094409942627 create new chi : 3.6278107166290283 time to delete rle : 0.0008020401000976562 batch 1 Loaded 11 chid ids of type : 3594 ++++++Number RLEs to save : 5968 TO DO : save crop sub photo not yet done ! save time : 0.8802468776702881 nb_obj : 6 nb_hashtags : 3 time to prepare the origin masks : 6.006304979324341 time for calcul the mask position with numpy : 0.6505396366119385 nb_pixel_total : 6795875 time to create 1 rle with new method : 0.6382884979248047 time for calcul the mask position with numpy : 0.020694732666015625 nb_pixel_total : 9390 time to create 1 rle with old method : 0.010307550430297852 time for calcul the mask position with numpy : 0.02110743522644043 nb_pixel_total : 88973 time to create 1 rle with old method : 0.09777355194091797 time for calcul the mask position with numpy : 0.022525787353515625 nb_pixel_total : 80606 time to create 1 rle with old method : 0.1085362434387207 time for calcul the mask position with numpy : 0.025510072708129883 nb_pixel_total : 3946 time to create 1 rle with old method : 0.004474639892578125 time for calcul the mask position with numpy : 0.023948192596435547 nb_pixel_total : 47876 time to create 1 rle with old method : 0.05486750602722168 time for calcul the mask position with numpy : 0.021314620971679688 nb_pixel_total : 23574 time to create 1 rle with old method : 0.026093482971191406 create new chi : 1.7646842002868652 time to delete rle : 0.0006575584411621094 batch 1 Loaded 13 chid ids of type : 3594 +++++++Number RLEs to save : 4842 TO DO : save crop sub photo not yet done ! save time : 0.9401466846466064 nb_obj : 13 nb_hashtags : 2 time to prepare the origin masks : 9.390228271484375 time for calcul the mask position with numpy : 1.6783733367919922 nb_pixel_total : 6781715 time to create 1 rle with new method : 1.4707696437835693 time for calcul the mask position with numpy : 0.035567522048950195 nb_pixel_total : 51953 time to create 1 rle with old method : 0.057338714599609375 time for calcul the mask position with numpy : 0.03600454330444336 nb_pixel_total : 16744 time to create 1 rle with old method : 0.01822662353515625 time for calcul the mask position with numpy : 0.03423357009887695 nb_pixel_total : 11394 time to create 1 rle with old method : 0.0124053955078125 time for calcul the mask position with numpy : 0.034332990646362305 nb_pixel_total : 8709 time to create 1 rle with old method : 0.009939193725585938 time for calcul the mask position with numpy : 0.03473687171936035 nb_pixel_total : 20520 time to create 1 rle with old method : 0.022796154022216797 time for calcul the mask position with numpy : 0.03457951545715332 nb_pixel_total : 11245 time to create 1 rle with old method : 0.012539863586425781 time for calcul the mask position with numpy : 0.03439664840698242 nb_pixel_total : 8124 time to create 1 rle with old method : 0.009073019027709961 time for calcul the mask position with numpy : 0.03363466262817383 nb_pixel_total : 3213 time to create 1 rle with old method : 0.0036690235137939453 time for calcul the mask position with numpy : 0.03320670127868652 nb_pixel_total : 23258 time to create 1 rle with old method : 0.025400161743164062 time for calcul the mask position with numpy : 0.03174090385437012 nb_pixel_total : 14589 time to create 1 rle with old method : 0.0162811279296875 time for calcul the mask position with numpy : 0.03482985496520996 nb_pixel_total : 11949 time to create 1 rle with old method : 0.013109683990478516 time for calcul the mask position with numpy : 0.035979509353637695 nb_pixel_total : 56824 time to create 1 rle with old method : 0.06648039817810059 time for calcul the mask position with numpy : 0.04596424102783203 nb_pixel_total : 30003 time to create 1 rle with old method : 0.03420615196228027 create new chi : 3.9508578777313232 time to delete rle : 0.0017466545104980469 batch 1 Loaded 27 chid ids of type : 3594 ++++++++++++++++++Number RLEs to save : 6697 TO DO : save crop sub photo not yet done ! save time : 1.8875975608825684 nb_obj : 19 nb_hashtags : 3 time to prepare the origin masks : 13.788968324661255 time for calcul the mask position with numpy : 0.49422335624694824 nb_pixel_total : 4038840 time to create 1 rle with new method : 0.6696844100952148 time for calcul the mask position with numpy : 0.037450551986694336 nb_pixel_total : 56305 time to create 1 rle with old method : 0.0701749324798584 time for calcul the mask position with numpy : 0.03860926628112793 nb_pixel_total : 117233 time to create 1 rle with old method : 0.13866019248962402 time for calcul the mask position with numpy : 0.043042898178100586 nb_pixel_total : 321159 time to create 1 rle with new method : 1.1538803577423096 time for calcul the mask position with numpy : 0.034332990646362305 nb_pixel_total : 5334 time to create 1 rle with old method : 0.006046772003173828 time for calcul the mask position with numpy : 0.03450202941894531 nb_pixel_total : 12849 time to create 1 rle with old method : 0.014429092407226562 time for calcul the mask position with numpy : 0.03544783592224121 nb_pixel_total : 91559 time to create 1 rle with old method : 0.10290312767028809 time for calcul the mask position with numpy : 0.03561139106750488 nb_pixel_total : 76731 time to create 1 rle with old method : 0.0965580940246582 time for calcul the mask position with numpy : 0.03929471969604492 nb_pixel_total : 75502 time to create 1 rle with old method : 0.0925743579864502 time for calcul the mask position with numpy : 0.035223960876464844 nb_pixel_total : 118086 time to create 1 rle with old method : 0.1390368938446045 time for calcul the mask position with numpy : 0.04855012893676758 nb_pixel_total : 285009 time to create 1 rle with new method : 1.3113970756530762 time for calcul the mask position with numpy : 0.03604316711425781 nb_pixel_total : 20063 time to create 1 rle with old method : 0.022194862365722656 time for calcul the mask position with numpy : 0.034445762634277344 nb_pixel_total : 34515 time to create 1 rle with old method : 0.03720450401306152 time for calcul the mask position with numpy : 0.02924823760986328 nb_pixel_total : 19651 time to create 1 rle with old method : 0.021399736404418945 time for calcul the mask position with numpy : 0.030016183853149414 nb_pixel_total : 26892 time to create 1 rle with old method : 0.029503583908081055 time for calcul the mask position with numpy : 0.029849767684936523 nb_pixel_total : 14899 time to create 1 rle with old method : 0.016629934310913086 time for calcul the mask position with numpy : 0.054520606994628906 nb_pixel_total : 1425852 time to create 1 rle with new method : 0.6235752105712891 time for calcul the mask position with numpy : 0.02164483070373535 nb_pixel_total : 27423 time to create 1 rle with old method : 0.030101537704467773 time for calcul the mask position with numpy : 0.021512269973754883 nb_pixel_total : 42212 time to create 1 rle with old method : 0.045624494552612305 time for calcul the mask position with numpy : 0.023595094680786133 nb_pixel_total : 240126 time to create 1 rle with new method : 1.0654973983764648 create new chi : 7.018420696258545 time to delete rle : 0.0070798397064208984 batch 1 Loaded 39 chid ids of type : 3594 ++++++++++++++++++++++++++++Number RLEs to save : 17928 TO DO : save crop sub photo not yet done ! save time : 3.0527305603027344 nb_obj : 23 nb_hashtags : 6 time to prepare the origin masks : 8.022651195526123 time for calcul the mask position with numpy : 0.20008301734924316 nb_pixel_total : 4942507 time to create 1 rle with new method : 0.2924385070800781 time for calcul the mask position with numpy : 0.05074882507324219 nb_pixel_total : 72619 time to create 1 rle with old method : 0.08008146286010742 time for calcul the mask position with numpy : 0.052778005599975586 nb_pixel_total : 498923 time to create 1 rle with new method : 0.6405143737792969 time for calcul the mask position with numpy : 0.043295860290527344 nb_pixel_total : 20671 time to create 1 rle with old method : 0.025826454162597656 time for calcul the mask position with numpy : 0.039780616760253906 nb_pixel_total : 263040 time to create 1 rle with new method : 0.5139346122741699 time for calcul the mask position with numpy : 0.02592635154724121 nb_pixel_total : 26732 time to create 1 rle with old method : 0.03701376914978027 time for calcul the mask position with numpy : 0.022821426391601562 nb_pixel_total : 65129 time to create 1 rle with old method : 0.07291841506958008 time for calcul the mask position with numpy : 0.030387163162231445 nb_pixel_total : 25003 time to create 1 rle with old method : 0.02944016456604004 time for calcul the mask position with numpy : 0.02931976318359375 nb_pixel_total : 4546 time to create 1 rle with old method : 0.005415678024291992 time for calcul the mask position with numpy : 0.030919790267944336 nb_pixel_total : 24143 time to create 1 rle with old method : 0.028069257736206055 time for calcul the mask position with numpy : 0.029878854751586914 nb_pixel_total : 7332 time to create 1 rle with old method : 0.008381843566894531 time for calcul the mask position with numpy : 0.03435254096984863 nb_pixel_total : 43641 time to create 1 rle with old method : 0.059960126876831055 time for calcul the mask position with numpy : 0.03609609603881836 nb_pixel_total : 406958 time to create 1 rle with new method : 0.4455423355102539 time for calcul the mask position with numpy : 0.028614521026611328 nb_pixel_total : 65477 time to create 1 rle with old method : 0.07319068908691406 time for calcul the mask position with numpy : 0.03506875038146973 nb_pixel_total : 8587 time to create 1 rle with old method : 0.009510278701782227 time for calcul the mask position with numpy : 0.034632205963134766 nb_pixel_total : 21627 time to create 1 rle with old method : 0.023823261260986328 time for calcul the mask position with numpy : 0.034576416015625 nb_pixel_total : 10932 time to create 1 rle with old method : 0.01201772689819336 time for calcul the mask position with numpy : 0.03341484069824219 nb_pixel_total : 50959 time to create 1 rle with old method : 0.05712151527404785 time for calcul the mask position with numpy : 0.04254555702209473 nb_pixel_total : 96798 time to create 1 rle with old method : 0.10749149322509766 time for calcul the mask position with numpy : 0.04067420959472656 nb_pixel_total : 33683 time to create 1 rle with old method : 0.03870582580566406 time for calcul the mask position with numpy : 0.04097867012023926 nb_pixel_total : 39719 time to create 1 rle with old method : 0.04356050491333008 time for calcul the mask position with numpy : 0.03300189971923828 nb_pixel_total : 50817 time to create 1 rle with old method : 0.05631566047668457 time for calcul the mask position with numpy : 0.03533625602722168 nb_pixel_total : 36190 time to create 1 rle with old method : 0.04459643363952637 time for calcul the mask position with numpy : 0.02816009521484375 nb_pixel_total : 234207 time to create 1 rle with new method : 1.5176193714141846 create new chi : 5.376280069351196 time to delete rle : 0.0036890506744384766 batch 1 Loaded 47 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++Number RLEs to save : 19072 TO DO : save crop sub photo not yet done ! save time : 1.4141061305999756 nb_obj : 14 nb_hashtags : 3 time to prepare the origin masks : 6.708509922027588 time for calcul the mask position with numpy : 0.2500145435333252 nb_pixel_total : 5893228 time to create 1 rle with new method : 0.6591331958770752 time for calcul the mask position with numpy : 0.02113485336303711 nb_pixel_total : 10920 time to create 1 rle with old method : 0.012082338333129883 time for calcul the mask position with numpy : 0.023149967193603516 nb_pixel_total : 185823 time to create 1 rle with new method : 0.30211377143859863 time for calcul the mask position with numpy : 0.024605751037597656 nb_pixel_total : 222744 time to create 1 rle with new method : 0.356731653213501 time for calcul the mask position with numpy : 0.03810000419616699 nb_pixel_total : 89747 time to create 1 rle with old method : 0.10116457939147949 time for calcul the mask position with numpy : 0.03990364074707031 nb_pixel_total : 104051 time to create 1 rle with old method : 0.12110090255737305 time for calcul the mask position with numpy : 0.039089202880859375 nb_pixel_total : 222749 time to create 1 rle with new method : 0.4091978073120117 time for calcul the mask position with numpy : 0.038752079010009766 nb_pixel_total : 196776 time to create 1 rle with new method : 0.5789413452148438 time for calcul the mask position with numpy : 0.037163496017456055 nb_pixel_total : 8089 time to create 1 rle with old method : 0.009229421615600586 time for calcul the mask position with numpy : 0.035436153411865234 nb_pixel_total : 3709 time to create 1 rle with old method : 0.0042955875396728516 time for calcul the mask position with numpy : 0.03516530990600586 nb_pixel_total : 50855 time to create 1 rle with old method : 0.0566706657409668 time for calcul the mask position with numpy : 0.03985452651977539 nb_pixel_total : 8219 time to create 1 rle with old method : 0.009405851364135742 time for calcul the mask position with numpy : 0.025184154510498047 nb_pixel_total : 10158 time to create 1 rle with old method : 0.011641740798950195 time for calcul the mask position with numpy : 0.03497719764709473 nb_pixel_total : 20895 time to create 1 rle with old method : 0.023406982421875 time for calcul the mask position with numpy : 0.03680825233459473 nb_pixel_total : 22277 time to create 1 rle with old method : 0.0252382755279541 create new chi : 3.5298051834106445 time to delete rle : 0.0032596588134765625 batch 1 Loaded 29 chid ids of type : 3594 ++++++++++++++++Number RLEs to save : 11218 TO DO : save crop sub photo not yet done ! save time : 2.7620513439178467 nb_obj : 15 nb_hashtags : 4 time to prepare the origin masks : 10.69626259803772 time for calcul the mask position with numpy : 0.5731668472290039 nb_pixel_total : 5598862 time to create 1 rle with new method : 0.9610860347747803 time for calcul the mask position with numpy : 0.024157285690307617 nb_pixel_total : 334816 time to create 1 rle with new method : 0.7474672794342041 time for calcul the mask position with numpy : 0.022845983505249023 nb_pixel_total : 144005 time to create 1 rle with old method : 0.1578810214996338 time for calcul the mask position with numpy : 0.021996021270751953 nb_pixel_total : 40056 time to create 1 rle with old method : 0.04298806190490723 time for calcul the mask position with numpy : 0.02048015594482422 nb_pixel_total : 7915 time to create 1 rle with old method : 0.008585929870605469 time for calcul the mask position with numpy : 0.020771265029907227 nb_pixel_total : 80512 time to create 1 rle with old method : 0.09723830223083496 time for calcul the mask position with numpy : 0.020857810974121094 nb_pixel_total : 9878 time to create 1 rle with old method : 0.010802507400512695 time for calcul the mask position with numpy : 0.027482986450195312 nb_pixel_total : 457942 time to create 1 rle with new method : 0.6036348342895508 time for calcul the mask position with numpy : 0.0298917293548584 nb_pixel_total : 75599 time to create 1 rle with old method : 0.10006213188171387 time for calcul the mask position with numpy : 0.038312435150146484 nb_pixel_total : 43837 time to create 1 rle with old method : 0.04734206199645996 time for calcul the mask position with numpy : 0.03343057632446289 nb_pixel_total : 101222 time to create 1 rle with old method : 0.10845017433166504 time for calcul the mask position with numpy : 0.03381705284118652 nb_pixel_total : 13813 time to create 1 rle with old method : 0.014901161193847656 time for calcul the mask position with numpy : 0.034166812896728516 nb_pixel_total : 46840 time to create 1 rle with old method : 0.05140209197998047 time for calcul the mask position with numpy : 0.021454572677612305 nb_pixel_total : 75410 time to create 1 rle with old method : 0.08334493637084961 time for calcul the mask position with numpy : 0.020858049392700195 nb_pixel_total : 16145 time to create 1 rle with old method : 0.017283201217651367 time for calcul the mask position with numpy : 0.020437002182006836 nb_pixel_total : 3388 time to create 1 rle with old method : 0.003837108612060547 create new chi : 4.102787733078003 time to delete rle : 0.0018384456634521484 batch 1 Loaded 31 chid ids of type : 3594 ++++++++++++++++Number RLEs to save : 12444 TO DO : save crop sub photo not yet done ! save time : 4.7632155418396 nb_obj : 24 nb_hashtags : 4 time to prepare the origin masks : 14.6045560836792 time for calcul the mask position with numpy : 0.8629922866821289 nb_pixel_total : 5639491 time to create 1 rle with new method : 1.5688555240631104 time for calcul the mask position with numpy : 0.03525495529174805 nb_pixel_total : 49851 time to create 1 rle with old method : 0.06081676483154297 time for calcul the mask position with numpy : 0.028669118881225586 nb_pixel_total : 8159 time to create 1 rle with old method : 0.008849859237670898 time for calcul the mask position with numpy : 0.029235124588012695 nb_pixel_total : 115833 time to create 1 rle with old method : 0.12471866607666016 time for calcul the mask position with numpy : 0.022097110748291016 nb_pixel_total : 9199 time to create 1 rle with old method : 0.010309934616088867 time for calcul the mask position with numpy : 0.02266836166381836 nb_pixel_total : 25650 time to create 1 rle with old method : 0.027442455291748047 time for calcul the mask position with numpy : 0.020505666732788086 nb_pixel_total : 44117 time to create 1 rle with old method : 0.04782390594482422 time for calcul the mask position with numpy : 0.021604299545288086 nb_pixel_total : 22925 time to create 1 rle with old method : 0.024413585662841797 time for calcul the mask position with numpy : 0.020581722259521484 nb_pixel_total : 12001 time to create 1 rle with old method : 0.013435602188110352 time for calcul the mask position with numpy : 0.020816802978515625 nb_pixel_total : 65741 time to create 1 rle with old method : 0.07661771774291992 time for calcul the mask position with numpy : 0.021111011505126953 nb_pixel_total : 11451 time to create 1 rle with old method : 0.012625932693481445 time for calcul the mask position with numpy : 0.01997661590576172 nb_pixel_total : 14314 time to create 1 rle with old method : 0.0160369873046875 time for calcul the mask position with numpy : 0.02138829231262207 nb_pixel_total : 7096 time to create 1 rle with old method : 0.0076329708099365234 time for calcul the mask position with numpy : 0.021715164184570312 nb_pixel_total : 153736 time to create 1 rle with new method : 1.1188502311706543 time for calcul the mask position with numpy : 0.02096271514892578 nb_pixel_total : 91403 time to create 1 rle with old method : 0.09979104995727539 time for calcul the mask position with numpy : 0.029783248901367188 nb_pixel_total : 37699 time to create 1 rle with old method : 0.04161238670349121 time for calcul the mask position with numpy : 0.03367257118225098 nb_pixel_total : 46478 time to create 1 rle with old method : 0.05059313774108887 time for calcul the mask position with numpy : 0.03345775604248047 nb_pixel_total : 12498 time to create 1 rle with old method : 0.013370275497436523 time for calcul the mask position with numpy : 0.03447604179382324 nb_pixel_total : 9916 time to create 1 rle with old method : 0.01083827018737793 time for calcul the mask position with numpy : 0.03338003158569336 nb_pixel_total : 90069 time to create 1 rle with old method : 0.12026071548461914 time for calcul the mask position with numpy : 0.033234357833862305 nb_pixel_total : 169031 time to create 1 rle with new method : 0.7991650104522705 time for calcul the mask position with numpy : 0.028280019760131836 nb_pixel_total : 109634 time to create 1 rle with old method : 0.11293339729309082 time for calcul the mask position with numpy : 0.020252466201782227 nb_pixel_total : 27018 time to create 1 rle with old method : 0.028943300247192383 time for calcul the mask position with numpy : 0.020040035247802734 nb_pixel_total : 174621 time to create 1 rle with new method : 1.276268482208252 time for calcul the mask position with numpy : 0.021157264709472656 nb_pixel_total : 102309 time to create 1 rle with old method : 0.10746049880981445 create new chi : 7.367846250534058 time to delete rle : 0.0024018287658691406 batch 1 Loaded 49 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 16799 TO DO : save crop sub photo not yet done ! save time : 5.1577839851379395 nb_obj : 13 nb_hashtags : 3 time to prepare the origin masks : 15.876880884170532 time for calcul the mask position with numpy : 0.7183101177215576 nb_pixel_total : 6224380 time to create 1 rle with new method : 1.132467269897461 time for calcul the mask position with numpy : 0.02503824234008789 nb_pixel_total : 16477 time to create 1 rle with old method : 0.018609046936035156 time for calcul the mask position with numpy : 0.020816564559936523 nb_pixel_total : 57288 time to create 1 rle with old method : 0.06466460227966309 time for calcul the mask position with numpy : 0.020548582077026367 nb_pixel_total : 6755 time to create 1 rle with old method : 0.007467746734619141 time for calcul the mask position with numpy : 0.021272659301757812 nb_pixel_total : 50321 time to create 1 rle with old method : 0.05608654022216797 time for calcul the mask position with numpy : 0.021589040756225586 nb_pixel_total : 20887 time to create 1 rle with old method : 0.023226022720336914 time for calcul the mask position with numpy : 0.02550196647644043 nb_pixel_total : 151818 time to create 1 rle with new method : 1.7970004081726074 time for calcul the mask position with numpy : 0.036032915115356445 nb_pixel_total : 52264 time to create 1 rle with old method : 0.18089985847473145 time for calcul the mask position with numpy : 0.03494405746459961 nb_pixel_total : 178976 time to create 1 rle with new method : 0.8312108516693115 time for calcul the mask position with numpy : 0.0335688591003418 nb_pixel_total : 46808 time to create 1 rle with old method : 0.05126810073852539 time for calcul the mask position with numpy : 0.03226065635681152 nb_pixel_total : 161266 time to create 1 rle with new method : 0.6475133895874023 time for calcul the mask position with numpy : 0.03481554985046387 nb_pixel_total : 9807 time to create 1 rle with old method : 0.011013031005859375 time for calcul the mask position with numpy : 0.03308701515197754 nb_pixel_total : 51316 time to create 1 rle with old method : 0.05609846115112305 time for calcul the mask position with numpy : 0.03890490531921387 nb_pixel_total : 21877 time to create 1 rle with old method : 0.024442195892333984 create new chi : 6.112760066986084 time to delete rle : 0.0029320716857910156 batch 1 Loaded 27 chid ids of type : 3594 +++++++++++++++++Number RLEs to save : 10729 TO DO : save crop sub photo not yet done ! save time : 7.988911867141724 map_output_result : {1351145984: (0.0, 'Should be the crop_list due to order', 0), 1351145980: (0.0, 'Should be the crop_list due to order', 0), 1351145976: (0.0, 'Should be the crop_list due to order', 0), 1351145908: (0.0, 'Should be the crop_list due to order', 0), 1351145902: (0.0, 'Should be the crop_list due to order', 0), 1351145862: (0.0, 'Should be the crop_list due to order', 0), 1351145861: (0.0, 'Should be the crop_list due to order', 0), 1351145793: (0.0, 'Should be the crop_list due to order', 0), 1351145763: (0.0, 'Should be the crop_list due to order', 0), 1351145750: (0.0, 'Should be the crop_list due to order', 0), 1351145722: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1351145984, 1351145980, 1351145976, 1351145908, 1351145902, 1351145862, 1351145861, 1351145793, 1351145763, 1351145750, 1351145722] Looping around the photos to save general results len do output : 11 /1351145984.Didn't retrieve data . /1351145980.Didn't retrieve data . /1351145976.Didn't retrieve data . /1351145908.Didn't retrieve data . /1351145902.Didn't retrieve data . /1351145862.Didn't retrieve data . /1351145861.Didn't retrieve data . /1351145793.Didn't retrieve data . /1351145763.Didn't retrieve data . /1351145750.Didn't retrieve data . /1351145722.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2740447') ('3318', '22234353', '1351145984', None, None, None, None, None, '2740447') ('3318', None, None, None, None, None, None, None, '2740447') ('3318', '22234353', '1351145980', None, None, None, None, None, '2740447') ('3318', None, None, None, None, None, None, None, '2740447') ('3318', '22234353', '1351145976', None, None, None, None, None, '2740447') ('3318', None, None, None, None, None, None, None, '2740447') ('3318', '22234353', '1351145908', None, None, None, None, None, '2740447') ('3318', None, None, None, None, None, None, None, '2740447') ('3318', '22234353', '1351145902', None, None, None, None, None, '2740447') ('3318', None, None, None, None, None, None, None, '2740447') ('3318', '22234353', '1351145862', None, None, None, None, None, '2740447') ('3318', None, None, None, None, None, None, None, '2740447') ('3318', '22234353', '1351145861', None, None, None, None, None, '2740447') ('3318', None, None, None, None, None, None, None, '2740447') ('3318', '22234353', '1351145793', None, None, None, None, None, '2740447') ('3318', None, None, None, None, None, None, None, '2740447') ('3318', '22234353', '1351145763', None, None, None, None, None, '2740447') ('3318', None, None, None, None, None, None, None, '2740447') ('3318', '22234353', '1351145750', None, None, None, None, None, '2740447') ('3318', None, None, None, None, None, None, None, '2740447') ('3318', '22234353', '1351145722', None, None, None, None, None, '2740447') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 33 time used for this insertion : 0.10904741287231445 save_final save missing photos in datou_result : time spend for datou_step_exec : 209.85724925994873 time spend to save output : 0.13974905014038086 total time spend for step 3 : 209.9969983100891 step4:ventilate_hashtags_in_portfolio Thu Apr 10 18:38:24 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 22234353 get user id for portfolio 22234353 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22234353 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','environnement','metal','papier','carton','pehd','pet_fonce','flou','autre','mal_croppe','background')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22234353 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','environnement','metal','papier','carton','pehd','pet_fonce','flou','autre','mal_croppe','background')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22234353 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','environnement','metal','papier','carton','pehd','pet_fonce','flou','autre','mal_croppe','background')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/22238022,22238023,22238024,22238025,22238026,22238027,22238028,22238029,22238030,22238031,22238032?tags=pet_clair,environnement,metal,papier,carton,pehd,pet_fonce,flou,autre,mal_croppe,background Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1351145984, 1351145980, 1351145976, 1351145908, 1351145902, 1351145862, 1351145861, 1351145793, 1351145763, 1351145750, 1351145722] Looping around the photos to save general results len do output : 1 /22234353. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2740447') ('3318', '22234353', '1351145984', None, None, None, None, None, '2740447') ('3318', None, None, None, None, None, None, None, '2740447') ('3318', '22234353', '1351145980', None, None, None, None, None, '2740447') ('3318', None, None, None, None, None, None, None, '2740447') ('3318', '22234353', '1351145976', None, None, None, None, None, '2740447') ('3318', None, None, None, None, None, None, None, '2740447') ('3318', '22234353', '1351145908', None, None, None, None, None, '2740447') ('3318', None, None, None, None, None, None, None, '2740447') ('3318', '22234353', '1351145902', None, None, None, None, None, '2740447') ('3318', None, None, None, None, None, None, None, '2740447') ('3318', '22234353', '1351145862', None, None, None, None, None, '2740447') ('3318', None, None, None, None, None, None, None, '2740447') ('3318', '22234353', '1351145861', None, None, None, None, None, '2740447') ('3318', None, None, None, None, None, None, None, '2740447') ('3318', '22234353', '1351145793', None, None, None, None, None, '2740447') ('3318', None, None, None, None, None, None, None, '2740447') ('3318', '22234353', '1351145763', None, None, None, None, None, '2740447') ('3318', None, None, None, None, None, None, None, '2740447') ('3318', '22234353', '1351145750', None, None, None, None, None, '2740447') ('3318', None, None, None, None, None, None, None, '2740447') ('3318', '22234353', '1351145722', None, None, None, None, None, '2740447') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.016126632690429688 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.4927711486816406 time spend to save output : 0.016399860382080078 total time spend for step 4 : 2.5091710090637207 step5:final Thu Apr 10 18:38:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1351145984: ('0.17680694042137057',), 1351145980: ('0.17680694042137057',), 1351145976: ('0.17680694042137057',), 1351145908: ('0.17680694042137057',), 1351145902: ('0.17680694042137057',), 1351145862: ('0.17680694042137057',), 1351145861: ('0.17680694042137057',), 1351145793: ('0.17680694042137057',), 1351145763: ('0.17680694042137057',), 1351145750: ('0.17680694042137057',), 1351145722: ('0.17680694042137057',)} new output for save of step final : {1351145984: ('0.17680694042137057',), 1351145980: ('0.17680694042137057',), 1351145976: ('0.17680694042137057',), 1351145908: ('0.17680694042137057',), 1351145902: ('0.17680694042137057',), 1351145862: ('0.17680694042137057',), 1351145861: ('0.17680694042137057',), 1351145793: ('0.17680694042137057',), 1351145763: ('0.17680694042137057',), 1351145750: ('0.17680694042137057',), 1351145722: ('0.17680694042137057',)} [1351145984, 1351145980, 1351145976, 1351145908, 1351145902, 1351145862, 1351145861, 1351145793, 1351145763, 1351145750, 1351145722] Looping around the photos to save general results len do output : 11 /1351145984.Didn't retrieve data . /1351145980.Didn't retrieve data . /1351145976.Didn't retrieve data . /1351145908.Didn't retrieve data . /1351145902.Didn't retrieve data . /1351145862.Didn't retrieve data . /1351145861.Didn't retrieve data . /1351145793.Didn't retrieve data . /1351145763.Didn't retrieve data . /1351145750.Didn't retrieve data . /1351145722.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2740447') ('3318', '22234353', '1351145984', None, None, None, None, None, '2740447') ('3318', None, None, None, None, None, None, None, '2740447') ('3318', '22234353', '1351145980', None, None, None, None, None, '2740447') ('3318', None, None, None, None, None, None, None, '2740447') ('3318', '22234353', '1351145976', None, None, None, None, None, '2740447') ('3318', None, None, None, None, None, None, None, '2740447') ('3318', '22234353', '1351145908', None, None, None, None, None, '2740447') ('3318', None, None, None, None, None, None, None, '2740447') ('3318', '22234353', '1351145902', None, None, None, None, None, '2740447') ('3318', None, None, None, None, None, None, None, '2740447') ('3318', '22234353', '1351145862', None, None, None, None, None, '2740447') ('3318', None, None, None, None, None, None, None, '2740447') ('3318', '22234353', '1351145861', None, None, None, None, None, '2740447') ('3318', None, None, None, None, None, None, None, '2740447') ('3318', '22234353', '1351145793', None, None, None, None, None, '2740447') ('3318', None, None, None, None, None, None, None, '2740447') ('3318', '22234353', '1351145763', None, None, None, None, None, '2740447') ('3318', None, None, None, None, None, None, None, '2740447') ('3318', '22234353', '1351145750', None, None, None, None, None, '2740447') ('3318', None, None, None, None, None, None, None, '2740447') ('3318', '22234353', '1351145722', None, None, None, None, None, '2740447') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 33 time used for this insertion : 0.01503896713256836 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.13359689712524414 time spend to save output : 0.01651310920715332 total time spend for step 5 : 0.15011000633239746 step6:blur_detection Thu Apr 10 18:38:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1744302628_3695433_1351145984_4cc0f4d9ef86d6b444b5c4471bcf4949.jpg resize: (2160, 3264) 1351145984 -1.6337287684008177 treat image : temp/1744302628_3695433_1351145980_25795b3f029d359068c3703b7e078978.jpg resize: (2160, 3264) 1351145980 1.5039794780594613 treat image : temp/1744302628_3695433_1351145976_aa365a1eda9297a714ab8a8882ffda95.jpg resize: (2160, 3264) 1351145976 -1.0432699462453783 treat image : temp/1744302628_3695433_1351145908_dd7be5ead819c8ff7956dc502f8d8485.jpg resize: (2160, 3264) 1351145908 -2.502746486821379 treat image : temp/1744302628_3695433_1351145902_f563c6ea1449b65fce95ae1203413ca6.jpg resize: (2160, 3264) 1351145902 -2.0880606406482376 treat image : temp/1744302628_3695433_1351145862_dd70eab5e5317a6e660e987bad7e0f59.jpg resize: (2160, 3264) 1351145862 -2.290152070834345 treat image : temp/1744302628_3695433_1351145861_b6d7311023248fe789aeef9c9de0249c.jpg resize: (2160, 3264) 1351145861 -0.9572716905787549 treat image : temp/1744302628_3695433_1351145793_33ec04364475c856d88c73399dfa6799.jpg resize: (2160, 3264) 1351145793 -1.7456070982875906 treat image : temp/1744302628_3695433_1351145763_2a340e9757b6c23825140dfd1fba4353.jpg resize: (2160, 3264) 1351145763 -3.513213636133436 treat image : temp/1744302628_3695433_1351145750_f1ceb8dd76aefbc23a9d2a8c1d8a5637.jpg resize: (2160, 3264) 1351145750 -5.667709921840222 treat image : temp/1744302628_3695433_1351145722_a27f0f368c3d226ac3ed087c137714ef.jpg resize: (2160, 3264) 1351145722 -3.7865297979654953 treat image : temp/1744302628_3695433_1351145984_4cc0f4d9ef86d6b444b5c4471bcf4949_rle_crop_3754567825_0.png resize: (212, 196) 1351252070 -1.2752959664971157 treat image : temp/1744302628_3695433_1351145984_4cc0f4d9ef86d6b444b5c4471bcf4949_rle_crop_3754567827_0.png resize: (150, 132) 1351252071 -0.4026181306722218 treat image : temp/1744302628_3695433_1351145984_4cc0f4d9ef86d6b444b5c4471bcf4949_rle_crop_3754567828_0.png resize: (194, 287) 1351252072 -1.5428247977329972 treat image : temp/1744302628_3695433_1351145984_4cc0f4d9ef86d6b444b5c4471bcf4949_rle_crop_3754567829_0.png resize: (224, 192) 1351252073 -0.8684075677824415 treat image : temp/1744302628_3695433_1351145984_4cc0f4d9ef86d6b444b5c4471bcf4949_rle_crop_3754567830_0.png resize: (200, 280) 1351252074 -2.642230860343433 treat image : temp/1744302628_3695433_1351145984_4cc0f4d9ef86d6b444b5c4471bcf4949_rle_crop_3754567832_0.png resize: (154, 175) 1351252075 2.5286877074869043 treat image : temp/1744302628_3695433_1351145984_4cc0f4d9ef86d6b444b5c4471bcf4949_rle_crop_3754567833_0.png resize: (231, 283) 1351252076 -1.208983792651573 treat image : temp/1744302628_3695433_1351145984_4cc0f4d9ef86d6b444b5c4471bcf4949_rle_crop_3754567834_0.png resize: (389, 298) 1351252077 -1.595788248144131 treat image : temp/1744302628_3695433_1351145984_4cc0f4d9ef86d6b444b5c4471bcf4949_rle_crop_3754567835_0.png resize: (366, 189) 1351252078 -2.98195558589232 treat image : temp/1744302628_3695433_1351145980_25795b3f029d359068c3703b7e078978_rle_crop_3754567838_0.png resize: (238, 307) 1351252079 -0.4378433627240046 treat image : temp/1744302628_3695433_1351145980_25795b3f029d359068c3703b7e078978_rle_crop_3754567839_0.png resize: (248, 436) 1351252080 -2.0117875140445953 treat image : temp/1744302628_3695433_1351145980_25795b3f029d359068c3703b7e078978_rle_crop_3754567840_0.png resize: (447, 246) 1351252081 -0.7029396308790817 treat image : temp/1744302628_3695433_1351145980_25795b3f029d359068c3703b7e078978_rle_crop_3754567841_0.png resize: (149, 204) 1351252082 -1.0498487773891234 treat image : temp/1744302628_3695433_1351145980_25795b3f029d359068c3703b7e078978_rle_crop_3754567842_0.png resize: (267, 277) 1351252083 -1.518029956088434 treat image : temp/1744302628_3695433_1351145980_25795b3f029d359068c3703b7e078978_rle_crop_3754567843_0.png resize: (795, 508) 1351252085 -1.294168998231646 treat image : temp/1744302628_3695433_1351145980_25795b3f029d359068c3703b7e078978_rle_crop_3754567846_0.png resize: (299, 203) 1351252086 -0.6653506706935715 treat image : temp/1744302628_3695433_1351145980_25795b3f029d359068c3703b7e078978_rle_crop_3754567848_0.png resize: (640, 396) 1351252087 -2.641135834325598 treat image : temp/1744302628_3695433_1351145980_25795b3f029d359068c3703b7e078978_rle_crop_3754567851_0.png resize: (180, 259) 1351252088 -1.6810615263142317 treat image : temp/1744302628_3695433_1351145980_25795b3f029d359068c3703b7e078978_rle_crop_3754567853_0.png resize: (240, 287) 1351252090 -0.3982485977078783 treat image : temp/1744302628_3695433_1351145980_25795b3f029d359068c3703b7e078978_rle_crop_3754567854_0.png resize: (376, 437) 1351252091 1.1019606085350802 treat image : temp/1744302628_3695433_1351145980_25795b3f029d359068c3703b7e078978_rle_crop_3754567855_0.png resize: (725, 1207) 1351252092 -0.6480782874034394 treat image : temp/1744302628_3695433_1351145980_25795b3f029d359068c3703b7e078978_rle_crop_3754567856_0.png resize: (248, 210) 1351252093 -0.5752520174177562 treat image : temp/1744302628_3695433_1351145980_25795b3f029d359068c3703b7e078978_rle_crop_3754567861_0.png resize: (213, 259) 1351252094 -1.9397238286687004 treat image : temp/1744302628_3695433_1351145980_25795b3f029d359068c3703b7e078978_rle_crop_3754567863_0.png resize: (429, 717) 1351252095 -0.19520682469335837 treat image : temp/1744302628_3695433_1351145980_25795b3f029d359068c3703b7e078978_rle_crop_3754567866_0.png resize: (273, 447) 1351252096 -1.6404117537706546 treat image : temp/1744302628_3695433_1351145980_25795b3f029d359068c3703b7e078978_rle_crop_3754567867_0.png resize: (114, 309) 1351252097 -2.3183864575034248 treat image : temp/1744302628_3695433_1351145976_aa365a1eda9297a714ab8a8882ffda95_rle_crop_3754567868_0.png resize: (334, 797) 1351252098 -2.529653441511733 treat image : temp/1744302628_3695433_1351145976_aa365a1eda9297a714ab8a8882ffda95_rle_crop_3754567870_0.png resize: (273, 561) 1351252099 0.7056067774998767 treat image : temp/1744302628_3695433_1351145976_aa365a1eda9297a714ab8a8882ffda95_rle_crop_3754567871_0.png resize: (181, 160) 1351252100 -1.4340569547388187 treat image : temp/1744302628_3695433_1351145908_dd7be5ead819c8ff7956dc502f8d8485_rle_crop_3754567875_0.png resize: (85, 62) 1351252101 -1.918746576115289 treat image : temp/1744302628_3695433_1351145908_dd7be5ead819c8ff7956dc502f8d8485_rle_crop_3754567877_0.png resize: (322, 463) 1351252102 -2.1304058253661817 treat image : temp/1744302628_3695433_1351145902_f563c6ea1449b65fce95ae1203413ca6_rle_crop_3754567880_0.png resize: (288, 291) 1351252103 -1.1854042253445811 treat image : temp/1744302628_3695433_1351145902_f563c6ea1449b65fce95ae1203413ca6_rle_crop_3754567881_0.png resize: (217, 74) 1351252104 0.1505504007702388 treat image : temp/1744302628_3695433_1351145902_f563c6ea1449b65fce95ae1203413ca6_rle_crop_3754567882_0.png resize: (185, 144) 1351252105 -1.437533305573604 treat image : temp/1744302628_3695433_1351145902_f563c6ea1449b65fce95ae1203413ca6_rle_crop_3754567884_0.png resize: (90, 111) 1351252106 -1.0833956956192035 treat image : temp/1744302628_3695433_1351145902_f563c6ea1449b65fce95ae1203413ca6_rle_crop_3754567885_0.png resize: (111, 87) 1351252107 0.34935295339301425 treat image : temp/1744302628_3695433_1351145902_f563c6ea1449b65fce95ae1203413ca6_rle_crop_3754567886_0.png resize: (95, 152) 1351252108 -0.8786317205672421 treat image : temp/1744302628_3695433_1351145902_f563c6ea1449b65fce95ae1203413ca6_rle_crop_3754567888_0.png resize: (106, 106) 1351252109 2.7972826500180714 treat image : temp/1744302628_3695433_1351145902_f563c6ea1449b65fce95ae1203413ca6_rle_crop_3754567890_0.png resize: (143, 163) 1351252110 -0.47023243022845773 treat image : temp/1744302628_3695433_1351145902_f563c6ea1449b65fce95ae1203413ca6_rle_crop_3754567891_0.png resize: (249, 333) 1351252111 -2.2653480737680654 treat image : temp/1744302628_3695433_1351145862_dd70eab5e5317a6e660e987bad7e0f59_rle_crop_3754567892_0.png resize: (614, 602) 1351252112 -2.54610674841903 treat image : temp/1744302628_3695433_1351145862_dd70eab5e5317a6e660e987bad7e0f59_rle_crop_3754567893_0.png resize: (415, 168) 1351252113 -1.2749263960963497 treat image : temp/1744302628_3695433_1351145862_dd70eab5e5317a6e660e987bad7e0f59_rle_crop_3754567894_0.png resize: (115, 363) 1351252114 -2.8826939544368395 treat image : temp/1744302628_3695433_1351145862_dd70eab5e5317a6e660e987bad7e0f59_rle_crop_3754567895_0.png resize: (1216, 1805) 1351252115 -1.3819137563150705 treat image : temp/1744302628_3695433_1351145862_dd70eab5e5317a6e660e987bad7e0f59_rle_crop_3754567898_0.png resize: (136, 185) 1351252116 -0.29696265958275836 treat image : temp/1744302628_3695433_1351145862_dd70eab5e5317a6e660e987bad7e0f59_rle_crop_3754567900_0.png resize: (156, 162) 1351252117 0.7248127629487066 treat image : temp/1744302628_3695433_1351145862_dd70eab5e5317a6e660e987bad7e0f59_rle_crop_3754567901_0.png resize: (737, 894) 1351252118 -0.875556149836906 treat image : temp/1744302628_3695433_1351145862_dd70eab5e5317a6e660e987bad7e0f59_rle_crop_3754567902_0.png resize: (249, 652) 1351252120 -2.298962931877439 treat image : temp/1744302628_3695433_1351145862_dd70eab5e5317a6e660e987bad7e0f59_rle_crop_3754567903_0.png resize: (455, 319) 1351252122 -3.3198455150933386 treat image : temp/1744302628_3695433_1351145862_dd70eab5e5317a6e660e987bad7e0f59_rle_crop_3754567904_0.png resize: (294, 348) 1351252123 -2.644944144196504 treat image : temp/1744302628_3695433_1351145862_dd70eab5e5317a6e660e987bad7e0f59_rle_crop_3754567905_0.png resize: (384, 432) 1351252124 -1.1520716044300383 treat image : temp/1744302628_3695433_1351145862_dd70eab5e5317a6e660e987bad7e0f59_rle_crop_3754567906_0.png resize: (135, 123) 1351252125 -0.9661042592764298 treat image : temp/1744302628_3695433_1351145862_dd70eab5e5317a6e660e987bad7e0f59_rle_crop_3754567907_0.png resize: (152, 106) 1351252126 -2.834102637603469 treat image : temp/1744302628_3695433_1351145862_dd70eab5e5317a6e660e987bad7e0f59_rle_crop_3754567909_0.png resize: (388, 445) 1351252128 -2.868852729639906 treat image : temp/1744302628_3695433_1351145861_b6d7311023248fe789aeef9c9de0249c_rle_crop_3754567911_0.png resize: (650, 553) 1351252129 -0.454222947135504 treat image : temp/1744302628_3695433_1351145861_b6d7311023248fe789aeef9c9de0249c_rle_crop_3754567912_0.png resize: (217, 280) 1351252130 -2.8514820864840265 treat image : temp/1744302628_3695433_1351145861_b6d7311023248fe789aeef9c9de0249c_rle_crop_3754567913_0.png resize: (242, 329) 1351252131 -1.2200167537473088 treat image : temp/1744302628_3695433_1351145861_b6d7311023248fe789aeef9c9de0249c_rle_crop_3754567914_0.png resize: (233, 296) 1351252132 -1.6261058212862394 treat image : temp/1744302628_3695433_1351145861_b6d7311023248fe789aeef9c9de0249c_rle_crop_3754567917_0.png resize: (455, 261) 1351252133 -2.7628324631161645 treat image : temp/1744302628_3695433_1351145861_b6d7311023248fe789aeef9c9de0249c_rle_crop_3754567918_0.png resize: (140, 109) 1351252134 -1.2978238984374744 treat image : temp/1744302628_3695433_1351145861_b6d7311023248fe789aeef9c9de0249c_rle_crop_3754567919_0.png resize: (176, 160) 1351252135 -1.0027428859844125 treat image : temp/1744302628_3695433_1351145861_b6d7311023248fe789aeef9c9de0249c_rle_crop_3754567923_0.png resize: (241, 365) 1351252136 -0.7254963883346465 treat image : temp/1744302628_3695433_1351145861_b6d7311023248fe789aeef9c9de0249c_rle_crop_3754567924_0.png resize: (80, 114) 1351252137 1.2065186132414103 treat image : temp/1744302628_3695433_1351145861_b6d7311023248fe789aeef9c9de0249c_rle_crop_3754567925_0.png resize: (212, 176) 1351252138 -1.7535770051920878 treat image : temp/1744302628_3695433_1351145861_b6d7311023248fe789aeef9c9de0249c_rle_crop_3754567926_0.png resize: (74, 76) 1351252139 -0.4352131644237972 treat image : temp/1744302628_3695433_1351145861_b6d7311023248fe789aeef9c9de0249c_rle_crop_3754567927_0.png resize: (198, 232) 1351252140 -1.4335615574782496 treat image : temp/1744302628_3695433_1351145861_b6d7311023248fe789aeef9c9de0249c_rle_crop_3754567929_0.png resize: (196, 240) 1351252141 -2.4631871521918387 treat image : temp/1744302628_3695433_1351145861_b6d7311023248fe789aeef9c9de0249c_rle_crop_3754567931_0.png resize: (164, 147) 1351252142 -0.23987495457473312 treat image : temp/1744302628_3695433_1351145861_b6d7311023248fe789aeef9c9de0249c_rle_crop_3754567933_0.png resize: (396, 348) 1351252144 -2.376312187409907 treat image : temp/1744302628_3695433_1351145793_33ec04364475c856d88c73399dfa6799_rle_crop_3754567934_0.png resize: (216, 247) 1351252145 -2.04136313195631 treat image : temp/1744302628_3695433_1351145793_33ec04364475c856d88c73399dfa6799_rle_crop_3754567935_0.png resize: (125, 230) 1351252146 -2.1615456020564183 treat image : temp/1744302628_3695433_1351145793_33ec04364475c856d88c73399dfa6799_rle_crop_3754567936_0.png resize: (150, 106) 1351252147 -1.673113090680579 treat image : temp/1744302628_3695433_1351145793_33ec04364475c856d88c73399dfa6799_rle_crop_3754567937_0.png resize: (119, 116) 1351252149 -3.2950418658652665 treat image : temp/1744302628_3695433_1351145793_33ec04364475c856d88c73399dfa6799_rle_crop_3754567938_0.png resize: (275, 327) 1351252150 -3.268358673402984 treat image : temp/1744302628_3695433_1351145793_33ec04364475c856d88c73399dfa6799_rle_crop_3754567939_0.png resize: (85, 109) 1351252151 0.3621201833414729 treat image : temp/1744302628_3695433_1351145793_33ec04364475c856d88c73399dfa6799_rle_crop_3754567940_0.png resize: (339, 123) 1351252152 -2.894566631020355 treat image : temp/1744302628_3695433_1351145793_33ec04364475c856d88c73399dfa6799_rle_crop_3754567942_0.png resize: (566, 471) 1351252153 -1.3017933637926682 treat image : temp/1744302628_3695433_1351145793_33ec04364475c856d88c73399dfa6799_rle_crop_3754567945_0.png resize: (600, 451) 1351252154 -0.3887060137804189 treat image : temp/1744302628_3695433_1351145793_33ec04364475c856d88c73399dfa6799_rle_crop_3754567946_0.png resize: (520, 509) 1351252155 -1.9366867775864323 treat image : temp/1744302628_3695433_1351145793_33ec04364475c856d88c73399dfa6799_rle_crop_3754567947_0.png resize: (151, 94) 1351252156 -2.3513793327775074 treat image : temp/1744302628_3695433_1351145763_2a340e9757b6c23825140dfd1fba4353_rle_crop_3754567957_0.png resize: (309, 62) 1351252157 -3.6819489756180754 treat image : temp/1744302628_3695433_1351145750_f1ceb8dd76aefbc23a9d2a8c1d8a5637_rle_crop_3754567963_0.png resize: (421, 422) 1351252158 -0.8529904223638267 treat image : temp/1744302628_3695433_1351145750_f1ceb8dd76aefbc23a9d2a8c1d8a5637_rle_crop_3754567966_0.png resize: (524, 473) 1351252159 -3.166259708565467 treat image : temp/1744302628_3695433_1351145750_f1ceb8dd76aefbc23a9d2a8c1d8a5637_rle_crop_3754567967_0.png resize: (551, 386) 1351252160 -0.9263991358008863 treat image : temp/1744302628_3695433_1351145750_f1ceb8dd76aefbc23a9d2a8c1d8a5637_rle_crop_3754567968_0.png resize: (373, 376) 1351252161 -3.7473979176691623 treat image : temp/1744302628_3695433_1351145750_f1ceb8dd76aefbc23a9d2a8c1d8a5637_rle_crop_3754567970_0.png resize: (156, 155) 1351252163 -2.286832037694105 treat image : temp/1744302628_3695433_1351145750_f1ceb8dd76aefbc23a9d2a8c1d8a5637_rle_crop_3754567971_0.png resize: (146, 437) 1351252164 -1.846435137781777 treat image : temp/1744302628_3695433_1351145750_f1ceb8dd76aefbc23a9d2a8c1d8a5637_rle_crop_3754567972_0.png resize: (143, 369) 1351252165 -2.7531666809956605 treat image : temp/1744302628_3695433_1351145750_f1ceb8dd76aefbc23a9d2a8c1d8a5637_rle_crop_3754567973_0.png resize: (338, 518) 1351252166 -4.2339530837961314 treat image : temp/1744302628_3695433_1351145750_f1ceb8dd76aefbc23a9d2a8c1d8a5637_rle_crop_3754567974_0.png resize: (358, 531) 1351252167 -2.597220003877521 treat image : temp/1744302628_3695433_1351145750_f1ceb8dd76aefbc23a9d2a8c1d8a5637_rle_crop_3754567975_0.png resize: (208, 81) 1351252168 -1.9002074956018982 treat image : temp/1744302628_3695433_1351145750_f1ceb8dd76aefbc23a9d2a8c1d8a5637_rle_crop_3754567976_0.png resize: (108, 179) 1351252169 -0.8961762855073561 treat image : temp/1744302628_3695433_1351145750_f1ceb8dd76aefbc23a9d2a8c1d8a5637_rle_crop_3754567979_0.png resize: (174, 91) 1351252170 -4.039462962324552 treat image : temp/1744302628_3695433_1351145750_f1ceb8dd76aefbc23a9d2a8c1d8a5637_rle_crop_3754567982_0.png resize: (222, 201) 1351252171 -2.6018844179815224 treat image : temp/1744302628_3695433_1351145750_f1ceb8dd76aefbc23a9d2a8c1d8a5637_rle_crop_3754567983_0.png resize: (164, 119) 1351252172 -3.427362522787639 treat image : temp/1744302628_3695433_1351145750_f1ceb8dd76aefbc23a9d2a8c1d8a5637_rle_crop_3754567984_0.png resize: (501, 535) 1351252173 -4.4415551323822475 treat image : temp/1744302628_3695433_1351145750_f1ceb8dd76aefbc23a9d2a8c1d8a5637_rle_crop_3754567985_0.png resize: (112, 137) 1351252174 -2.411612335285512 treat image : temp/1744302628_3695433_1351145722_a27f0f368c3d226ac3ed087c137714ef_rle_crop_3754567987_0.png resize: (193, 167) 1351252175 -1.1689101058194606 treat image : temp/1744302628_3695433_1351145722_a27f0f368c3d226ac3ed087c137714ef_rle_crop_3754567989_0.png resize: (167, 80) 1351252176 -1.4996925578815146 treat image : temp/1744302628_3695433_1351145722_a27f0f368c3d226ac3ed087c137714ef_rle_crop_3754567991_0.png resize: (272, 320) 1351252177 -3.1210438699657446 treat image : temp/1744302628_3695433_1351145722_a27f0f368c3d226ac3ed087c137714ef_rle_crop_3754567992_0.png resize: (817, 362) 1351252178 -0.915417305568271 treat image : temp/1744302628_3695433_1351145722_a27f0f368c3d226ac3ed087c137714ef_rle_crop_3754567999_0.png resize: (174, 203) 1351252179 -1.5910411062062024 treat image : temp/1744302628_3695433_1351145984_4cc0f4d9ef86d6b444b5c4471bcf4949_rle_crop_3754567836_0.png resize: (68, 141) 1351252262 -0.5238704286907613 treat image : temp/1744302628_3695433_1351145980_25795b3f029d359068c3703b7e078978_rle_crop_3754567837_0.png resize: (158, 142) 1351252264 -0.030876005061957194 treat image : temp/1744302628_3695433_1351145980_25795b3f029d359068c3703b7e078978_rle_crop_3754567845_0.png resize: (307, 453) 1351252266 -1.692642080360002 treat image : temp/1744302628_3695433_1351145980_25795b3f029d359068c3703b7e078978_rle_crop_3754567847_0.png resize: (300, 290) 1351252267 -2.0715818794117173 treat image : temp/1744302628_3695433_1351145980_25795b3f029d359068c3703b7e078978_rle_crop_3754567849_0.png resize: (435, 591) 1351252268 -1.5118812240068227 treat image : temp/1744302628_3695433_1351145980_25795b3f029d359068c3703b7e078978_rle_crop_3754567850_0.png resize: (624, 946) 1351252270 -0.5573470477865978 treat image : temp/1744302628_3695433_1351145980_25795b3f029d359068c3703b7e078978_rle_crop_3754567852_0.png resize: (79, 191) 1351252271 -2.6465027059370803 treat image : temp/1744302628_3695433_1351145980_25795b3f029d359068c3703b7e078978_rle_crop_3754567858_0.png resize: (304, 130) 1351252272 -2.0137988901049138 treat image : temp/1744302628_3695433_1351145980_25795b3f029d359068c3703b7e078978_rle_crop_3754567865_0.png resize: (127, 162) 1351252274 -1.0038840367274962 treat image : temp/1744302628_3695433_1351145908_dd7be5ead819c8ff7956dc502f8d8485_rle_crop_3754567873_0.png resize: (183, 170) 1351252275 -0.45398160658857056 treat image : temp/1744302628_3695433_1351145908_dd7be5ead819c8ff7956dc502f8d8485_rle_crop_3754567874_0.png resize: (241, 284) 1351252276 -1.0916351208279442 treat image : temp/1744302628_3695433_1351145908_dd7be5ead819c8ff7956dc502f8d8485_rle_crop_3754567878_0.png resize: (111, 128) 1351252278 -1.110342240326138 treat image : temp/1744302628_3695433_1351145902_f563c6ea1449b65fce95ae1203413ca6_rle_crop_3754567879_0.png resize: (193, 322) 1351252279 -2.321483742230408 treat image : temp/1744302628_3695433_1351145902_f563c6ea1449b65fce95ae1203413ca6_rle_crop_3754567883_0.png resize: (185, 200) 1351252283 -1.7061675275252302 treat image : temp/1744302628_3695433_1351145902_f563c6ea1449b65fce95ae1203413ca6_rle_crop_3754567887_0.png resize: (186, 195) 1351252284 -1.4880086155336267 treat image : temp/1744302628_3695433_1351145902_f563c6ea1449b65fce95ae1203413ca6_rle_crop_3754567889_0.png resize: (148, 145) 1351252285 -1.095933672880468 treat image : temp/1744302628_3695433_1351145862_dd70eab5e5317a6e660e987bad7e0f59_rle_crop_3754567896_0.png resize: (174, 160) 1351252287 -1.403096996206887 treat image : temp/1744302628_3695433_1351145862_dd70eab5e5317a6e660e987bad7e0f59_rle_crop_3754567897_0.png resize: (119, 284) 1351252288 -0.8094066330416585 treat image : temp/1744302628_3695433_1351145862_dd70eab5e5317a6e660e987bad7e0f59_rle_crop_3754567899_0.png resize: (216, 259) 1351252289 -3.5055084797786074 treat image : temp/1744302628_3695433_1351145862_dd70eab5e5317a6e660e987bad7e0f59_rle_crop_3754567908_0.png resize: (551, 1016) 1351252291 -1.0365758183390585 treat image : temp/1744302628_3695433_1351145861_b6d7311023248fe789aeef9c9de0249c_rle_crop_3754567916_0.png resize: (243, 489) 1351252292 -1.8297451435621233 treat image : temp/1744302628_3695433_1351145861_b6d7311023248fe789aeef9c9de0249c_rle_crop_3754567922_0.png resize: (798, 727) 1351252293 -1.3537298480891455 treat image : temp/1744302628_3695433_1351145763_2a340e9757b6c23825140dfd1fba4353_rle_crop_3754567949_0.png resize: (117, 176) 1351252295 -1.3213492266377493 treat image : temp/1744302628_3695433_1351145763_2a340e9757b6c23825140dfd1fba4353_rle_crop_3754567951_0.png resize: (256, 283) 1351252296 -2.666109506539994 treat image : temp/1744302628_3695433_1351145763_2a340e9757b6c23825140dfd1fba4353_rle_crop_3754567952_0.png resize: (132, 160) 1351252297 -1.4360521862703144 treat image : temp/1744302628_3695433_1351145763_2a340e9757b6c23825140dfd1fba4353_rle_crop_3754567953_0.png resize: (400, 347) 1351252299 -2.198039174485593 treat image : temp/1744302628_3695433_1351145763_2a340e9757b6c23825140dfd1fba4353_rle_crop_3754567958_0.png resize: (243, 433) 1351252300 -1.9737893308292855 treat image : temp/1744302628_3695433_1351145763_2a340e9757b6c23825140dfd1fba4353_rle_crop_3754567959_0.png resize: (128, 147) 1351252301 -3.0496130753751878 treat image : temp/1744302628_3695433_1351145763_2a340e9757b6c23825140dfd1fba4353_rle_crop_3754567960_0.png resize: (575, 148) 1351252303 -1.7790525264260209 treat image : temp/1744302628_3695433_1351145763_2a340e9757b6c23825140dfd1fba4353_rle_crop_3754567961_0.png resize: (611, 315) 1351252304 -2.644612150758111 treat image : temp/1744302628_3695433_1351145750_f1ceb8dd76aefbc23a9d2a8c1d8a5637_rle_crop_3754567964_0.png resize: (625, 381) 1351252305 -3.1089152383694763 treat image : temp/1744302628_3695433_1351145750_f1ceb8dd76aefbc23a9d2a8c1d8a5637_rle_crop_3754567965_0.png resize: (211, 164) 1351252307 -3.149050385901396 treat image : temp/1744302628_3695433_1351145750_f1ceb8dd76aefbc23a9d2a8c1d8a5637_rle_crop_3754567969_0.png resize: (136, 100) 1351252308 -2.3741049240761094 treat image : temp/1744302628_3695433_1351145750_f1ceb8dd76aefbc23a9d2a8c1d8a5637_rle_crop_3754567977_0.png resize: (106, 165) 1351252309 -2.054651531610973 treat image : temp/1744302628_3695433_1351145750_f1ceb8dd76aefbc23a9d2a8c1d8a5637_rle_crop_3754567980_0.png resize: (168, 189) 1351252311 -2.5136228435140437 treat image : temp/1744302628_3695433_1351145750_f1ceb8dd76aefbc23a9d2a8c1d8a5637_rle_crop_3754567986_0.png resize: (292, 260) 1351252312 -1.9915819526936598 treat image : temp/1744302628_3695433_1351145722_a27f0f368c3d226ac3ed087c137714ef_rle_crop_3754567988_0.png resize: (316, 277) 1351252313 -1.630139522391201 treat image : temp/1744302628_3695433_1351145722_a27f0f368c3d226ac3ed087c137714ef_rle_crop_3754567993_0.png resize: (342, 231) 1351252316 -2.0796704391502647 treat image : temp/1744302628_3695433_1351145722_a27f0f368c3d226ac3ed087c137714ef_rle_crop_3754567995_0.png resize: (118, 219) 1351252317 -0.9852848386700405 treat image : temp/1744302628_3695433_1351145722_a27f0f368c3d226ac3ed087c137714ef_rle_crop_3754567996_0.png resize: (240, 420) 1351252318 -1.7143973929931717 treat image : temp/1744302628_3695433_1351145722_a27f0f368c3d226ac3ed087c137714ef_rle_crop_3754567997_0.png resize: (95, 102) 1351252320 -0.8368227224397782 treat image : temp/1744302628_3695433_1351145722_a27f0f368c3d226ac3ed087c137714ef_rle_crop_3754567998_0.png resize: (349, 226) 1351252321 -1.6027515644697297 treat image : temp/1744302628_3695433_1351145861_b6d7311023248fe789aeef9c9de0249c_rle_crop_3754567920_0.png resize: (67, 143) 1351252331 -0.471837563526767 treat image : temp/1744302628_3695433_1351145750_f1ceb8dd76aefbc23a9d2a8c1d8a5637_rle_crop_3754567981_0.png resize: (268, 206) 1351252333 -3.570006706601498 treat image : temp/1744302628_3695433_1351145984_4cc0f4d9ef86d6b444b5c4471bcf4949_rle_crop_3754567826_0.png resize: (211, 282) 1351252397 -0.838142161769888 treat image : temp/1744302628_3695433_1351145980_25795b3f029d359068c3703b7e078978_rle_crop_3754567857_0.png resize: (429, 681) 1351252399 -0.18615414868346958 treat image : temp/1744302628_3695433_1351145980_25795b3f029d359068c3703b7e078978_rle_crop_3754567859_0.png resize: (210, 282) 1351252400 -1.929306889833346 treat image : temp/1744302628_3695433_1351145980_25795b3f029d359068c3703b7e078978_rle_crop_3754567860_0.png resize: (287, 324) 1351252401 -1.0020549462802435 treat image : temp/1744302628_3695433_1351145980_25795b3f029d359068c3703b7e078978_rle_crop_3754567864_0.png resize: (335, 502) 1351252402 -1.9932666304478843 treat image : temp/1744302628_3695433_1351145976_aa365a1eda9297a714ab8a8882ffda95_rle_crop_3754567872_0.png resize: (524, 109) 1351252403 -3.1302906858793667 treat image : temp/1744302628_3695433_1351145908_dd7be5ead819c8ff7956dc502f8d8485_rle_crop_3754567876_0.png resize: (282, 369) 1351252404 -2.347220588429788 treat image : temp/1744302628_3695433_1351145862_dd70eab5e5317a6e660e987bad7e0f59_rle_crop_3754567910_0.png resize: (273, 339) 1351252405 -3.173555614470068 treat image : temp/1744302628_3695433_1351145861_b6d7311023248fe789aeef9c9de0249c_rle_crop_3754567915_0.png resize: (342, 346) 1351252406 -2.5011365934804894 treat image : temp/1744302628_3695433_1351145861_b6d7311023248fe789aeef9c9de0249c_rle_crop_3754567921_0.png resize: (267, 338) 1351252407 -2.382819857858486 treat image : temp/1744302628_3695433_1351145861_b6d7311023248fe789aeef9c9de0249c_rle_crop_3754567930_0.png resize: (468, 663) 1351252408 -2.1786404331373674 treat image : temp/1744302628_3695433_1351145793_33ec04364475c856d88c73399dfa6799_rle_crop_3754567941_0.png resize: (583, 419) 1351252409 -2.6481529823963434 treat image : temp/1744302628_3695433_1351145793_33ec04364475c856d88c73399dfa6799_rle_crop_3754567943_0.png resize: (378, 376) 1351252410 -2.5592415993403432 treat image : temp/1744302628_3695433_1351145763_2a340e9757b6c23825140dfd1fba4353_rle_crop_3754567950_0.png resize: (282, 351) 1351252411 -2.145894439252159 treat image : temp/1744302628_3695433_1351145763_2a340e9757b6c23825140dfd1fba4353_rle_crop_3754567955_0.png resize: (327, 393) 1351252415 -2.9355412098267233 treat image : temp/1744302628_3695433_1351145763_2a340e9757b6c23825140dfd1fba4353_rle_crop_3754567962_0.png resize: (482, 948) 1351252416 -1.6628453965773926 treat image : temp/1744302628_3695433_1351145750_f1ceb8dd76aefbc23a9d2a8c1d8a5637_rle_crop_3754567978_0.png resize: (234, 617) 1351252417 -1.8704173591734055 treat image : temp/1744302628_3695433_1351145722_a27f0f368c3d226ac3ed087c137714ef_rle_crop_3754567990_0.png resize: (520, 395) 1351252418 -1.5812962538028692 treat image : temp/1744302628_3695433_1351145722_a27f0f368c3d226ac3ed087c137714ef_rle_crop_3754567994_0.png resize: (413, 451) 1351252419 -0.3913381215315728 treat image : temp/1744302628_3695433_1351145976_aa365a1eda9297a714ab8a8882ffda95_rle_crop_3754567869_0.png resize: (567, 460) 1351252428 -1.3861160174830305 treat image : temp/1744302628_3695433_1351145861_b6d7311023248fe789aeef9c9de0249c_rle_crop_3754567928_0.png resize: (339, 301) 1351252429 -1.1806375877599393 treat image : temp/1744302628_3695433_1351145793_33ec04364475c856d88c73399dfa6799_rle_crop_3754567944_0.png resize: (341, 356) 1351252430 0.1316179182477621 treat image : temp/1744302628_3695433_1351145763_2a340e9757b6c23825140dfd1fba4353_rle_crop_3754567948_0.png resize: (127, 32) 1351252431 2.296879245176154 treat image : temp/1744302628_3695433_1351145763_2a340e9757b6c23825140dfd1fba4353_rle_crop_3754567954_0.png resize: (136, 402) 1351252432 -0.6301537991931709 treat image : temp/1744302628_3695433_1351145763_2a340e9757b6c23825140dfd1fba4353_rle_crop_3754567956_0.png resize: (781, 856) 1351252433 -3.8270885134839716 treat image : temp/1744302628_3695433_1351145980_25795b3f029d359068c3703b7e078978_rle_crop_3754567844_0.png resize: (341, 353) 1351252457 -1.1289863052843183 treat image : temp/1744302628_3695433_1351145861_b6d7311023248fe789aeef9c9de0249c_rle_crop_3754567932_0.png resize: (1221, 819) 1351252460 -1.133518297548441 treat image : temp/1744302628_3695433_1351145984_4cc0f4d9ef86d6b444b5c4471bcf4949_rle_crop_3754567831_0.png resize: (572, 543) 1351252514 -1.1972313712733968 treat image : temp/1744302628_3695433_1351145980_25795b3f029d359068c3703b7e078978_rle_crop_3754567862_0.png resize: (259, 323) 1351252515 -1.663296446881696 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 186 time used for this insertion : 0.25476598739624023 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 186 time used for this insertion : 0.04812955856323242 save missing photos in datou_result : time spend for datou_step_exec : 60.323593854904175 time spend to save output : 0.30997681617736816 total time spend for step 6 : 60.63357067108154 step7:brightness Thu Apr 10 18:39:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1744302628_3695433_1351145984_4cc0f4d9ef86d6b444b5c4471bcf4949.jpg treat image : temp/1744302628_3695433_1351145980_25795b3f029d359068c3703b7e078978.jpg treat image : temp/1744302628_3695433_1351145976_aa365a1eda9297a714ab8a8882ffda95.jpg treat image : temp/1744302628_3695433_1351145908_dd7be5ead819c8ff7956dc502f8d8485.jpg treat image : temp/1744302628_3695433_1351145902_f563c6ea1449b65fce95ae1203413ca6.jpg treat image : temp/1744302628_3695433_1351145862_dd70eab5e5317a6e660e987bad7e0f59.jpg treat image : temp/1744302628_3695433_1351145861_b6d7311023248fe789aeef9c9de0249c.jpg treat image : temp/1744302628_3695433_1351145793_33ec04364475c856d88c73399dfa6799.jpg treat image : temp/1744302628_3695433_1351145763_2a340e9757b6c23825140dfd1fba4353.jpg treat image : temp/1744302628_3695433_1351145750_f1ceb8dd76aefbc23a9d2a8c1d8a5637.jpg treat image : temp/1744302628_3695433_1351145722_a27f0f368c3d226ac3ed087c137714ef.jpg treat image : temp/1744302628_3695433_1351145984_4cc0f4d9ef86d6b444b5c4471bcf4949_rle_crop_3754567825_0.png treat image : temp/1744302628_3695433_1351145984_4cc0f4d9ef86d6b444b5c4471bcf4949_rle_crop_3754567827_0.png treat image : temp/1744302628_3695433_1351145984_4cc0f4d9ef86d6b444b5c4471bcf4949_rle_crop_3754567828_0.png treat image : temp/1744302628_3695433_1351145984_4cc0f4d9ef86d6b444b5c4471bcf4949_rle_crop_3754567829_0.png treat image : temp/1744302628_3695433_1351145984_4cc0f4d9ef86d6b444b5c4471bcf4949_rle_crop_3754567830_0.png treat image : temp/1744302628_3695433_1351145984_4cc0f4d9ef86d6b444b5c4471bcf4949_rle_crop_3754567832_0.png treat image : temp/1744302628_3695433_1351145984_4cc0f4d9ef86d6b444b5c4471bcf4949_rle_crop_3754567833_0.png treat image : temp/1744302628_3695433_1351145984_4cc0f4d9ef86d6b444b5c4471bcf4949_rle_crop_3754567834_0.png treat image : temp/1744302628_3695433_1351145984_4cc0f4d9ef86d6b444b5c4471bcf4949_rle_crop_3754567835_0.png treat image : temp/1744302628_3695433_1351145980_25795b3f029d359068c3703b7e078978_rle_crop_3754567838_0.png treat image : temp/1744302628_3695433_1351145980_25795b3f029d359068c3703b7e078978_rle_crop_3754567839_0.png treat image : temp/1744302628_3695433_1351145980_25795b3f029d359068c3703b7e078978_rle_crop_3754567840_0.png treat image : temp/1744302628_3695433_1351145980_25795b3f029d359068c3703b7e078978_rle_crop_3754567841_0.png treat image : temp/1744302628_3695433_1351145980_25795b3f029d359068c3703b7e078978_rle_crop_3754567842_0.png treat image : temp/1744302628_3695433_1351145980_25795b3f029d359068c3703b7e078978_rle_crop_3754567843_0.png treat image : temp/1744302628_3695433_1351145980_25795b3f029d359068c3703b7e078978_rle_crop_3754567846_0.png treat image : temp/1744302628_3695433_1351145980_25795b3f029d359068c3703b7e078978_rle_crop_3754567848_0.png treat image : temp/1744302628_3695433_1351145980_25795b3f029d359068c3703b7e078978_rle_crop_3754567851_0.png treat image : temp/1744302628_3695433_1351145980_25795b3f029d359068c3703b7e078978_rle_crop_3754567853_0.png treat image : temp/1744302628_3695433_1351145980_25795b3f029d359068c3703b7e078978_rle_crop_3754567854_0.png treat image : temp/1744302628_3695433_1351145980_25795b3f029d359068c3703b7e078978_rle_crop_3754567855_0.png treat image : temp/1744302628_3695433_1351145980_25795b3f029d359068c3703b7e078978_rle_crop_3754567856_0.png treat image : temp/1744302628_3695433_1351145980_25795b3f029d359068c3703b7e078978_rle_crop_3754567861_0.png treat image : temp/1744302628_3695433_1351145980_25795b3f029d359068c3703b7e078978_rle_crop_3754567863_0.png treat image : temp/1744302628_3695433_1351145980_25795b3f029d359068c3703b7e078978_rle_crop_3754567866_0.png treat image : temp/1744302628_3695433_1351145980_25795b3f029d359068c3703b7e078978_rle_crop_3754567867_0.png treat image : temp/1744302628_3695433_1351145976_aa365a1eda9297a714ab8a8882ffda95_rle_crop_3754567868_0.png treat image : temp/1744302628_3695433_1351145976_aa365a1eda9297a714ab8a8882ffda95_rle_crop_3754567870_0.png treat image : temp/1744302628_3695433_1351145976_aa365a1eda9297a714ab8a8882ffda95_rle_crop_3754567871_0.png treat image : temp/1744302628_3695433_1351145908_dd7be5ead819c8ff7956dc502f8d8485_rle_crop_3754567875_0.png treat image : temp/1744302628_3695433_1351145908_dd7be5ead819c8ff7956dc502f8d8485_rle_crop_3754567877_0.png treat image : temp/1744302628_3695433_1351145902_f563c6ea1449b65fce95ae1203413ca6_rle_crop_3754567880_0.png treat image : temp/1744302628_3695433_1351145902_f563c6ea1449b65fce95ae1203413ca6_rle_crop_3754567881_0.png treat image : temp/1744302628_3695433_1351145902_f563c6ea1449b65fce95ae1203413ca6_rle_crop_3754567882_0.png treat image : temp/1744302628_3695433_1351145902_f563c6ea1449b65fce95ae1203413ca6_rle_crop_3754567884_0.png treat image : temp/1744302628_3695433_1351145902_f563c6ea1449b65fce95ae1203413ca6_rle_crop_3754567885_0.png treat image : temp/1744302628_3695433_1351145902_f563c6ea1449b65fce95ae1203413ca6_rle_crop_3754567886_0.png treat image : temp/1744302628_3695433_1351145902_f563c6ea1449b65fce95ae1203413ca6_rle_crop_3754567888_0.png treat image : temp/1744302628_3695433_1351145902_f563c6ea1449b65fce95ae1203413ca6_rle_crop_3754567890_0.png treat image : temp/1744302628_3695433_1351145902_f563c6ea1449b65fce95ae1203413ca6_rle_crop_3754567891_0.png treat image : temp/1744302628_3695433_1351145862_dd70eab5e5317a6e660e987bad7e0f59_rle_crop_3754567892_0.png treat image : temp/1744302628_3695433_1351145862_dd70eab5e5317a6e660e987bad7e0f59_rle_crop_3754567893_0.png treat image : temp/1744302628_3695433_1351145862_dd70eab5e5317a6e660e987bad7e0f59_rle_crop_3754567894_0.png treat image : temp/1744302628_3695433_1351145862_dd70eab5e5317a6e660e987bad7e0f59_rle_crop_3754567895_0.png treat image : temp/1744302628_3695433_1351145862_dd70eab5e5317a6e660e987bad7e0f59_rle_crop_3754567898_0.png treat image : temp/1744302628_3695433_1351145862_dd70eab5e5317a6e660e987bad7e0f59_rle_crop_3754567900_0.png treat image : temp/1744302628_3695433_1351145862_dd70eab5e5317a6e660e987bad7e0f59_rle_crop_3754567901_0.png treat image : temp/1744302628_3695433_1351145862_dd70eab5e5317a6e660e987bad7e0f59_rle_crop_3754567902_0.png treat image : temp/1744302628_3695433_1351145862_dd70eab5e5317a6e660e987bad7e0f59_rle_crop_3754567903_0.png treat image : temp/1744302628_3695433_1351145862_dd70eab5e5317a6e660e987bad7e0f59_rle_crop_3754567904_0.png treat image : temp/1744302628_3695433_1351145862_dd70eab5e5317a6e660e987bad7e0f59_rle_crop_3754567905_0.png treat image : temp/1744302628_3695433_1351145862_dd70eab5e5317a6e660e987bad7e0f59_rle_crop_3754567906_0.png treat image : temp/1744302628_3695433_1351145862_dd70eab5e5317a6e660e987bad7e0f59_rle_crop_3754567907_0.png treat image : temp/1744302628_3695433_1351145862_dd70eab5e5317a6e660e987bad7e0f59_rle_crop_3754567909_0.png treat image : temp/1744302628_3695433_1351145861_b6d7311023248fe789aeef9c9de0249c_rle_crop_3754567911_0.png treat image : temp/1744302628_3695433_1351145861_b6d7311023248fe789aeef9c9de0249c_rle_crop_3754567912_0.png treat image : temp/1744302628_3695433_1351145861_b6d7311023248fe789aeef9c9de0249c_rle_crop_3754567913_0.png treat image : temp/1744302628_3695433_1351145861_b6d7311023248fe789aeef9c9de0249c_rle_crop_3754567914_0.png treat image : temp/1744302628_3695433_1351145861_b6d7311023248fe789aeef9c9de0249c_rle_crop_3754567917_0.png treat image : temp/1744302628_3695433_1351145861_b6d7311023248fe789aeef9c9de0249c_rle_crop_3754567918_0.png treat image : temp/1744302628_3695433_1351145861_b6d7311023248fe789aeef9c9de0249c_rle_crop_3754567919_0.png treat image : temp/1744302628_3695433_1351145861_b6d7311023248fe789aeef9c9de0249c_rle_crop_3754567923_0.png treat image : temp/1744302628_3695433_1351145861_b6d7311023248fe789aeef9c9de0249c_rle_crop_3754567924_0.png treat image : temp/1744302628_3695433_1351145861_b6d7311023248fe789aeef9c9de0249c_rle_crop_3754567925_0.png treat image : temp/1744302628_3695433_1351145861_b6d7311023248fe789aeef9c9de0249c_rle_crop_3754567926_0.png treat image : temp/1744302628_3695433_1351145861_b6d7311023248fe789aeef9c9de0249c_rle_crop_3754567927_0.png treat image : temp/1744302628_3695433_1351145861_b6d7311023248fe789aeef9c9de0249c_rle_crop_3754567929_0.png treat image : temp/1744302628_3695433_1351145861_b6d7311023248fe789aeef9c9de0249c_rle_crop_3754567931_0.png treat image : temp/1744302628_3695433_1351145861_b6d7311023248fe789aeef9c9de0249c_rle_crop_3754567933_0.png treat image : temp/1744302628_3695433_1351145793_33ec04364475c856d88c73399dfa6799_rle_crop_3754567934_0.png treat image : temp/1744302628_3695433_1351145793_33ec04364475c856d88c73399dfa6799_rle_crop_3754567935_0.png treat image : temp/1744302628_3695433_1351145793_33ec04364475c856d88c73399dfa6799_rle_crop_3754567936_0.png treat image : temp/1744302628_3695433_1351145793_33ec04364475c856d88c73399dfa6799_rle_crop_3754567937_0.png treat image : temp/1744302628_3695433_1351145793_33ec04364475c856d88c73399dfa6799_rle_crop_3754567938_0.png treat image : temp/1744302628_3695433_1351145793_33ec04364475c856d88c73399dfa6799_rle_crop_3754567939_0.png treat image : temp/1744302628_3695433_1351145793_33ec04364475c856d88c73399dfa6799_rle_crop_3754567940_0.png treat image : temp/1744302628_3695433_1351145793_33ec04364475c856d88c73399dfa6799_rle_crop_3754567942_0.png treat image : temp/1744302628_3695433_1351145793_33ec04364475c856d88c73399dfa6799_rle_crop_3754567945_0.png treat image : temp/1744302628_3695433_1351145793_33ec04364475c856d88c73399dfa6799_rle_crop_3754567946_0.png treat image : temp/1744302628_3695433_1351145793_33ec04364475c856d88c73399dfa6799_rle_crop_3754567947_0.png treat image : temp/1744302628_3695433_1351145763_2a340e9757b6c23825140dfd1fba4353_rle_crop_3754567957_0.png treat image : temp/1744302628_3695433_1351145750_f1ceb8dd76aefbc23a9d2a8c1d8a5637_rle_crop_3754567963_0.png treat image : temp/1744302628_3695433_1351145750_f1ceb8dd76aefbc23a9d2a8c1d8a5637_rle_crop_3754567966_0.png treat image : temp/1744302628_3695433_1351145750_f1ceb8dd76aefbc23a9d2a8c1d8a5637_rle_crop_3754567967_0.png treat image : temp/1744302628_3695433_1351145750_f1ceb8dd76aefbc23a9d2a8c1d8a5637_rle_crop_3754567968_0.png treat image : temp/1744302628_3695433_1351145750_f1ceb8dd76aefbc23a9d2a8c1d8a5637_rle_crop_3754567970_0.png treat image : temp/1744302628_3695433_1351145750_f1ceb8dd76aefbc23a9d2a8c1d8a5637_rle_crop_3754567971_0.png treat image : temp/1744302628_3695433_1351145750_f1ceb8dd76aefbc23a9d2a8c1d8a5637_rle_crop_3754567972_0.png treat image : temp/1744302628_3695433_1351145750_f1ceb8dd76aefbc23a9d2a8c1d8a5637_rle_crop_3754567973_0.png treat image : temp/1744302628_3695433_1351145750_f1ceb8dd76aefbc23a9d2a8c1d8a5637_rle_crop_3754567974_0.png treat image : temp/1744302628_3695433_1351145750_f1ceb8dd76aefbc23a9d2a8c1d8a5637_rle_crop_3754567975_0.png treat image : temp/1744302628_3695433_1351145750_f1ceb8dd76aefbc23a9d2a8c1d8a5637_rle_crop_3754567976_0.png treat image : temp/1744302628_3695433_1351145750_f1ceb8dd76aefbc23a9d2a8c1d8a5637_rle_crop_3754567979_0.png treat image : temp/1744302628_3695433_1351145750_f1ceb8dd76aefbc23a9d2a8c1d8a5637_rle_crop_3754567982_0.png treat image : temp/1744302628_3695433_1351145750_f1ceb8dd76aefbc23a9d2a8c1d8a5637_rle_crop_3754567983_0.png treat image : temp/1744302628_3695433_1351145750_f1ceb8dd76aefbc23a9d2a8c1d8a5637_rle_crop_3754567984_0.png treat image : temp/1744302628_3695433_1351145750_f1ceb8dd76aefbc23a9d2a8c1d8a5637_rle_crop_3754567985_0.png treat image : temp/1744302628_3695433_1351145722_a27f0f368c3d226ac3ed087c137714ef_rle_crop_3754567987_0.png treat image : temp/1744302628_3695433_1351145722_a27f0f368c3d226ac3ed087c137714ef_rle_crop_3754567989_0.png treat image : temp/1744302628_3695433_1351145722_a27f0f368c3d226ac3ed087c137714ef_rle_crop_3754567991_0.png treat image : temp/1744302628_3695433_1351145722_a27f0f368c3d226ac3ed087c137714ef_rle_crop_3754567992_0.png treat image : temp/1744302628_3695433_1351145722_a27f0f368c3d226ac3ed087c137714ef_rle_crop_3754567999_0.png treat image : temp/1744302628_3695433_1351145984_4cc0f4d9ef86d6b444b5c4471bcf4949_rle_crop_3754567836_0.png treat image : temp/1744302628_3695433_1351145980_25795b3f029d359068c3703b7e078978_rle_crop_3754567837_0.png treat image : temp/1744302628_3695433_1351145980_25795b3f029d359068c3703b7e078978_rle_crop_3754567845_0.png treat image : temp/1744302628_3695433_1351145980_25795b3f029d359068c3703b7e078978_rle_crop_3754567847_0.png treat image : temp/1744302628_3695433_1351145980_25795b3f029d359068c3703b7e078978_rle_crop_3754567849_0.png treat image : temp/1744302628_3695433_1351145980_25795b3f029d359068c3703b7e078978_rle_crop_3754567850_0.png treat image : temp/1744302628_3695433_1351145980_25795b3f029d359068c3703b7e078978_rle_crop_3754567852_0.png treat image : temp/1744302628_3695433_1351145980_25795b3f029d359068c3703b7e078978_rle_crop_3754567858_0.png treat image : temp/1744302628_3695433_1351145980_25795b3f029d359068c3703b7e078978_rle_crop_3754567865_0.png treat image : temp/1744302628_3695433_1351145908_dd7be5ead819c8ff7956dc502f8d8485_rle_crop_3754567873_0.png treat image : temp/1744302628_3695433_1351145908_dd7be5ead819c8ff7956dc502f8d8485_rle_crop_3754567874_0.png treat image : temp/1744302628_3695433_1351145908_dd7be5ead819c8ff7956dc502f8d8485_rle_crop_3754567878_0.png treat image : temp/1744302628_3695433_1351145902_f563c6ea1449b65fce95ae1203413ca6_rle_crop_3754567879_0.png treat image : temp/1744302628_3695433_1351145902_f563c6ea1449b65fce95ae1203413ca6_rle_crop_3754567883_0.png treat image : temp/1744302628_3695433_1351145902_f563c6ea1449b65fce95ae1203413ca6_rle_crop_3754567887_0.png treat image : temp/1744302628_3695433_1351145902_f563c6ea1449b65fce95ae1203413ca6_rle_crop_3754567889_0.png treat image : temp/1744302628_3695433_1351145862_dd70eab5e5317a6e660e987bad7e0f59_rle_crop_3754567896_0.png treat image : temp/1744302628_3695433_1351145862_dd70eab5e5317a6e660e987bad7e0f59_rle_crop_3754567897_0.png treat image : temp/1744302628_3695433_1351145862_dd70eab5e5317a6e660e987bad7e0f59_rle_crop_3754567899_0.png treat image : temp/1744302628_3695433_1351145862_dd70eab5e5317a6e660e987bad7e0f59_rle_crop_3754567908_0.png treat image : temp/1744302628_3695433_1351145861_b6d7311023248fe789aeef9c9de0249c_rle_crop_3754567916_0.png treat image : temp/1744302628_3695433_1351145861_b6d7311023248fe789aeef9c9de0249c_rle_crop_3754567922_0.png treat image : temp/1744302628_3695433_1351145763_2a340e9757b6c23825140dfd1fba4353_rle_crop_3754567949_0.png treat image : temp/1744302628_3695433_1351145763_2a340e9757b6c23825140dfd1fba4353_rle_crop_3754567951_0.png treat image : temp/1744302628_3695433_1351145763_2a340e9757b6c23825140dfd1fba4353_rle_crop_3754567952_0.png treat image : temp/1744302628_3695433_1351145763_2a340e9757b6c23825140dfd1fba4353_rle_crop_3754567953_0.png treat image : temp/1744302628_3695433_1351145763_2a340e9757b6c23825140dfd1fba4353_rle_crop_3754567958_0.png treat image : temp/1744302628_3695433_1351145763_2a340e9757b6c23825140dfd1fba4353_rle_crop_3754567959_0.png treat image : temp/1744302628_3695433_1351145763_2a340e9757b6c23825140dfd1fba4353_rle_crop_3754567960_0.png treat image : temp/1744302628_3695433_1351145763_2a340e9757b6c23825140dfd1fba4353_rle_crop_3754567961_0.png treat image : temp/1744302628_3695433_1351145750_f1ceb8dd76aefbc23a9d2a8c1d8a5637_rle_crop_3754567964_0.png treat image : temp/1744302628_3695433_1351145750_f1ceb8dd76aefbc23a9d2a8c1d8a5637_rle_crop_3754567965_0.png treat image : temp/1744302628_3695433_1351145750_f1ceb8dd76aefbc23a9d2a8c1d8a5637_rle_crop_3754567969_0.png treat image : temp/1744302628_3695433_1351145750_f1ceb8dd76aefbc23a9d2a8c1d8a5637_rle_crop_3754567977_0.png treat image : temp/1744302628_3695433_1351145750_f1ceb8dd76aefbc23a9d2a8c1d8a5637_rle_crop_3754567980_0.png treat image : temp/1744302628_3695433_1351145750_f1ceb8dd76aefbc23a9d2a8c1d8a5637_rle_crop_3754567986_0.png treat image : temp/1744302628_3695433_1351145722_a27f0f368c3d226ac3ed087c137714ef_rle_crop_3754567988_0.png treat image : temp/1744302628_3695433_1351145722_a27f0f368c3d226ac3ed087c137714ef_rle_crop_3754567993_0.png treat image : temp/1744302628_3695433_1351145722_a27f0f368c3d226ac3ed087c137714ef_rle_crop_3754567995_0.png treat image : temp/1744302628_3695433_1351145722_a27f0f368c3d226ac3ed087c137714ef_rle_crop_3754567996_0.png treat image : temp/1744302628_3695433_1351145722_a27f0f368c3d226ac3ed087c137714ef_rle_crop_3754567997_0.png treat image : temp/1744302628_3695433_1351145722_a27f0f368c3d226ac3ed087c137714ef_rle_crop_3754567998_0.png treat image : temp/1744302628_3695433_1351145861_b6d7311023248fe789aeef9c9de0249c_rle_crop_3754567920_0.png treat image : temp/1744302628_3695433_1351145750_f1ceb8dd76aefbc23a9d2a8c1d8a5637_rle_crop_3754567981_0.png treat image : temp/1744302628_3695433_1351145984_4cc0f4d9ef86d6b444b5c4471bcf4949_rle_crop_3754567826_0.png treat image : temp/1744302628_3695433_1351145980_25795b3f029d359068c3703b7e078978_rle_crop_3754567857_0.png treat image : temp/1744302628_3695433_1351145980_25795b3f029d359068c3703b7e078978_rle_crop_3754567859_0.png treat image : temp/1744302628_3695433_1351145980_25795b3f029d359068c3703b7e078978_rle_crop_3754567860_0.png treat image : temp/1744302628_3695433_1351145980_25795b3f029d359068c3703b7e078978_rle_crop_3754567864_0.png treat image : temp/1744302628_3695433_1351145976_aa365a1eda9297a714ab8a8882ffda95_rle_crop_3754567872_0.png treat image : temp/1744302628_3695433_1351145908_dd7be5ead819c8ff7956dc502f8d8485_rle_crop_3754567876_0.png treat image : temp/1744302628_3695433_1351145862_dd70eab5e5317a6e660e987bad7e0f59_rle_crop_3754567910_0.png treat image : temp/1744302628_3695433_1351145861_b6d7311023248fe789aeef9c9de0249c_rle_crop_3754567915_0.png treat image : temp/1744302628_3695433_1351145861_b6d7311023248fe789aeef9c9de0249c_rle_crop_3754567921_0.png treat image : temp/1744302628_3695433_1351145861_b6d7311023248fe789aeef9c9de0249c_rle_crop_3754567930_0.png treat image : temp/1744302628_3695433_1351145793_33ec04364475c856d88c73399dfa6799_rle_crop_3754567941_0.png treat image : temp/1744302628_3695433_1351145793_33ec04364475c856d88c73399dfa6799_rle_crop_3754567943_0.png treat image : temp/1744302628_3695433_1351145763_2a340e9757b6c23825140dfd1fba4353_rle_crop_3754567950_0.png treat image : temp/1744302628_3695433_1351145763_2a340e9757b6c23825140dfd1fba4353_rle_crop_3754567955_0.png treat image : temp/1744302628_3695433_1351145763_2a340e9757b6c23825140dfd1fba4353_rle_crop_3754567962_0.png treat image : temp/1744302628_3695433_1351145750_f1ceb8dd76aefbc23a9d2a8c1d8a5637_rle_crop_3754567978_0.png treat image : temp/1744302628_3695433_1351145722_a27f0f368c3d226ac3ed087c137714ef_rle_crop_3754567990_0.png treat image : temp/1744302628_3695433_1351145722_a27f0f368c3d226ac3ed087c137714ef_rle_crop_3754567994_0.png treat image : temp/1744302628_3695433_1351145976_aa365a1eda9297a714ab8a8882ffda95_rle_crop_3754567869_0.png treat image : temp/1744302628_3695433_1351145861_b6d7311023248fe789aeef9c9de0249c_rle_crop_3754567928_0.png treat image : temp/1744302628_3695433_1351145793_33ec04364475c856d88c73399dfa6799_rle_crop_3754567944_0.png treat image : temp/1744302628_3695433_1351145763_2a340e9757b6c23825140dfd1fba4353_rle_crop_3754567948_0.png treat image : temp/1744302628_3695433_1351145763_2a340e9757b6c23825140dfd1fba4353_rle_crop_3754567954_0.png treat image : temp/1744302628_3695433_1351145763_2a340e9757b6c23825140dfd1fba4353_rle_crop_3754567956_0.png treat image : temp/1744302628_3695433_1351145980_25795b3f029d359068c3703b7e078978_rle_crop_3754567844_0.png treat image : temp/1744302628_3695433_1351145861_b6d7311023248fe789aeef9c9de0249c_rle_crop_3754567932_0.png treat image : temp/1744302628_3695433_1351145984_4cc0f4d9ef86d6b444b5c4471bcf4949_rle_crop_3754567831_0.png treat image : temp/1744302628_3695433_1351145980_25795b3f029d359068c3703b7e078978_rle_crop_3754567862_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 186 time used for this insertion : 0.019201278686523438 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 186 time used for this insertion : 0.041747331619262695 save missing photos in datou_result : time spend for datou_step_exec : 10.634979963302612 time spend to save output : 0.06643271446228027 total time spend for step 7 : 10.701412677764893 step8:velours_tree Thu Apr 10 18:39:38 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 1.52152419090271 time spend to save output : 4.9591064453125e-05 total time spend for step 8 : 1.521573781967163 step9:send_mail_cod Thu Apr 10 18:39:40 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P22234353_10-04-2025_18_39_40.pdf 22238022 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette222380221744303180 22238024 change filename to text .change filename to text .imagette222380241744303181 22238025 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette222380251744303181 22238026 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette222380261744303184 22238027 change filename to text .change filename to text .imagette222380271744303185 22238028 change filename to text .change filename to text .imagette222380281744303185 22238029 imagette222380291744303185 22238030 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette222380301744303185 22238031 imagette222380311744303186 22238032 imagette222380321744303186 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=22234353 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/22238022,22238023,22238024,22238025,22238026,22238027,22238028,22238029,22238030,22238031,22238032?tags=pet_clair,environnement,metal,papier,carton,pehd,pet_fonce,flou,autre,mal_croppe,background args[1351145984] : ((1351145984, -1.6337287684008177, 492688767), (1351145984, 0.1312611624657253, 2107752395), '0.17680694042137057') We are sending mail with results at report@fotonower.com args[1351145980] : ((1351145980, 1.5039794780594613, 492688767), (1351145980, -0.24107450898105975, 496442774), '0.17680694042137057') We are sending mail with results at report@fotonower.com args[1351145976] : ((1351145976, -1.0432699462453783, 492688767), (1351145976, 0.10582894724701433, 2107752395), '0.17680694042137057') We are sending mail with results at report@fotonower.com args[1351145908] : ((1351145908, -2.502746486821379, 492609224), (1351145908, 0.26500196061356407, 2107752395), '0.17680694042137057') We are sending mail with results at report@fotonower.com args[1351145902] : ((1351145902, -2.0880606406482376, 492609224), (1351145902, -0.28901440932128925, 496442774), '0.17680694042137057') We are sending mail with results at report@fotonower.com args[1351145862] : ((1351145862, -2.290152070834345, 492609224), (1351145862, 0.05955234176274477, 2107752395), '0.17680694042137057') We are sending mail with results at report@fotonower.com args[1351145861] : ((1351145861, -0.9572716905787549, 492688767), (1351145861, -0.2141799157462494, 496442774), '0.17680694042137057') We are sending mail with results at report@fotonower.com args[1351145793] : ((1351145793, -1.7456070982875906, 492688767), (1351145793, -0.37306747118525074, 496442774), '0.17680694042137057') We are sending mail with results at report@fotonower.com args[1351145763] : ((1351145763, -3.513213636133436, 492609224), (1351145763, -0.1660683657600778, 496442774), '0.17680694042137057') We are sending mail with results at report@fotonower.com args[1351145750] : ((1351145750, -5.667709921840222, 492609224), (1351145750, 0.07865632128658519, 2107752395), '0.17680694042137057') We are sending mail with results at report@fotonower.com args[1351145722] : ((1351145722, -3.7865297979654953, 492609224), (1351145722, -0.09079830192548, 496442774), '0.17680694042137057') We are sending mail with results at report@fotonower.com refus_total : 0.17680694042137057 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=22234353 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 SELECT photo_id, url FROM MTRBack.photos ph WHERE photo_id IN (1351145862,1351145722,1351145750,1351145763,1351145793,1351145861,1351145902,1351145908,1351145976,1351145980,1351145984) Found this number of photos: 11 begin to download photo : 1351145862 begin to download photo : 1351145763 begin to download photo : 1351145902 begin to download photo : 1351145980 download finish for photo 1351145763 begin to download photo : 1351145793 download finish for photo 1351145980 begin to download photo : 1351145984 download finish for photo 1351145862 begin to download photo : 1351145722 download finish for photo 1351145902 begin to download photo : 1351145908 download finish for photo 1351145793 begin to download photo : 1351145861 download finish for photo 1351145984 download finish for photo 1351145908 begin to download photo : 1351145976 download finish for photo 1351145722 begin to download photo : 1351145750 download finish for photo 1351145861 download finish for photo 1351145976 download finish for photo 1351145750 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22234353_10-04-2025_18_39_40.pdf results_Auto_P22234353_10-04-2025_18_39_40.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22234353_10-04-2025_18_39_40.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','22234353','results_Auto_P22234353_10-04-2025_18_39_40.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22234353_10-04-2025_18_39_40.pdf','pdf','','1.04','0.17680694042137057') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/22234353

https://www.fotonower.com/image?json=false&list_photos_id=1351145984
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1351145980
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.5039794780594613)
https://www.fotonower.com/image?json=false&list_photos_id=1351145976
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1351145908
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1351145902
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1351145862
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1351145861
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1351145793
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1351145763
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1351145750
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1351145722
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 17.68%
Veuillez trouver les photos des contaminants.

exemples de contaminants: pet_clair: https://www.fotonower.com/view/22238022?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/22238024?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/22238025?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/22238026?limit=200
exemples de contaminants: pehd: https://www.fotonower.com/view/22238027?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/22238028?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/22238030?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22234353_10-04-2025_18_39_40.pdf.

Lien vers velours :https://www.fotonower.com/velours/22238022,22238023,22238024,22238025,22238026,22238027,22238028,22238029,22238030,22238031,22238032?tags=pet_clair,environnement,metal,papier,carton,pehd,pet_fonce,flou,autre,mal_croppe,background.


L'équipe Fotonower 202 b'' Server: nginx Date: Thu, 10 Apr 2025 16:39:49 GMT Content-Length: 0 Connection: close X-Message-Id: cAQKYdSITTqPygTxOl4KOA Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1351145984, 1351145980, 1351145976, 1351145908, 1351145902, 1351145862, 1351145861, 1351145793, 1351145763, 1351145750, 1351145722] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2740447') ('3318', '22234353', '1351145984', None, None, None, None, None, '2740447') ('3318', None, None, None, None, None, None, None, '2740447') ('3318', '22234353', '1351145980', None, None, None, None, None, '2740447') ('3318', None, None, None, None, None, None, None, '2740447') ('3318', '22234353', '1351145976', None, None, None, None, None, '2740447') ('3318', None, None, None, None, None, None, None, '2740447') ('3318', '22234353', '1351145908', None, None, None, None, None, '2740447') ('3318', None, None, None, None, None, None, None, '2740447') ('3318', '22234353', '1351145902', None, None, None, None, None, '2740447') ('3318', None, None, None, None, None, None, None, '2740447') ('3318', '22234353', '1351145862', None, None, None, None, None, '2740447') ('3318', None, None, None, None, None, None, None, '2740447') ('3318', '22234353', '1351145861', None, None, None, None, None, '2740447') ('3318', None, None, None, None, None, None, None, '2740447') ('3318', '22234353', '1351145793', None, None, None, None, None, '2740447') ('3318', None, None, None, None, None, None, None, '2740447') ('3318', '22234353', '1351145763', None, None, None, None, None, '2740447') ('3318', None, None, None, None, None, None, None, '2740447') ('3318', '22234353', '1351145750', None, None, None, None, None, '2740447') ('3318', None, None, None, None, None, None, None, '2740447') ('3318', '22234353', '1351145722', None, None, None, None, None, '2740447') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.15825772285461426 save_final save missing photos in datou_result : time spend for datou_step_exec : 9.82468318939209 time spend to save output : 0.15852785110473633 total time spend for step 9 : 9.983211040496826 step10:split_time_score Thu Apr 10 18:39:50 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('13', 11),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 10042025 22234353 Nombre de photos uploadées : 11 / 23040 (0%) 10042025 22234353 Nombre de photos taguées (types de déchets): 0 / 11 (0%) 10042025 22234353 Nombre de photos taguées (volume) : 0 / 11 (0%) elapsed_time : load_data_split_time_score 2.1457672119140625e-06 elapsed_time : order_list_meta_photo_and_scores 5.7220458984375e-06 ??????????? elapsed_time : fill_and_build_computed_from_old_data 0.0005743503570556641 elapsed_time : insert_dashboard_record_day_entry 0.027222871780395508 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.07834330256764702 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22214622_10-04-2025_09_15_52.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22214622 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22214622 AND mptpi.`type`=3726 To do Qualite : 0.30404372758941545 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22222738_10-04-2025_13_49_21.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22222738 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22222738 AND mptpi.`type`=3594 To do Qualite : 0.13080439814814812 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22222739_10-04-2025_12_31_33.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22222739 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22222739 AND mptpi.`type`=3594 To do Qualite : 0.08491796816652654 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22222743_10-04-2025_12_25_42.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22222743 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22222743 AND mptpi.`type`=3726 To do Qualite : 0.2361900233183552 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22234330_10-04-2025_17_49_13.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22234330 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22234330 AND mptpi.`type`=3594 To do Qualite : 0.06472482777268794 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22234331_10-04-2025_17_50_57.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22234331 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22234331 AND mptpi.`type`=3726 To do Qualite : 0.17680694042137057 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22234353_10-04-2025_18_39_40.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22234353 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22234353 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22237479 order by id desc limit 1 Qualite : 0.19070316427853187 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22234383_10-04-2025_17_25_46.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22234383 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22234383 AND mptpi.`type`=3594 To do Qualite : 0.06993581970696396 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22237481_10-04-2025_18_38_46.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22237481 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22237481 AND mptpi.`type`=3726 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'10042025': {'nb_upload': 11, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1351145984, 1351145980, 1351145976, 1351145908, 1351145902, 1351145862, 1351145861, 1351145793, 1351145763, 1351145750, 1351145722] Looping around the photos to save general results len do output : 1 /22234353Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2740447') ('3318', '22234353', '1351145984', None, None, None, None, None, '2740447') ('3318', None, None, None, None, None, None, None, '2740447') ('3318', '22234353', '1351145980', None, None, None, None, None, '2740447') ('3318', None, None, None, None, None, None, None, '2740447') ('3318', '22234353', '1351145976', None, None, None, None, None, '2740447') ('3318', None, None, None, None, None, None, None, '2740447') ('3318', '22234353', '1351145908', None, None, None, None, None, '2740447') ('3318', None, None, None, None, None, None, None, '2740447') ('3318', '22234353', '1351145902', None, None, None, None, None, '2740447') ('3318', None, None, None, None, None, None, None, '2740447') ('3318', '22234353', '1351145862', None, None, None, None, None, '2740447') ('3318', None, None, None, None, None, None, None, '2740447') ('3318', '22234353', '1351145861', None, None, None, None, None, '2740447') ('3318', None, None, None, None, None, None, None, '2740447') ('3318', '22234353', '1351145793', None, None, None, None, None, '2740447') ('3318', None, None, None, None, None, None, None, '2740447') ('3318', '22234353', '1351145763', None, None, None, None, None, '2740447') ('3318', None, None, None, None, None, None, None, '2740447') ('3318', '22234353', '1351145750', None, None, None, None, None, '2740447') ('3318', None, None, None, None, None, None, None, '2740447') ('3318', '22234353', '1351145722', None, None, None, None, None, '2740447') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.01572394371032715 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.6208956241607666 time spend to save output : 0.015981435775756836 total time spend for step 10 : 1.6368770599365234 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 11 set_done_treatment 195.88user 223.17system 9:26.37elapsed 73%CPU (0avgtext+0avgdata 5613060maxresident)k 941032inputs+161144outputs (18862major+16715113minor)pagefaults 0swaps