python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1018967 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3337311'] with mtr_portfolio_ids : ['25266836'] and first list_photo_ids : [] new path : /proc/1018967/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 8 ; length of list_pids : 8 ; length of list_args : 8 time to download the photos : 1.5791442394256592 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Thu Jul 24 10:10:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 5665 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-07-24 10:10:33.544080: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-07-24 10:10:33.579522: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493035000 Hz 2025-07-24 10:10:33.581637: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fad60000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-07-24 10:10:33.581691: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-07-24 10:10:33.586662: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-07-24 10:10:33.757615: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x2d561880 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-07-24 10:10:33.757661: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-07-24 10:10:33.759238: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-07-24 10:10:33.760966: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-07-24 10:10:33.791546: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-07-24 10:10:33.810482: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-07-24 10:10:33.814874: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-07-24 10:10:33.846101: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-07-24 10:10:33.850314: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-07-24 10:10:33.905656: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-07-24 10:10:33.907111: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-07-24 10:10:33.907563: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-07-24 10:10:33.909100: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-07-24 10:10:33.909121: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-07-24 10:10:33.909133: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-07-24 10:10:33.910748: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 5183 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-07-24 10:10:34.284999: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-07-24 10:10:34.285148: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-07-24 10:10:34.285171: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-07-24 10:10:34.285190: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-07-24 10:10:34.285204: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-07-24 10:10:34.285219: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-07-24 10:10:34.285235: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-07-24 10:10:34.285254: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-07-24 10:10:34.286249: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-07-24 10:10:34.287416: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-07-24 10:10:34.287450: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-07-24 10:10:34.287466: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-07-24 10:10:34.287485: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-07-24 10:10:34.287501: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-07-24 10:10:34.287517: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-07-24 10:10:34.287539: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-07-24 10:10:34.287563: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-07-24 10:10:34.288591: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-07-24 10:10:34.288628: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-07-24 10:10:34.288638: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-07-24 10:10:34.288647: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-07-24 10:10:34.289648: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 5183 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-07-24 10:10:48.074377: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-07-24 10:10:48.394495: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-07-24 10:10:50.420240: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 10:10:50.421063: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.60G (3865470464 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 10:10:51.249541: W tensorflow/core/common_runtime/bfc_allocator.cc:311] Garbage collection: deallocate free memory regions (i.e., allocations) so that we can re-allocate a larger region to avoid OOM due to memory fragmentation. If you see this message frequently, you are running near the threshold of the available device memory and re-allocation may incur great performance overhead. You may try smaller batch sizes to observe the performance impact. Set TF_ENABLE_GPU_GARBAGE_COLLECTION=false if you'd like to disable this feature. 2025-07-24 10:10:51.327494: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 10:10:51.327615: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 3.29GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-07-24 10:10:51.329092: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 10:10:51.329122: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 3.29GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-07-24 10:10:51.336785: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 10:10:51.336825: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 1.78GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-07-24 10:10:51.337557: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 10:10:51.337590: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 1.78GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-07-24 10:10:51.378155: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 10:10:51.378218: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 19.91MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-07-24 10:10:51.378269: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-07-24 10:10:51.379689: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 10:10:51.379727: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 16.00MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-07-24 10:10:51.381097: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 10:10:51.381140: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 16.00MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-07-24 10:10:51.388010: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 10:10:51.388039: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 63.85MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-07-24 10:10:51.388764: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 10:10:51.388794: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 63.85MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-07-24 10:10:51.389544: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 10:10:51.389566: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.26GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-07-24 10:10:51.390289: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 10:10:51.398807: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 10:10:51.399631: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 10:10:51.425569: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 10:10:51.427034: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 10:10:51.428349: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 10:10:51.429167: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 10:10:51.433565: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 10:10:51.434383: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 10:10:51.435210: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 10:10:51.436021: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 10:10:51.437986: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 10:10:51.447659: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 10:10:51.448500: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 10:10:51.458078: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 10:10:51.458921: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 10:10:51.459778: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 10:10:51.460563: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 10:10:51.461372: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-07-24 10:10:51.462140: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 8 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 46 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 49 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 61 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 42 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 42 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 38 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 32 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 34 Detection mask done ! Trying to reset tf kernel 1019523 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 4472 tf kernel not reseted sub process len(results) : 8 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 8 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5665 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.001981973648071289 nb_pixel_total : 45726 time to create 1 rle with old method : 0.05012226104736328 length of segment : 338 time for calcul the mask position with numpy : 0.0020890235900878906 nb_pixel_total : 68095 time to create 1 rle with old method : 0.07483124732971191 length of segment : 363 time for calcul the mask position with numpy : 0.0008683204650878906 nb_pixel_total : 41091 time to create 1 rle with old method : 0.046448707580566406 length of segment : 265 time for calcul the mask position with numpy : 0.0004019737243652344 nb_pixel_total : 15047 time to create 1 rle with old method : 0.017735719680786133 length of segment : 99 time for calcul the mask position with numpy : 0.0012826919555664062 nb_pixel_total : 22881 time to create 1 rle with old method : 0.033298492431640625 length of segment : 203 time for calcul the mask position with numpy : 0.0007724761962890625 nb_pixel_total : 27218 time to create 1 rle with old method : 0.03160977363586426 length of segment : 291 time for calcul the mask position with numpy : 0.0015196800231933594 nb_pixel_total : 56118 time to create 1 rle with old method : 0.06658530235290527 length of segment : 280 time for calcul the mask position with numpy : 0.0005557537078857422 nb_pixel_total : 18411 time to create 1 rle with old method : 0.021342754364013672 length of segment : 198 time for calcul the mask position with numpy : 0.0017840862274169922 nb_pixel_total : 50625 time to create 1 rle with old method : 0.05644702911376953 length of segment : 364 time for calcul the mask position with numpy : 0.004577159881591797 nb_pixel_total : 102140 time to create 1 rle with old method : 0.11303877830505371 length of segment : 370 time for calcul the mask position with numpy : 0.0006480216979980469 nb_pixel_total : 22784 time to create 1 rle with old method : 0.030321598052978516 length of segment : 162 time for calcul the mask position with numpy : 0.0003192424774169922 nb_pixel_total : 6968 time to create 1 rle with old method : 0.00802469253540039 length of segment : 130 time for calcul the mask position with numpy : 0.0014448165893554688 nb_pixel_total : 45840 time to create 1 rle with old method : 0.0592653751373291 length of segment : 239 time for calcul the mask position with numpy : 0.0013382434844970703 nb_pixel_total : 42728 time to create 1 rle with old method : 0.05087900161743164 length of segment : 325 time for calcul the mask position with numpy : 0.000997304916381836 nb_pixel_total : 34472 time to create 1 rle with old method : 0.04607868194580078 length of segment : 212 time for calcul the mask position with numpy : 0.0025315284729003906 nb_pixel_total : 44677 time to create 1 rle with old method : 0.05637693405151367 length of segment : 304 time for calcul the mask position with numpy : 0.0018768310546875 nb_pixel_total : 75768 time to create 1 rle with old method : 0.08971858024597168 length of segment : 399 time for calcul the mask position with numpy : 0.0010616779327392578 nb_pixel_total : 19771 time to create 1 rle with old method : 0.022709369659423828 length of segment : 135 time for calcul the mask position with numpy : 0.0027408599853515625 nb_pixel_total : 58374 time to create 1 rle with old method : 0.06758880615234375 length of segment : 198 time for calcul the mask position with numpy : 0.0010361671447753906 nb_pixel_total : 19127 time to create 1 rle with old method : 0.022557735443115234 length of segment : 169 time for calcul the mask position with numpy : 0.0058901309967041016 nb_pixel_total : 122287 time to create 1 rle with old method : 0.14193439483642578 length of segment : 390 time for calcul the mask position with numpy : 0.0011162757873535156 nb_pixel_total : 20800 time to create 1 rle with old method : 0.02342963218688965 length of segment : 173 time for calcul the mask position with numpy : 0.0016894340515136719 nb_pixel_total : 30689 time to create 1 rle with old method : 0.034653663635253906 length of segment : 297 time for calcul the mask position with numpy : 0.0030095577239990234 nb_pixel_total : 75563 time to create 1 rle with old method : 0.08609795570373535 length of segment : 402 time for calcul the mask position with numpy : 0.0013878345489501953 nb_pixel_total : 30293 time to create 1 rle with old method : 0.03469443321228027 length of segment : 204 time for calcul the mask position with numpy : 0.00153350830078125 nb_pixel_total : 26358 time to create 1 rle with old method : 0.030377864837646484 length of segment : 193 time for calcul the mask position with numpy : 0.0010733604431152344 nb_pixel_total : 26846 time to create 1 rle with old method : 0.031050443649291992 length of segment : 173 time for calcul the mask position with numpy : 0.002093791961669922 nb_pixel_total : 42286 time to create 1 rle with old method : 0.049195289611816406 length of segment : 233 time for calcul the mask position with numpy : 0.0020720958709716797 nb_pixel_total : 27867 time to create 1 rle with old method : 0.03208637237548828 length of segment : 319 time for calcul the mask position with numpy : 0.000982522964477539 nb_pixel_total : 18961 time to create 1 rle with old method : 0.022301197052001953 length of segment : 187 time for calcul the mask position with numpy : 0.02303791046142578 nb_pixel_total : 515679 time to create 1 rle with new method : 0.02839350700378418 length of segment : 1071 time for calcul the mask position with numpy : 0.001331329345703125 nb_pixel_total : 29790 time to create 1 rle with old method : 0.03761625289916992 length of segment : 250 time for calcul the mask position with numpy : 0.0006723403930664062 nb_pixel_total : 30996 time to create 1 rle with old method : 0.03534245491027832 length of segment : 240 time for calcul the mask position with numpy : 0.0025720596313476562 nb_pixel_total : 50591 time to create 1 rle with old method : 0.05721640586853027 length of segment : 396 time for calcul the mask position with numpy : 0.001394510269165039 nb_pixel_total : 31873 time to create 1 rle with old method : 0.03673863410949707 length of segment : 360 time for calcul the mask position with numpy : 0.004009246826171875 nb_pixel_total : 88239 time to create 1 rle with old method : 0.10603165626525879 length of segment : 478 time for calcul the mask position with numpy : 0.004007577896118164 nb_pixel_total : 56064 time to create 1 rle with old method : 0.06472969055175781 length of segment : 503 time for calcul the mask position with numpy : 0.000213623046875 nb_pixel_total : 5618 time to create 1 rle with old method : 0.0070760250091552734 length of segment : 84 time for calcul the mask position with numpy : 0.002337217330932617 nb_pixel_total : 21917 time to create 1 rle with old method : 0.027376651763916016 length of segment : 196 time for calcul the mask position with numpy : 0.001016855239868164 nb_pixel_total : 13422 time to create 1 rle with old method : 0.016251087188720703 length of segment : 268 time for calcul the mask position with numpy : 0.0008916854858398438 nb_pixel_total : 44632 time to create 1 rle with old method : 0.05825948715209961 length of segment : 294 time for calcul the mask position with numpy : 0.0007505416870117188 nb_pixel_total : 10334 time to create 1 rle with old method : 0.012762069702148438 length of segment : 148 time for calcul the mask position with numpy : 0.003810405731201172 nb_pixel_total : 97112 time to create 1 rle with old method : 0.11540889739990234 length of segment : 418 time for calcul the mask position with numpy : 0.0006227493286132812 nb_pixel_total : 9663 time to create 1 rle with old method : 0.01166677474975586 length of segment : 160 time for calcul the mask position with numpy : 0.006618499755859375 nb_pixel_total : 236743 time to create 1 rle with new method : 0.01301264762878418 length of segment : 711 time for calcul the mask position with numpy : 0.00019216537475585938 nb_pixel_total : 6003 time to create 1 rle with old method : 0.007014036178588867 length of segment : 87 time for calcul the mask position with numpy : 0.0013933181762695312 nb_pixel_total : 26349 time to create 1 rle with old method : 0.03082132339477539 length of segment : 172 time for calcul the mask position with numpy : 0.0006532669067382812 nb_pixel_total : 22551 time to create 1 rle with old method : 0.026114702224731445 length of segment : 307 time for calcul the mask position with numpy : 0.002321958541870117 nb_pixel_total : 36490 time to create 1 rle with old method : 0.04472184181213379 length of segment : 339 time for calcul the mask position with numpy : 0.0019390583038330078 nb_pixel_total : 31555 time to create 1 rle with old method : 0.036476850509643555 length of segment : 372 time for calcul the mask position with numpy : 0.0016553401947021484 nb_pixel_total : 28723 time to create 1 rle with old method : 0.03375124931335449 length of segment : 269 time for calcul the mask position with numpy : 0.002395153045654297 nb_pixel_total : 46600 time to create 1 rle with old method : 0.05437135696411133 length of segment : 216 time for calcul the mask position with numpy : 0.0014188289642333984 nb_pixel_total : 25465 time to create 1 rle with old method : 0.030020475387573242 length of segment : 251 time for calcul the mask position with numpy : 0.0010976791381835938 nb_pixel_total : 27452 time to create 1 rle with old method : 0.03270983695983887 length of segment : 147 time for calcul the mask position with numpy : 0.0036363601684570312 nb_pixel_total : 21594 time to create 1 rle with old method : 0.02654743194580078 length of segment : 165 time for calcul the mask position with numpy : 0.001401662826538086 nb_pixel_total : 27240 time to create 1 rle with old method : 0.033685922622680664 length of segment : 455 time for calcul the mask position with numpy : 0.0012102127075195312 nb_pixel_total : 23094 time to create 1 rle with old method : 0.027339696884155273 length of segment : 152 time for calcul the mask position with numpy : 0.00270843505859375 nb_pixel_total : 42473 time to create 1 rle with old method : 0.05055069923400879 length of segment : 303 time for calcul the mask position with numpy : 0.0013759136199951172 nb_pixel_total : 30863 time to create 1 rle with old method : 0.036386728286743164 length of segment : 209 time for calcul the mask position with numpy : 0.0004794597625732422 nb_pixel_total : 9403 time to create 1 rle with old method : 0.011364459991455078 length of segment : 104 time for calcul the mask position with numpy : 0.002457857131958008 nb_pixel_total : 56976 time to create 1 rle with old method : 0.0679776668548584 length of segment : 302 time for calcul the mask position with numpy : 0.0016903877258300781 nb_pixel_total : 25302 time to create 1 rle with old method : 0.030605554580688477 length of segment : 257 time for calcul the mask position with numpy : 0.0007169246673583984 nb_pixel_total : 13065 time to create 1 rle with old method : 0.015948057174682617 length of segment : 107 time for calcul the mask position with numpy : 0.003116130828857422 nb_pixel_total : 49017 time to create 1 rle with old method : 0.05759024620056152 length of segment : 239 time for calcul the mask position with numpy : 0.0020041465759277344 nb_pixel_total : 52398 time to create 1 rle with old method : 0.06154036521911621 length of segment : 474 time for calcul the mask position with numpy : 0.0010662078857421875 nb_pixel_total : 18604 time to create 1 rle with old method : 0.023458480834960938 length of segment : 149 time for calcul the mask position with numpy : 0.0037627220153808594 nb_pixel_total : 22631 time to create 1 rle with old method : 0.027446746826171875 length of segment : 414 time for calcul the mask position with numpy : 0.00069427490234375 nb_pixel_total : 15026 time to create 1 rle with old method : 0.018085956573486328 length of segment : 154 time for calcul the mask position with numpy : 0.006865501403808594 nb_pixel_total : 130990 time to create 1 rle with old method : 0.17195391654968262 length of segment : 477 time for calcul the mask position with numpy : 0.0009915828704833984 nb_pixel_total : 14363 time to create 1 rle with old method : 0.018852949142456055 length of segment : 224 time for calcul the mask position with numpy : 0.0011587142944335938 nb_pixel_total : 11215 time to create 1 rle with old method : 0.021179914474487305 length of segment : 172 time for calcul the mask position with numpy : 0.001180887222290039 nb_pixel_total : 12219 time to create 1 rle with old method : 0.02094244956970215 length of segment : 98 time for calcul the mask position with numpy : 0.0008566379547119141 nb_pixel_total : 18268 time to create 1 rle with old method : 0.022017478942871094 length of segment : 198 time for calcul the mask position with numpy : 0.002389192581176758 nb_pixel_total : 44082 time to create 1 rle with old method : 0.05325913429260254 length of segment : 207 time for calcul the mask position with numpy : 0.0035321712493896484 nb_pixel_total : 51824 time to create 1 rle with old method : 0.06080889701843262 length of segment : 514 time for calcul the mask position with numpy : 0.0008060932159423828 nb_pixel_total : 14788 time to create 1 rle with old method : 0.01855635643005371 length of segment : 183 time for calcul the mask position with numpy : 0.00022554397583007812 nb_pixel_total : 6288 time to create 1 rle with old method : 0.0076825618743896484 length of segment : 130 time for calcul the mask position with numpy : 0.012609720230102539 nb_pixel_total : 112924 time to create 1 rle with old method : 0.1326920986175537 length of segment : 1200 time for calcul the mask position with numpy : 0.0035376548767089844 nb_pixel_total : 100012 time to create 1 rle with old method : 0.11722707748413086 length of segment : 436 time for calcul the mask position with numpy : 0.000324249267578125 nb_pixel_total : 13305 time to create 1 rle with old method : 0.01827692985534668 length of segment : 137 time for calcul the mask position with numpy : 0.001294851303100586 nb_pixel_total : 28929 time to create 1 rle with old method : 0.03461146354675293 length of segment : 148 time for calcul the mask position with numpy : 0.001726388931274414 nb_pixel_total : 40509 time to create 1 rle with old method : 0.04745745658874512 length of segment : 176 time for calcul the mask position with numpy : 0.0027916431427001953 nb_pixel_total : 57946 time to create 1 rle with old method : 0.0675201416015625 length of segment : 503 time for calcul the mask position with numpy : 0.0009043216705322266 nb_pixel_total : 23921 time to create 1 rle with old method : 0.0292205810546875 length of segment : 164 time for calcul the mask position with numpy : 0.0009510517120361328 nb_pixel_total : 26674 time to create 1 rle with old method : 0.03144669532775879 length of segment : 204 time for calcul the mask position with numpy : 0.0020897388458251953 nb_pixel_total : 42826 time to create 1 rle with old method : 0.05087423324584961 length of segment : 236 time for calcul the mask position with numpy : 0.0015788078308105469 nb_pixel_total : 43117 time to create 1 rle with old method : 0.05121922492980957 length of segment : 213 time for calcul the mask position with numpy : 0.001073598861694336 nb_pixel_total : 32157 time to create 1 rle with old method : 0.03799867630004883 length of segment : 197 time for calcul the mask position with numpy : 0.0005016326904296875 nb_pixel_total : 13508 time to create 1 rle with old method : 0.016272544860839844 length of segment : 109 time for calcul the mask position with numpy : 0.0008046627044677734 nb_pixel_total : 19117 time to create 1 rle with old method : 0.02302408218383789 length of segment : 156 time for calcul the mask position with numpy : 0.0010089874267578125 nb_pixel_total : 20205 time to create 1 rle with old method : 0.025181293487548828 length of segment : 175 time for calcul the mask position with numpy : 0.003509998321533203 nb_pixel_total : 99195 time to create 1 rle with old method : 0.11619019508361816 length of segment : 286 time for calcul the mask position with numpy : 0.0029077529907226562 nb_pixel_total : 39074 time to create 1 rle with old method : 0.046327829360961914 length of segment : 384 time for calcul the mask position with numpy : 0.0027217864990234375 nb_pixel_total : 54668 time to create 1 rle with old method : 0.06369376182556152 length of segment : 428 time for calcul the mask position with numpy : 0.0018053054809570312 nb_pixel_total : 37797 time to create 1 rle with old method : 0.044541120529174805 length of segment : 490 time for calcul the mask position with numpy : 0.004148006439208984 nb_pixel_total : 93426 time to create 1 rle with old method : 0.10952234268188477 length of segment : 464 time for calcul the mask position with numpy : 0.0015850067138671875 nb_pixel_total : 33770 time to create 1 rle with old method : 0.04207921028137207 length of segment : 168 time for calcul the mask position with numpy : 0.003206014633178711 nb_pixel_total : 81814 time to create 1 rle with old method : 0.12216734886169434 length of segment : 332 time for calcul the mask position with numpy : 0.0012555122375488281 nb_pixel_total : 29951 time to create 1 rle with old method : 0.03551888465881348 length of segment : 217 time for calcul the mask position with numpy : 0.0003082752227783203 nb_pixel_total : 8479 time to create 1 rle with old method : 0.010343313217163086 length of segment : 91 time for calcul the mask position with numpy : 0.001329183578491211 nb_pixel_total : 28287 time to create 1 rle with old method : 0.034076690673828125 length of segment : 205 time for calcul the mask position with numpy : 0.0011005401611328125 nb_pixel_total : 32600 time to create 1 rle with old method : 0.03926229476928711 length of segment : 177 time for calcul the mask position with numpy : 0.00040531158447265625 nb_pixel_total : 17597 time to create 1 rle with old method : 0.02099156379699707 length of segment : 138 time for calcul the mask position with numpy : 0.00026226043701171875 nb_pixel_total : 8870 time to create 1 rle with old method : 0.012107372283935547 length of segment : 134 time for calcul the mask position with numpy : 0.0004436969757080078 nb_pixel_total : 12387 time to create 1 rle with old method : 0.015250682830810547 length of segment : 100 time for calcul the mask position with numpy : 0.0035643577575683594 nb_pixel_total : 100099 time to create 1 rle with old method : 0.1182093620300293 length of segment : 369 time for calcul the mask position with numpy : 0.0005347728729248047 nb_pixel_total : 19368 time to create 1 rle with old method : 0.023128271102905273 length of segment : 174 time for calcul the mask position with numpy : 0.0025594234466552734 nb_pixel_total : 40065 time to create 1 rle with old method : 0.04715585708618164 length of segment : 239 time for calcul the mask position with numpy : 0.00018215179443359375 nb_pixel_total : 4015 time to create 1 rle with old method : 0.004987001419067383 length of segment : 70 time for calcul the mask position with numpy : 0.00017333030700683594 nb_pixel_total : 5423 time to create 1 rle with old method : 0.006731986999511719 length of segment : 61 time for calcul the mask position with numpy : 0.00027060508728027344 nb_pixel_total : 5729 time to create 1 rle with old method : 0.007080793380737305 length of segment : 92 time for calcul the mask position with numpy : 0.0006170272827148438 nb_pixel_total : 9363 time to create 1 rle with old method : 0.011328458786010742 length of segment : 159 time for calcul the mask position with numpy : 0.0015561580657958984 nb_pixel_total : 39092 time to create 1 rle with old method : 0.04636549949645996 length of segment : 244 time for calcul the mask position with numpy : 0.005442142486572266 nb_pixel_total : 96056 time to create 1 rle with old method : 0.11946988105773926 length of segment : 402 time for calcul the mask position with numpy : 0.0020372867584228516 nb_pixel_total : 53837 time to create 1 rle with old method : 0.06204509735107422 length of segment : 284 time for calcul the mask position with numpy : 0.001672506332397461 nb_pixel_total : 51794 time to create 1 rle with old method : 0.07922768592834473 length of segment : 265 time for calcul the mask position with numpy : 0.002251148223876953 nb_pixel_total : 69666 time to create 1 rle with old method : 0.0815284252166748 length of segment : 389 time for calcul the mask position with numpy : 0.0007297992706298828 nb_pixel_total : 19812 time to create 1 rle with old method : 0.024004697799682617 length of segment : 266 time for calcul the mask position with numpy : 0.0010259151458740234 nb_pixel_total : 23852 time to create 1 rle with old method : 0.02841973304748535 length of segment : 165 time for calcul the mask position with numpy : 0.0035715103149414062 nb_pixel_total : 136930 time to create 1 rle with old method : 0.16021347045898438 length of segment : 466 time for calcul the mask position with numpy : 0.0070497989654541016 nb_pixel_total : 239811 time to create 1 rle with new method : 0.014235258102416992 length of segment : 569 time for calcul the mask position with numpy : 0.0014302730560302734 nb_pixel_total : 64861 time to create 1 rle with old method : 0.07575154304504395 length of segment : 363 time for calcul the mask position with numpy : 0.0006856918334960938 nb_pixel_total : 17214 time to create 1 rle with old method : 0.020415306091308594 length of segment : 186 time for calcul the mask position with numpy : 0.0011026859283447266 nb_pixel_total : 32444 time to create 1 rle with old method : 0.03827857971191406 length of segment : 226 time for calcul the mask position with numpy : 0.001130819320678711 nb_pixel_total : 24187 time to create 1 rle with old method : 0.029254436492919922 length of segment : 259 time for calcul the mask position with numpy : 0.0005636215209960938 nb_pixel_total : 14897 time to create 1 rle with old method : 0.017783164978027344 length of segment : 139 time for calcul the mask position with numpy : 0.003283262252807617 nb_pixel_total : 91054 time to create 1 rle with old method : 0.10630393028259277 length of segment : 495 time for calcul the mask position with numpy : 0.0016870498657226562 nb_pixel_total : 70397 time to create 1 rle with old method : 0.0830075740814209 length of segment : 292 time for calcul the mask position with numpy : 0.001333475112915039 nb_pixel_total : 40802 time to create 1 rle with old method : 0.04763674736022949 length of segment : 313 time for calcul the mask position with numpy : 0.003625154495239258 nb_pixel_total : 129627 time to create 1 rle with old method : 0.14995360374450684 length of segment : 347 time for calcul the mask position with numpy : 0.005636930465698242 nb_pixel_total : 167251 time to create 1 rle with new method : 0.018383502960205078 length of segment : 1026 time for calcul the mask position with numpy : 0.0017557144165039062 nb_pixel_total : 56119 time to create 1 rle with old method : 0.06530642509460449 length of segment : 403 time for calcul the mask position with numpy : 0.0004885196685791016 nb_pixel_total : 12689 time to create 1 rle with old method : 0.014761924743652344 length of segment : 131 time for calcul the mask position with numpy : 0.0010178089141845703 nb_pixel_total : 24987 time to create 1 rle with old method : 0.029749393463134766 length of segment : 204 time for calcul the mask position with numpy : 0.001928091049194336 nb_pixel_total : 69701 time to create 1 rle with old method : 0.08107352256774902 length of segment : 338 time for calcul the mask position with numpy : 0.0005128383636474609 nb_pixel_total : 13571 time to create 1 rle with old method : 0.016379117965698242 length of segment : 146 time for calcul the mask position with numpy : 0.0006186962127685547 nb_pixel_total : 16118 time to create 1 rle with old method : 0.019947290420532227 length of segment : 94 time for calcul the mask position with numpy : 0.00030493736267089844 nb_pixel_total : 7601 time to create 1 rle with old method : 0.00925135612487793 length of segment : 105 time for calcul the mask position with numpy : 0.0005166530609130859 nb_pixel_total : 16074 time to create 1 rle with old method : 0.019225120544433594 length of segment : 96 time for calcul the mask position with numpy : 0.0012383460998535156 nb_pixel_total : 47193 time to create 1 rle with old method : 0.055071115493774414 length of segment : 242 time for calcul the mask position with numpy : 0.0009615421295166016 nb_pixel_total : 33738 time to create 1 rle with old method : 0.03947734832763672 length of segment : 182 time for calcul the mask position with numpy : 0.0009860992431640625 nb_pixel_total : 35437 time to create 1 rle with old method : 0.05383920669555664 length of segment : 182 time for calcul the mask position with numpy : 0.0005440711975097656 nb_pixel_total : 16183 time to create 1 rle with old method : 0.019276142120361328 length of segment : 140 time for calcul the mask position with numpy : 0.0003821849822998047 nb_pixel_total : 9954 time to create 1 rle with old method : 0.012198925018310547 length of segment : 93 time for calcul the mask position with numpy : 0.0008378028869628906 nb_pixel_total : 20874 time to create 1 rle with old method : 0.0249788761138916 length of segment : 227 time for calcul the mask position with numpy : 0.0013043880462646484 nb_pixel_total : 32306 time to create 1 rle with old method : 0.03820681571960449 length of segment : 231 time for calcul the mask position with numpy : 0.0008499622344970703 nb_pixel_total : 26581 time to create 1 rle with old method : 0.03145265579223633 length of segment : 140 time for calcul the mask position with numpy : 0.0015103816986083984 nb_pixel_total : 25029 time to create 1 rle with old method : 0.03009176254272461 length of segment : 205 time for calcul the mask position with numpy : 0.0018117427825927734 nb_pixel_total : 59123 time to create 1 rle with old method : 0.06976485252380371 length of segment : 274 time for calcul the mask position with numpy : 0.0007853507995605469 nb_pixel_total : 18075 time to create 1 rle with old method : 0.02153944969177246 length of segment : 157 time for calcul the mask position with numpy : 0.0004563331604003906 nb_pixel_total : 8275 time to create 1 rle with old method : 0.010204076766967773 length of segment : 124 time for calcul the mask position with numpy : 0.0011107921600341797 nb_pixel_total : 29059 time to create 1 rle with old method : 0.03456926345825195 length of segment : 299 time for calcul the mask position with numpy : 0.00016021728515625 nb_pixel_total : 4873 time to create 1 rle with old method : 0.005890846252441406 length of segment : 96 time for calcul the mask position with numpy : 0.0009410381317138672 nb_pixel_total : 36481 time to create 1 rle with old method : 0.0421595573425293 length of segment : 169 time for calcul the mask position with numpy : 0.0013387203216552734 nb_pixel_total : 48065 time to create 1 rle with old method : 0.05605721473693848 length of segment : 252 time for calcul the mask position with numpy : 0.0014731884002685547 nb_pixel_total : 37113 time to create 1 rle with old method : 0.04562973976135254 length of segment : 395 time for calcul the mask position with numpy : 0.0019943714141845703 nb_pixel_total : 32212 time to create 1 rle with old method : 0.05179715156555176 length of segment : 410 time for calcul the mask position with numpy : 0.0005023479461669922 nb_pixel_total : 9575 time to create 1 rle with old method : 0.01163625717163086 length of segment : 115 time for calcul the mask position with numpy : 0.0009047985076904297 nb_pixel_total : 23885 time to create 1 rle with old method : 0.028855323791503906 length of segment : 141 time for calcul the mask position with numpy : 0.0005447864532470703 nb_pixel_total : 13669 time to create 1 rle with old method : 0.016057729721069336 length of segment : 93 time for calcul the mask position with numpy : 0.0017554759979248047 nb_pixel_total : 56242 time to create 1 rle with old method : 0.06597018241882324 length of segment : 373 time for calcul the mask position with numpy : 0.00045871734619140625 nb_pixel_total : 4975 time to create 1 rle with old method : 0.005928754806518555 length of segment : 117 time for calcul the mask position with numpy : 0.005075216293334961 nb_pixel_total : 120186 time to create 1 rle with old method : 0.13940072059631348 length of segment : 339 time for calcul the mask position with numpy : 0.003091573715209961 nb_pixel_total : 84275 time to create 1 rle with old method : 0.0956122875213623 length of segment : 317 time for calcul the mask position with numpy : 0.012436866760253906 nb_pixel_total : 206895 time to create 1 rle with new method : 0.0236818790435791 length of segment : 843 time for calcul the mask position with numpy : 0.0009815692901611328 nb_pixel_total : 19516 time to create 1 rle with old method : 0.02267932891845703 length of segment : 200 time for calcul the mask position with numpy : 0.0007250308990478516 nb_pixel_total : 36735 time to create 1 rle with old method : 0.04500436782836914 length of segment : 244 time for calcul the mask position with numpy : 0.0003864765167236328 nb_pixel_total : 19473 time to create 1 rle with old method : 0.023326635360717773 length of segment : 208 time for calcul the mask position with numpy : 0.0016291141510009766 nb_pixel_total : 28323 time to create 1 rle with old method : 0.03433728218078613 length of segment : 343 time for calcul the mask position with numpy : 0.003683805465698242 nb_pixel_total : 117248 time to create 1 rle with old method : 0.13921856880187988 length of segment : 486 time for calcul the mask position with numpy : 0.0011682510375976562 nb_pixel_total : 26490 time to create 1 rle with old method : 0.032065391540527344 length of segment : 281 time for calcul the mask position with numpy : 0.006711721420288086 nb_pixel_total : 206506 time to create 1 rle with new method : 0.012422561645507812 length of segment : 442 time for calcul the mask position with numpy : 0.0015721321105957031 nb_pixel_total : 36153 time to create 1 rle with old method : 0.04387784004211426 length of segment : 229 time for calcul the mask position with numpy : 0.0032019615173339844 nb_pixel_total : 61341 time to create 1 rle with old method : 0.07863783836364746 length of segment : 317 time for calcul the mask position with numpy : 0.0016894340515136719 nb_pixel_total : 33716 time to create 1 rle with old method : 0.040013790130615234 length of segment : 266 time for calcul the mask position with numpy : 0.0020210742950439453 nb_pixel_total : 64318 time to create 1 rle with old method : 0.07547593116760254 length of segment : 305 time for calcul the mask position with numpy : 0.0005974769592285156 nb_pixel_total : 14257 time to create 1 rle with old method : 0.016287565231323242 length of segment : 134 time for calcul the mask position with numpy : 0.001140594482421875 nb_pixel_total : 29777 time to create 1 rle with old method : 0.03547978401184082 length of segment : 175 time for calcul the mask position with numpy : 0.0008609294891357422 nb_pixel_total : 27625 time to create 1 rle with old method : 0.03252553939819336 length of segment : 229 time for calcul the mask position with numpy : 0.0008053779602050781 nb_pixel_total : 17788 time to create 1 rle with old method : 0.020763397216796875 length of segment : 255 time for calcul the mask position with numpy : 0.0014002323150634766 nb_pixel_total : 38132 time to create 1 rle with old method : 0.044744014739990234 length of segment : 211 time for calcul the mask position with numpy : 0.00015497207641601562 nb_pixel_total : 4477 time to create 1 rle with old method : 0.005366086959838867 length of segment : 109 time for calcul the mask position with numpy : 0.0009927749633789062 nb_pixel_total : 32596 time to create 1 rle with old method : 0.03785443305969238 length of segment : 192 time for calcul the mask position with numpy : 0.00023412704467773438 nb_pixel_total : 10094 time to create 1 rle with old method : 0.012315988540649414 length of segment : 94 time for calcul the mask position with numpy : 0.002271413803100586 nb_pixel_total : 63129 time to create 1 rle with old method : 0.07527375221252441 length of segment : 382 time for calcul the mask position with numpy : 0.0007712841033935547 nb_pixel_total : 28274 time to create 1 rle with old method : 0.03213357925415039 length of segment : 142 time for calcul the mask position with numpy : 0.0017096996307373047 nb_pixel_total : 56313 time to create 1 rle with old method : 0.0698239803314209 length of segment : 210 time spent for convertir_results : 15.639955759048462 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 187 chid ids of type : 3594 Number RLEs to save : 49694 save missing photos in datou_result : time spend for datou_step_exec : 102.01339387893677 time spend to save output : 3.2424349784851074 total time spend for step 1 : 105.25582885742188 step2:crop_condition Thu Jul 24 10:12:14 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 8 ! batch 1 Loaded 187 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 159 About to insert : list_path_to_insert length 159 new photo from crops ! About to upload 159 photos upload in portfolio : 3736932 init cache_photo without model_param we have 159 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1753344772_1018967 This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! we have uploaded 159 photos in the portfolio 3736932 time of upload the photos Elapsed time : 38.67655348777771 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 15 About to insert : list_path_to_insert length 15 new photo from crops ! About to upload 15 photos upload in portfolio : 3736932 init cache_photo without model_param we have 15 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1753344815_1018967 This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! we have uploaded 15 photos in the portfolio 3736932 time of upload the photos Elapsed time : 4.2333526611328125 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1753344821_1018967 This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.7738866806030273 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 11 About to insert : list_path_to_insert length 11 new photo from crops ! About to upload 11 photos upload in portfolio : 3736932 init cache_photo without model_param we have 11 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1753344826_1018967 This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! we have uploaded 11 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.9517881870269775 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1753344830_1018967 This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.5738084316253662 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1373490553, 1373490484, 1373490376, 1373490368, 1373490349, 1373490317, 1373490301, 1373490253] Looping around the photos to save general results len do output : 187 /1373502072Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502073Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502074Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502075Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502076Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502077Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502078Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502079Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502080Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502081Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502082Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502083Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502084Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502085Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502086Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502087Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502088Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502090Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502091Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502092Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502093Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502094Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502095Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502096Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502097Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502100Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502101Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502102Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502103Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502104Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502106Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502107Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502108Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502109Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502110Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502111Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502112Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502113Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502114Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502115Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502116Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502117Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502118Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502119Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502120Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502121Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502122Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502123Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502124Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502125Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502126Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502127Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502128Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502129Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502130Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502132Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502133Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502134Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502135Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502136Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502137Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502138Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502139Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502141Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502142Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502143Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502144Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502145Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502146Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502147Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502148Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502149Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502150Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502151Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502152Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502153Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502154Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502155Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502156Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502157Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502158Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502159Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502160Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502161Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502162Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502163Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502164Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502165Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502167Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502168Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502169Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502170Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502171Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502172Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502173Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502174Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502175Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502176Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502177Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502178Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502179Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502180Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502181Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502182Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502183Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502184Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502185Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502186Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502187Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502188Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502190Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502191Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502192Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502193Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502194Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502195Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502196Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502198Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502199Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502200Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502201Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502202Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502203Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502204Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502205Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502206Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502207Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502208Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502209Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502210Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502211Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502212Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502213Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502214Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502215Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502216Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502217Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502218Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502219Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502220Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502221Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502222Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502223Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502224Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502225Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502227Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502228Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502229Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502230Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502231Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502232Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502233Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502234Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502235Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502236Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502237Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502238Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502239Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502240Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502247Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502249Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502250Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502251Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502253Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502254Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502255Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502256Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502257Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502258Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502259Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502260Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502261Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502262Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502263Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502265Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502270Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502271Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502272Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502273Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502274Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502275Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502276Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502277Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502278Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502279Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502280Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373502281Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3337311') ('3318', '25266836', '1373490553', None, None, None, None, None, '3337311') ('3318', None, None, None, None, None, None, None, '3337311') ('3318', '25266836', '1373490484', None, None, None, None, None, '3337311') ('3318', None, None, None, None, None, None, None, '3337311') ('3318', '25266836', '1373490376', None, None, None, None, None, '3337311') ('3318', None, None, None, None, None, None, None, '3337311') ('3318', '25266836', '1373490368', None, None, None, None, None, '3337311') ('3318', None, None, None, None, None, None, None, '3337311') ('3318', '25266836', '1373490349', None, None, None, None, None, '3337311') ('3318', None, None, None, None, None, None, None, '3337311') ('3318', '25266836', '1373490317', None, None, None, None, None, '3337311') ('3318', None, None, None, None, None, None, None, '3337311') ('3318', '25266836', '1373490301', None, None, None, None, None, '3337311') ('3318', None, None, None, None, None, None, None, '3337311') ('3318', '25266836', '1373490253', None, None, None, None, None, '3337311') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 569 time used for this insertion : 0.07347345352172852 save_final save missing photos in datou_result : time spend for datou_step_exec : 95.87704133987427 time spend to save output : 0.0782327651977539 total time spend for step 2 : 95.95527410507202 step3:rle_unique_nms_with_priority Thu Jul 24 10:13:50 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 187 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 20 nb_hashtags : 3 time to prepare the origin masks : 8.862157106399536 time for calcul the mask position with numpy : 0.7376983165740967 nb_pixel_total : 7476731 time to create 1 rle with new method : 1.062403678894043 time for calcul the mask position with numpy : 0.026049375534057617 nb_pixel_total : 19127 time to create 1 rle with old method : 0.022164583206176758 time for calcul the mask position with numpy : 0.026010513305664062 nb_pixel_total : 58374 time to create 1 rle with old method : 0.06642389297485352 time for calcul the mask position with numpy : 0.025257349014282227 nb_pixel_total : 19771 time to create 1 rle with old method : 0.022170543670654297 time for calcul the mask position with numpy : 0.025751113891601562 nb_pixel_total : 75768 time to create 1 rle with old method : 0.08767247200012207 time for calcul the mask position with numpy : 0.027382850646972656 nb_pixel_total : 44677 time to create 1 rle with old method : 0.051300764083862305 time for calcul the mask position with numpy : 0.026894330978393555 nb_pixel_total : 34472 time to create 1 rle with old method : 0.04027128219604492 time for calcul the mask position with numpy : 0.025257587432861328 nb_pixel_total : 42728 time to create 1 rle with old method : 0.04915881156921387 time for calcul the mask position with numpy : 0.02524590492248535 nb_pixel_total : 45840 time to create 1 rle with old method : 0.052747249603271484 time for calcul the mask position with numpy : 0.025375843048095703 nb_pixel_total : 6968 time to create 1 rle with old method : 0.008217573165893555 time for calcul the mask position with numpy : 0.03511834144592285 nb_pixel_total : 22784 time to create 1 rle with old method : 0.02628493309020996 time for calcul the mask position with numpy : 0.025202035903930664 nb_pixel_total : 102140 time to create 1 rle with old method : 0.11866903305053711 time for calcul the mask position with numpy : 0.026674747467041016 nb_pixel_total : 50625 time to create 1 rle with old method : 0.05835843086242676 time for calcul the mask position with numpy : 0.029307842254638672 nb_pixel_total : 18219 time to create 1 rle with old method : 0.021706104278564453 time for calcul the mask position with numpy : 0.026520252227783203 nb_pixel_total : 56118 time to create 1 rle with old method : 0.06545853614807129 time for calcul the mask position with numpy : 0.025130748748779297 nb_pixel_total : 27218 time to create 1 rle with old method : 0.031883955001831055 time for calcul the mask position with numpy : 0.027333498001098633 nb_pixel_total : 22881 time to create 1 rle with old method : 0.02654099464416504 time for calcul the mask position with numpy : 0.026094436645507812 nb_pixel_total : 15047 time to create 1 rle with old method : 0.017470359802246094 time for calcul the mask position with numpy : 0.026980876922607422 nb_pixel_total : 41091 time to create 1 rle with old method : 0.04772019386291504 time for calcul the mask position with numpy : 0.030881881713867188 nb_pixel_total : 68095 time to create 1 rle with old method : 0.0783541202545166 time for calcul the mask position with numpy : 0.026641368865966797 nb_pixel_total : 45726 time to create 1 rle with old method : 0.05368542671203613 create new chi : 3.325040102005005 time to delete rle : 0.0217440128326416 batch 1 Loaded 41 chid ids of type : 3594 ++++++++++++++++++++++++Number RLEs to save : 12222 TO DO : save crop sub photo not yet done ! save time : 0.8170943260192871 nb_obj : 26 nb_hashtags : 3 time to prepare the origin masks : 4.959705591201782 time for calcul the mask position with numpy : 0.7183256149291992 nb_pixel_total : 6673344 time to create 1 rle with new method : 0.9912748336791992 time for calcul the mask position with numpy : 0.03441786766052246 nb_pixel_total : 21917 time to create 1 rle with old method : 0.025806427001953125 time for calcul the mask position with numpy : 0.038434505462646484 nb_pixel_total : 87050 time to create 1 rle with old method : 0.10146689414978027 time for calcul the mask position with numpy : 0.03437042236328125 nb_pixel_total : 5514 time to create 1 rle with old method : 0.006411075592041016 time for calcul the mask position with numpy : 0.03464508056640625 nb_pixel_total : 20800 time to create 1 rle with old method : 0.025010108947753906 time for calcul the mask position with numpy : 0.034445762634277344 nb_pixel_total : 42286 time to create 1 rle with old method : 0.04932522773742676 time for calcul the mask position with numpy : 0.034409523010253906 nb_pixel_total : 26846 time to create 1 rle with old method : 0.031244516372680664 time for calcul the mask position with numpy : 0.034868717193603516 nb_pixel_total : 56064 time to create 1 rle with old method : 0.06598019599914551 time for calcul the mask position with numpy : 0.03466391563415527 nb_pixel_total : 44632 time to create 1 rle with old method : 0.05144476890563965 time for calcul the mask position with numpy : 0.040283203125 nb_pixel_total : 489172 time to create 1 rle with new method : 0.89121413230896 time for calcul the mask position with numpy : 0.034218788146972656 nb_pixel_total : 29790 time to create 1 rle with old method : 0.03435564041137695 time for calcul the mask position with numpy : 0.03409910202026367 nb_pixel_total : 31699 time to create 1 rle with old method : 0.03719496726989746 time for calcul the mask position with numpy : 0.0342710018157959 nb_pixel_total : 26358 time to create 1 rle with old method : 0.03060293197631836 time for calcul the mask position with numpy : 0.03401517868041992 nb_pixel_total : 75563 time to create 1 rle with old method : 0.08668851852416992 time for calcul the mask position with numpy : 0.03572487831115723 nb_pixel_total : 27867 time to create 1 rle with old method : 0.032334327697753906 time for calcul the mask position with numpy : 0.034130096435546875 nb_pixel_total : 30293 time to create 1 rle with old method : 0.034642934799194336 time for calcul the mask position with numpy : 0.03421831130981445 nb_pixel_total : 97112 time to create 1 rle with old method : 0.11261606216430664 time for calcul the mask position with numpy : 0.034552574157714844 nb_pixel_total : 216478 time to create 1 rle with new method : 0.7311320304870605 time for calcul the mask position with numpy : 0.03412508964538574 nb_pixel_total : 10334 time to create 1 rle with old method : 0.011890649795532227 time for calcul the mask position with numpy : 0.03661990165710449 nb_pixel_total : 30129 time to create 1 rle with old method : 0.03412055969238281 time for calcul the mask position with numpy : 0.03554224967956543 nb_pixel_total : 50591 time to create 1 rle with old method : 0.05696535110473633 time for calcul the mask position with numpy : 0.03380775451660156 nb_pixel_total : 18961 time to create 1 rle with old method : 0.022219419479370117 time for calcul the mask position with numpy : 0.03384232521057129 nb_pixel_total : 5539 time to create 1 rle with old method : 0.006438732147216797 time for calcul the mask position with numpy : 0.033693790435791016 nb_pixel_total : 30689 time to create 1 rle with old method : 0.03516960144042969 time for calcul the mask position with numpy : 0.03412747383117676 nb_pixel_total : 122287 time to create 1 rle with old method : 0.13897442817687988 time for calcul the mask position with numpy : 0.034030914306640625 nb_pixel_total : 9663 time to create 1 rle with old method : 0.011499881744384766 time for calcul the mask position with numpy : 0.033689022064208984 nb_pixel_total : 13422 time to create 1 rle with old method : 0.015178680419921875 create new chi : 5.387314796447754 time to delete rle : 0.0024285316467285156 batch 1 Loaded 53 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++Number RLEs to save : 17792 TO DO : save crop sub photo not yet done ! save time : 1.1716279983520508 nb_obj : 37 nb_hashtags : 3 time to prepare the origin masks : 4.476459980010986 time for calcul the mask position with numpy : 0.6438357830047607 nb_pixel_total : 6997743 time to create 1 rle with new method : 0.8331420421600342 time for calcul the mask position with numpy : 0.03730034828186035 nb_pixel_total : 13305 time to create 1 rle with old method : 0.016544342041015625 time for calcul the mask position with numpy : 0.038369178771972656 nb_pixel_total : 36490 time to create 1 rle with old method : 0.043218135833740234 time for calcul the mask position with numpy : 0.03395581245422363 nb_pixel_total : 28929 time to create 1 rle with old method : 0.03325152397155762 time for calcul the mask position with numpy : 0.03519892692565918 nb_pixel_total : 130990 time to create 1 rle with old method : 0.1530616283416748 time for calcul the mask position with numpy : 0.034453392028808594 nb_pixel_total : 49017 time to create 1 rle with old method : 0.05745887756347656 time for calcul the mask position with numpy : 0.03447461128234863 nb_pixel_total : 15026 time to create 1 rle with old method : 0.017562389373779297 time for calcul the mask position with numpy : 0.035341739654541016 nb_pixel_total : 44082 time to create 1 rle with old method : 0.05226445198059082 time for calcul the mask position with numpy : 0.0345158576965332 nb_pixel_total : 14788 time to create 1 rle with old method : 0.01733994483947754 time for calcul the mask position with numpy : 0.035419464111328125 nb_pixel_total : 100012 time to create 1 rle with old method : 0.1148838996887207 time for calcul the mask position with numpy : 0.034734487533569336 nb_pixel_total : 31555 time to create 1 rle with old method : 0.03683733940124512 time for calcul the mask position with numpy : 0.03444075584411621 nb_pixel_total : 18268 time to create 1 rle with old method : 0.020681142807006836 time for calcul the mask position with numpy : 0.03389286994934082 nb_pixel_total : 26349 time to create 1 rle with old method : 0.030081748962402344 time for calcul the mask position with numpy : 0.03392481803894043 nb_pixel_total : 40509 time to create 1 rle with old method : 0.04614901542663574 time for calcul the mask position with numpy : 0.03403902053833008 nb_pixel_total : 9403 time to create 1 rle with old method : 0.010997295379638672 time for calcul the mask position with numpy : 0.0341799259185791 nb_pixel_total : 28723 time to create 1 rle with old method : 0.04292011260986328 time for calcul the mask position with numpy : 0.038976192474365234 nb_pixel_total : 56976 time to create 1 rle with old method : 0.06903576850891113 time for calcul the mask position with numpy : 0.034497976303100586 nb_pixel_total : 18604 time to create 1 rle with old method : 0.021625280380249023 time for calcul the mask position with numpy : 0.034036874771118164 nb_pixel_total : 11215 time to create 1 rle with old method : 0.012708425521850586 time for calcul the mask position with numpy : 0.039907217025756836 nb_pixel_total : 46600 time to create 1 rle with old method : 0.05298900604248047 time for calcul the mask position with numpy : 0.03401446342468262 nb_pixel_total : 57946 time to create 1 rle with old method : 0.06618976593017578 time for calcul the mask position with numpy : 0.03533935546875 nb_pixel_total : 25465 time to create 1 rle with old method : 0.031004667282104492 time for calcul the mask position with numpy : 0.03445172309875488 nb_pixel_total : 102177 time to create 1 rle with old method : 0.11662459373474121 time for calcul the mask position with numpy : 0.03382253646850586 nb_pixel_total : 52398 time to create 1 rle with old method : 0.06016898155212402 time for calcul the mask position with numpy : 0.03480172157287598 nb_pixel_total : 42473 time to create 1 rle with old method : 0.049071311950683594 time for calcul the mask position with numpy : 0.034377336502075195 nb_pixel_total : 21594 time to create 1 rle with old method : 0.024814367294311523 time for calcul the mask position with numpy : 0.03589057922363281 nb_pixel_total : 22631 time to create 1 rle with old method : 0.02634406089782715 time for calcul the mask position with numpy : 0.03476667404174805 nb_pixel_total : 13065 time to create 1 rle with old method : 0.015201330184936523 time for calcul the mask position with numpy : 0.03534388542175293 nb_pixel_total : 22551 time to create 1 rle with old method : 0.026282787322998047 time for calcul the mask position with numpy : 0.03453540802001953 nb_pixel_total : 49869 time to create 1 rle with old method : 0.05773520469665527 time for calcul the mask position with numpy : 0.035394906997680664 nb_pixel_total : 26079 time to create 1 rle with old method : 0.04208683967590332 time for calcul the mask position with numpy : 0.03817415237426758 nb_pixel_total : 30863 time to create 1 rle with old method : 0.035774946212768555 time for calcul the mask position with numpy : 0.03546643257141113 nb_pixel_total : 14350 time to create 1 rle with old method : 0.020697355270385742 time for calcul the mask position with numpy : 0.03706622123718262 nb_pixel_total : 12219 time to create 1 rle with old method : 0.014923334121704102 time for calcul the mask position with numpy : 0.03475141525268555 nb_pixel_total : 25302 time to create 1 rle with old method : 0.03040766716003418 time for calcul the mask position with numpy : 0.03528189659118652 nb_pixel_total : 6288 time to create 1 rle with old method : 0.007895708084106445 time for calcul the mask position with numpy : 0.037531375885009766 nb_pixel_total : 23094 time to create 1 rle with old method : 0.03769540786743164 time for calcul the mask position with numpy : 0.037384986877441406 nb_pixel_total : 27452 time to create 1 rle with old method : 0.03189730644226074 create new chi : 4.376433610916138 time to delete rle : 0.0034079551696777344 batch 1 Loaded 75 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 22147 TO DO : save crop sub photo not yet done ! save time : 1.5111100673675537 nb_obj : 29 nb_hashtags : 3 time to prepare the origin masks : 4.765089273452759 time for calcul the mask position with numpy : 0.7096021175384521 nb_pixel_total : 7322240 time to create 1 rle with new method : 1.0795960426330566 time for calcul the mask position with numpy : 0.03481721878051758 nb_pixel_total : 37797 time to create 1 rle with old method : 0.0447385311126709 time for calcul the mask position with numpy : 0.03466224670410156 nb_pixel_total : 5266 time to create 1 rle with old method : 0.006193637847900391 time for calcul the mask position with numpy : 0.03538799285888672 nb_pixel_total : 28287 time to create 1 rle with old method : 0.03569817543029785 time for calcul the mask position with numpy : 0.034848690032958984 nb_pixel_total : 20205 time to create 1 rle with old method : 0.023510456085205078 time for calcul the mask position with numpy : 0.03549385070800781 nb_pixel_total : 29951 time to create 1 rle with old method : 0.03801608085632324 time for calcul the mask position with numpy : 0.03498554229736328 nb_pixel_total : 99195 time to create 1 rle with old method : 0.11200737953186035 time for calcul the mask position with numpy : 0.03414297103881836 nb_pixel_total : 9363 time to create 1 rle with old method : 0.010956048965454102 time for calcul the mask position with numpy : 0.03785967826843262 nb_pixel_total : 32157 time to create 1 rle with old method : 0.04994797706604004 time for calcul the mask position with numpy : 0.03490710258483887 nb_pixel_total : 93426 time to create 1 rle with old method : 0.11025428771972656 time for calcul the mask position with numpy : 0.03471708297729492 nb_pixel_total : 42826 time to create 1 rle with old method : 0.05276298522949219 time for calcul the mask position with numpy : 0.03613996505737305 nb_pixel_total : 40065 time to create 1 rle with old method : 0.0531926155090332 time for calcul the mask position with numpy : 0.035126447677612305 nb_pixel_total : 98927 time to create 1 rle with old method : 0.12346553802490234 time for calcul the mask position with numpy : 0.034674882888793945 nb_pixel_total : 33770 time to create 1 rle with old method : 0.03926372528076172 time for calcul the mask position with numpy : 0.03454256057739258 nb_pixel_total : 19368 time to create 1 rle with old method : 0.023934602737426758 time for calcul the mask position with numpy : 0.03489112854003906 nb_pixel_total : 81814 time to create 1 rle with old method : 0.10084700584411621 time for calcul the mask position with numpy : 0.03587079048156738 nb_pixel_total : 23921 time to create 1 rle with old method : 0.027767658233642578 time for calcul the mask position with numpy : 0.03549361228942871 nb_pixel_total : 43117 time to create 1 rle with old method : 0.05009913444519043 time for calcul the mask position with numpy : 0.035542964935302734 nb_pixel_total : 32600 time to create 1 rle with old method : 0.03779339790344238 time for calcul the mask position with numpy : 0.03561687469482422 nb_pixel_total : 54668 time to create 1 rle with old method : 0.0633993148803711 time for calcul the mask position with numpy : 0.034668922424316406 nb_pixel_total : 33421 time to create 1 rle with old method : 0.0397796630859375 time for calcul the mask position with numpy : 0.03448200225830078 nb_pixel_total : 19117 time to create 1 rle with old method : 0.022235393524169922 time for calcul the mask position with numpy : 0.034757137298583984 nb_pixel_total : 5729 time to create 1 rle with old method : 0.006932973861694336 time for calcul the mask position with numpy : 0.03873419761657715 nb_pixel_total : 26674 time to create 1 rle with old method : 0.030496835708618164 time for calcul the mask position with numpy : 0.03482222557067871 nb_pixel_total : 17597 time to create 1 rle with old method : 0.021414518356323242 time for calcul the mask position with numpy : 0.036154985427856445 nb_pixel_total : 13508 time to create 1 rle with old method : 0.016242027282714844 time for calcul the mask position with numpy : 0.03502845764160156 nb_pixel_total : 12387 time to create 1 rle with old method : 0.01567244529724121 time for calcul the mask position with numpy : 0.034540414810180664 nb_pixel_total : 8479 time to create 1 rle with old method : 0.0098876953125 time for calcul the mask position with numpy : 0.03522229194641113 nb_pixel_total : 3102 time to create 1 rle with old method : 0.0036962032318115234 time for calcul the mask position with numpy : 0.03588461875915527 nb_pixel_total : 5423 time to create 1 rle with old method : 0.006315708160400391 create new chi : 4.028393268585205 time to delete rle : 0.002414703369140625 batch 1 Loaded 59 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++Number RLEs to save : 14040 TO DO : save crop sub photo not yet done ! save time : 0.9666156768798828 nb_obj : 21 nb_hashtags : 2 time to prepare the origin masks : 8.286949396133423 time for calcul the mask position with numpy : 0.588200569152832 nb_pixel_total : 6856817 time to create 1 rle with new method : 1.0246689319610596 time for calcul the mask position with numpy : 0.02484416961669922 nb_pixel_total : 12689 time to create 1 rle with old method : 0.014838695526123047 time for calcul the mask position with numpy : 0.027048110961914062 nb_pixel_total : 56119 time to create 1 rle with old method : 0.0646059513092041 time for calcul the mask position with numpy : 0.027637958526611328 nb_pixel_total : 156091 time to create 1 rle with new method : 0.6877164840698242 time for calcul the mask position with numpy : 0.0256497859954834 nb_pixel_total : 129627 time to create 1 rle with old method : 0.14683842658996582 time for calcul the mask position with numpy : 0.024194717407226562 nb_pixel_total : 40802 time to create 1 rle with old method : 0.045964956283569336 time for calcul the mask position with numpy : 0.02402043342590332 nb_pixel_total : 70397 time to create 1 rle with old method : 0.08043241500854492 time for calcul the mask position with numpy : 0.024015426635742188 nb_pixel_total : 91054 time to create 1 rle with old method : 0.10428333282470703 time for calcul the mask position with numpy : 0.025014877319335938 nb_pixel_total : 14897 time to create 1 rle with old method : 0.016819000244140625 time for calcul the mask position with numpy : 0.024780750274658203 nb_pixel_total : 24187 time to create 1 rle with old method : 0.026582956314086914 time for calcul the mask position with numpy : 0.02469921112060547 nb_pixel_total : 32444 time to create 1 rle with old method : 0.03719758987426758 time for calcul the mask position with numpy : 0.02483963966369629 nb_pixel_total : 17214 time to create 1 rle with old method : 0.019025325775146484 time for calcul the mask position with numpy : 0.025155067443847656 nb_pixel_total : 61212 time to create 1 rle with old method : 0.067626953125 time for calcul the mask position with numpy : 0.025386333465576172 nb_pixel_total : 239811 time to create 1 rle with new method : 0.819138765335083 time for calcul the mask position with numpy : 0.02974700927734375 nb_pixel_total : 136930 time to create 1 rle with old method : 0.15602612495422363 time for calcul the mask position with numpy : 0.025208473205566406 nb_pixel_total : 23852 time to create 1 rle with old method : 0.026950836181640625 time for calcul the mask position with numpy : 0.024226665496826172 nb_pixel_total : 19812 time to create 1 rle with old method : 0.022223711013793945 time for calcul the mask position with numpy : 0.025549650192260742 nb_pixel_total : 69666 time to create 1 rle with old method : 0.07967138290405273 time for calcul the mask position with numpy : 0.025072336196899414 nb_pixel_total : 51794 time to create 1 rle with old method : 0.059145212173461914 time for calcul the mask position with numpy : 0.024098634719848633 nb_pixel_total : 53837 time to create 1 rle with old method : 0.05997037887573242 time for calcul the mask position with numpy : 0.025134801864624023 nb_pixel_total : 96056 time to create 1 rle with old method : 0.1080625057220459 time for calcul the mask position with numpy : 0.02536177635192871 nb_pixel_total : 39092 time to create 1 rle with old method : 0.04331207275390625 create new chi : 4.92565655708313 time to delete rle : 0.002168893814086914 batch 1 Loaded 43 chid ids of type : 3594 ++++++++++++++++++++++++++++++Number RLEs to save : 16110 TO DO : save crop sub photo not yet done ! save time : 1.0294756889343262 nb_obj : 23 nb_hashtags : 4 time to prepare the origin masks : 10.258400678634644 time for calcul the mask position with numpy : 0.7004029750823975 nb_pixel_total : 7659726 time to create 1 rle with new method : 0.7611370086669922 time for calcul the mask position with numpy : 0.039655208587646484 nb_pixel_total : 35803 time to create 1 rle with old method : 0.04067850112915039 time for calcul the mask position with numpy : 0.024622201919555664 nb_pixel_total : 48065 time to create 1 rle with old method : 0.05490303039550781 time for calcul the mask position with numpy : 0.02497553825378418 nb_pixel_total : 36481 time to create 1 rle with old method : 0.04163956642150879 time for calcul the mask position with numpy : 0.024489641189575195 nb_pixel_total : 4764 time to create 1 rle with old method : 0.005443572998046875 time for calcul the mask position with numpy : 0.0252382755279541 nb_pixel_total : 29059 time to create 1 rle with old method : 0.03282427787780762 time for calcul the mask position with numpy : 0.02420973777770996 nb_pixel_total : 8275 time to create 1 rle with old method : 0.009725093841552734 time for calcul the mask position with numpy : 0.025227785110473633 nb_pixel_total : 18075 time to create 1 rle with old method : 0.020488739013671875 time for calcul the mask position with numpy : 0.02521038055419922 nb_pixel_total : 58805 time to create 1 rle with old method : 0.06638598442077637 time for calcul the mask position with numpy : 0.02434372901916504 nb_pixel_total : 25029 time to create 1 rle with old method : 0.0285184383392334 time for calcul the mask position with numpy : 0.024556636810302734 nb_pixel_total : 26581 time to create 1 rle with old method : 0.03057861328125 time for calcul the mask position with numpy : 0.025430917739868164 nb_pixel_total : 32306 time to create 1 rle with old method : 0.03621840476989746 time for calcul the mask position with numpy : 0.024814844131469727 nb_pixel_total : 20874 time to create 1 rle with old method : 0.02370142936706543 time for calcul the mask position with numpy : 0.02409505844116211 nb_pixel_total : 9954 time to create 1 rle with old method : 0.011383295059204102 time for calcul the mask position with numpy : 0.02459406852722168 nb_pixel_total : 16183 time to create 1 rle with old method : 0.018120765686035156 time for calcul the mask position with numpy : 0.025008440017700195 nb_pixel_total : 35437 time to create 1 rle with old method : 0.04007863998413086 time for calcul the mask position with numpy : 0.024724721908569336 nb_pixel_total : 33738 time to create 1 rle with old method : 0.03809165954589844 time for calcul the mask position with numpy : 0.02545928955078125 nb_pixel_total : 47193 time to create 1 rle with old method : 0.07511234283447266 time for calcul the mask position with numpy : 0.026580810546875 nb_pixel_total : 16074 time to create 1 rle with old method : 0.01818537712097168 time for calcul the mask position with numpy : 0.024209260940551758 nb_pixel_total : 7601 time to create 1 rle with old method : 0.008726358413696289 time for calcul the mask position with numpy : 0.024276018142700195 nb_pixel_total : 16118 time to create 1 rle with old method : 0.017946720123291016 time for calcul the mask position with numpy : 0.024700403213500977 nb_pixel_total : 13571 time to create 1 rle with old method : 0.01535177230834961 time for calcul the mask position with numpy : 0.024447202682495117 nb_pixel_total : 69701 time to create 1 rle with old method : 0.08046364784240723 time for calcul the mask position with numpy : 0.024680376052856445 nb_pixel_total : 24987 time to create 1 rle with old method : 0.028804779052734375 create new chi : 2.8358871936798096 time to delete rle : 0.0016334056854248047 batch 1 Loaded 47 chid ids of type : 3594 ++++++++++++++++++++++++++Number RLEs to save : 10846 TO DO : save crop sub photo not yet done ! save time : 0.7584657669067383 nb_obj : 16 nb_hashtags : 2 time to prepare the origin masks : 6.938806772232056 time for calcul the mask position with numpy : 0.7476596832275391 nb_pixel_total : 7299499 time to create 1 rle with new method : 0.908228874206543 time for calcul the mask position with numpy : 0.03586149215698242 nb_pixel_total : 206506 time to create 1 rle with new method : 0.8305604457855225 time for calcul the mask position with numpy : 0.02283954620361328 nb_pixel_total : 26490 time to create 1 rle with old method : 0.028780221939086914 time for calcul the mask position with numpy : 0.02511453628540039 nb_pixel_total : 117248 time to create 1 rle with old method : 0.13113808631896973 time for calcul the mask position with numpy : 0.025495052337646484 nb_pixel_total : 28323 time to create 1 rle with old method : 0.03097391128540039 time for calcul the mask position with numpy : 0.023869037628173828 nb_pixel_total : 19473 time to create 1 rle with old method : 0.02117609977722168 time for calcul the mask position with numpy : 0.02414417266845703 nb_pixel_total : 25431 time to create 1 rle with old method : 0.02800774574279785 time for calcul the mask position with numpy : 0.024623870849609375 nb_pixel_total : 19516 time to create 1 rle with old method : 0.02151775360107422 time for calcul the mask position with numpy : 0.024820804595947266 nb_pixel_total : 206895 time to create 1 rle with new method : 0.5636558532714844 time for calcul the mask position with numpy : 0.02498602867126465 nb_pixel_total : 84275 time to create 1 rle with old method : 0.09309864044189453 time for calcul the mask position with numpy : 0.025069236755371094 nb_pixel_total : 120186 time to create 1 rle with old method : 0.1370992660522461 time for calcul the mask position with numpy : 0.0265653133392334 nb_pixel_total : 4975 time to create 1 rle with old method : 0.005727291107177734 time for calcul the mask position with numpy : 0.025925159454345703 nb_pixel_total : 56242 time to create 1 rle with old method : 0.06264591217041016 time for calcul the mask position with numpy : 0.025697708129882812 nb_pixel_total : 13669 time to create 1 rle with old method : 0.01540517807006836 time for calcul the mask position with numpy : 0.03859210014343262 nb_pixel_total : 23885 time to create 1 rle with old method : 0.02704763412475586 time for calcul the mask position with numpy : 0.038168907165527344 nb_pixel_total : 9575 time to create 1 rle with old method : 0.010691404342651367 time for calcul the mask position with numpy : 0.037090301513671875 nb_pixel_total : 32212 time to create 1 rle with old method : 0.0351567268371582 create new chi : 4.238300323486328 time to delete rle : 0.001695394515991211 batch 1 Loaded 33 chid ids of type : 3594 ++++++++++++++++++++Number RLEs to save : 11840 TO DO : save crop sub photo not yet done ! save time : 0.7919425964355469 nb_obj : 15 nb_hashtags : 3 time to prepare the origin masks : 8.307294130325317 time for calcul the mask position with numpy : 1.9947528839111328 nb_pixel_total : 7781078 time to create 1 rle with new method : 0.9988288879394531 time for calcul the mask position with numpy : 0.02686452865600586 nb_pixel_total : 56313 time to create 1 rle with old method : 0.06692314147949219 time for calcul the mask position with numpy : 0.043126583099365234 nb_pixel_total : 28274 time to create 1 rle with old method : 0.03261232376098633 time for calcul the mask position with numpy : 0.045148611068725586 nb_pixel_total : 63129 time to create 1 rle with old method : 0.08727288246154785 time for calcul the mask position with numpy : 0.04582786560058594 nb_pixel_total : 5443 time to create 1 rle with old method : 0.006517887115478516 time for calcul the mask position with numpy : 0.04666471481323242 nb_pixel_total : 32596 time to create 1 rle with old method : 0.040001630783081055 time for calcul the mask position with numpy : 0.04513287544250488 nb_pixel_total : 4460 time to create 1 rle with old method : 0.005329132080078125 time for calcul the mask position with numpy : 0.04600834846496582 nb_pixel_total : 38132 time to create 1 rle with old method : 0.04506516456604004 time for calcul the mask position with numpy : 0.04334521293640137 nb_pixel_total : 17788 time to create 1 rle with old method : 0.020915508270263672 time for calcul the mask position with numpy : 0.043967485427856445 nb_pixel_total : 27625 time to create 1 rle with old method : 0.04781055450439453 time for calcul the mask position with numpy : 0.05553126335144043 nb_pixel_total : 29777 time to create 1 rle with old method : 0.034454345703125 time for calcul the mask position with numpy : 0.042433738708496094 nb_pixel_total : 14257 time to create 1 rle with old method : 0.01698446273803711 time for calcul the mask position with numpy : 0.04406309127807617 nb_pixel_total : 64318 time to create 1 rle with old method : 0.07924342155456543 time for calcul the mask position with numpy : 0.038411855697631836 nb_pixel_total : 33716 time to create 1 rle with old method : 0.03800821304321289 time for calcul the mask position with numpy : 0.03841376304626465 nb_pixel_total : 61341 time to create 1 rle with old method : 0.06904006004333496 time for calcul the mask position with numpy : 0.024181604385375977 nb_pixel_total : 36153 time to create 1 rle with old method : 0.0405116081237793 create new chi : 4.304817199707031 time to delete rle : 0.0020618438720703125 batch 1 Loaded 31 chid ids of type : 3594 +++++++++++++++++++++Number RLEs to save : 8558 TO DO : save crop sub photo not yet done ! save time : 0.6412315368652344 map_output_result : {1373490553: (0.0, 'Should be the crop_list due to order', 0), 1373490484: (0.0, 'Should be the crop_list due to order', 0), 1373490376: (0.0, 'Should be the crop_list due to order', 0), 1373490368: (0.0, 'Should be the crop_list due to order', 0), 1373490349: (0.0, 'Should be the crop_list due to order', 0), 1373490317: (0.0, 'Should be the crop_list due to order', 0), 1373490301: (0.0, 'Should be the crop_list due to order', 0), 1373490253: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1373490553, 1373490484, 1373490376, 1373490368, 1373490349, 1373490317, 1373490301, 1373490253] Looping around the photos to save general results len do output : 8 /1373490553.Didn't retrieve data . /1373490484.Didn't retrieve data . /1373490376.Didn't retrieve data . /1373490368.Didn't retrieve data . /1373490349.Didn't retrieve data . /1373490317.Didn't retrieve data . /1373490301.Didn't retrieve data . /1373490253.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3337311') ('3318', '25266836', '1373490553', None, None, None, None, None, '3337311') ('3318', None, None, None, None, None, None, None, '3337311') ('3318', '25266836', '1373490484', None, None, None, None, None, '3337311') ('3318', None, None, None, None, None, None, None, '3337311') ('3318', '25266836', '1373490376', None, None, None, None, None, '3337311') ('3318', None, None, None, None, None, None, None, '3337311') ('3318', '25266836', '1373490368', None, None, None, None, None, '3337311') ('3318', None, None, None, None, None, None, None, '3337311') ('3318', '25266836', '1373490349', None, None, None, None, None, '3337311') ('3318', None, None, None, None, None, None, None, '3337311') ('3318', '25266836', '1373490317', None, None, None, None, None, '3337311') ('3318', None, None, None, None, None, None, None, '3337311') ('3318', '25266836', '1373490301', None, None, None, None, None, '3337311') ('3318', None, None, None, None, None, None, None, '3337311') ('3318', '25266836', '1373490253', None, None, None, None, None, '3337311') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.014055252075195312 save_final save missing photos in datou_result : time spend for datou_step_exec : 99.31174206733704 time spend to save output : 0.015148639678955078 total time spend for step 3 : 99.32689070701599 step4:ventilate_hashtags_in_portfolio Thu Jul 24 10:15:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 25266836 get user id for portfolio 25266836 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25266836 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','metal','background','pet_clair','pehd','environnement','mal_croppe','carton','autre','pet_fonce','flou')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25266836 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','metal','background','pet_clair','pehd','environnement','mal_croppe','carton','autre','pet_fonce','flou')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25266836 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','metal','background','pet_clair','pehd','environnement','mal_croppe','carton','autre','pet_fonce','flou')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/25267417,25267418,25267419,25267420,25267421,25267422,25267423,25267424,25267425,25267426,25267427?tags=papier,metal,background,pet_clair,pehd,environnement,mal_croppe,carton,autre,pet_fonce,flou Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1373490553, 1373490484, 1373490376, 1373490368, 1373490349, 1373490317, 1373490301, 1373490253] Looping around the photos to save general results len do output : 1 /25266836. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3337311') ('3318', '25266836', '1373490553', None, None, None, None, None, '3337311') ('3318', None, None, None, None, None, None, None, '3337311') ('3318', '25266836', '1373490484', None, None, None, None, None, '3337311') ('3318', None, None, None, None, None, None, None, '3337311') ('3318', '25266836', '1373490376', None, None, None, None, None, '3337311') ('3318', None, None, None, None, None, None, None, '3337311') ('3318', '25266836', '1373490368', None, None, None, None, None, '3337311') ('3318', None, None, None, None, None, None, None, '3337311') ('3318', '25266836', '1373490349', None, None, None, None, None, '3337311') ('3318', None, None, None, None, None, None, None, '3337311') ('3318', '25266836', '1373490317', None, None, None, None, None, '3337311') ('3318', None, None, None, None, None, None, None, '3337311') ('3318', '25266836', '1373490301', None, None, None, None, None, '3337311') ('3318', None, None, None, None, None, None, None, '3337311') ('3318', '25266836', '1373490253', None, None, None, None, None, '3337311') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.01574397087097168 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.7138586044311523 time spend to save output : 0.015993356704711914 total time spend for step 4 : 1.7298519611358643 step5:final Thu Jul 24 10:15:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1373490553: ('0.12490388093171298',), 1373490484: ('0.12490388093171298',), 1373490376: ('0.12490388093171298',), 1373490368: ('0.12490388093171298',), 1373490349: ('0.12490388093171298',), 1373490317: ('0.12490388093171298',), 1373490301: ('0.12490388093171298',), 1373490253: ('0.12490388093171298',)} new output for save of step final : {1373490553: ('0.12490388093171298',), 1373490484: ('0.12490388093171298',), 1373490376: ('0.12490388093171298',), 1373490368: ('0.12490388093171298',), 1373490349: ('0.12490388093171298',), 1373490317: ('0.12490388093171298',), 1373490301: ('0.12490388093171298',), 1373490253: ('0.12490388093171298',)} [1373490553, 1373490484, 1373490376, 1373490368, 1373490349, 1373490317, 1373490301, 1373490253] Looping around the photos to save general results len do output : 8 /1373490553.Didn't retrieve data . /1373490484.Didn't retrieve data . /1373490376.Didn't retrieve data . /1373490368.Didn't retrieve data . /1373490349.Didn't retrieve data . /1373490317.Didn't retrieve data . /1373490301.Didn't retrieve data . /1373490253.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3337311') ('3318', '25266836', '1373490553', None, None, None, None, None, '3337311') ('3318', None, None, None, None, None, None, None, '3337311') ('3318', '25266836', '1373490484', None, None, None, None, None, '3337311') ('3318', None, None, None, None, None, None, None, '3337311') ('3318', '25266836', '1373490376', None, None, None, None, None, '3337311') ('3318', None, None, None, None, None, None, None, '3337311') ('3318', '25266836', '1373490368', None, None, None, None, None, '3337311') ('3318', None, None, None, None, None, None, None, '3337311') ('3318', '25266836', '1373490349', None, None, None, None, None, '3337311') ('3318', None, None, None, None, None, None, None, '3337311') ('3318', '25266836', '1373490317', None, None, None, None, None, '3337311') ('3318', None, None, None, None, None, None, None, '3337311') ('3318', '25266836', '1373490301', None, None, None, None, None, '3337311') ('3318', None, None, None, None, None, None, None, '3337311') ('3318', '25266836', '1373490253', None, None, None, None, None, '3337311') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.014281034469604492 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.12303304672241211 time spend to save output : 0.014700889587402344 total time spend for step 5 : 0.13773393630981445 step6:blur_detection Thu Jul 24 10:15:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1753344628_1018967_1373490553_cf2ec0cec9c27a9b3ef63869fe5cf4c0.jpg resize: (2160, 3840) 1373490553 -7.686886015784252 treat image : temp/1753344628_1018967_1373490484_cada5609c77324748ba4167a608b4659.jpg resize: (2160, 3840) 1373490484 -7.725158739937881 treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead.jpg resize: (2160, 3840) 1373490376 -7.629035151043603 treat image : temp/1753344628_1018967_1373490368_882407a2a62a0ef018fa8be23230f479.jpg resize: (2160, 3840) 1373490368 -7.605841245864178 treat image : temp/1753344628_1018967_1373490349_1adabe4f393c69aad809b60b58cadb74.jpg resize: (2160, 3840) 1373490349 -7.425025847658653 treat image : temp/1753344628_1018967_1373490317_7616166cbdc4bcbda0fec64076f3766f.jpg resize: (2160, 3840) 1373490317 -7.315632939206749 treat image : temp/1753344628_1018967_1373490301_449144c9494786872d6b71738572425f.jpg resize: (2160, 3840) 1373490301 -7.566376019738585 treat image : temp/1753344628_1018967_1373490253_0e8a13afe8c09ff2954d74f844f447ac.jpg resize: (2160, 3840) 1373490253 -7.304376692279202 treat image : temp/1753344628_1018967_1373490553_cf2ec0cec9c27a9b3ef63869fe5cf4c0_rle_crop_3892383286_0.png resize: (315, 223) 1373502072 -3.5617668434329923 treat image : temp/1753344628_1018967_1373490553_cf2ec0cec9c27a9b3ef63869fe5cf4c0_rle_crop_3892383274_0.png resize: (363, 255) 1373502073 -0.16948446069685313 treat image : temp/1753344628_1018967_1373490553_cf2ec0cec9c27a9b3ef63869fe5cf4c0_rle_crop_3892383280_0.png resize: (198, 136) 1373502074 -3.364739818086772 treat image : temp/1753344628_1018967_1373490553_cf2ec0cec9c27a9b3ef63869fe5cf4c0_rle_crop_3892383283_0.png resize: (154, 219) 1373502075 -4.40108965166288 treat image : temp/1753344628_1018967_1373490553_cf2ec0cec9c27a9b3ef63869fe5cf4c0_rle_crop_3892383290_0.png resize: (134, 230) 1373502076 -3.414118718715405 treat image : temp/1753344628_1018967_1373490553_cf2ec0cec9c27a9b3ef63869fe5cf4c0_rle_crop_3892383275_0.png resize: (242, 190) 1373502077 -5.70267343959431 treat image : temp/1753344628_1018967_1373490553_cf2ec0cec9c27a9b3ef63869fe5cf4c0_rle_crop_3892383282_0.png resize: (295, 588) 1373502078 -5.248684710018375 treat image : temp/1753344628_1018967_1373490553_cf2ec0cec9c27a9b3ef63869fe5cf4c0_rle_crop_3892383276_0.png resize: (83, 253) 1373502079 -4.646698157317354 treat image : temp/1753344628_1018967_1373490553_cf2ec0cec9c27a9b3ef63869fe5cf4c0_rle_crop_3892383291_0.png resize: (192, 425) 1373502080 -3.773262689935576 treat image : temp/1753344628_1018967_1373490553_cf2ec0cec9c27a9b3ef63869fe5cf4c0_rle_crop_3892383279_0.png resize: (278, 312) 1373502081 -1.4534859669316875 treat image : temp/1753344628_1018967_1373490553_cf2ec0cec9c27a9b3ef63869fe5cf4c0_rle_crop_3892383288_0.png resize: (303, 200) 1373502082 -3.0141770125023464 treat image : temp/1753344628_1018967_1373490553_cf2ec0cec9c27a9b3ef63869fe5cf4c0_rle_crop_3892383281_0.png resize: (328, 274) 1373502083 -3.6913452514849805 treat image : temp/1753344628_1018967_1373490553_cf2ec0cec9c27a9b3ef63869fe5cf4c0_rle_crop_3892383273_0.png resize: (326, 255) 1373502084 -2.613342427694953 treat image : temp/1753344628_1018967_1373490553_cf2ec0cec9c27a9b3ef63869fe5cf4c0_rle_crop_3892383284_0.png resize: (123, 111) 1373502085 -3.5545123019231504 treat image : temp/1753344628_1018967_1373490553_cf2ec0cec9c27a9b3ef63869fe5cf4c0_rle_crop_3892383277_0.png resize: (190, 323) 1373502086 -3.691414786695682 treat image : temp/1753344628_1018967_1373490553_cf2ec0cec9c27a9b3ef63869fe5cf4c0_rle_crop_3892383292_0.png resize: (154, 208) 1373502087 -3.3553943567496995 treat image : temp/1753344628_1018967_1373490553_cf2ec0cec9c27a9b3ef63869fe5cf4c0_rle_crop_3892383287_0.png resize: (212, 224) 1373502088 -1.5609884471461946 treat image : temp/1753344628_1018967_1373490553_cf2ec0cec9c27a9b3ef63869fe5cf4c0_rle_crop_3892383285_0.png resize: (233, 343) 1373502090 -3.5576604573832054 treat image : temp/1753344628_1018967_1373490484_cada5609c77324748ba4167a608b4659_rle_crop_3892383308_0.png resize: (478, 317) 1373502091 -3.6777613857771727 treat image : temp/1753344628_1018967_1373490484_cada5609c77324748ba4167a608b4659_rle_crop_3892383304_0.png resize: (238, 187) 1373502092 -2.155957959879598 treat image : temp/1753344628_1018967_1373490484_cada5609c77324748ba4167a608b4659_rle_crop_3892383294_0.png resize: (173, 194) 1373502093 -3.5818742751838 treat image : temp/1753344628_1018967_1373490484_cada5609c77324748ba4167a608b4659_rle_crop_3892383296_0.png resize: (357, 262) 1373502094 -2.0647371894808617 treat image : temp/1753344628_1018967_1373490484_cada5609c77324748ba4167a608b4659_rle_crop_3892383318_0.png resize: (82, 91) 1373502095 -3.171808368274005 treat image : temp/1753344628_1018967_1373490484_cada5609c77324748ba4167a608b4659_rle_crop_3892383312_0.png resize: (180, 154) 1373502096 -4.3674154886869765 treat image : temp/1753344628_1018967_1373490484_cada5609c77324748ba4167a608b4659_rle_crop_3892383303_0.png resize: (833, 950) 1373502097 -5.100006672619538 treat image : temp/1753344628_1018967_1373490484_cada5609c77324748ba4167a608b4659_rle_crop_3892383316_0.png resize: (133, 145) 1373502100 -4.828053105961786 treat image : temp/1753344628_1018967_1373490484_cada5609c77324748ba4167a608b4659_rle_crop_3892383293_0.png resize: (247, 721) 1373502101 -4.9978067293451085 treat image : temp/1753344628_1018967_1373490484_cada5609c77324748ba4167a608b4659_rle_crop_3892383302_0.png resize: (149, 210) 1373502102 -5.422170603565119 treat image : temp/1753344628_1018967_1373490484_cada5609c77324748ba4167a608b4659_rle_crop_3892383310_0.png resize: (74, 129) 1373502103 -4.831737246101131 treat image : temp/1753344628_1018967_1373490484_cada5609c77324748ba4167a608b4659_rle_crop_3892383301_0.png resize: (213, 261) 1373502104 2.2333914298644557 treat image : temp/1753344628_1018967_1373490484_cada5609c77324748ba4167a608b4659_rle_crop_3892383305_0.png resize: (240, 225) 1373502106 -5.18767256346438 treat image : temp/1753344628_1018967_1373490484_cada5609c77324748ba4167a608b4659_rle_crop_3892383317_0.png resize: (615, 548) 1373502107 -5.218354319292893 treat image : temp/1753344628_1018967_1373490484_cada5609c77324748ba4167a608b4659_rle_crop_3892383307_0.png resize: (317, 184) 1373502108 -0.6603909757132086 treat image : temp/1753344628_1018967_1373490484_cada5609c77324748ba4167a608b4659_rle_crop_3892383299_0.png resize: (173, 199) 1373502109 -1.420199439400571 treat image : temp/1753344628_1018967_1373490484_cada5609c77324748ba4167a608b4659_rle_crop_3892383295_0.png resize: (191, 284) 1373502110 -4.739098613497002 treat image : temp/1753344628_1018967_1373490484_cada5609c77324748ba4167a608b4659_rle_crop_3892383314_0.png resize: (146, 117) 1373502111 -3.760367226504574 treat image : temp/1753344628_1018967_1373490484_cada5609c77324748ba4167a608b4659_rle_crop_3892383309_0.png resize: (350, 426) 1373502112 -2.307988668804268 treat image : temp/1753344628_1018967_1373490484_cada5609c77324748ba4167a608b4659_rle_crop_3892383297_0.png resize: (204, 237) 1373502113 -3.0328746898142596 treat image : temp/1753344628_1018967_1373490484_cada5609c77324748ba4167a608b4659_rle_crop_3892383298_0.png resize: (184, 280) 1373502114 -4.261748117236986 treat image : temp/1753344628_1018967_1373490484_cada5609c77324748ba4167a608b4659_rle_crop_3892383300_0.png resize: (233, 345) 1373502115 -4.185912794790935 treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead_rle_crop_3892383332_0.png resize: (102, 120) 1373502116 -3.2881494136740894 treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead_rle_crop_3892383347_0.png resize: (402, 391) 1373502117 -2.2212097756894833 treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead_rle_crop_3892383321_0.png resize: (257, 268) 1373502118 -3.0729016980991744 treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead_rle_crop_3892383352_0.png resize: (137, 131) 1373502119 -3.6680437460102002 treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead_rle_crop_3892383326_0.png resize: (146, 232) 1373502120 -0.9651882291501497 treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead_rle_crop_3892383323_0.png resize: (262, 183) 1373502121 -3.2413098127121027 treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead_rle_crop_3892383328_0.png resize: (270, 166) 1373502122 -3.2279211994883217 treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead_rle_crop_3892383348_0.png resize: (183, 133) 1373502123 -3.7917265498264032 treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead_rle_crop_3892383320_0.png resize: (295, 114) 1373502124 -4.565965903286972 treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead_rle_crop_3892383351_0.png resize: (414, 331) 1373502125 -2.018792680522195 treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead_rle_crop_3892383322_0.png resize: (353, 138) 1373502126 -3.224267893823354 treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead_rle_crop_3892383350_0.png resize: (762, 736) 1373502127 -2.9268850172918746 treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead_rle_crop_3892383346_0.png resize: (204, 364) 1373502128 -4.330424005080911 treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead_rle_crop_3892383349_0.png resize: (125, 70) 1373502129 -3.8860043588068223 treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead_rle_crop_3892383343_0.png resize: (172, 82) 1373502130 -3.9985364449493015 treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead_rle_crop_3892383339_0.png resize: (323, 183) 1373502132 -2.5987968323393345 treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead_rle_crop_3892383333_0.png resize: (301, 264) 1373502133 -4.466613017076732 treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead_rle_crop_3892383325_0.png resize: (190, 246) 1373502134 -2.607099638212544 treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead_rle_crop_3892383330_0.png resize: (291, 208) 1373502135 -4.129946752487304 treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead_rle_crop_3892383329_0.png resize: (151, 214) 1373502136 -1.6017347093259926 treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead_rle_crop_3892383353_0.png resize: (147, 237) 1373502137 -1.2146766804344067 treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead_rle_crop_3892383342_0.png resize: (178, 187) 1373502138 -2.9489148678434045 treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead_rle_crop_3892383354_0.png resize: (166, 351) 1373502139 -2.2327326981849818 treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead_rle_crop_3892383337_0.png resize: (464, 158) 1373502141 -3.6359327309715828 treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead_rle_crop_3892383331_0.png resize: (206, 211) 1373502142 -3.9854677582854245 treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead_rle_crop_3892383338_0.png resize: (149, 263) 1373502143 -3.9049242445549397 treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead_rle_crop_3892383335_0.png resize: (100, 153) 1373502144 -4.157878613116688 treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead_rle_crop_3892383327_0.png resize: (153, 187) 1373502145 -3.2376330411725744 treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead_rle_crop_3892383324_0.png resize: (206, 305) 1373502146 -3.972081243613241 treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead_rle_crop_3892383344_0.png resize: (94, 213) 1373502147 -3.6720071882827026 treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead_rle_crop_3892383334_0.png resize: (257, 153) 1373502148 -4.993054757337251 treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead_rle_crop_3892383355_0.png resize: (455, 171) 1373502149 -4.888545518752052 treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead_rle_crop_3892383345_0.png resize: (198, 143) 1373502150 -3.436295195093751 treat image : temp/1753344628_1018967_1373490368_882407a2a62a0ef018fa8be23230f479_rle_crop_3892383378_0.png resize: (356, 506) 1373502151 -4.615463324511621 treat image : temp/1753344628_1018967_1373490368_882407a2a62a0ef018fa8be23230f479_rle_crop_3892383374_0.png resize: (177, 274) 1373502152 -0.7882659269450142 treat image : temp/1753344628_1018967_1373490368_882407a2a62a0ef018fa8be23230f479_rle_crop_3892383371_0.png resize: (207, 242) 1373502153 -3.7165877012550768 treat image : temp/1753344628_1018967_1373490368_882407a2a62a0ef018fa8be23230f479_rle_crop_3892383357_0.png resize: (204, 193) 1373502154 -2.6620772276687585 treat image : temp/1753344628_1018967_1373490368_882407a2a62a0ef018fa8be23230f479_rle_crop_3892383367_0.png resize: (248, 279) 1373502155 -2.4863432262093323 treat image : temp/1753344628_1018967_1373490368_882407a2a62a0ef018fa8be23230f479_rle_crop_3892383376_0.png resize: (134, 117) 1373502156 -2.814851309848308 treat image : temp/1753344628_1018967_1373490368_882407a2a62a0ef018fa8be23230f479_rle_crop_3892383372_0.png resize: (91, 128) 1373502157 -4.061520603917029 treat image : temp/1753344628_1018967_1373490368_882407a2a62a0ef018fa8be23230f479_rle_crop_3892383373_0.png resize: (194, 302) 1373502158 -3.0733584068666526 treat image : temp/1753344628_1018967_1373490368_882407a2a62a0ef018fa8be23230f479_rle_crop_3892383370_0.png resize: (288, 424) 1373502159 -3.2069408124567884 treat image : temp/1753344628_1018967_1373490368_882407a2a62a0ef018fa8be23230f479_rle_crop_3892383383_0.png resize: (92, 84) 1373502160 -5.073005614854358 treat image : temp/1753344628_1018967_1373490368_882407a2a62a0ef018fa8be23230f479_rle_crop_3892383361_0.png resize: (108, 163) 1373502161 -5.166914638781703 treat image : temp/1753344628_1018967_1373490368_882407a2a62a0ef018fa8be23230f479_rle_crop_3892383362_0.png resize: (156, 181) 1373502162 -3.558302714690349 treat image : temp/1753344628_1018967_1373490368_882407a2a62a0ef018fa8be23230f479_rle_crop_3892383365_0.png resize: (235, 301) 1373502163 -3.844415625776411 treat image : temp/1753344628_1018967_1373490368_882407a2a62a0ef018fa8be23230f479_rle_crop_3892383381_0.png resize: (69, 76) 1373502164 -3.359987573420483 treat image : temp/1753344628_1018967_1373490368_882407a2a62a0ef018fa8be23230f479_rle_crop_3892383375_0.png resize: (130, 169) 1373502165 -3.9785359090042496 treat image : temp/1753344628_1018967_1373490368_882407a2a62a0ef018fa8be23230f479_rle_crop_3892383382_0.png resize: (51, 140) 1373502167 -4.314386672180161 treat image : temp/1753344628_1018967_1373490368_882407a2a62a0ef018fa8be23230f479_rle_crop_3892383379_0.png resize: (170, 143) 1373502168 -4.110060088819874 treat image : temp/1753344628_1018967_1373490368_882407a2a62a0ef018fa8be23230f479_rle_crop_3892383380_0.png resize: (222, 302) 1373502169 -1.9113205961496997 treat image : temp/1753344628_1018967_1373490368_882407a2a62a0ef018fa8be23230f479_rle_crop_3892383369_0.png resize: (159, 289) 1373502170 -2.784937092194343 treat image : temp/1753344628_1018967_1373490368_882407a2a62a0ef018fa8be23230f479_rle_crop_3892383358_0.png resize: (235, 308) 1373502171 -3.4234121483270203 treat image : temp/1753344628_1018967_1373490368_882407a2a62a0ef018fa8be23230f479_rle_crop_3892383359_0.png resize: (210, 322) 1373502172 -1.8084409073400867 treat image : temp/1753344628_1018967_1373490368_882407a2a62a0ef018fa8be23230f479_rle_crop_3892383368_0.png resize: (431, 372) 1373502173 -1.4342064303150595 treat image : temp/1753344628_1018967_1373490368_882407a2a62a0ef018fa8be23230f479_rle_crop_3892383377_0.png resize: (100, 204) 1373502174 -4.633968895150369 treat image : temp/1753344628_1018967_1373490368_882407a2a62a0ef018fa8be23230f479_rle_crop_3892383366_0.png resize: (403, 231) 1373502175 -5.221101498951021 treat image : temp/1753344628_1018967_1373490368_882407a2a62a0ef018fa8be23230f479_rle_crop_3892383363_0.png resize: (170, 161) 1373502176 -3.2353715211476124 treat image : temp/1753344628_1018967_1373490368_882407a2a62a0ef018fa8be23230f479_rle_crop_3892383356_0.png resize: (163, 207) 1373502177 -3.2289410260292155 treat image : temp/1753344628_1018967_1373490368_882407a2a62a0ef018fa8be23230f479_rle_crop_3892383384_0.png resize: (159, 79) 1373502178 -3.537489885807738 treat image : temp/1753344628_1018967_1373490349_1adabe4f393c69aad809b60b58cadb74_rle_crop_3892383387_0.png resize: (278, 286) 1373502179 -2.9241907538422733 treat image : temp/1753344628_1018967_1373490349_1adabe4f393c69aad809b60b58cadb74_rle_crop_3892383388_0.png resize: (213, 360) 1373502180 -3.925442552879741 treat image : temp/1753344628_1018967_1373490349_1adabe4f393c69aad809b60b58cadb74_rle_crop_3892383386_0.png resize: (401, 394) 1373502181 -3.2257349508982722 treat image : temp/1753344628_1018967_1373490349_1adabe4f393c69aad809b60b58cadb74_rle_crop_3892383393_0.png resize: (566, 600) 1373502182 -4.378597188946988 treat image : temp/1753344628_1018967_1373490349_1adabe4f393c69aad809b60b58cadb74_rle_crop_3892383394_0.png resize: (342, 304) 1373502183 -4.449412304880294 treat image : temp/1753344628_1018967_1373490349_1adabe4f393c69aad809b60b58cadb74_rle_crop_3892383391_0.png resize: (165, 206) 1373502184 -2.108417012230152 treat image : temp/1753344628_1018967_1373490349_1adabe4f393c69aad809b60b58cadb74_rle_crop_3892383405_0.png resize: (131, 138) 1373502185 -3.1386552867328406 treat image : temp/1753344628_1018967_1373490349_1adabe4f393c69aad809b60b58cadb74_rle_crop_3892383395_0.png resize: (185, 120) 1373502186 -2.936557379497322 treat image : temp/1753344628_1018967_1373490349_1adabe4f393c69aad809b60b58cadb74_rle_crop_3892383385_0.png resize: (241, 245) 1373502187 -3.2529325142705376 treat image : temp/1753344628_1018967_1373490349_1adabe4f393c69aad809b60b58cadb74_rle_crop_3892383403_0.png resize: (534, 620) 1373502188 -4.768255542708438 treat image : temp/1753344628_1018967_1373490349_1adabe4f393c69aad809b60b58cadb74_rle_crop_3892383396_0.png resize: (226, 206) 1373502190 -3.199428355680196 treat image : temp/1753344628_1018967_1373490349_1adabe4f393c69aad809b60b58cadb74_rle_crop_3892383392_0.png resize: (382, 523) 1373502191 -3.493536343452865 treat image : temp/1753344628_1018967_1373490349_1adabe4f393c69aad809b60b58cadb74_rle_crop_3892383397_0.png resize: (259, 175) 1373502192 -3.247491357750422 treat image : temp/1753344628_1018967_1373490349_1adabe4f393c69aad809b60b58cadb74_rle_crop_3892383389_0.png resize: (313, 369) 1373502193 -0.1590056153667597 treat image : temp/1753344628_1018967_1373490349_1adabe4f393c69aad809b60b58cadb74_rle_crop_3892383402_0.png resize: (332, 562) 1373502194 -4.116811273440318 treat image : temp/1753344628_1018967_1373490349_1adabe4f393c69aad809b60b58cadb74_rle_crop_3892383390_0.png resize: (155, 269) 1373502195 -4.081166896451785 treat image : temp/1753344628_1018967_1373490349_1adabe4f393c69aad809b60b58cadb74_rle_crop_3892383404_0.png resize: (366, 242) 1373502196 -4.099426195538844 treat image : temp/1753344628_1018967_1373490349_1adabe4f393c69aad809b60b58cadb74_rle_crop_3892383400_0.png resize: (218, 419) 1373502198 -5.221460679051041 treat image : temp/1753344628_1018967_1373490349_1adabe4f393c69aad809b60b58cadb74_rle_crop_3892383399_0.png resize: (359, 428) 1373502199 -4.244279110002049 treat image : temp/1753344628_1018967_1373490349_1adabe4f393c69aad809b60b58cadb74_rle_crop_3892383401_0.png resize: (241, 272) 1373502200 -4.1274450479821825 treat image : temp/1753344628_1018967_1373490317_7616166cbdc4bcbda0fec64076f3766f_rle_crop_3892383412_0.png resize: (233, 287) 1373502201 -4.250815430972072 treat image : temp/1753344628_1018967_1373490317_7616166cbdc4bcbda0fec64076f3766f_rle_crop_3892383410_0.png resize: (105, 111) 1373502202 -4.108783473674459 treat image : temp/1753344628_1018967_1373490317_7616166cbdc4bcbda0fec64076f3766f_rle_crop_3892383426_0.png resize: (167, 296) 1373502203 -4.94583454588678 treat image : temp/1753344628_1018967_1373490317_7616166cbdc4bcbda0fec64076f3766f_rle_crop_3892383413_0.png resize: (176, 276) 1373502204 -4.147696597105695 treat image : temp/1753344628_1018967_1373490317_7616166cbdc4bcbda0fec64076f3766f_rle_crop_3892383424_0.png resize: (230, 247) 1373502205 -4.189406546269658 treat image : temp/1753344628_1018967_1373490317_7616166cbdc4bcbda0fec64076f3766f_rle_crop_3892383408_0.png resize: (146, 148) 1373502206 -3.515115063692857 treat image : temp/1753344628_1018967_1373490317_7616166cbdc4bcbda0fec64076f3766f_rle_crop_3892383425_0.png resize: (95, 88) 1373502207 -4.485610603386372 treat image : temp/1753344628_1018967_1373490317_7616166cbdc4bcbda0fec64076f3766f_rle_crop_3892383406_0.png resize: (204, 227) 1373502208 -3.3156743839026888 treat image : temp/1753344628_1018967_1373490317_7616166cbdc4bcbda0fec64076f3766f_rle_crop_3892383411_0.png resize: (92, 219) 1373502209 -3.796301061623101 treat image : temp/1753344628_1018967_1373490317_7616166cbdc4bcbda0fec64076f3766f_rle_crop_3892383418_0.png resize: (231, 217) 1373502210 -3.8781803068929155 treat image : temp/1753344628_1018967_1373490317_7616166cbdc4bcbda0fec64076f3766f_rle_crop_3892383422_0.png resize: (157, 159) 1373502211 -4.261609092497694 treat image : temp/1753344628_1018967_1373490317_7616166cbdc4bcbda0fec64076f3766f_rle_crop_3892383428_0.png resize: (285, 273) 1373502212 -4.325750080910566 treat image : temp/1753344628_1018967_1373490317_7616166cbdc4bcbda0fec64076f3766f_rle_crop_3892383421_0.png resize: (264, 345) 1373502213 -4.3553656185325655 treat image : temp/1753344628_1018967_1373490317_7616166cbdc4bcbda0fec64076f3766f_rle_crop_3892383417_0.png resize: (227, 148) 1373502214 -4.006375808828992 treat image : temp/1753344628_1018967_1373490317_7616166cbdc4bcbda0fec64076f3766f_rle_crop_3892383407_0.png resize: (296, 368) 1373502215 -2.5454323019744796 treat image : temp/1753344628_1018967_1373490317_7616166cbdc4bcbda0fec64076f3766f_rle_crop_3892383427_0.png resize: (226, 291) 1373502216 -4.121983057226412 treat image : temp/1753344628_1018967_1373490301_449144c9494786872d6b71738572425f_rle_crop_3892383429_0.png resize: (363, 174) 1373502217 -2.731428548113663 treat image : temp/1753344628_1018967_1373490301_449144c9494786872d6b71738572425f_rle_crop_3892383433_0.png resize: (373, 266) 1373502218 -3.838365217769197 treat image : temp/1753344628_1018967_1373490301_449144c9494786872d6b71738572425f_rle_crop_3892383443_0.png resize: (204, 177) 1373502219 -3.108026624874004 treat image : temp/1753344628_1018967_1373490301_449144c9494786872d6b71738572425f_rle_crop_3892383444_0.png resize: (435, 671) 1373502220 -4.479474857902527 treat image : temp/1753344628_1018967_1373490301_449144c9494786872d6b71738572425f_rle_crop_3892383441_0.png resize: (343, 197) 1373502221 -2.5239831799854824 treat image : temp/1753344628_1018967_1373490301_449144c9494786872d6b71738572425f_rle_crop_3892383431_0.png resize: (129, 261) 1373502222 -3.4247674977945053 treat image : temp/1753344628_1018967_1373490301_449144c9494786872d6b71738572425f_rle_crop_3892383435_0.png resize: (305, 726) 1373502223 -2.7278168220235472 treat image : temp/1753344628_1018967_1373490301_449144c9494786872d6b71738572425f_rle_crop_3892383436_0.png resize: (296, 400) 1373502224 -4.4373051598436355 treat image : temp/1753344628_1018967_1373490301_449144c9494786872d6b71738572425f_rle_crop_3892383442_0.png resize: (475, 357) 1373502225 -5.225545475639766 treat image : temp/1753344628_1018967_1373490301_449144c9494786872d6b71738572425f_rle_crop_3892383437_0.png resize: (679, 675) 1373502227 -4.250517337462369 treat image : temp/1753344628_1018967_1373490301_449144c9494786872d6b71738572425f_rle_crop_3892383440_0.png resize: (206, 125) 1373502228 -2.1341650499034004 treat image : temp/1753344628_1018967_1373490301_449144c9494786872d6b71738572425f_rle_crop_3892383439_0.png resize: (166, 455) 1373502229 -3.7102864727835074 treat image : temp/1753344628_1018967_1373490301_449144c9494786872d6b71738572425f_rle_crop_3892383432_0.png resize: (90, 180) 1373502230 -1.4098506247662523 treat image : temp/1753344628_1018967_1373490301_449144c9494786872d6b71738572425f_rle_crop_3892383438_0.png resize: (197, 129) 1373502231 -0.9806705173597177 treat image : temp/1753344628_1018967_1373490301_449144c9494786872d6b71738572425f_rle_crop_3892383434_0.png resize: (117, 105) 1373502232 -3.362574418854755 treat image : temp/1753344628_1018967_1373490253_0e8a13afe8c09ff2954d74f844f447ac_rle_crop_3892383453_0.png resize: (209, 305) 1373502233 -3.2271339751744463 treat image : temp/1753344628_1018967_1373490253_0e8a13afe8c09ff2954d74f844f447ac_rle_crop_3892383458_0.png resize: (141, 268) 1373502234 -4.568463973390215 treat image : temp/1753344628_1018967_1373490253_0e8a13afe8c09ff2954d74f844f447ac_rle_crop_3892383456_0.png resize: (88, 163) 1373502235 -0.23494341220755113 treat image : temp/1753344628_1018967_1373490253_0e8a13afe8c09ff2954d74f844f447ac_rle_crop_3892383446_0.png resize: (316, 326) 1373502236 -2.2421185616348738 treat image : temp/1753344628_1018967_1373490253_0e8a13afe8c09ff2954d74f844f447ac_rle_crop_3892383445_0.png resize: (246, 230) 1373502237 -4.64088401434674 treat image : temp/1753344628_1018967_1373490253_0e8a13afe8c09ff2954d74f844f447ac_rle_crop_3892383454_0.png resize: (92, 98) 1373502238 -3.1357892291564027 treat image : temp/1753344628_1018967_1373490253_0e8a13afe8c09ff2954d74f844f447ac_rle_crop_3892383452_0.png resize: (251, 94) 1373502239 -5.136956941487951 treat image : temp/1753344628_1018967_1373490253_0e8a13afe8c09ff2954d74f844f447ac_rle_crop_3892383447_0.png resize: (193, 278) 1373502240 -2.6306713474719157 treat image : temp/1753344628_1018967_1373490553_cf2ec0cec9c27a9b3ef63869fe5cf4c0_rle_crop_3892383278_0.png resize: (283, 117) 1373502247 -4.3204283196037325 treat image : temp/1753344628_1018967_1373490484_cada5609c77324748ba4167a608b4659_rle_crop_3892383313_0.png resize: (292, 238) 1373502249 -3.249868194592814 treat image : temp/1753344628_1018967_1373490484_cada5609c77324748ba4167a608b4659_rle_crop_3892383311_0.png resize: (141, 437) 1373502250 -1.8527385846117708 treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead_rle_crop_3892383340_0.png resize: (154, 147) 1373502251 -4.0052052541436725 treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead_rle_crop_3892383319_0.png resize: (146, 250) 1373502253 -4.078862895217383 treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead_rle_crop_3892383341_0.png resize: (401, 525) 1373502254 -4.177714746564764 treat image : temp/1753344628_1018967_1373490317_7616166cbdc4bcbda0fec64076f3766f_rle_crop_3892383423_0.png resize: (124, 104) 1373502255 -4.1193682356635675 treat image : temp/1753344628_1018967_1373490317_7616166cbdc4bcbda0fec64076f3766f_rle_crop_3892383415_0.png resize: (140, 129) 1373502256 -1.8534738100800996 treat image : temp/1753344628_1018967_1373490317_7616166cbdc4bcbda0fec64076f3766f_rle_crop_3892383414_0.png resize: (181, 259) 1373502257 -3.8519178004216723 treat image : temp/1753344628_1018967_1373490317_7616166cbdc4bcbda0fec64076f3766f_rle_crop_3892383420_0.png resize: (171, 271) 1373502258 -3.6944602657911925 treat image : temp/1753344628_1018967_1373490317_7616166cbdc4bcbda0fec64076f3766f_rle_crop_3892383409_0.png resize: (90, 268) 1373502259 -4.198098212568124 treat image : temp/1753344628_1018967_1373490301_449144c9494786872d6b71738572425f_rle_crop_3892383430_0.png resize: (115, 124) 1373502260 -2.481555250124797 treat image : temp/1753344628_1018967_1373490253_0e8a13afe8c09ff2954d74f844f447ac_rle_crop_3892383449_0.png resize: (134, 143) 1373502261 -4.818060376527866 treat image : temp/1753344628_1018967_1373490253_0e8a13afe8c09ff2954d74f844f447ac_rle_crop_3892383450_0.png resize: (163, 286) 1373502262 -2.869231118816825 treat image : temp/1753344628_1018967_1373490253_0e8a13afe8c09ff2954d74f844f447ac_rle_crop_3892383455_0.png resize: (176, 229) 1373502263 -3.2607086777835534 treat image : temp/1753344628_1018967_1373490317_7616166cbdc4bcbda0fec64076f3766f_rle_crop_3892383416_0.png resize: (79, 175) 1373502265 -5.33636474016651 treat image : temp/1753344628_1018967_1373490553_cf2ec0cec9c27a9b3ef63869fe5cf4c0_rle_crop_3892383289_0.png resize: (399, 263) 1373502270 -4.837153051777709 treat image : temp/1753344628_1018967_1373490484_cada5609c77324748ba4167a608b4659_rle_crop_3892383315_0.png resize: (418, 313) 1373502271 -5.310840117463666 treat image : temp/1753344628_1018967_1373490484_cada5609c77324748ba4167a608b4659_rle_crop_3892383306_0.png resize: (395, 167) 1373502272 -4.357588679188124 treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead_rle_crop_3892383336_0.png resize: (235, 284) 1373502273 -3.955580413886122 treat image : temp/1753344628_1018967_1373490368_882407a2a62a0ef018fa8be23230f479_rle_crop_3892383364_0.png resize: (262, 486) 1373502274 -5.052475094646442 treat image : temp/1753344628_1018967_1373490349_1adabe4f393c69aad809b60b58cadb74_rle_crop_3892383398_0.png resize: (139, 143) 1373502275 -3.3994955768606987 treat image : temp/1753344628_1018967_1373490317_7616166cbdc4bcbda0fec64076f3766f_rle_crop_3892383419_0.png resize: (139, 215) 1373502276 -5.011404400189393 treat image : temp/1753344628_1018967_1373490253_0e8a13afe8c09ff2954d74f844f447ac_rle_crop_3892383451_0.png resize: (194, 179) 1373502277 -5.085102064276711 treat image : temp/1753344628_1018967_1373490253_0e8a13afe8c09ff2954d74f844f447ac_rle_crop_3892383459_0.png resize: (209, 356) 1373502278 -2.2632905504078127 treat image : temp/1753344628_1018967_1373490253_0e8a13afe8c09ff2954d74f844f447ac_rle_crop_3892383457_0.png resize: (369, 269) 1373502279 -2.5177169456516046 treat image : temp/1753344628_1018967_1373490253_0e8a13afe8c09ff2954d74f844f447ac_rle_crop_3892383448_0.png resize: (301, 290) 1373502280 -5.104471828907286 treat image : temp/1753344628_1018967_1373490368_882407a2a62a0ef018fa8be23230f479_rle_crop_3892383360_0.png resize: (192, 206) 1373502281 -4.387738424461303 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 195 time used for this insertion : 0.020763635635375977 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 195 time used for this insertion : 0.28463006019592285 save missing photos in datou_result : time spend for datou_step_exec : 40.352848291397095 time spend to save output : 0.3116638660430908 total time spend for step 6 : 40.664512157440186 step7:brightness Thu Jul 24 10:16:12 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1753344628_1018967_1373490553_cf2ec0cec9c27a9b3ef63869fe5cf4c0.jpg treat image : temp/1753344628_1018967_1373490484_cada5609c77324748ba4167a608b4659.jpg treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead.jpg treat image : temp/1753344628_1018967_1373490368_882407a2a62a0ef018fa8be23230f479.jpg treat image : temp/1753344628_1018967_1373490349_1adabe4f393c69aad809b60b58cadb74.jpg treat image : temp/1753344628_1018967_1373490317_7616166cbdc4bcbda0fec64076f3766f.jpg treat image : temp/1753344628_1018967_1373490301_449144c9494786872d6b71738572425f.jpg treat image : temp/1753344628_1018967_1373490253_0e8a13afe8c09ff2954d74f844f447ac.jpg treat image : temp/1753344628_1018967_1373490553_cf2ec0cec9c27a9b3ef63869fe5cf4c0_rle_crop_3892383286_0.png treat image : temp/1753344628_1018967_1373490553_cf2ec0cec9c27a9b3ef63869fe5cf4c0_rle_crop_3892383274_0.png treat image : temp/1753344628_1018967_1373490553_cf2ec0cec9c27a9b3ef63869fe5cf4c0_rle_crop_3892383280_0.png treat image : temp/1753344628_1018967_1373490553_cf2ec0cec9c27a9b3ef63869fe5cf4c0_rle_crop_3892383283_0.png treat image : temp/1753344628_1018967_1373490553_cf2ec0cec9c27a9b3ef63869fe5cf4c0_rle_crop_3892383290_0.png treat image : temp/1753344628_1018967_1373490553_cf2ec0cec9c27a9b3ef63869fe5cf4c0_rle_crop_3892383275_0.png treat image : temp/1753344628_1018967_1373490553_cf2ec0cec9c27a9b3ef63869fe5cf4c0_rle_crop_3892383282_0.png treat image : temp/1753344628_1018967_1373490553_cf2ec0cec9c27a9b3ef63869fe5cf4c0_rle_crop_3892383276_0.png treat image : temp/1753344628_1018967_1373490553_cf2ec0cec9c27a9b3ef63869fe5cf4c0_rle_crop_3892383291_0.png treat image : temp/1753344628_1018967_1373490553_cf2ec0cec9c27a9b3ef63869fe5cf4c0_rle_crop_3892383279_0.png treat image : temp/1753344628_1018967_1373490553_cf2ec0cec9c27a9b3ef63869fe5cf4c0_rle_crop_3892383288_0.png treat image : temp/1753344628_1018967_1373490553_cf2ec0cec9c27a9b3ef63869fe5cf4c0_rle_crop_3892383281_0.png treat image : temp/1753344628_1018967_1373490553_cf2ec0cec9c27a9b3ef63869fe5cf4c0_rle_crop_3892383273_0.png treat image : temp/1753344628_1018967_1373490553_cf2ec0cec9c27a9b3ef63869fe5cf4c0_rle_crop_3892383284_0.png treat image : temp/1753344628_1018967_1373490553_cf2ec0cec9c27a9b3ef63869fe5cf4c0_rle_crop_3892383277_0.png treat image : temp/1753344628_1018967_1373490553_cf2ec0cec9c27a9b3ef63869fe5cf4c0_rle_crop_3892383292_0.png treat image : temp/1753344628_1018967_1373490553_cf2ec0cec9c27a9b3ef63869fe5cf4c0_rle_crop_3892383287_0.png treat image : temp/1753344628_1018967_1373490553_cf2ec0cec9c27a9b3ef63869fe5cf4c0_rle_crop_3892383285_0.png treat image : temp/1753344628_1018967_1373490484_cada5609c77324748ba4167a608b4659_rle_crop_3892383308_0.png treat image : temp/1753344628_1018967_1373490484_cada5609c77324748ba4167a608b4659_rle_crop_3892383304_0.png treat image : temp/1753344628_1018967_1373490484_cada5609c77324748ba4167a608b4659_rle_crop_3892383294_0.png treat image : temp/1753344628_1018967_1373490484_cada5609c77324748ba4167a608b4659_rle_crop_3892383296_0.png treat image : temp/1753344628_1018967_1373490484_cada5609c77324748ba4167a608b4659_rle_crop_3892383318_0.png treat image : temp/1753344628_1018967_1373490484_cada5609c77324748ba4167a608b4659_rle_crop_3892383312_0.png treat image : temp/1753344628_1018967_1373490484_cada5609c77324748ba4167a608b4659_rle_crop_3892383303_0.png treat image : temp/1753344628_1018967_1373490484_cada5609c77324748ba4167a608b4659_rle_crop_3892383316_0.png treat image : temp/1753344628_1018967_1373490484_cada5609c77324748ba4167a608b4659_rle_crop_3892383293_0.png treat image : temp/1753344628_1018967_1373490484_cada5609c77324748ba4167a608b4659_rle_crop_3892383302_0.png treat image : temp/1753344628_1018967_1373490484_cada5609c77324748ba4167a608b4659_rle_crop_3892383310_0.png treat image : temp/1753344628_1018967_1373490484_cada5609c77324748ba4167a608b4659_rle_crop_3892383301_0.png treat image : temp/1753344628_1018967_1373490484_cada5609c77324748ba4167a608b4659_rle_crop_3892383305_0.png treat image : temp/1753344628_1018967_1373490484_cada5609c77324748ba4167a608b4659_rle_crop_3892383317_0.png treat image : temp/1753344628_1018967_1373490484_cada5609c77324748ba4167a608b4659_rle_crop_3892383307_0.png treat image : temp/1753344628_1018967_1373490484_cada5609c77324748ba4167a608b4659_rle_crop_3892383299_0.png treat image : temp/1753344628_1018967_1373490484_cada5609c77324748ba4167a608b4659_rle_crop_3892383295_0.png treat image : temp/1753344628_1018967_1373490484_cada5609c77324748ba4167a608b4659_rle_crop_3892383314_0.png treat image : temp/1753344628_1018967_1373490484_cada5609c77324748ba4167a608b4659_rle_crop_3892383309_0.png treat image : temp/1753344628_1018967_1373490484_cada5609c77324748ba4167a608b4659_rle_crop_3892383297_0.png treat image : temp/1753344628_1018967_1373490484_cada5609c77324748ba4167a608b4659_rle_crop_3892383298_0.png treat image : temp/1753344628_1018967_1373490484_cada5609c77324748ba4167a608b4659_rle_crop_3892383300_0.png treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead_rle_crop_3892383332_0.png treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead_rle_crop_3892383347_0.png treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead_rle_crop_3892383321_0.png treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead_rle_crop_3892383352_0.png treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead_rle_crop_3892383326_0.png treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead_rle_crop_3892383323_0.png treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead_rle_crop_3892383328_0.png treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead_rle_crop_3892383348_0.png treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead_rle_crop_3892383320_0.png treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead_rle_crop_3892383351_0.png treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead_rle_crop_3892383322_0.png treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead_rle_crop_3892383350_0.png treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead_rle_crop_3892383346_0.png treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead_rle_crop_3892383349_0.png treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead_rle_crop_3892383343_0.png treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead_rle_crop_3892383339_0.png treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead_rle_crop_3892383333_0.png treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead_rle_crop_3892383325_0.png treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead_rle_crop_3892383330_0.png treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead_rle_crop_3892383329_0.png treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead_rle_crop_3892383353_0.png treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead_rle_crop_3892383342_0.png treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead_rle_crop_3892383354_0.png treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead_rle_crop_3892383337_0.png treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead_rle_crop_3892383331_0.png treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead_rle_crop_3892383338_0.png treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead_rle_crop_3892383335_0.png treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead_rle_crop_3892383327_0.png treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead_rle_crop_3892383324_0.png treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead_rle_crop_3892383344_0.png treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead_rle_crop_3892383334_0.png treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead_rle_crop_3892383355_0.png treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead_rle_crop_3892383345_0.png treat image : temp/1753344628_1018967_1373490368_882407a2a62a0ef018fa8be23230f479_rle_crop_3892383378_0.png treat image : temp/1753344628_1018967_1373490368_882407a2a62a0ef018fa8be23230f479_rle_crop_3892383374_0.png treat image : temp/1753344628_1018967_1373490368_882407a2a62a0ef018fa8be23230f479_rle_crop_3892383371_0.png treat image : temp/1753344628_1018967_1373490368_882407a2a62a0ef018fa8be23230f479_rle_crop_3892383357_0.png treat image : temp/1753344628_1018967_1373490368_882407a2a62a0ef018fa8be23230f479_rle_crop_3892383367_0.png treat image : temp/1753344628_1018967_1373490368_882407a2a62a0ef018fa8be23230f479_rle_crop_3892383376_0.png treat image : temp/1753344628_1018967_1373490368_882407a2a62a0ef018fa8be23230f479_rle_crop_3892383372_0.png treat image : temp/1753344628_1018967_1373490368_882407a2a62a0ef018fa8be23230f479_rle_crop_3892383373_0.png treat image : temp/1753344628_1018967_1373490368_882407a2a62a0ef018fa8be23230f479_rle_crop_3892383370_0.png treat image : temp/1753344628_1018967_1373490368_882407a2a62a0ef018fa8be23230f479_rle_crop_3892383383_0.png treat image : temp/1753344628_1018967_1373490368_882407a2a62a0ef018fa8be23230f479_rle_crop_3892383361_0.png treat image : temp/1753344628_1018967_1373490368_882407a2a62a0ef018fa8be23230f479_rle_crop_3892383362_0.png treat image : temp/1753344628_1018967_1373490368_882407a2a62a0ef018fa8be23230f479_rle_crop_3892383365_0.png treat image : temp/1753344628_1018967_1373490368_882407a2a62a0ef018fa8be23230f479_rle_crop_3892383381_0.png treat image : temp/1753344628_1018967_1373490368_882407a2a62a0ef018fa8be23230f479_rle_crop_3892383375_0.png treat image : temp/1753344628_1018967_1373490368_882407a2a62a0ef018fa8be23230f479_rle_crop_3892383382_0.png treat image : temp/1753344628_1018967_1373490368_882407a2a62a0ef018fa8be23230f479_rle_crop_3892383379_0.png treat image : temp/1753344628_1018967_1373490368_882407a2a62a0ef018fa8be23230f479_rle_crop_3892383380_0.png treat image : temp/1753344628_1018967_1373490368_882407a2a62a0ef018fa8be23230f479_rle_crop_3892383369_0.png treat image : temp/1753344628_1018967_1373490368_882407a2a62a0ef018fa8be23230f479_rle_crop_3892383358_0.png treat image : temp/1753344628_1018967_1373490368_882407a2a62a0ef018fa8be23230f479_rle_crop_3892383359_0.png treat image : temp/1753344628_1018967_1373490368_882407a2a62a0ef018fa8be23230f479_rle_crop_3892383368_0.png treat image : temp/1753344628_1018967_1373490368_882407a2a62a0ef018fa8be23230f479_rle_crop_3892383377_0.png treat image : temp/1753344628_1018967_1373490368_882407a2a62a0ef018fa8be23230f479_rle_crop_3892383366_0.png treat image : temp/1753344628_1018967_1373490368_882407a2a62a0ef018fa8be23230f479_rle_crop_3892383363_0.png treat image : temp/1753344628_1018967_1373490368_882407a2a62a0ef018fa8be23230f479_rle_crop_3892383356_0.png treat image : temp/1753344628_1018967_1373490368_882407a2a62a0ef018fa8be23230f479_rle_crop_3892383384_0.png treat image : temp/1753344628_1018967_1373490349_1adabe4f393c69aad809b60b58cadb74_rle_crop_3892383387_0.png treat image : temp/1753344628_1018967_1373490349_1adabe4f393c69aad809b60b58cadb74_rle_crop_3892383388_0.png treat image : temp/1753344628_1018967_1373490349_1adabe4f393c69aad809b60b58cadb74_rle_crop_3892383386_0.png treat image : temp/1753344628_1018967_1373490349_1adabe4f393c69aad809b60b58cadb74_rle_crop_3892383393_0.png treat image : temp/1753344628_1018967_1373490349_1adabe4f393c69aad809b60b58cadb74_rle_crop_3892383394_0.png treat image : temp/1753344628_1018967_1373490349_1adabe4f393c69aad809b60b58cadb74_rle_crop_3892383391_0.png treat image : temp/1753344628_1018967_1373490349_1adabe4f393c69aad809b60b58cadb74_rle_crop_3892383405_0.png treat image : temp/1753344628_1018967_1373490349_1adabe4f393c69aad809b60b58cadb74_rle_crop_3892383395_0.png treat image : temp/1753344628_1018967_1373490349_1adabe4f393c69aad809b60b58cadb74_rle_crop_3892383385_0.png treat image : temp/1753344628_1018967_1373490349_1adabe4f393c69aad809b60b58cadb74_rle_crop_3892383403_0.png treat image : temp/1753344628_1018967_1373490349_1adabe4f393c69aad809b60b58cadb74_rle_crop_3892383396_0.png treat image : temp/1753344628_1018967_1373490349_1adabe4f393c69aad809b60b58cadb74_rle_crop_3892383392_0.png treat image : temp/1753344628_1018967_1373490349_1adabe4f393c69aad809b60b58cadb74_rle_crop_3892383397_0.png treat image : temp/1753344628_1018967_1373490349_1adabe4f393c69aad809b60b58cadb74_rle_crop_3892383389_0.png treat image : temp/1753344628_1018967_1373490349_1adabe4f393c69aad809b60b58cadb74_rle_crop_3892383402_0.png treat image : temp/1753344628_1018967_1373490349_1adabe4f393c69aad809b60b58cadb74_rle_crop_3892383390_0.png treat image : temp/1753344628_1018967_1373490349_1adabe4f393c69aad809b60b58cadb74_rle_crop_3892383404_0.png treat image : temp/1753344628_1018967_1373490349_1adabe4f393c69aad809b60b58cadb74_rle_crop_3892383400_0.png treat image : temp/1753344628_1018967_1373490349_1adabe4f393c69aad809b60b58cadb74_rle_crop_3892383399_0.png treat image : temp/1753344628_1018967_1373490349_1adabe4f393c69aad809b60b58cadb74_rle_crop_3892383401_0.png treat image : temp/1753344628_1018967_1373490317_7616166cbdc4bcbda0fec64076f3766f_rle_crop_3892383412_0.png treat image : temp/1753344628_1018967_1373490317_7616166cbdc4bcbda0fec64076f3766f_rle_crop_3892383410_0.png treat image : temp/1753344628_1018967_1373490317_7616166cbdc4bcbda0fec64076f3766f_rle_crop_3892383426_0.png treat image : temp/1753344628_1018967_1373490317_7616166cbdc4bcbda0fec64076f3766f_rle_crop_3892383413_0.png treat image : temp/1753344628_1018967_1373490317_7616166cbdc4bcbda0fec64076f3766f_rle_crop_3892383424_0.png treat image : temp/1753344628_1018967_1373490317_7616166cbdc4bcbda0fec64076f3766f_rle_crop_3892383408_0.png treat image : temp/1753344628_1018967_1373490317_7616166cbdc4bcbda0fec64076f3766f_rle_crop_3892383425_0.png treat image : temp/1753344628_1018967_1373490317_7616166cbdc4bcbda0fec64076f3766f_rle_crop_3892383406_0.png treat image : temp/1753344628_1018967_1373490317_7616166cbdc4bcbda0fec64076f3766f_rle_crop_3892383411_0.png treat image : temp/1753344628_1018967_1373490317_7616166cbdc4bcbda0fec64076f3766f_rle_crop_3892383418_0.png treat image : temp/1753344628_1018967_1373490317_7616166cbdc4bcbda0fec64076f3766f_rle_crop_3892383422_0.png treat image : temp/1753344628_1018967_1373490317_7616166cbdc4bcbda0fec64076f3766f_rle_crop_3892383428_0.png treat image : temp/1753344628_1018967_1373490317_7616166cbdc4bcbda0fec64076f3766f_rle_crop_3892383421_0.png treat image : temp/1753344628_1018967_1373490317_7616166cbdc4bcbda0fec64076f3766f_rle_crop_3892383417_0.png treat image : temp/1753344628_1018967_1373490317_7616166cbdc4bcbda0fec64076f3766f_rle_crop_3892383407_0.png treat image : temp/1753344628_1018967_1373490317_7616166cbdc4bcbda0fec64076f3766f_rle_crop_3892383427_0.png treat image : temp/1753344628_1018967_1373490301_449144c9494786872d6b71738572425f_rle_crop_3892383429_0.png treat image : temp/1753344628_1018967_1373490301_449144c9494786872d6b71738572425f_rle_crop_3892383433_0.png treat image : temp/1753344628_1018967_1373490301_449144c9494786872d6b71738572425f_rle_crop_3892383443_0.png treat image : temp/1753344628_1018967_1373490301_449144c9494786872d6b71738572425f_rle_crop_3892383444_0.png treat image : temp/1753344628_1018967_1373490301_449144c9494786872d6b71738572425f_rle_crop_3892383441_0.png treat image : temp/1753344628_1018967_1373490301_449144c9494786872d6b71738572425f_rle_crop_3892383431_0.png treat image : temp/1753344628_1018967_1373490301_449144c9494786872d6b71738572425f_rle_crop_3892383435_0.png treat image : temp/1753344628_1018967_1373490301_449144c9494786872d6b71738572425f_rle_crop_3892383436_0.png treat image : temp/1753344628_1018967_1373490301_449144c9494786872d6b71738572425f_rle_crop_3892383442_0.png treat image : temp/1753344628_1018967_1373490301_449144c9494786872d6b71738572425f_rle_crop_3892383437_0.png treat image : temp/1753344628_1018967_1373490301_449144c9494786872d6b71738572425f_rle_crop_3892383440_0.png treat image : temp/1753344628_1018967_1373490301_449144c9494786872d6b71738572425f_rle_crop_3892383439_0.png treat image : temp/1753344628_1018967_1373490301_449144c9494786872d6b71738572425f_rle_crop_3892383432_0.png treat image : temp/1753344628_1018967_1373490301_449144c9494786872d6b71738572425f_rle_crop_3892383438_0.png treat image : temp/1753344628_1018967_1373490301_449144c9494786872d6b71738572425f_rle_crop_3892383434_0.png treat image : temp/1753344628_1018967_1373490253_0e8a13afe8c09ff2954d74f844f447ac_rle_crop_3892383453_0.png treat image : temp/1753344628_1018967_1373490253_0e8a13afe8c09ff2954d74f844f447ac_rle_crop_3892383458_0.png treat image : temp/1753344628_1018967_1373490253_0e8a13afe8c09ff2954d74f844f447ac_rle_crop_3892383456_0.png treat image : temp/1753344628_1018967_1373490253_0e8a13afe8c09ff2954d74f844f447ac_rle_crop_3892383446_0.png treat image : temp/1753344628_1018967_1373490253_0e8a13afe8c09ff2954d74f844f447ac_rle_crop_3892383445_0.png treat image : temp/1753344628_1018967_1373490253_0e8a13afe8c09ff2954d74f844f447ac_rle_crop_3892383454_0.png treat image : temp/1753344628_1018967_1373490253_0e8a13afe8c09ff2954d74f844f447ac_rle_crop_3892383452_0.png treat image : temp/1753344628_1018967_1373490253_0e8a13afe8c09ff2954d74f844f447ac_rle_crop_3892383447_0.png treat image : temp/1753344628_1018967_1373490553_cf2ec0cec9c27a9b3ef63869fe5cf4c0_rle_crop_3892383278_0.png treat image : temp/1753344628_1018967_1373490484_cada5609c77324748ba4167a608b4659_rle_crop_3892383313_0.png treat image : temp/1753344628_1018967_1373490484_cada5609c77324748ba4167a608b4659_rle_crop_3892383311_0.png treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead_rle_crop_3892383340_0.png treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead_rle_crop_3892383319_0.png treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead_rle_crop_3892383341_0.png treat image : temp/1753344628_1018967_1373490317_7616166cbdc4bcbda0fec64076f3766f_rle_crop_3892383423_0.png treat image : temp/1753344628_1018967_1373490317_7616166cbdc4bcbda0fec64076f3766f_rle_crop_3892383415_0.png treat image : temp/1753344628_1018967_1373490317_7616166cbdc4bcbda0fec64076f3766f_rle_crop_3892383414_0.png treat image : temp/1753344628_1018967_1373490317_7616166cbdc4bcbda0fec64076f3766f_rle_crop_3892383420_0.png treat image : temp/1753344628_1018967_1373490317_7616166cbdc4bcbda0fec64076f3766f_rle_crop_3892383409_0.png treat image : temp/1753344628_1018967_1373490301_449144c9494786872d6b71738572425f_rle_crop_3892383430_0.png treat image : temp/1753344628_1018967_1373490253_0e8a13afe8c09ff2954d74f844f447ac_rle_crop_3892383449_0.png treat image : temp/1753344628_1018967_1373490253_0e8a13afe8c09ff2954d74f844f447ac_rle_crop_3892383450_0.png treat image : temp/1753344628_1018967_1373490253_0e8a13afe8c09ff2954d74f844f447ac_rle_crop_3892383455_0.png treat image : temp/1753344628_1018967_1373490317_7616166cbdc4bcbda0fec64076f3766f_rle_crop_3892383416_0.png treat image : temp/1753344628_1018967_1373490553_cf2ec0cec9c27a9b3ef63869fe5cf4c0_rle_crop_3892383289_0.png treat image : temp/1753344628_1018967_1373490484_cada5609c77324748ba4167a608b4659_rle_crop_3892383315_0.png treat image : temp/1753344628_1018967_1373490484_cada5609c77324748ba4167a608b4659_rle_crop_3892383306_0.png treat image : temp/1753344628_1018967_1373490376_453892b1f44a11f89738f73b27d1eead_rle_crop_3892383336_0.png treat image : temp/1753344628_1018967_1373490368_882407a2a62a0ef018fa8be23230f479_rle_crop_3892383364_0.png treat image : temp/1753344628_1018967_1373490349_1adabe4f393c69aad809b60b58cadb74_rle_crop_3892383398_0.png treat image : temp/1753344628_1018967_1373490317_7616166cbdc4bcbda0fec64076f3766f_rle_crop_3892383419_0.png treat image : temp/1753344628_1018967_1373490253_0e8a13afe8c09ff2954d74f844f447ac_rle_crop_3892383451_0.png treat image : temp/1753344628_1018967_1373490253_0e8a13afe8c09ff2954d74f844f447ac_rle_crop_3892383459_0.png treat image : temp/1753344628_1018967_1373490253_0e8a13afe8c09ff2954d74f844f447ac_rle_crop_3892383457_0.png treat image : temp/1753344628_1018967_1373490253_0e8a13afe8c09ff2954d74f844f447ac_rle_crop_3892383448_0.png treat image : temp/1753344628_1018967_1373490368_882407a2a62a0ef018fa8be23230f479_rle_crop_3892383360_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 195 time used for this insertion : 0.029642105102539062 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 195 time used for this insertion : 0.05273032188415527 save missing photos in datou_result : time spend for datou_step_exec : 10.092942237854004 time spend to save output : 0.08705520629882812 total time spend for step 7 : 10.179997444152832 step8:velours_tree Thu Jul 24 10:16:22 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 2.9839444160461426 time spend to save output : 4.1484832763671875e-05 total time spend for step 8 : 2.9839859008789062 step9:send_mail_cod Thu Jul 24 10:16:25 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P25266836_24-07-2025_10_16_25.pdf 25267417 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette252674171753344985 25267418 change filename to text .imagette252674181753344987 25267419 imagette252674191753344987 25267420 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette252674201753344987 25267421 imagette252674211753344988 25267423 imagette252674231753344988 25267424 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette252674241753344988 25267425 change filename to text .imagette252674251753344989 25267426 imagette252674261753344989 25267427 imagette252674271753344989 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=25266836 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/25267417,25267418,25267419,25267420,25267421,25267422,25267423,25267424,25267425,25267426,25267427?tags=papier,metal,background,pet_clair,pehd,environnement,mal_croppe,carton,autre,pet_fonce,flou args[1373490553] : ((1373490553, -7.686886015784252, 492609224), (1373490553, 1.4190729621436708, 2107752395), '0.12490388093171298') We are sending mail with results at report@fotonower.com args[1373490484] : ((1373490484, -7.725158739937881, 492609224), (1373490484, 1.569838568871712, 2107752395), '0.12490388093171298') We are sending mail with results at report@fotonower.com args[1373490376] : ((1373490376, -7.629035151043603, 492609224), (1373490376, 0.9002542483502848, 2107752395), '0.12490388093171298') We are sending mail with results at report@fotonower.com args[1373490368] : ((1373490368, -7.605841245864178, 492609224), (1373490368, 1.009196130804909, 2107752395), '0.12490388093171298') We are sending mail with results at report@fotonower.com args[1373490349] : ((1373490349, -7.425025847658653, 492609224), (1373490349, 0.7430472590988216, 2107752395), '0.12490388093171298') We are sending mail with results at report@fotonower.com args[1373490317] : ((1373490317, -7.315632939206749, 492609224), (1373490317, 0.4228408866580531, 2107752395), '0.12490388093171298') We are sending mail with results at report@fotonower.com args[1373490301] : ((1373490301, -7.566376019738585, 492609224), (1373490301, 1.2117529977718589, 2107752395), '0.12490388093171298') We are sending mail with results at report@fotonower.com args[1373490253] : ((1373490253, -7.304376692279202, 492609224), (1373490253, 0.7940924785502724, 2107752395), '0.12490388093171298') We are sending mail with results at report@fotonower.com refus_total : 0.12490388093171298 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=25266836 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25266836_24-07-2025_10_16_25.pdf results_Auto_P25266836_24-07-2025_10_16_25.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25266836_24-07-2025_10_16_25.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','25266836','results_Auto_P25266836_24-07-2025_10_16_25.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25266836_24-07-2025_10_16_25.pdf','pdf','','0.55','0.12490388093171298') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/25266836

https://www.fotonower.com/image?json=false&list_photos_id=1373490553
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1373490484
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1373490376
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1373490368
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1373490349
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1373490317
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1373490301
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1373490253
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 12.49%
Veuillez trouver les photos des contaminants.

exemples de contaminants: papier: https://www.fotonower.com/view/25267417?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/25267418?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/25267420?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/25267424?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/25267425?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25266836_24-07-2025_10_16_25.pdf.

Lien vers velours :https://www.fotonower.com/velours/25267417,25267418,25267419,25267420,25267421,25267422,25267423,25267424,25267425,25267426,25267427?tags=papier,metal,background,pet_clair,pehd,environnement,mal_croppe,carton,autre,pet_fonce,flou.


L'équipe Fotonower 202 b'' Server: nginx Date: Thu, 24 Jul 2025 08:16:32 GMT Content-Length: 0 Connection: close X-Message-Id: f4blfPygTyuAckx0Jbz9ag Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1373490553, 1373490484, 1373490376, 1373490368, 1373490349, 1373490317, 1373490301, 1373490253] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3337311') ('3318', '25266836', '1373490553', None, None, None, None, None, '3337311') ('3318', None, None, None, None, None, None, None, '3337311') ('3318', '25266836', '1373490484', None, None, None, None, None, '3337311') ('3318', None, None, None, None, None, None, None, '3337311') ('3318', '25266836', '1373490376', None, None, None, None, None, '3337311') ('3318', None, None, None, None, None, None, None, '3337311') ('3318', '25266836', '1373490368', None, None, None, None, None, '3337311') ('3318', None, None, None, None, None, None, None, '3337311') ('3318', '25266836', '1373490349', None, None, None, None, None, '3337311') ('3318', None, None, None, None, None, None, None, '3337311') ('3318', '25266836', '1373490317', None, None, None, None, None, '3337311') ('3318', None, None, None, None, None, None, None, '3337311') ('3318', '25266836', '1373490301', None, None, None, None, None, '3337311') ('3318', None, None, None, None, None, None, None, '3337311') ('3318', '25266836', '1373490253', None, None, None, None, None, '3337311') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.01651477813720703 save_final save missing photos in datou_result : time spend for datou_step_exec : 6.412230968475342 time spend to save output : 0.0168154239654541 total time spend for step 9 : 6.429046392440796 step10:split_time_score Thu Jul 24 10:16:32 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('09', 8),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 24072025 25266836 Nombre de photos uploadées : 8 / 23040 (0%) 24072025 25266836 Nombre de photos taguées (types de déchets): 0 / 8 (0%) 24072025 25266836 Nombre de photos taguées (volume) : 0 / 8 (0%) elapsed_time : load_data_split_time_score 2.384185791015625e-06 elapsed_time : order_list_meta_photo_and_scores 1.4543533325195312e-05 ???????? elapsed_time : fill_and_build_computed_from_old_data 0.00044035911560058594 elapsed_time : insert_dashboard_record_day_entry 0.029642343521118164 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.03791742956327484 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25257554_24-07-2025_07_23_41.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25257554 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25257554 AND mptpi.`type`=3726 To do Qualite : 0.10505730774176954 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25259010_24-07-2025_07_44_45.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25259010 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25259010 AND mptpi.`type`=3594 To do Qualite : 0.043389295478997295 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25266810_24-07-2025_10_13_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25266810 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25266810 AND mptpi.`type`=3726 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25266815 order by id desc limit 1 Qualite : 0.12490388093171298 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25266836_24-07-2025_10_16_25.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25266836 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25266836 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'24072025': {'nb_upload': 8, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1373490553, 1373490484, 1373490376, 1373490368, 1373490349, 1373490317, 1373490301, 1373490253] Looping around the photos to save general results len do output : 1 /25266836Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3337311') ('3318', '25266836', '1373490553', None, None, None, None, None, '3337311') ('3318', None, None, None, None, None, None, None, '3337311') ('3318', '25266836', '1373490484', None, None, None, None, None, '3337311') ('3318', None, None, None, None, None, None, None, '3337311') ('3318', '25266836', '1373490376', None, None, None, None, None, '3337311') ('3318', None, None, None, None, None, None, None, '3337311') ('3318', '25266836', '1373490368', None, None, None, None, None, '3337311') ('3318', None, None, None, None, None, None, None, '3337311') ('3318', '25266836', '1373490349', None, None, None, None, None, '3337311') ('3318', None, None, None, None, None, None, None, '3337311') ('3318', '25266836', '1373490317', None, None, None, None, None, '3337311') ('3318', None, None, None, None, None, None, None, '3337311') ('3318', '25266836', '1373490301', None, None, None, None, None, '3337311') ('3318', None, None, None, None, None, None, None, '3337311') ('3318', '25266836', '1373490253', None, None, None, None, None, '3337311') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.029210567474365234 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.48270845413208 time spend to save output : 0.02947831153869629 total time spend for step 10 : 1.5121867656707764 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 8 set_done_treatment 167.72user 135.25system 6:09.63elapsed 81%CPU (0avgtext+0avgdata 6092916maxresident)k 2408736inputs+135392outputs (20062major+15621108minor)pagefaults 0swaps