python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2684437 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3449335'] with mtr_portfolio_ids : ['25686587'] and first list_photo_ids : [] new path : /proc/2684437/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 38 ; length of list_pids : 38 ; length of list_args : 38 time to download the photos : 4.6598005294799805 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Tue Aug 5 14:20:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10957 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-08-05 14:20:33.953550: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-08-05 14:20:33.979385: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493035000 Hz 2025-08-05 14:20:33.981345: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f6c88000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-08-05 14:20:33.981389: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-08-05 14:20:33.985093: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-08-05 14:20:34.129378: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x35df1290 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-08-05 14:20:34.129427: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-08-05 14:20:34.130744: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-05 14:20:34.131106: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-05 14:20:34.134086: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-05 14:20:34.136695: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-05 14:20:34.137176: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-05 14:20:34.140505: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-05 14:20:34.141481: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-05 14:20:34.148831: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-05 14:20:34.150238: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-05 14:20:34.150291: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-05 14:20:34.151015: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-05 14:20:34.151029: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-05 14:20:34.151048: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-05 14:20:34.152381: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10154 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-08-05 14:20:34.386276: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-05 14:20:34.386355: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-05 14:20:34.386375: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-05 14:20:34.386393: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-05 14:20:34.386410: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-05 14:20:34.386427: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-05 14:20:34.386445: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-05 14:20:34.386463: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-05 14:20:34.388058: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-05 14:20:34.389376: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-05 14:20:34.389414: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-05 14:20:34.389435: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-05 14:20:34.389455: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-05 14:20:34.389475: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-05 14:20:34.389494: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-05 14:20:34.389513: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-05 14:20:34.389533: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-05 14:20:34.391102: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-05 14:20:34.391132: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-05 14:20:34.391142: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-05 14:20:34.391151: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-05 14:20:34.392614: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10154 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-08-05 14:20:43.560430: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-05 14:20:43.748508: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 38 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 23.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 8.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 6.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 18.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 21.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 31.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 19.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 19.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 18.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 1 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 21.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 20.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 22.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 1 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 22.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 19.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 18.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 22.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 16.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 16.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 1 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 23.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 19.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 Detection mask done ! Trying to reset tf kernel 2685023 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 376 tf kernel not reseted sub process len(results) : 38 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 38 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5665 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.002117156982421875 nb_pixel_total : 103973 time to create 1 rle with old method : 0.11409735679626465 length of segment : 560 time for calcul the mask position with numpy : 0.00013303756713867188 nb_pixel_total : 3758 time to create 1 rle with old method : 0.004422664642333984 length of segment : 70 time for calcul the mask position with numpy : 0.0015552043914794922 nb_pixel_total : 109277 time to create 1 rle with old method : 0.11864185333251953 length of segment : 532 time for calcul the mask position with numpy : 0.00019216537475585938 nb_pixel_total : 9030 time to create 1 rle with old method : 0.01002192497253418 length of segment : 89 time for calcul the mask position with numpy : 0.00021386146545410156 nb_pixel_total : 12459 time to create 1 rle with old method : 0.013534784317016602 length of segment : 136 time for calcul the mask position with numpy : 0.013869047164916992 nb_pixel_total : 740172 time to create 1 rle with new method : 0.10994648933410645 length of segment : 922 time for calcul the mask position with numpy : 0.0001621246337890625 nb_pixel_total : 3787 time to create 1 rle with old method : 0.004967927932739258 length of segment : 73 time for calcul the mask position with numpy : 0.00020837783813476562 nb_pixel_total : 12271 time to create 1 rle with old method : 0.01396322250366211 length of segment : 135 time for calcul the mask position with numpy : 0.015982389450073242 nb_pixel_total : 892025 time to create 1 rle with new method : 0.28282856941223145 length of segment : 1693 time for calcul the mask position with numpy : 0.0012865066528320312 nb_pixel_total : 88643 time to create 1 rle with old method : 0.09495782852172852 length of segment : 482 time for calcul the mask position with numpy : 8.821487426757812e-05 nb_pixel_total : 2594 time to create 1 rle with old method : 0.003086090087890625 length of segment : 53 time for calcul the mask position with numpy : 0.010780811309814453 nb_pixel_total : 726209 time to create 1 rle with new method : 0.12126421928405762 length of segment : 897 time for calcul the mask position with numpy : 0.00020360946655273438 nb_pixel_total : 10805 time to create 1 rle with old method : 0.01236414909362793 length of segment : 146 time for calcul the mask position with numpy : 0.0013909339904785156 nb_pixel_total : 95228 time to create 1 rle with old method : 0.1068422794342041 length of segment : 491 time for calcul the mask position with numpy : 0.0168914794921875 nb_pixel_total : 763655 time to create 1 rle with new method : 0.02360844612121582 length of segment : 966 time for calcul the mask position with numpy : 0.00034880638122558594 nb_pixel_total : 10747 time to create 1 rle with old method : 0.012027263641357422 length of segment : 115 time for calcul the mask position with numpy : 0.012736797332763672 nb_pixel_total : 772440 time to create 1 rle with new method : 0.01984238624572754 length of segment : 1000 time for calcul the mask position with numpy : 0.0001423358917236328 nb_pixel_total : 7153 time to create 1 rle with old method : 0.007748842239379883 length of segment : 85 time for calcul the mask position with numpy : 0.00017762184143066406 nb_pixel_total : 9414 time to create 1 rle with old method : 0.010782718658447266 length of segment : 132 time for calcul the mask position with numpy : 9.512901306152344e-05 nb_pixel_total : 4862 time to create 1 rle with old method : 0.005441427230834961 length of segment : 122 time for calcul the mask position with numpy : 0.0002932548522949219 nb_pixel_total : 23335 time to create 1 rle with old method : 0.025430679321289062 length of segment : 254 time for calcul the mask position with numpy : 9.942054748535156e-05 nb_pixel_total : 5345 time to create 1 rle with old method : 0.0064182281494140625 length of segment : 54 time for calcul the mask position with numpy : 0.0018203258514404297 nb_pixel_total : 132017 time to create 1 rle with old method : 0.14014363288879395 length of segment : 570 time for calcul the mask position with numpy : 0.0004303455352783203 nb_pixel_total : 6944 time to create 1 rle with old method : 0.008110761642456055 length of segment : 135 time for calcul the mask position with numpy : 0.0007653236389160156 nb_pixel_total : 24776 time to create 1 rle with old method : 0.028246402740478516 length of segment : 216 time for calcul the mask position with numpy : 0.0027632713317871094 nb_pixel_total : 126399 time to create 1 rle with old method : 0.14290785789489746 length of segment : 552 time for calcul the mask position with numpy : 0.01658153533935547 nb_pixel_total : 760160 time to create 1 rle with new method : 0.026834726333618164 length of segment : 1000 time for calcul the mask position with numpy : 0.00040149688720703125 nb_pixel_total : 6412 time to create 1 rle with old method : 0.0077135562896728516 length of segment : 123 time for calcul the mask position with numpy : 0.003409147262573242 nb_pixel_total : 114161 time to create 1 rle with old method : 0.1276259422302246 length of segment : 508 time for calcul the mask position with numpy : 0.00024437904357910156 nb_pixel_total : 3541 time to create 1 rle with old method : 0.004125118255615234 length of segment : 68 time for calcul the mask position with numpy : 0.0003910064697265625 nb_pixel_total : 11408 time to create 1 rle with old method : 0.012995481491088867 length of segment : 126 time for calcul the mask position with numpy : 0.00017762184143066406 nb_pixel_total : 2453 time to create 1 rle with old method : 0.0030107498168945312 length of segment : 61 time for calcul the mask position with numpy : 0.021691322326660156 nb_pixel_total : 764027 time to create 1 rle with new method : 0.03776240348815918 length of segment : 993 time for calcul the mask position with numpy : 0.002439737319946289 nb_pixel_total : 101034 time to create 1 rle with old method : 0.11270427703857422 length of segment : 500 time for calcul the mask position with numpy : 0.014068126678466797 nb_pixel_total : 726882 time to create 1 rle with new method : 0.020423173904418945 length of segment : 884 time for calcul the mask position with numpy : 0.014960050582885742 nb_pixel_total : 732035 time to create 1 rle with new method : 0.02247452735900879 length of segment : 956 time for calcul the mask position with numpy : 0.016632795333862305 nb_pixel_total : 756589 time to create 1 rle with new method : 0.023885726928710938 length of segment : 944 time for calcul the mask position with numpy : 0.00021409988403320312 nb_pixel_total : 5286 time to create 1 rle with old method : 0.00601959228515625 length of segment : 67 time for calcul the mask position with numpy : 0.00018405914306640625 nb_pixel_total : 6292 time to create 1 rle with old method : 0.006955623626708984 length of segment : 82 time for calcul the mask position with numpy : 0.00023102760314941406 nb_pixel_total : 6080 time to create 1 rle with old method : 0.0066680908203125 length of segment : 87 time for calcul the mask position with numpy : 0.022228240966796875 nb_pixel_total : 1084973 time to create 1 rle with new method : 0.05365705490112305 length of segment : 1888 time for calcul the mask position with numpy : 0.0018422603607177734 nb_pixel_total : 111967 time to create 1 rle with old method : 0.1218721866607666 length of segment : 697 time for calcul the mask position with numpy : 0.00024271011352539062 nb_pixel_total : 5998 time to create 1 rle with old method : 0.00680994987487793 length of segment : 123 time for calcul the mask position with numpy : 0.0004825592041015625 nb_pixel_total : 17431 time to create 1 rle with old method : 0.019535303115844727 length of segment : 170 time for calcul the mask position with numpy : 0.0006129741668701172 nb_pixel_total : 21482 time to create 1 rle with old method : 0.024318933486938477 length of segment : 170 time for calcul the mask position with numpy : 0.00032782554626464844 nb_pixel_total : 10820 time to create 1 rle with old method : 0.012993335723876953 length of segment : 82 time for calcul the mask position with numpy : 0.00031375885009765625 nb_pixel_total : 8678 time to create 1 rle with old method : 0.010575056076049805 length of segment : 152 time for calcul the mask position with numpy : 0.00011539459228515625 nb_pixel_total : 2852 time to create 1 rle with old method : 0.003533601760864258 length of segment : 41 time for calcul the mask position with numpy : 0.013335227966308594 nb_pixel_total : 707148 time to create 1 rle with new method : 0.021355152130126953 length of segment : 952 time for calcul the mask position with numpy : 0.0001513957977294922 nb_pixel_total : 2885 time to create 1 rle with old method : 0.0037050247192382812 length of segment : 41 time for calcul the mask position with numpy : 0.01367330551147461 nb_pixel_total : 787575 time to create 1 rle with new method : 0.02067255973815918 length of segment : 1273 time for calcul the mask position with numpy : 0.0002307891845703125 nb_pixel_total : 13725 time to create 1 rle with old method : 0.015592336654663086 length of segment : 171 time for calcul the mask position with numpy : 0.01004648208618164 nb_pixel_total : 750149 time to create 1 rle with new method : 0.015393733978271484 length of segment : 986 time for calcul the mask position with numpy : 0.002413511276245117 nb_pixel_total : 126687 time to create 1 rle with old method : 0.13795065879821777 length of segment : 537 time for calcul the mask position with numpy : 0.00013589859008789062 nb_pixel_total : 4482 time to create 1 rle with old method : 0.005262613296508789 length of segment : 55 time for calcul the mask position with numpy : 9.989738464355469e-05 nb_pixel_total : 2362 time to create 1 rle with old method : 0.0027573108673095703 length of segment : 36 time for calcul the mask position with numpy : 0.010982751846313477 nb_pixel_total : 738669 time to create 1 rle with new method : 0.017725706100463867 length of segment : 948 time for calcul the mask position with numpy : 0.00024199485778808594 nb_pixel_total : 6119 time to create 1 rle with old method : 0.007062196731567383 length of segment : 93 time for calcul the mask position with numpy : 0.0003705024719238281 nb_pixel_total : 16552 time to create 1 rle with old method : 0.01875472068786621 length of segment : 231 time for calcul the mask position with numpy : 0.012700319290161133 nb_pixel_total : 875352 time to create 1 rle with new method : 0.022173404693603516 length of segment : 1526 time for calcul the mask position with numpy : 0.0002636909484863281 nb_pixel_total : 4818 time to create 1 rle with old method : 0.0058138370513916016 length of segment : 101 time for calcul the mask position with numpy : 0.0022780895233154297 nb_pixel_total : 106963 time to create 1 rle with old method : 0.1208653450012207 length of segment : 511 time for calcul the mask position with numpy : 0.0005109310150146484 nb_pixel_total : 14797 time to create 1 rle with old method : 0.01737666130065918 length of segment : 160 time for calcul the mask position with numpy : 0.011104822158813477 nb_pixel_total : 714760 time to create 1 rle with new method : 0.01767420768737793 length of segment : 949 time for calcul the mask position with numpy : 0.0022079944610595703 nb_pixel_total : 103793 time to create 1 rle with old method : 0.1145329475402832 length of segment : 527 time for calcul the mask position with numpy : 0.00017333030700683594 nb_pixel_total : 4079 time to create 1 rle with old method : 0.00481867790222168 length of segment : 97 time for calcul the mask position with numpy : 0.00015807151794433594 nb_pixel_total : 4666 time to create 1 rle with old method : 0.00545954704284668 length of segment : 52 time for calcul the mask position with numpy : 0.00032711029052734375 nb_pixel_total : 11382 time to create 1 rle with old method : 0.012957334518432617 length of segment : 128 time for calcul the mask position with numpy : 0.011801481246948242 nb_pixel_total : 738742 time to create 1 rle with new method : 0.020486831665039062 length of segment : 1211 time for calcul the mask position with numpy : 0.00013971328735351562 nb_pixel_total : 3830 time to create 1 rle with old method : 0.0044558048248291016 length of segment : 51 time for calcul the mask position with numpy : 0.00024175643920898438 nb_pixel_total : 6209 time to create 1 rle with old method : 0.006737232208251953 length of segment : 131 time for calcul the mask position with numpy : 0.00011420249938964844 nb_pixel_total : 2807 time to create 1 rle with old method : 0.0031006336212158203 length of segment : 44 time for calcul the mask position with numpy : 0.0023102760314941406 nb_pixel_total : 120665 time to create 1 rle with old method : 0.13315749168395996 length of segment : 552 time for calcul the mask position with numpy : 0.0111846923828125 nb_pixel_total : 715030 time to create 1 rle with new method : 0.017060518264770508 length of segment : 894 time for calcul the mask position with numpy : 0.009191751480102539 nb_pixel_total : 727906 time to create 1 rle with new method : 0.014233589172363281 length of segment : 967 time for calcul the mask position with numpy : 0.0003819465637207031 nb_pixel_total : 11937 time to create 1 rle with old method : 0.01295328140258789 length of segment : 160 time for calcul the mask position with numpy : 0.010510683059692383 nb_pixel_total : 734722 time to create 1 rle with new method : 0.015537738800048828 length of segment : 938 time for calcul the mask position with numpy : 0.00022864341735839844 nb_pixel_total : 8079 time to create 1 rle with old method : 0.0096588134765625 length of segment : 81 time for calcul the mask position with numpy : 0.0002665519714355469 nb_pixel_total : 9737 time to create 1 rle with old method : 0.011472225189208984 length of segment : 142 time for calcul the mask position with numpy : 0.0006287097930908203 nb_pixel_total : 28004 time to create 1 rle with old method : 0.032289981842041016 length of segment : 179 time for calcul the mask position with numpy : 0.015477180480957031 nb_pixel_total : 743686 time to create 1 rle with new method : 0.026486873626708984 length of segment : 997 time for calcul the mask position with numpy : 0.010556221008300781 nb_pixel_total : 742852 time to create 1 rle with new method : 0.016351699829101562 length of segment : 1005 time for calcul the mask position with numpy : 0.013782262802124023 nb_pixel_total : 878830 time to create 1 rle with new method : 0.02265334129333496 length of segment : 1588 time for calcul the mask position with numpy : 0.00020694732666015625 nb_pixel_total : 4387 time to create 1 rle with old method : 0.005082845687866211 length of segment : 64 time for calcul the mask position with numpy : 0.017501354217529297 nb_pixel_total : 1212441 time to create 1 rle with new method : 0.029942035675048828 length of segment : 1476 time for calcul the mask position with numpy : 0.00010895729064941406 nb_pixel_total : 3080 time to create 1 rle with old method : 0.003596782684326172 length of segment : 75 time for calcul the mask position with numpy : 0.0004425048828125 nb_pixel_total : 10037 time to create 1 rle with old method : 0.011544942855834961 length of segment : 179 time for calcul the mask position with numpy : 0.013531684875488281 nb_pixel_total : 806479 time to create 1 rle with new method : 0.019814014434814453 length of segment : 1503 time for calcul the mask position with numpy : 0.0020377635955810547 nb_pixel_total : 106608 time to create 1 rle with old method : 0.11621999740600586 length of segment : 495 time for calcul the mask position with numpy : 0.0010280609130859375 nb_pixel_total : 30665 time to create 1 rle with old method : 0.040758371353149414 length of segment : 288 time for calcul the mask position with numpy : 0.01587820053100586 nb_pixel_total : 1056434 time to create 1 rle with new method : 0.024897336959838867 length of segment : 1875 time for calcul the mask position with numpy : 0.00011372566223144531 nb_pixel_total : 3579 time to create 1 rle with old method : 0.004060983657836914 length of segment : 71 time for calcul the mask position with numpy : 0.0001423358917236328 nb_pixel_total : 7557 time to create 1 rle with old method : 0.008778810501098633 length of segment : 121 time for calcul the mask position with numpy : 0.00034356117248535156 nb_pixel_total : 10823 time to create 1 rle with old method : 0.01178598403930664 length of segment : 165 time for calcul the mask position with numpy : 0.015440940856933594 nb_pixel_total : 820938 time to create 1 rle with new method : 0.0225522518157959 length of segment : 1028 time for calcul the mask position with numpy : 0.0001575946807861328 nb_pixel_total : 4201 time to create 1 rle with old method : 0.00482177734375 length of segment : 110 time for calcul the mask position with numpy : 0.00012493133544921875 nb_pixel_total : 6164 time to create 1 rle with old method : 0.0070993900299072266 length of segment : 98 time for calcul the mask position with numpy : 0.011476278305053711 nb_pixel_total : 740773 time to create 1 rle with new method : 0.0169985294342041 length of segment : 979 time for calcul the mask position with numpy : 0.0002956390380859375 nb_pixel_total : 5867 time to create 1 rle with old method : 0.006669282913208008 length of segment : 105 time for calcul the mask position with numpy : 0.012061595916748047 nb_pixel_total : 717206 time to create 1 rle with new method : 0.0176239013671875 length of segment : 979 time for calcul the mask position with numpy : 0.0003044605255126953 nb_pixel_total : 5725 time to create 1 rle with old method : 0.006661176681518555 length of segment : 134 time for calcul the mask position with numpy : 0.0007700920104980469 nb_pixel_total : 34233 time to create 1 rle with old method : 0.038633108139038086 length of segment : 234 time for calcul the mask position with numpy : 0.0003495216369628906 nb_pixel_total : 6219 time to create 1 rle with old method : 0.007233381271362305 length of segment : 94 time for calcul the mask position with numpy : 0.01856064796447754 nb_pixel_total : 756098 time to create 1 rle with new method : 0.027123451232910156 length of segment : 998 time for calcul the mask position with numpy : 0.00043582916259765625 nb_pixel_total : 13911 time to create 1 rle with old method : 0.015427827835083008 length of segment : 171 time for calcul the mask position with numpy : 0.014200687408447266 nb_pixel_total : 732188 time to create 1 rle with new method : 0.021888017654418945 length of segment : 936 time for calcul the mask position with numpy : 0.0017783641815185547 nb_pixel_total : 103438 time to create 1 rle with old method : 0.11390495300292969 length of segment : 589 time spent for convertir_results : 10.869102716445923 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 107 chid ids of type : 3594 Number RLEs to save : 51283 save missing photos in datou_result : time spend for datou_step_exec : 49.52342414855957 time spend to save output : 2.9243805408477783 total time spend for step 1 : 52.44780468940735 step2:crop_condition Tue Aug 5 14:21:23 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 38 ! batch 1 Loaded 107 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 19 About to insert : list_path_to_insert length 19 new photo from crops ! About to upload 19 photos upload in portfolio : 3736932 init cache_photo without model_param we have 19 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1754396485_2684437 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 19 photos in the portfolio 3736932 time of upload the photos Elapsed time : 5.469254970550537 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1754396492_2684437 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.8046016693115234 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3736932 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1754396493_2684437 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 4 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.3556315898895264 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 75 About to insert : list_path_to_insert length 75 new photo from crops ! About to upload 75 photos upload in portfolio : 3736932 init cache_photo without model_param we have 75 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1754396603_2684437 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 75 photos in the portfolio 3736932 time of upload the photos Elapsed time : 17.541768550872803 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 7 About to insert : list_path_to_insert length 7 new photo from crops ! About to upload 7 photos upload in portfolio : 3736932 init cache_photo without model_param we have 7 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1754396622_2684437 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 7 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.9103693962097168 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1375304419, 1375304417, 1375304410, 1375304409, 1375304383, 1375304378, 1375304371, 1375304362, 1375304356, 1375304352, 1375304338, 1375304335, 1375304332, 1375304328, 1375304304, 1375304276, 1375304055, 1375304029, 1375303997, 1375303956, 1375303926, 1375303900, 1375303868, 1375303866, 1375303864, 1375303861, 1375303859, 1375303856, 1375303844, 1375303842, 1375303839, 1375303835, 1375303833, 1375303830, 1375303665, 1375303656, 1375303632, 1375303578] Looping around the photos to save general results len do output : 107 /1375312803Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312804Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312805Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312806Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312807Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312808Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312809Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312810Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312811Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312812Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312813Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312814Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312815Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312816Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312817Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312818Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312819Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312820Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312822Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312823Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312824Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312825Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312826Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312827Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312828Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312914Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312915Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312916Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312917Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312918Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312919Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312920Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312921Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312922Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312923Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312924Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312925Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312926Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312927Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312928Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312929Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312930Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312931Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312932Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312933Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312934Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312935Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312936Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312937Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312938Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312939Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312940Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312941Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312942Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312943Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312945Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312946Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312947Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312948Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312949Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312950Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312951Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312952Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312953Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312954Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312955Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312956Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312957Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312958Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312959Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312960Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312961Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312962Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312963Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312964Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312965Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312966Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312967Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312968Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312969Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312970Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312971Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312972Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312973Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312974Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312975Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312976Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312977Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312978Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312979Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312980Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312981Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312982Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312983Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312984Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312985Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312986Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312987Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312988Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312989Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312992Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312993Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312994Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312995Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312996Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312997Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375312998Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304419', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304417', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304410', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304409', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304383', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304378', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304371', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304362', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304356', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304352', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304338', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304335', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304332', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304328', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304304', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304276', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304055', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304029', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303997', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303956', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303926', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303900', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303868', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303866', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303864', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303861', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303859', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303856', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303844', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303842', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303839', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303835', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303833', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303830', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303665', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303656', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303632', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303578', None, None, None, None, None, '3449335') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 359 time used for this insertion : 0.03345942497253418 save_final save missing photos in datou_result : time spend for datou_step_exec : 140.41750645637512 time spend to save output : 0.039223432540893555 total time spend for step 2 : 140.45672988891602 step3:rle_unique_nms_with_priority Tue Aug 5 14:23:44 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 107 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.7998871803283691 time for calcul the mask position with numpy : 0.08175516128540039 nb_pixel_total : 1969627 time to create 1 rle with new method : 0.17525100708007812 time for calcul the mask position with numpy : 0.006658315658569336 nb_pixel_total : 103973 time to create 1 rle with old method : 0.11257171630859375 create new chi : 0.38060665130615234 time to delete rle : 0.022472620010375977 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 2200 TO DO : save crop sub photo not yet done ! save time : 0.18266868591308594 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 0.12407040596008301 time for calcul the mask position with numpy : 0.15981245040893555 nb_pixel_total : 1207089 time to create 1 rle with new method : 0.09601712226867676 time for calcul the mask position with numpy : 0.017739295959472656 nb_pixel_total : 731987 time to create 1 rle with new method : 0.15705347061157227 time for calcul the mask position with numpy : 0.0056760311126708984 nb_pixel_total : 12459 time to create 1 rle with old method : 0.013033151626586914 time for calcul the mask position with numpy : 0.005683183670043945 nb_pixel_total : 9030 time to create 1 rle with old method : 0.00975489616394043 time for calcul the mask position with numpy : 0.006716728210449219 nb_pixel_total : 109277 time to create 1 rle with old method : 0.12046575546264648 time for calcul the mask position with numpy : 0.006138324737548828 nb_pixel_total : 3758 time to create 1 rle with old method : 0.004273891448974609 create new chi : 0.6116118431091309 time to delete rle : 0.0007338523864746094 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 4514 TO DO : save crop sub photo not yet done ! save time : 0.3153524398803711 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.09023809432983398 time for calcul the mask position with numpy : 0.024095535278320312 nb_pixel_total : 2057542 time to create 1 rle with new method : 0.11173892021179199 time for calcul the mask position with numpy : 0.006159067153930664 nb_pixel_total : 12271 time to create 1 rle with old method : 0.013252735137939453 time for calcul the mask position with numpy : 0.006052732467651367 nb_pixel_total : 3787 time to create 1 rle with old method : 0.003963470458984375 create new chi : 0.17571759223937988 time to delete rle : 0.00027251243591308594 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1496 TO DO : save crop sub photo not yet done ! save time : 0.12394595146179199 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.04683732986450195 time for calcul the mask position with numpy : 0.01385045051574707 nb_pixel_total : 1092932 time to create 1 rle with new method : 0.11150217056274414 time for calcul the mask position with numpy : 0.006643772125244141 nb_pixel_total : 88643 time to create 1 rle with old method : 0.0979163646697998 time for calcul the mask position with numpy : 0.02253437042236328 nb_pixel_total : 892025 time to create 1 rle with new method : 0.16211390495300293 create new chi : 0.4243497848510742 time to delete rle : 0.0007092952728271484 batch 1 Loaded 5 chid ids of type : 3594 ++++++Number RLEs to save : 5430 TO DO : save crop sub photo not yet done ! save time : 0.35106921195983887 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.04622507095336914 time for calcul the mask position with numpy : 0.014644622802734375 nb_pixel_total : 1344797 time to create 1 rle with new method : 0.08613300323486328 time for calcul the mask position with numpy : 0.013368844985961914 nb_pixel_total : 726209 time to create 1 rle with new method : 0.14752507209777832 time for calcul the mask position with numpy : 0.005751132965087891 nb_pixel_total : 2594 time to create 1 rle with old method : 0.0028142929077148438 create new chi : 0.2795994281768799 time to delete rle : 0.0005559921264648438 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2980 TO DO : save crop sub photo not yet done ! save time : 0.20505714416503906 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.056845903396606445 time for calcul the mask position with numpy : 0.019256114959716797 nb_pixel_total : 1203912 time to create 1 rle with new method : 0.1579885482788086 time for calcul the mask position with numpy : 0.12531185150146484 nb_pixel_total : 763655 time to create 1 rle with new method : 0.09002184867858887 time for calcul the mask position with numpy : 0.006246328353881836 nb_pixel_total : 95228 time to create 1 rle with old method : 0.09995484352111816 time for calcul the mask position with numpy : 0.005974769592285156 nb_pixel_total : 10805 time to create 1 rle with old method : 0.011591196060180664 create new chi : 0.5256862640380859 time to delete rle : 0.0006196498870849609 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 4281 TO DO : save crop sub photo not yet done ! save time : 0.2896878719329834 nb_obj : 4 nb_hashtags : 1 time to prepare the origin masks : 0.346937894821167 time for calcul the mask position with numpy : 0.050737619400024414 nb_pixel_total : 1273846 time to create 1 rle with new method : 0.16382670402526855 time for calcul the mask position with numpy : 0.0060460567474365234 nb_pixel_total : 9414 time to create 1 rle with old method : 0.010270118713378906 time for calcul the mask position with numpy : 0.005831718444824219 nb_pixel_total : 7153 time to create 1 rle with old method : 0.00772404670715332 time for calcul the mask position with numpy : 0.017928600311279297 nb_pixel_total : 772440 time to create 1 rle with new method : 0.12294292449951172 time for calcul the mask position with numpy : 0.006323814392089844 nb_pixel_total : 10747 time to create 1 rle with old method : 0.011539459228515625 create new chi : 0.4123268127441406 time to delete rle : 0.0005605220794677734 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 3744 TO DO : save crop sub photo not yet done ! save time : 0.2653474807739258 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 0.05444836616516113 time for calcul the mask position with numpy : 0.04111814498901367 nb_pixel_total : 1908041 time to create 1 rle with new method : 0.19192051887512207 time for calcul the mask position with numpy : 0.006440877914428711 nb_pixel_total : 132017 time to create 1 rle with old method : 0.14605355262756348 time for calcul the mask position with numpy : 0.006391048431396484 nb_pixel_total : 5345 time to create 1 rle with old method : 0.0064334869384765625 time for calcul the mask position with numpy : 0.00672149658203125 nb_pixel_total : 23335 time to create 1 rle with old method : 0.025761127471923828 time for calcul the mask position with numpy : 0.006086111068725586 nb_pixel_total : 4862 time to create 1 rle with old method : 0.0053691864013671875 create new chi : 0.45213818550109863 time to delete rle : 0.0004992485046386719 batch 1 Loaded 9 chid ids of type : 3594 +++++Number RLEs to save : 3080 TO DO : save crop sub photo not yet done ! save time : 0.23258233070373535 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.06870794296264648 time for calcul the mask position with numpy : 0.017932415008544922 nb_pixel_total : 1155321 time to create 1 rle with new method : 0.18536734580993652 time for calcul the mask position with numpy : 0.010885477066040039 nb_pixel_total : 760160 time to create 1 rle with new method : 0.0879964828491211 time for calcul the mask position with numpy : 0.006605625152587891 nb_pixel_total : 126399 time to create 1 rle with old method : 0.13431525230407715 time for calcul the mask position with numpy : 0.005952596664428711 nb_pixel_total : 24776 time to create 1 rle with old method : 0.0262908935546875 time for calcul the mask position with numpy : 0.00592494010925293 nb_pixel_total : 6944 time to create 1 rle with old method : 0.00741887092590332 create new chi : 0.5040829181671143 time to delete rle : 0.0007228851318359375 batch 1 Loaded 9 chid ids of type : 3594 +++++Number RLEs to save : 4886 TO DO : save crop sub photo not yet done ! save time : 0.3196709156036377 nb_obj : 6 nb_hashtags : 4 time to prepare the origin masks : 0.2848172187805176 time for calcul the mask position with numpy : 0.04391789436340332 nb_pixel_total : 1179278 time to create 1 rle with new method : 0.22394824028015137 time for calcul the mask position with numpy : 0.011960506439208984 nb_pixel_total : 756347 time to create 1 rle with new method : 0.08715677261352539 time for calcul the mask position with numpy : 0.005784034729003906 nb_pixel_total : 2453 time to create 1 rle with old method : 0.002572298049926758 time for calcul the mask position with numpy : 0.0056438446044921875 nb_pixel_total : 11408 time to create 1 rle with old method : 0.012226343154907227 time for calcul the mask position with numpy : 0.005684614181518555 nb_pixel_total : 3541 time to create 1 rle with old method : 0.003817319869995117 time for calcul the mask position with numpy : 0.006632566452026367 nb_pixel_total : 114161 time to create 1 rle with old method : 0.12156319618225098 time for calcul the mask position with numpy : 0.005965709686279297 nb_pixel_total : 6412 time to create 1 rle with old method : 0.0068340301513671875 create new chi : 0.5519227981567383 time to delete rle : 0.0007183551788330078 batch 1 Loaded 13 chid ids of type : 3594 ++++++Number RLEs to save : 4759 TO DO : save crop sub photo not yet done ! save time : 0.31386280059814453 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.046701908111572266 time for calcul the mask position with numpy : 0.014909505844116211 nb_pixel_total : 1245684 time to create 1 rle with new method : 0.029810667037963867 time for calcul the mask position with numpy : 0.12432241439819336 nb_pixel_total : 726882 time to create 1 rle with new method : 0.029198408126831055 time for calcul the mask position with numpy : 0.006776094436645508 nb_pixel_total : 101034 time to create 1 rle with old method : 0.1069328784942627 create new chi : 0.319338321685791 time to delete rle : 0.0005240440368652344 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 3848 TO DO : save crop sub photo not yet done ! save time : 0.2798752784729004 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.04322457313537598 time for calcul the mask position with numpy : 0.04898405075073242 nb_pixel_total : 1341565 time to create 1 rle with new method : 0.14361071586608887 time for calcul the mask position with numpy : 0.011036872863769531 nb_pixel_total : 732035 time to create 1 rle with new method : 0.14264750480651855 create new chi : 0.3540036678314209 time to delete rle : 0.00031566619873046875 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 2992 TO DO : save crop sub photo not yet done ! save time : 0.20595407485961914 No data in photo_id : 1375304332 nb_obj : 3 nb_hashtags : 1 time to prepare the origin masks : 0.05377006530761719 time for calcul the mask position with numpy : 0.019492387771606445 nb_pixel_total : 1305433 time to create 1 rle with new method : 0.09261035919189453 time for calcul the mask position with numpy : 0.006070375442504883 nb_pixel_total : 6292 time to create 1 rle with old method : 0.006858348846435547 time for calcul the mask position with numpy : 0.005848407745361328 nb_pixel_total : 5286 time to create 1 rle with old method : 0.0057680606842041016 time for calcul the mask position with numpy : 0.010966062545776367 nb_pixel_total : 756589 time to create 1 rle with new method : 0.15515899658203125 create new chi : 0.31246066093444824 time to delete rle : 0.00037980079650878906 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 3266 TO DO : save crop sub photo not yet done ! save time : 0.24092507362365723 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.06623435020446777 time for calcul the mask position with numpy : 0.04236793518066406 nb_pixel_total : 872244 time to create 1 rle with new method : 0.19024085998535156 time for calcul the mask position with numpy : 0.00581812858581543 nb_pixel_total : 801 time to create 1 rle with old method : 0.0008819103240966797 time for calcul the mask position with numpy : 0.00625157356262207 nb_pixel_total : 111967 time to create 1 rle with old method : 0.12219595909118652 time for calcul the mask position with numpy : 0.049425363540649414 nb_pixel_total : 1082508 time to create 1 rle with new method : 0.09774160385131836 time for calcul the mask position with numpy : 0.0062139034271240234 nb_pixel_total : 6080 time to create 1 rle with old method : 0.0067348480224609375 create new chi : 0.5424361228942871 time to delete rle : 0.0011036396026611328 batch 1 Loaded 9 chid ids of type : 3594 ++++++Number RLEs to save : 6419 TO DO : save crop sub photo not yet done ! save time : 0.4016127586364746 nb_obj : 6 nb_hashtags : 3 time to prepare the origin masks : 0.22868728637695312 time for calcul the mask position with numpy : 0.13447237014770508 nb_pixel_total : 1305189 time to create 1 rle with new method : 0.10758304595947266 time for calcul the mask position with numpy : 0.01128244400024414 nb_pixel_total : 707148 time to create 1 rle with new method : 0.3226308822631836 time for calcul the mask position with numpy : 0.005974769592285156 nb_pixel_total : 2852 time to create 1 rle with old method : 0.003117799758911133 time for calcul the mask position with numpy : 0.00598454475402832 nb_pixel_total : 8678 time to create 1 rle with old method : 0.00968313217163086 time for calcul the mask position with numpy : 0.006113767623901367 nb_pixel_total : 10820 time to create 1 rle with old method : 0.01215672492980957 time for calcul the mask position with numpy : 0.006444215774536133 nb_pixel_total : 21482 time to create 1 rle with old method : 0.023002147674560547 time for calcul the mask position with numpy : 0.005998134613037109 nb_pixel_total : 17431 time to create 1 rle with old method : 0.018770217895507812 create new chi : 0.6828746795654297 time to delete rle : 0.0006096363067626953 batch 1 Loaded 13 chid ids of type : 3594 ++++++Number RLEs to save : 4214 TO DO : save crop sub photo not yet done ! save time : 0.29542994499206543 nb_obj : 3 nb_hashtags : 1 time to prepare the origin masks : 0.055835723876953125 time for calcul the mask position with numpy : 0.014222383499145508 nb_pixel_total : 1269415 time to create 1 rle with new method : 0.02898097038269043 time for calcul the mask position with numpy : 0.0060863494873046875 nb_pixel_total : 13725 time to create 1 rle with old method : 0.015401363372802734 time for calcul the mask position with numpy : 0.011068344116210938 nb_pixel_total : 787575 time to create 1 rle with new method : 0.02739405632019043 time for calcul the mask position with numpy : 0.005700826644897461 nb_pixel_total : 2885 time to create 1 rle with old method : 0.003116130828857422 create new chi : 0.11910200119018555 time to delete rle : 0.000644683837890625 batch 1 Loaded 7 chid ids of type : 3594 ++++++Number RLEs to save : 4050 TO DO : save crop sub photo not yet done ! save time : 0.2753715515136719 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.04025769233703613 time for calcul the mask position with numpy : 0.014084577560424805 nb_pixel_total : 1323451 time to create 1 rle with new method : 0.09356975555419922 time for calcul the mask position with numpy : 0.010681629180908203 nb_pixel_total : 750149 time to create 1 rle with new method : 0.13697457313537598 create new chi : 0.2624680995941162 time to delete rle : 0.00028133392333984375 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 3052 TO DO : save crop sub photo not yet done ! save time : 0.21755766868591309 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.11274862289428711 time for calcul the mask position with numpy : 0.04730391502380371 nb_pixel_total : 1201400 time to create 1 rle with new method : 0.148667573928833 time for calcul the mask position with numpy : 0.013818025588989258 nb_pixel_total : 738669 time to create 1 rle with new method : 0.16229534149169922 time for calcul the mask position with numpy : 0.0058400630950927734 nb_pixel_total : 2362 time to create 1 rle with old method : 0.0026509761810302734 time for calcul the mask position with numpy : 0.005799055099487305 nb_pixel_total : 4482 time to create 1 rle with old method : 0.005098819732666016 time for calcul the mask position with numpy : 0.006905794143676758 nb_pixel_total : 126687 time to create 1 rle with old method : 0.13792014122009277 create new chi : 0.545600175857544 time to delete rle : 0.0008711814880371094 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 4232 TO DO : save crop sub photo not yet done ! save time : 0.301893949508667 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.051880598068237305 time for calcul the mask position with numpy : 0.014505386352539062 nb_pixel_total : 1188320 time to create 1 rle with new method : 0.08611536026000977 time for calcul the mask position with numpy : 0.012010574340820312 nb_pixel_total : 862609 time to create 1 rle with new method : 0.17358779907226562 time for calcul the mask position with numpy : 0.006096363067626953 nb_pixel_total : 16552 time to create 1 rle with old method : 0.0182950496673584 time for calcul the mask position with numpy : 0.005939960479736328 nb_pixel_total : 6119 time to create 1 rle with old method : 0.0069141387939453125 create new chi : 0.33071017265319824 time to delete rle : 0.0008046627044677734 batch 1 Loaded 7 chid ids of type : 3594 ++++++Number RLEs to save : 4753 TO DO : save crop sub photo not yet done ! save time : 0.32054996490478516 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.1717686653137207 time for calcul the mask position with numpy : 0.16854047775268555 nb_pixel_total : 1232262 time to create 1 rle with new method : 0.20605802536010742 time for calcul the mask position with numpy : 0.010893821716308594 nb_pixel_total : 714760 time to create 1 rle with new method : 0.15613484382629395 time for calcul the mask position with numpy : 0.006278038024902344 nb_pixel_total : 14797 time to create 1 rle with old method : 0.016758203506469727 time for calcul the mask position with numpy : 0.006771087646484375 nb_pixel_total : 106963 time to create 1 rle with old method : 0.12659144401550293 time for calcul the mask position with numpy : 0.011335372924804688 nb_pixel_total : 4818 time to create 1 rle with old method : 0.008668184280395508 create new chi : 0.7277131080627441 time to delete rle : 0.0013878345489501953 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 4522 TO DO : save crop sub photo not yet done ! save time : 0.3279452323913574 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 0.5484862327575684 time for calcul the mask position with numpy : 0.0489659309387207 nb_pixel_total : 1218369 time to create 1 rle with new method : 0.2239983081817627 time for calcul the mask position with numpy : 0.010766267776489258 nb_pixel_total : 731311 time to create 1 rle with new method : 0.1835339069366455 time for calcul the mask position with numpy : 0.0059680938720703125 nb_pixel_total : 11382 time to create 1 rle with old method : 0.012324333190917969 time for calcul the mask position with numpy : 0.0057833194732666016 nb_pixel_total : 4666 time to create 1 rle with old method : 0.0053253173828125 time for calcul the mask position with numpy : 0.006077289581298828 nb_pixel_total : 4079 time to create 1 rle with old method : 0.004657745361328125 time for calcul the mask position with numpy : 0.007264375686645508 nb_pixel_total : 103793 time to create 1 rle with old method : 0.10986590385437012 create new chi : 0.6332974433898926 time to delete rle : 0.0007390975952148438 batch 1 Loaded 11 chid ids of type : 3594 +++++++++Number RLEs to save : 5082 TO DO : save crop sub photo not yet done ! save time : 0.34739136695861816 nb_obj : 5 nb_hashtags : 2 time to prepare the origin masks : 0.07486438751220703 time for calcul the mask position with numpy : 0.014871358871459961 nb_pixel_total : 1225969 time to create 1 rle with new method : 0.06820344924926758 time for calcul the mask position with numpy : 0.010849475860595703 nb_pixel_total : 714120 time to create 1 rle with new method : 0.1687629222869873 time for calcul the mask position with numpy : 0.007050514221191406 nb_pixel_total : 120665 time to create 1 rle with old method : 0.1300978660583496 time for calcul the mask position with numpy : 0.005922555923461914 nb_pixel_total : 2807 time to create 1 rle with old method : 0.0030248165130615234 time for calcul the mask position with numpy : 0.00571894645690918 nb_pixel_total : 6209 time to create 1 rle with old method : 0.006723165512084961 time for calcul the mask position with numpy : 0.005873918533325195 nb_pixel_total : 3830 time to create 1 rle with old method : 0.00421595573425293 create new chi : 0.43855738639831543 time to delete rle : 0.0007114410400390625 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 4344 TO DO : save crop sub photo not yet done ! save time : 0.3076629638671875 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.04394054412841797 time for calcul the mask position with numpy : 0.014811038970947266 nb_pixel_total : 1345694 time to create 1 rle with new method : 0.0922858715057373 time for calcul the mask position with numpy : 0.011174201965332031 nb_pixel_total : 727906 time to create 1 rle with new method : 0.11749124526977539 create new chi : 0.24329495429992676 time to delete rle : 0.00028777122497558594 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 3014 TO DO : save crop sub photo not yet done ! save time : 0.235260009765625 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.10825824737548828 time for calcul the mask position with numpy : 0.12833476066589355 nb_pixel_total : 1309125 time to create 1 rle with new method : 0.18326878547668457 time for calcul the mask position with numpy : 0.006137371063232422 nb_pixel_total : 9737 time to create 1 rle with old method : 0.01093745231628418 time for calcul the mask position with numpy : 0.006159305572509766 nb_pixel_total : 8079 time to create 1 rle with old method : 0.009186744689941406 time for calcul the mask position with numpy : 0.01143956184387207 nb_pixel_total : 734722 time to create 1 rle with new method : 0.09058141708374023 time for calcul the mask position with numpy : 0.006094455718994141 nb_pixel_total : 11937 time to create 1 rle with old method : 0.013109445571899414 create new chi : 0.47435688972473145 time to delete rle : 0.0007917881011962891 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 3722 TO DO : save crop sub photo not yet done ! save time : 0.2782630920410156 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.05611896514892578 time for calcul the mask position with numpy : 0.014793157577514648 nb_pixel_total : 1301910 time to create 1 rle with new method : 0.15804171562194824 time for calcul the mask position with numpy : 0.010888099670410156 nb_pixel_total : 743686 time to create 1 rle with new method : 0.05291318893432617 time for calcul the mask position with numpy : 0.006314754486083984 nb_pixel_total : 28004 time to create 1 rle with old method : 0.03109431266784668 create new chi : 0.281217098236084 time to delete rle : 0.00054168701171875 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 3432 TO DO : save crop sub photo not yet done ! save time : 0.22443461418151855 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.04604053497314453 time for calcul the mask position with numpy : 0.015335798263549805 nb_pixel_total : 1330748 time to create 1 rle with new method : 0.1344292163848877 time for calcul the mask position with numpy : 0.011986732482910156 nb_pixel_total : 742852 time to create 1 rle with new method : 0.08732914924621582 create new chi : 0.2562737464904785 time to delete rle : 0.0003123283386230469 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 3090 TO DO : save crop sub photo not yet done ! save time : 0.2104811668395996 No data in photo_id : 1375303856 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03545022010803223 time for calcul the mask position with numpy : 0.01375889778137207 nb_pixel_total : 1194770 time to create 1 rle with new method : 0.20316767692565918 time for calcul the mask position with numpy : 0.011885881423950195 nb_pixel_total : 878830 time to create 1 rle with new method : 0.08965492248535156 create new chi : 0.3257269859313965 time to delete rle : 0.0005078315734863281 batch 1 Loaded 3 chid ids of type : 3594 ++++Number RLEs to save : 4256 TO DO : save crop sub photo not yet done ! save time : 0.260683536529541 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.0526731014251709 time for calcul the mask position with numpy : 0.011374950408935547 nb_pixel_total : 857835 time to create 1 rle with new method : 0.2255845069885254 time for calcul the mask position with numpy : 0.0059397220611572266 nb_pixel_total : 3080 time to create 1 rle with old method : 0.0035600662231445312 time for calcul the mask position with numpy : 0.013822793960571289 nb_pixel_total : 1208298 time to create 1 rle with new method : 0.1959545612335205 time for calcul the mask position with numpy : 0.0067179203033447266 nb_pixel_total : 4387 time to create 1 rle with old method : 0.0048487186431884766 create new chi : 0.48122072219848633 time to delete rle : 0.0008676052093505859 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 4277 TO DO : save crop sub photo not yet done ! save time : 0.25629305839538574 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.08228659629821777 time for calcul the mask position with numpy : 0.016242504119873047 nb_pixel_total : 1257910 time to create 1 rle with new method : 0.18595433235168457 time for calcul the mask position with numpy : 0.015118598937988281 nb_pixel_total : 805653 time to create 1 rle with new method : 0.2080669403076172 time for calcul the mask position with numpy : 0.005767822265625 nb_pixel_total : 10037 time to create 1 rle with old method : 0.01033163070678711 create new chi : 0.4573707580566406 time to delete rle : 0.0006613731384277344 batch 1 Loaded 5 chid ids of type : 3594 ++++Number RLEs to save : 4376 TO DO : save crop sub photo not yet done ! save time : 0.280397891998291 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 0.27417445182800293 time for calcul the mask position with numpy : 0.012152433395385742 nb_pixel_total : 875994 time to create 1 rle with new method : 0.2131946086883545 time for calcul the mask position with numpy : 0.006003618240356445 nb_pixel_total : 320 time to create 1 rle with old method : 0.0004017353057861328 time for calcul the mask position with numpy : 0.009959936141967773 nb_pixel_total : 3579 time to create 1 rle with old method : 0.004111528396606445 time for calcul the mask position with numpy : 0.045244693756103516 nb_pixel_total : 1056434 time to create 1 rle with new method : 0.09405732154846191 time for calcul the mask position with numpy : 0.0062007904052734375 nb_pixel_total : 30665 time to create 1 rle with old method : 0.034958839416503906 time for calcul the mask position with numpy : 0.00945281982421875 nb_pixel_total : 106608 time to create 1 rle with old method : 0.11298322677612305 create new chi : 0.562537431716919 time to delete rle : 0.0010497570037841797 batch 1 Loaded 11 chid ids of type : 3594 +++++++Number RLEs to save : 6571 TO DO : save crop sub photo not yet done ! save time : 0.4657866954803467 No data in photo_id : 1375303833 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.06870841979980469 time for calcul the mask position with numpy : 0.01963329315185547 nb_pixel_total : 1247756 time to create 1 rle with new method : 0.1509847640991211 time for calcul the mask position with numpy : 0.006609916687011719 nb_pixel_total : 4201 time to create 1 rle with old method : 0.004779338836669922 time for calcul the mask position with numpy : 0.011752128601074219 nb_pixel_total : 810820 time to create 1 rle with new method : 0.028000354766845703 time for calcul the mask position with numpy : 0.005913257598876953 nb_pixel_total : 10823 time to create 1 rle with old method : 0.01155853271484375 create new chi : 0.2397146224975586 time to delete rle : 0.0006349086761474609 batch 1 Loaded 8 chid ids of type : 3594 +++++Number RLEs to save : 3685 TO DO : save crop sub photo not yet done ! save time : 0.23660826683044434 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.04289364814758301 time for calcul the mask position with numpy : 0.01444554328918457 nb_pixel_total : 1332827 time to create 1 rle with new method : 0.17861127853393555 time for calcul the mask position with numpy : 0.017175912857055664 nb_pixel_total : 740773 time to create 1 rle with new method : 0.06617426872253418 create new chi : 0.2837653160095215 time to delete rle : 0.0003273487091064453 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 3038 TO DO : save crop sub photo not yet done ! save time : 0.211470365524292 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.1269526481628418 time for calcul the mask position with numpy : 0.07401537895202637 nb_pixel_total : 1310569 time to create 1 rle with new method : 0.13740205764770508 time for calcul the mask position with numpy : 0.007755279541015625 nb_pixel_total : 34233 time to create 1 rle with old method : 0.036921024322509766 time for calcul the mask position with numpy : 0.006005287170410156 nb_pixel_total : 5725 time to create 1 rle with old method : 0.006598234176635742 time for calcul the mask position with numpy : 0.011113643646240234 nb_pixel_total : 717206 time to create 1 rle with new method : 0.18682527542114258 time for calcul the mask position with numpy : 0.00577998161315918 nb_pixel_total : 5867 time to create 1 rle with old method : 0.006550788879394531 create new chi : 0.4897434711456299 time to delete rle : 0.0006833076477050781 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 3984 TO DO : save crop sub photo not yet done ! save time : 0.2553725242614746 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.05444669723510742 time for calcul the mask position with numpy : 0.01513671875 nb_pixel_total : 1297372 time to create 1 rle with new method : 0.06413888931274414 time for calcul the mask position with numpy : 0.006245613098144531 nb_pixel_total : 13911 time to create 1 rle with old method : 0.015494823455810547 time for calcul the mask position with numpy : 0.014247894287109375 nb_pixel_total : 756098 time to create 1 rle with new method : 0.08761739730834961 time for calcul the mask position with numpy : 0.005705595016479492 nb_pixel_total : 6219 time to create 1 rle with old method : 0.006792783737182617 create new chi : 0.22254443168640137 time to delete rle : 0.0005881786346435547 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 3606 TO DO : save crop sub photo not yet done ! save time : 0.2534971237182617 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.051865339279174805 time for calcul the mask position with numpy : 0.02004718780517578 nb_pixel_total : 1237974 time to create 1 rle with new method : 0.20964813232421875 time for calcul the mask position with numpy : 0.010801076889038086 nb_pixel_total : 103438 time to create 1 rle with old method : 0.10824871063232422 time for calcul the mask position with numpy : 0.013634681701660156 nb_pixel_total : 732188 time to create 1 rle with new method : 0.14492130279541016 create new chi : 0.5145792961120605 time to delete rle : 0.0005695819854736328 batch 1 Loaded 5 chid ids of type : 3594 +++Number RLEs to save : 4130 TO DO : save crop sub photo not yet done ! save time : 0.25799036026000977 map_output_result : {1375304419: (0.0, 'Should be the crop_list due to order', 0), 1375304417: (0.0, 'Should be the crop_list due to order', 0), 1375304410: (0.0, 'Should be the crop_list due to order', 0), 1375304409: (0.0, 'Should be the crop_list due to order', 0), 1375304383: (0.0, 'Should be the crop_list due to order', 0), 1375304378: (0.0, 'Should be the crop_list due to order', 0), 1375304371: (0.0, 'Should be the crop_list due to order', 0), 1375304362: (0.0, 'Should be the crop_list due to order', 0), 1375304356: (0.0, 'Should be the crop_list due to order', 0), 1375304352: (0.0, 'Should be the crop_list due to order', 0), 1375304338: (0.0, 'Should be the crop_list due to order', 0), 1375304335: (0.0, 'Should be the crop_list due to order', 0), 1375304332: (0.0, 'Should be the crop_list due to order', 0.0), 1375304328: (0.0, 'Should be the crop_list due to order', 0), 1375304304: (0.0, 'Should be the crop_list due to order', 0), 1375304276: (0.0, 'Should be the crop_list due to order', 0), 1375304055: (0.0, 'Should be the crop_list due to order', 0), 1375304029: (0.0, 'Should be the crop_list due to order', 0), 1375303997: (0.0, 'Should be the crop_list due to order', 0), 1375303956: (0.0, 'Should be the crop_list due to order', 0), 1375303926: (0.0, 'Should be the crop_list due to order', 0), 1375303900: (0.0, 'Should be the crop_list due to order', 0), 1375303868: (0.0, 'Should be the crop_list due to order', 0), 1375303866: (0.0, 'Should be the crop_list due to order', 0), 1375303864: (0.0, 'Should be the crop_list due to order', 0), 1375303861: (0.0, 'Should be the crop_list due to order', 0), 1375303859: (0.0, 'Should be the crop_list due to order', 0), 1375303856: (0.0, 'Should be the crop_list due to order', 0.0), 1375303844: (0.0, 'Should be the crop_list due to order', 0), 1375303842: (0.0, 'Should be the crop_list due to order', 0), 1375303839: (0.0, 'Should be the crop_list due to order', 0), 1375303835: (0.0, 'Should be the crop_list due to order', 0), 1375303833: (0.0, 'Should be the crop_list due to order', 0.0), 1375303830: (0.0, 'Should be the crop_list due to order', 0), 1375303665: (0.0, 'Should be the crop_list due to order', 0), 1375303656: (0.0, 'Should be the crop_list due to order', 0), 1375303632: (0.0, 'Should be the crop_list due to order', 0), 1375303578: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1375304419, 1375304417, 1375304410, 1375304409, 1375304383, 1375304378, 1375304371, 1375304362, 1375304356, 1375304352, 1375304338, 1375304335, 1375304332, 1375304328, 1375304304, 1375304276, 1375304055, 1375304029, 1375303997, 1375303956, 1375303926, 1375303900, 1375303868, 1375303866, 1375303864, 1375303861, 1375303859, 1375303856, 1375303844, 1375303842, 1375303839, 1375303835, 1375303833, 1375303830, 1375303665, 1375303656, 1375303632, 1375303578] Looping around the photos to save general results len do output : 38 /1375304419.Didn't retrieve data . /1375304417.Didn't retrieve data . /1375304410.Didn't retrieve data . /1375304409.Didn't retrieve data . /1375304383.Didn't retrieve data . /1375304378.Didn't retrieve data . /1375304371.Didn't retrieve data . /1375304362.Didn't retrieve data . /1375304356.Didn't retrieve data . /1375304352.Didn't retrieve data . /1375304338.Didn't retrieve data . /1375304335.Didn't retrieve data . /1375304332.Didn't retrieve data . /1375304328.Didn't retrieve data . /1375304304.Didn't retrieve data . /1375304276.Didn't retrieve data . /1375304055.Didn't retrieve data . /1375304029.Didn't retrieve data . /1375303997.Didn't retrieve data . /1375303956.Didn't retrieve data . /1375303926.Didn't retrieve data . /1375303900.Didn't retrieve data . /1375303868.Didn't retrieve data . /1375303866.Didn't retrieve data . /1375303864.Didn't retrieve data . /1375303861.Didn't retrieve data . /1375303859.Didn't retrieve data . /1375303856.Didn't retrieve data . /1375303844.Didn't retrieve data . /1375303842.Didn't retrieve data . /1375303839.Didn't retrieve data . /1375303835.Didn't retrieve data . /1375303833.Didn't retrieve data . /1375303830.Didn't retrieve data . /1375303665.Didn't retrieve data . /1375303656.Didn't retrieve data . /1375303632.Didn't retrieve data . /1375303578.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304419', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304417', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304410', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304409', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304383', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304378', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304371', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304362', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304356', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304352', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304338', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304335', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304332', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304328', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304304', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304276', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304055', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304029', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303997', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303956', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303926', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303900', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303868', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303866', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303864', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303861', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303859', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303856', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303844', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303842', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303839', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303835', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303833', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303830', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303665', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303656', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303632', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303578', None, None, None, None, None, '3449335') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 114 time used for this insertion : 0.019275903701782227 save_final save missing photos in datou_result : time spend for datou_step_exec : 29.62721848487854 time spend to save output : 0.020848512649536133 total time spend for step 3 : 29.648066997528076 step4:ventilate_hashtags_in_portfolio Tue Aug 5 14:24:13 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 25686587 get user id for portfolio 25686587 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25686587 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','autre','mal_croppe','pet_fonce','background','environnement','carton','flou','metal','pehd','pet_clair')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25686587 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','autre','mal_croppe','pet_fonce','background','environnement','carton','flou','metal','pehd','pet_clair')) AND mptpi.`min_score`=0.5 To do To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25686587 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','autre','mal_croppe','pet_fonce','background','environnement','carton','flou','metal','pehd','pet_clair')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/25687228,25687229,25687230,25687231,25687232,25687233,25687234,25687235,25687236,25687237,25687238?tags=papier,autre,mal_croppe,pet_fonce,background,environnement,carton,flou,metal,pehd,pet_clair Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1375304419, 1375304417, 1375304410, 1375304409, 1375304383, 1375304378, 1375304371, 1375304362, 1375304356, 1375304352, 1375304338, 1375304335, 1375304332, 1375304328, 1375304304, 1375304276, 1375304055, 1375304029, 1375303997, 1375303956, 1375303926, 1375303900, 1375303868, 1375303866, 1375303864, 1375303861, 1375303859, 1375303856, 1375303844, 1375303842, 1375303839, 1375303835, 1375303833, 1375303830, 1375303665, 1375303656, 1375303632, 1375303578] Looping around the photos to save general results len do output : 1 /25686587. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304419', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304417', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304410', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304409', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304383', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304378', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304371', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304362', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304356', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304352', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304338', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304335', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304332', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304328', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304304', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304276', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304055', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304029', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303997', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303956', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303926', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303900', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303868', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303866', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303864', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303861', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303859', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303856', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303844', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303842', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303839', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303835', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303833', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303830', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303665', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303656', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303632', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303578', None, None, None, None, None, '3449335') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 39 time used for this insertion : 0.019125699996948242 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.7599382400512695 time spend to save output : 0.019546985626220703 total time spend for step 4 : 0.7794852256774902 step5:final Tue Aug 5 14:24:14 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1375304419: ('0.34968209368908376',), 1375304417: ('0.34968209368908376',), 1375304410: ('0.34968209368908376',), 1375304409: ('0.34968209368908376',), 1375304383: ('0.34968209368908376',), 1375304378: ('0.34968209368908376',), 1375304371: ('0.34968209368908376',), 1375304362: ('0.34968209368908376',), 1375304356: ('0.34968209368908376',), 1375304352: ('0.34968209368908376',), 1375304338: ('0.34968209368908376',), 1375304335: ('0.34968209368908376',), 1375304332: ('0.34968209368908376',), 1375304328: ('0.34968209368908376',), 1375304304: ('0.34968209368908376',), 1375304276: ('0.34968209368908376',), 1375304055: ('0.34968209368908376',), 1375304029: ('0.34968209368908376',), 1375303997: ('0.34968209368908376',), 1375303956: ('0.34968209368908376',), 1375303926: ('0.34968209368908376',), 1375303900: ('0.34968209368908376',), 1375303868: ('0.34968209368908376',), 1375303866: ('0.34968209368908376',), 1375303864: ('0.34968209368908376',), 1375303861: ('0.34968209368908376',), 1375303859: ('0.34968209368908376',), 1375303856: ('0.34968209368908376',), 1375303844: ('0.34968209368908376',), 1375303842: ('0.34968209368908376',), 1375303839: ('0.34968209368908376',), 1375303835: ('0.34968209368908376',), 1375303833: ('0.34968209368908376',), 1375303830: ('0.34968209368908376',), 1375303665: ('0.34968209368908376',), 1375303656: ('0.34968209368908376',), 1375303632: ('0.34968209368908376',), 1375303578: ('0.34968209368908376',)} new output for save of step final : {1375304419: ('0.34968209368908376',), 1375304417: ('0.34968209368908376',), 1375304410: ('0.34968209368908376',), 1375304409: ('0.34968209368908376',), 1375304383: ('0.34968209368908376',), 1375304378: ('0.34968209368908376',), 1375304371: ('0.34968209368908376',), 1375304362: ('0.34968209368908376',), 1375304356: ('0.34968209368908376',), 1375304352: ('0.34968209368908376',), 1375304338: ('0.34968209368908376',), 1375304335: ('0.34968209368908376',), 1375304332: ('0.34968209368908376',), 1375304328: ('0.34968209368908376',), 1375304304: ('0.34968209368908376',), 1375304276: ('0.34968209368908376',), 1375304055: ('0.34968209368908376',), 1375304029: ('0.34968209368908376',), 1375303997: ('0.34968209368908376',), 1375303956: ('0.34968209368908376',), 1375303926: ('0.34968209368908376',), 1375303900: ('0.34968209368908376',), 1375303868: ('0.34968209368908376',), 1375303866: ('0.34968209368908376',), 1375303864: ('0.34968209368908376',), 1375303861: ('0.34968209368908376',), 1375303859: ('0.34968209368908376',), 1375303856: ('0.34968209368908376',), 1375303844: ('0.34968209368908376',), 1375303842: ('0.34968209368908376',), 1375303839: ('0.34968209368908376',), 1375303835: ('0.34968209368908376',), 1375303833: ('0.34968209368908376',), 1375303830: ('0.34968209368908376',), 1375303665: ('0.34968209368908376',), 1375303656: ('0.34968209368908376',), 1375303632: ('0.34968209368908376',), 1375303578: ('0.34968209368908376',)} [1375304419, 1375304417, 1375304410, 1375304409, 1375304383, 1375304378, 1375304371, 1375304362, 1375304356, 1375304352, 1375304338, 1375304335, 1375304332, 1375304328, 1375304304, 1375304276, 1375304055, 1375304029, 1375303997, 1375303956, 1375303926, 1375303900, 1375303868, 1375303866, 1375303864, 1375303861, 1375303859, 1375303856, 1375303844, 1375303842, 1375303839, 1375303835, 1375303833, 1375303830, 1375303665, 1375303656, 1375303632, 1375303578] Looping around the photos to save general results len do output : 38 /1375304419.Didn't retrieve data . /1375304417.Didn't retrieve data . /1375304410.Didn't retrieve data . /1375304409.Didn't retrieve data . /1375304383.Didn't retrieve data . /1375304378.Didn't retrieve data . /1375304371.Didn't retrieve data . /1375304362.Didn't retrieve data . /1375304356.Didn't retrieve data . /1375304352.Didn't retrieve data . /1375304338.Didn't retrieve data . /1375304335.Didn't retrieve data . /1375304332.Didn't retrieve data . /1375304328.Didn't retrieve data . /1375304304.Didn't retrieve data . /1375304276.Didn't retrieve data . /1375304055.Didn't retrieve data . /1375304029.Didn't retrieve data . /1375303997.Didn't retrieve data . /1375303956.Didn't retrieve data . /1375303926.Didn't retrieve data . /1375303900.Didn't retrieve data . /1375303868.Didn't retrieve data . /1375303866.Didn't retrieve data . /1375303864.Didn't retrieve data . /1375303861.Didn't retrieve data . /1375303859.Didn't retrieve data . /1375303856.Didn't retrieve data . /1375303844.Didn't retrieve data . /1375303842.Didn't retrieve data . /1375303839.Didn't retrieve data . /1375303835.Didn't retrieve data . /1375303833.Didn't retrieve data . /1375303830.Didn't retrieve data . /1375303665.Didn't retrieve data . /1375303656.Didn't retrieve data . /1375303632.Didn't retrieve data . /1375303578.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304419', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304417', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304410', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304409', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304383', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304378', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304371', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304362', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304356', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304352', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304338', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304335', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304332', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304328', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304304', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304276', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304055', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304029', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303997', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303956', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303926', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303900', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303868', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303866', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303864', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303861', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303859', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303856', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303844', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303842', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303839', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303835', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303833', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303830', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303665', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303656', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303632', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303578', None, None, None, None, None, '3449335') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 114 time used for this insertion : 0.01995372772216797 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.12491559982299805 time spend to save output : 0.02155900001525879 total time spend for step 5 : 0.14647459983825684 step6:blur_detection Tue Aug 5 14:24:14 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1754396426_2684437_1375304419_265bae54c1ba2dc2f905be8185688043.jpg resize: (1080, 1920) 1375304419 -2.734327390891019 treat image : temp/1754396426_2684437_1375304417_5bf6dda69f96a172ebb1261af860acbb.jpg resize: (1080, 1920) 1375304417 -4.347085279631546 treat image : temp/1754396426_2684437_1375304410_6929cb2c93e6b1a193c3d396abe38cf3.jpg resize: (1080, 1920) 1375304410 -1.7797645248298113 treat image : temp/1754396426_2684437_1375304409_e3ecf4bc41928a35bc288c2e5327831e.jpg resize: (1080, 1920) 1375304409 0.2549845519497991 treat image : temp/1754396426_2684437_1375304383_d026fe6018dd9ed65fa9595942c87f0b.jpg resize: (1080, 1920) 1375304383 -1.635507100042786 treat image : temp/1754396426_2684437_1375304378_3337695f1b61cb9cc8ba4fc84ec3d11e.jpg resize: (1080, 1920) 1375304378 -2.1473373454709765 treat image : temp/1754396426_2684437_1375304371_44d8ac90fc72a3526ab0dde36b7d11eb.jpg resize: (1080, 1920) 1375304371 -0.5581984955909963 treat image : temp/1754396426_2684437_1375304362_8a6ba32a00debe2267dc049e1bf15d0f.jpg resize: (1080, 1920) 1375304362 -2.3566287809022457 treat image : temp/1754396426_2684437_1375304356_299279f66d2d9fb18730bcbf47f50edb.jpg resize: (1080, 1920) 1375304356 -2.726114724344888 treat image : temp/1754396426_2684437_1375304352_6d3a1d08df78a0a16a61eb59783bb61c.jpg resize: (1080, 1920) 1375304352 -2.548097383841598 treat image : temp/1754396426_2684437_1375304338_69e95bf4851938e0fb31f93f4300e88b.jpg resize: (1080, 1920) 1375304338 -2.0424935183743265 treat image : temp/1754396426_2684437_1375304335_dfd1a91acc483d14c38fbf687b1cc5ea.jpg resize: (1080, 1920) 1375304335 -1.0118619756234537 treat image : temp/1754396426_2684437_1375304332_93c3c54ec782913597f093628a8f18e0.jpg resize: (1080, 1920) 1375304332 -1.2752798809059502 treat image : temp/1754396426_2684437_1375304328_6c2753e8a8972c010ffd7d8cec24211f.jpg resize: (1080, 1920) 1375304328 0.2275481521028714 treat image : temp/1754396426_2684437_1375304304_54af68eae9d5ae4522b8bb56115f8ba8.jpg resize: (1080, 1920) 1375304304 -2.1854879638879012 treat image : temp/1754396426_2684437_1375304276_5b322438ef5beb98c13a4453e0436094.jpg resize: (1080, 1920) 1375304276 -2.5536096524523098 treat image : temp/1754396426_2684437_1375304055_b56c7b1ca0245ded41bd268ca3fda912.jpg resize: (1080, 1920) 1375304055 -2.0107264827864957 treat image : temp/1754396426_2684437_1375304029_834d650b9b6dd188702ca39f52cd4508.jpg resize: (1080, 1920) 1375304029 -2.122162490480517 treat image : temp/1754396426_2684437_1375303997_ea819b60a2ea4355a93446f09b7a4e51.jpg resize: (1080, 1920) 1375303997 -2.016432693046371 treat image : temp/1754396426_2684437_1375303956_b5940449d0f3a8554f0009ea39bc6e68.jpg resize: (1080, 1920) 1375303956 -2.323291309964407 treat image : temp/1754396426_2684437_1375303926_726a87d16d7cdf70de934f329f77c29d.jpg resize: (1080, 1920) 1375303926 -2.8257822894453515 treat image : temp/1754396426_2684437_1375303900_00a35dbd58a9966202395ce3ec56d413.jpg resize: (1080, 1920) 1375303900 -4.418921785178734 treat image : temp/1754396426_2684437_1375303868_64c1a53e91b76d70e48ea98ad1fb1244.jpg resize: (1080, 1920) 1375303868 -2.569173108717434 treat image : temp/1754396426_2684437_1375303866_6df282e6a83d0bb043531cc6c1d9c9af.jpg resize: (1080, 1920) 1375303866 -1.990753388641721 treat image : temp/1754396426_2684437_1375303864_d5c370c7156e717a05769ce84f7e1a5d.jpg resize: (1080, 1920) 1375303864 -0.16343887887316627 treat image : temp/1754396426_2684437_1375303861_22109ca6cbcc4ca531bc87a1dc9bf8e5.jpg resize: (1080, 1920) 1375303861 -2.526406531008145 treat image : temp/1754396426_2684437_1375303859_1e6ac8aab97710f7311240770678c273.jpg resize: (1080, 1920) 1375303859 -1.2702295282757963 treat image : temp/1754396426_2684437_1375303856_ce98c5c2e4ca8e7a6dd04ed39db3fce8.jpg resize: (1080, 1920) 1375303856 3.836375122670119 treat image : temp/1754396426_2684437_1375303844_c8847bc12d9067a829664909865cbac0.jpg resize: (1080, 1920) 1375303844 -2.3362466384681086 treat image : temp/1754396426_2684437_1375303842_351c5e398f5bf735495deed6cb6b6f00.jpg resize: (1080, 1920) 1375303842 -2.4520871479497584 treat image : temp/1754396426_2684437_1375303839_9ba7337abf221f76b7626d5c6a1eadac.jpg resize: (1080, 1920) 1375303839 -1.0396586517287334 treat image : temp/1754396426_2684437_1375303835_13894658dbe64aba489fd0d6d03c82b4.jpg resize: (1080, 1920) 1375303835 -2.224651140094315 treat image : temp/1754396426_2684437_1375303833_4b8d05e5f18a9fbd3e3015509f394157.jpg resize: (1080, 1920) 1375303833 -2.5001459201253264 treat image : temp/1754396426_2684437_1375303830_3b6599a606b60db7f4e71240a3209db9.jpg resize: (1080, 1920) 1375303830 -0.5516238497236083 treat image : temp/1754396426_2684437_1375303665_7789937bbee46edd7103201ae322b8dc.jpg resize: (1080, 1920) 1375303665 -1.3076837260890815 treat image : temp/1754396426_2684437_1375303656_d07f88ea30b94156e0a79d5500b7f6e0.jpg resize: (1080, 1920) 1375303656 -2.451351775070157 treat image : temp/1754396426_2684437_1375303632_e42b28f076f2faffb1746e4b6417d0a6.jpg resize: (1080, 1920) 1375303632 -2.242982940727533 treat image : temp/1754396426_2684437_1375303578_10ae70df3fb7b50639d0cb94e9bb252c.jpg resize: (1080, 1920) 1375303578 -2.1497995769579994 treat image : temp/1754396426_2684437_1375304417_5bf6dda69f96a172ebb1261af860acbb_rle_crop_3903714034_0.png resize: (70, 77) 1375312803 -3.8780346891403106 treat image : temp/1754396426_2684437_1375304410_6929cb2c93e6b1a193c3d396abe38cf3_rle_crop_3903714039_0.png resize: (72, 77) 1375312804 -2.857787075711564 treat image : temp/1754396426_2684437_1375304362_8a6ba32a00debe2267dc049e1bf15d0f_rle_crop_3903714054_0.png resize: (54, 136) 1375312805 -1.7636144924486767 treat image : temp/1754396426_2684437_1375304356_299279f66d2d9fb18730bcbf47f50edb_rle_crop_3903714056_0.png resize: (114, 108) 1375312806 -0.7934705388115101 treat image : temp/1754396426_2684437_1375304352_6d3a1d08df78a0a16a61eb59783bb61c_rle_crop_3903714060_0.png resize: (122, 92) 1375312807 -1.860428070875998 treat image : temp/1754396426_2684437_1375304352_6d3a1d08df78a0a16a61eb59783bb61c_rle_crop_3903714062_0.png resize: (68, 75) 1375312808 -2.5942572560335684 treat image : temp/1754396426_2684437_1375303956_b5940449d0f3a8554f0009ea39bc6e68_rle_crop_3903714090_0.png resize: (93, 112) 1375312809 -1.6871044983518988 treat image : temp/1754396426_2684437_1375303956_b5940449d0f3a8554f0009ea39bc6e68_rle_crop_3903714091_0.png resize: (228, 105) 1375312810 -1.5311390179968585 treat image : temp/1754396426_2684437_1375303926_726a87d16d7cdf70de934f329f77c29d_rle_crop_3903714093_0.png resize: (101, 115) 1375312811 -0.3188466543653797 treat image : temp/1754396426_2684437_1375303900_00a35dbd58a9966202395ce3ec56d413_rle_crop_3903714098_0.png resize: (94, 105) 1375312812 -3.9992950844050017 treat image : temp/1754396426_2684437_1375303900_00a35dbd58a9966202395ce3ec56d413_rle_crop_3903714099_0.png resize: (51, 113) 1375312813 -3.1585151525006583 treat image : temp/1754396426_2684437_1375303864_d5c370c7156e717a05769ce84f7e1a5d_rle_crop_3903714108_0.png resize: (155, 143) 1375312814 -1.5852960891336996 treat image : temp/1754396426_2684437_1375303842_351c5e398f5bf735495deed6cb6b6f00_rle_crop_3903714116_0.png resize: (64, 88) 1375312815 0.3411225146948902 treat image : temp/1754396426_2684437_1375303839_9ba7337abf221f76b7626d5c6a1eadac_rle_crop_3903714119_0.png resize: (179, 103) 1375312816 -0.9899334514857178 treat image : temp/1754396426_2684437_1375303835_13894658dbe64aba489fd0d6d03c82b4_rle_crop_3903714124_0.png resize: (71, 76) 1375312817 -2.5914456023193964 treat image : temp/1754396426_2684437_1375303830_3b6599a606b60db7f4e71240a3209db9_rle_crop_3903714128_0.png resize: (110, 71) 1375312818 -2.5999155696336946 treat image : temp/1754396426_2684437_1375303656_d07f88ea30b94156e0a79d5500b7f6e0_rle_crop_3903714131_0.png resize: (105, 91) 1375312819 -1.3877204224773039 treat image : temp/1754396426_2684437_1375303656_d07f88ea30b94156e0a79d5500b7f6e0_rle_crop_3903714133_0.png resize: (134, 89) 1375312820 -1.6677844317542065 treat image : temp/1754396426_2684437_1375303632_e42b28f076f2faffb1746e4b6417d0a6_rle_crop_3903714135_0.png resize: (81, 133) 1375312822 -1.5594335528208716 treat image : temp/1754396426_2684437_1375304378_3337695f1b61cb9cc8ba4fc84ec3d11e_rle_crop_3903714045_0.png resize: (146, 96) 1375312823 -1.0755006241164669 treat image : temp/1754396426_2684437_1375304276_5b322438ef5beb98c13a4453e0436094_rle_crop_3903714078_0.png resize: (82, 185) 1375312824 -1.5775587976076246 treat image : temp/1754396426_2684437_1375304352_6d3a1d08df78a0a16a61eb59783bb61c_rle_crop_3903714064_0.png resize: (61, 57) 1375312825 -3.7819559374900775 treat image : temp/1754396426_2684437_1375304276_5b322438ef5beb98c13a4453e0436094_rle_crop_3903714080_0.png resize: (41, 89) 1375312826 -0.02495122068667781 treat image : temp/1754396426_2684437_1375303997_ea819b60a2ea4355a93446f09b7a4e51_rle_crop_3903714087_0.png resize: (55, 118) 1375312827 -3.445126481536259 treat image : temp/1754396426_2684437_1375303868_64c1a53e91b76d70e48ea98ad1fb1244_rle_crop_3903714104_0.png resize: (44, 77) 1375312828 -4.461617671939199 treat image : temp/1754396426_2684437_1375304419_265bae54c1ba2dc2f905be8185688043_rle_crop_3903714033_0.png resize: (553, 333) 1375312914 -0.5378988552870585 treat image : temp/1754396426_2684437_1375304417_5bf6dda69f96a172ebb1261af860acbb_rle_crop_3903714035_0.png resize: (531, 338) 1375312915 -0.01796793112899826 treat image : temp/1754396426_2684437_1375304417_5bf6dda69f96a172ebb1261af860acbb_rle_crop_3903714036_0.png resize: (84, 171) 1375312916 -3.7889937942131002 treat image : temp/1754396426_2684437_1375304417_5bf6dda69f96a172ebb1261af860acbb_rle_crop_3903714038_0.png resize: (920, 1045) 1375312917 -0.9539473334840308 treat image : temp/1754396426_2684437_1375304409_e3ecf4bc41928a35bc288c2e5327831e_rle_crop_3903714041_0.png resize: (1001, 1508) 1375312918 -1.1230693209228648 treat image : temp/1754396426_2684437_1375304409_e3ecf4bc41928a35bc288c2e5327831e_rle_crop_3903714042_0.png resize: (477, 313) 1375312919 -0.17999853808864916 treat image : temp/1754396426_2684437_1375304383_d026fe6018dd9ed65fa9595942c87f0b_rle_crop_3903714043_0.png resize: (52, 67) 1375312920 -0.26142980425794027 treat image : temp/1754396426_2684437_1375304383_d026fe6018dd9ed65fa9595942c87f0b_rle_crop_3903714044_0.png resize: (895, 1024) 1375312921 0.6420830243447018 treat image : temp/1754396426_2684437_1375304378_3337695f1b61cb9cc8ba4fc84ec3d11e_rle_crop_3903714046_0.png resize: (490, 323) 1375312922 -0.09701027107284697 treat image : temp/1754396426_2684437_1375304378_3337695f1b61cb9cc8ba4fc84ec3d11e_rle_crop_3903714047_0.png resize: (966, 1053) 1375312923 -0.10081618747513807 treat image : temp/1754396426_2684437_1375304371_44d8ac90fc72a3526ab0dde36b7d11eb_rle_crop_3903714048_0.png resize: (107, 136) 1375312924 -3.0153625770767305 treat image : temp/1754396426_2684437_1375304371_44d8ac90fc72a3526ab0dde36b7d11eb_rle_crop_3903714049_0.png resize: (990, 1091) 1375312925 0.06343213127770189 treat image : temp/1754396426_2684437_1375304371_44d8ac90fc72a3526ab0dde36b7d11eb_rle_crop_3903714050_0.png resize: (82, 114) 1375312926 0.39203170231227163 treat image : temp/1754396426_2684437_1375304371_44d8ac90fc72a3526ab0dde36b7d11eb_rle_crop_3903714051_0.png resize: (129, 95) 1375312927 -0.11239861474762174 treat image : temp/1754396426_2684437_1375304362_8a6ba32a00debe2267dc049e1bf15d0f_rle_crop_3903714053_0.png resize: (254, 117) 1375312928 -4.207771115237268 treat image : temp/1754396426_2684437_1375304362_8a6ba32a00debe2267dc049e1bf15d0f_rle_crop_3903714055_0.png resize: (563, 382) 1375312929 0.2833303385880421 treat image : temp/1754396426_2684437_1375304356_299279f66d2d9fb18730bcbf47f50edb_rle_crop_3903714057_0.png resize: (216, 164) 1375312930 -3.4849749301943644 treat image : temp/1754396426_2684437_1375304356_299279f66d2d9fb18730bcbf47f50edb_rle_crop_3903714058_0.png resize: (547, 347) 1375312931 -0.08887923856400584 treat image : temp/1754396426_2684437_1375304356_299279f66d2d9fb18730bcbf47f50edb_rle_crop_3903714059_0.png resize: (995, 1053) 1375312932 -0.5161609441826575 treat image : temp/1754396426_2684437_1375304352_6d3a1d08df78a0a16a61eb59783bb61c_rle_crop_3903714061_0.png resize: (507, 383) 1375312933 0.39748042958671886 treat image : temp/1754396426_2684437_1375304352_6d3a1d08df78a0a16a61eb59783bb61c_rle_crop_3903714065_0.png resize: (989, 1026) 1375312934 -0.37111711204323455 treat image : temp/1754396426_2684437_1375304338_69e95bf4851938e0fb31f93f4300e88b_rle_crop_3903714066_0.png resize: (494, 347) 1375312935 -0.581607884389391 treat image : temp/1754396426_2684437_1375304338_69e95bf4851938e0fb31f93f4300e88b_rle_crop_3903714067_0.png resize: (879, 1049) 1375312936 0.21128443765822744 treat image : temp/1754396426_2684437_1375304335_dfd1a91acc483d14c38fbf687b1cc5ea_rle_crop_3903714068_0.png resize: (956, 994) 1375312937 0.8721604178776879 treat image : temp/1754396426_2684437_1375304328_6c2753e8a8972c010ffd7d8cec24211f_rle_crop_3903714069_0.png resize: (938, 1075) 1375312938 1.517951676960035 treat image : temp/1754396426_2684437_1375304328_6c2753e8a8972c010ffd7d8cec24211f_rle_crop_3903714070_0.png resize: (67, 100) 1375312939 -0.18975891982605808 treat image : temp/1754396426_2684437_1375304328_6c2753e8a8972c010ffd7d8cec24211f_rle_crop_3903714071_0.png resize: (82, 101) 1375312940 -1.1096704215082318 treat image : temp/1754396426_2684437_1375304304_54af68eae9d5ae4522b8bb56115f8ba8_rle_crop_3903714072_0.png resize: (82, 87) 1375312941 -1.9133230897343434 treat image : temp/1754396426_2684437_1375304304_54af68eae9d5ae4522b8bb56115f8ba8_rle_crop_3903714073_0.png resize: (995, 1258) 1375312942 -2.090191643131 treat image : temp/1754396426_2684437_1375304304_54af68eae9d5ae4522b8bb56115f8ba8_rle_crop_3903714074_0.png resize: (512, 335) 1375312943 -0.7952271956295406 treat image : temp/1754396426_2684437_1375304276_5b322438ef5beb98c13a4453e0436094_rle_crop_3903714076_0.png resize: (164, 136) 1375312945 -3.618092647384298 treat image : temp/1754396426_2684437_1375304276_5b322438ef5beb98c13a4453e0436094_rle_crop_3903714077_0.png resize: (160, 256) 1375312946 -3.358060323298615 treat image : temp/1754396426_2684437_1375304276_5b322438ef5beb98c13a4453e0436094_rle_crop_3903714079_0.png resize: (131, 108) 1375312947 -1.5847293457378644 treat image : temp/1754396426_2684437_1375304276_5b322438ef5beb98c13a4453e0436094_rle_crop_3903714081_0.png resize: (940, 965) 1375312948 0.24636090139591693 treat image : temp/1754396426_2684437_1375304055_b56c7b1ca0245ded41bd268ca3fda912_rle_crop_3903714082_0.png resize: (40, 81) 1375312949 2.084465657335485 treat image : temp/1754396426_2684437_1375304055_b56c7b1ca0245ded41bd268ca3fda912_rle_crop_3903714083_0.png resize: (985, 1123) 1375312950 -0.5656471333007401 treat image : temp/1754396426_2684437_1375304055_b56c7b1ca0245ded41bd268ca3fda912_rle_crop_3903714084_0.png resize: (170, 97) 1375312951 -0.9468072839193648 treat image : temp/1754396426_2684437_1375304029_834d650b9b6dd188702ca39f52cd4508_rle_crop_3903714085_0.png resize: (984, 1033) 1375312952 0.1515923468699471 treat image : temp/1754396426_2684437_1375303997_ea819b60a2ea4355a93446f09b7a4e51_rle_crop_3903714086_0.png resize: (528, 386) 1375312953 -0.016088580368134667 treat image : temp/1754396426_2684437_1375303997_ea819b60a2ea4355a93446f09b7a4e51_rle_crop_3903714088_0.png resize: (34, 78) 1375312954 20.0 treat image : temp/1754396426_2684437_1375303997_ea819b60a2ea4355a93446f09b7a4e51_rle_crop_3903714089_0.png resize: (947, 1005) 1375312955 0.11743242824964785 treat image : temp/1754396426_2684437_1375303956_b5940449d0f3a8554f0009ea39bc6e68_rle_crop_3903714092_0.png resize: (1014, 1258) 1375312956 -1.2244394050820597 treat image : temp/1754396426_2684437_1375303926_726a87d16d7cdf70de934f329f77c29d_rle_crop_3903714094_0.png resize: (506, 353) 1375312957 -0.14549942956323947 treat image : temp/1754396426_2684437_1375303926_726a87d16d7cdf70de934f329f77c29d_rle_crop_3903714095_0.png resize: (160, 128) 1375312958 -3.7290055547030327 treat image : temp/1754396426_2684437_1375303926_726a87d16d7cdf70de934f329f77c29d_rle_crop_3903714096_0.png resize: (941, 959) 1375312959 0.20668166894278167 treat image : temp/1754396426_2684437_1375303900_00a35dbd58a9966202395ce3ec56d413_rle_crop_3903714097_0.png resize: (527, 351) 1375312960 -0.06090802753931257 treat image : temp/1754396426_2684437_1375303900_00a35dbd58a9966202395ce3ec56d413_rle_crop_3903714101_0.png resize: (935, 1325) 1375312961 -1.1025439497362222 treat image : temp/1754396426_2684437_1375303868_64c1a53e91b76d70e48ea98ad1fb1244_rle_crop_3903714102_0.png resize: (50, 92) 1375312962 -1.0784765899905688 treat image : temp/1754396426_2684437_1375303868_64c1a53e91b76d70e48ea98ad1fb1244_rle_crop_3903714103_0.png resize: (128, 63) 1375312963 -1.9637483648640577 treat image : temp/1754396426_2684437_1375303868_64c1a53e91b76d70e48ea98ad1fb1244_rle_crop_3903714105_0.png resize: (540, 353) 1375312964 -0.07828182971763742 treat image : temp/1754396426_2684437_1375303868_64c1a53e91b76d70e48ea98ad1fb1244_rle_crop_3903714106_0.png resize: (892, 1024) 1375312965 -0.024764965542053482 treat image : temp/1754396426_2684437_1375303866_6df282e6a83d0bb043531cc6c1d9c9af_rle_crop_3903714107_0.png resize: (963, 1010) 1375312966 -0.3114055119421108 treat image : temp/1754396426_2684437_1375303864_d5c370c7156e717a05769ce84f7e1a5d_rle_crop_3903714109_0.png resize: (938, 1027) 1375312967 1.258951465871197 treat image : temp/1754396426_2684437_1375303864_d5c370c7156e717a05769ce84f7e1a5d_rle_crop_3903714110_0.png resize: (76, 130) 1375312968 -0.4037682007131092 treat image : temp/1754396426_2684437_1375303864_d5c370c7156e717a05769ce84f7e1a5d_rle_crop_3903714111_0.png resize: (142, 91) 1375312969 -2.1990404094172167 treat image : temp/1754396426_2684437_1375303861_22109ca6cbcc4ca531bc87a1dc9bf8e5_rle_crop_3903714112_0.png resize: (176, 211) 1375312970 -1.3715979803242606 treat image : temp/1754396426_2684437_1375303861_22109ca6cbcc4ca531bc87a1dc9bf8e5_rle_crop_3903714113_0.png resize: (989, 1060) 1375312971 -0.12867665782199234 treat image : temp/1754396426_2684437_1375303859_1e6ac8aab97710f7311240770678c273_rle_crop_3903714114_0.png resize: (993, 999) 1375312972 0.02761291915592821 treat image : temp/1754396426_2684437_1375303844_c8847bc12d9067a829664909865cbac0_rle_crop_3903714115_0.png resize: (992, 1175) 1375312973 -1.5317746241514738 treat image : temp/1754396426_2684437_1375303842_351c5e398f5bf735495deed6cb6b6f00_rle_crop_3903714117_0.png resize: (1006, 1422) 1375312974 -2.0453606609432655 treat image : temp/1754396426_2684437_1375303842_351c5e398f5bf735495deed6cb6b6f00_rle_crop_3903714118_0.png resize: (75, 64) 1375312975 -3.680986045059115 treat image : temp/1754396426_2684437_1375303839_9ba7337abf221f76b7626d5c6a1eadac_rle_crop_3903714120_0.png resize: (964, 1166) 1375312976 -0.6466378127434181 treat image : temp/1754396426_2684437_1375303835_13894658dbe64aba489fd0d6d03c82b4_rle_crop_3903714121_0.png resize: (494, 370) 1375312977 0.33568704215445305 treat image : temp/1754396426_2684437_1375303835_13894658dbe64aba489fd0d6d03c82b4_rle_crop_3903714122_0.png resize: (218, 416) 1375312978 -2.110258023518074 treat image : temp/1754396426_2684437_1375303835_13894658dbe64aba489fd0d6d03c82b4_rle_crop_3903714123_0.png resize: (1003, 1304) 1375312979 -2.1886115657041953 treat image : temp/1754396426_2684437_1375303830_3b6599a606b60db7f4e71240a3209db9_rle_crop_3903714126_0.png resize: (165, 78) 1375312980 -1.6371532440139986 treat image : temp/1754396426_2684437_1375303830_3b6599a606b60db7f4e71240a3209db9_rle_crop_3903714127_0.png resize: (951, 1210) 1375312981 0.6505366064612782 treat image : temp/1754396426_2684437_1375303830_3b6599a606b60db7f4e71240a3209db9_rle_crop_3903714129_0.png resize: (97, 79) 1375312982 -0.9760382230355352 treat image : temp/1754396426_2684437_1375303665_7789937bbee46edd7103201ae322b8dc_rle_crop_3903714130_0.png resize: (974, 1021) 1375312983 0.8879628170289127 treat image : temp/1754396426_2684437_1375303656_d07f88ea30b94156e0a79d5500b7f6e0_rle_crop_3903714132_0.png resize: (964, 975) 1375312984 -0.24509734200089717 treat image : temp/1754396426_2684437_1375303656_d07f88ea30b94156e0a79d5500b7f6e0_rle_crop_3903714134_0.png resize: (196, 252) 1375312985 -1.9834598860340418 treat image : temp/1754396426_2684437_1375303632_e42b28f076f2faffb1746e4b6417d0a6_rle_crop_3903714136_0.png resize: (992, 1042) 1375312986 -0.39929282682112127 treat image : temp/1754396426_2684437_1375303632_e42b28f076f2faffb1746e4b6417d0a6_rle_crop_3903714137_0.png resize: (171, 96) 1375312987 0.8580894850115164 treat image : temp/1754396426_2684437_1375303578_10ae70df3fb7b50639d0cb94e9bb252c_rle_crop_3903714138_0.png resize: (934, 1019) 1375312988 -0.23811744350156025 treat image : temp/1754396426_2684437_1375303578_10ae70df3fb7b50639d0cb94e9bb252c_rle_crop_3903714139_0.png resize: (513, 334) 1375312989 -0.8886975117459831 treat image : temp/1754396426_2684437_1375304417_5bf6dda69f96a172ebb1261af860acbb_rle_crop_3903714037_0.png resize: (131, 133) 1375312992 -3.260698614097945 treat image : temp/1754396426_2684437_1375304410_6929cb2c93e6b1a193c3d396abe38cf3_rle_crop_3903714040_0.png resize: (131, 132) 1375312993 -2.3366574814647967 treat image : temp/1754396426_2684437_1375304362_8a6ba32a00debe2267dc049e1bf15d0f_rle_crop_3903714052_0.png resize: (119, 56) 1375312994 -1.8724434602204147 treat image : temp/1754396426_2684437_1375304352_6d3a1d08df78a0a16a61eb59783bb61c_rle_crop_3903714063_0.png resize: (125, 125) 1375312995 -2.260010999164117 treat image : temp/1754396426_2684437_1375304304_54af68eae9d5ae4522b8bb56115f8ba8_rle_crop_3903714075_0.png resize: (123, 63) 1375312996 -1.3890245016218155 treat image : temp/1754396426_2684437_1375303900_00a35dbd58a9966202395ce3ec56d413_rle_crop_3903714100_0.png resize: (127, 126) 1375312997 -2.833930351360215 treat image : temp/1754396426_2684437_1375303835_13894658dbe64aba489fd0d6d03c82b4_rle_crop_3903714125_0.png resize: (121, 88) 1375312998 -1.6960039552088186 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 145 time used for this insertion : 0.021001577377319336 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 145 time used for this insertion : 0.03462052345275879 save missing photos in datou_result : time spend for datou_step_exec : 43.96632218360901 time spend to save output : 0.28740644454956055 total time spend for step 6 : 44.25372862815857 step7:brightness Tue Aug 5 14:24:59 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1754396426_2684437_1375304419_265bae54c1ba2dc2f905be8185688043.jpg treat image : temp/1754396426_2684437_1375304417_5bf6dda69f96a172ebb1261af860acbb.jpg treat image : temp/1754396426_2684437_1375304410_6929cb2c93e6b1a193c3d396abe38cf3.jpg treat image : temp/1754396426_2684437_1375304409_e3ecf4bc41928a35bc288c2e5327831e.jpg treat image : temp/1754396426_2684437_1375304383_d026fe6018dd9ed65fa9595942c87f0b.jpg treat image : temp/1754396426_2684437_1375304378_3337695f1b61cb9cc8ba4fc84ec3d11e.jpg treat image : temp/1754396426_2684437_1375304371_44d8ac90fc72a3526ab0dde36b7d11eb.jpg treat image : temp/1754396426_2684437_1375304362_8a6ba32a00debe2267dc049e1bf15d0f.jpg treat image : temp/1754396426_2684437_1375304356_299279f66d2d9fb18730bcbf47f50edb.jpg treat image : temp/1754396426_2684437_1375304352_6d3a1d08df78a0a16a61eb59783bb61c.jpg treat image : temp/1754396426_2684437_1375304338_69e95bf4851938e0fb31f93f4300e88b.jpg treat image : temp/1754396426_2684437_1375304335_dfd1a91acc483d14c38fbf687b1cc5ea.jpg treat image : temp/1754396426_2684437_1375304332_93c3c54ec782913597f093628a8f18e0.jpg treat image : temp/1754396426_2684437_1375304328_6c2753e8a8972c010ffd7d8cec24211f.jpg treat image : temp/1754396426_2684437_1375304304_54af68eae9d5ae4522b8bb56115f8ba8.jpg treat image : temp/1754396426_2684437_1375304276_5b322438ef5beb98c13a4453e0436094.jpg treat image : temp/1754396426_2684437_1375304055_b56c7b1ca0245ded41bd268ca3fda912.jpg treat image : temp/1754396426_2684437_1375304029_834d650b9b6dd188702ca39f52cd4508.jpg treat image : temp/1754396426_2684437_1375303997_ea819b60a2ea4355a93446f09b7a4e51.jpg treat image : temp/1754396426_2684437_1375303956_b5940449d0f3a8554f0009ea39bc6e68.jpg treat image : temp/1754396426_2684437_1375303926_726a87d16d7cdf70de934f329f77c29d.jpg treat image : temp/1754396426_2684437_1375303900_00a35dbd58a9966202395ce3ec56d413.jpg treat image : temp/1754396426_2684437_1375303868_64c1a53e91b76d70e48ea98ad1fb1244.jpg treat image : temp/1754396426_2684437_1375303866_6df282e6a83d0bb043531cc6c1d9c9af.jpg treat image : temp/1754396426_2684437_1375303864_d5c370c7156e717a05769ce84f7e1a5d.jpg treat image : temp/1754396426_2684437_1375303861_22109ca6cbcc4ca531bc87a1dc9bf8e5.jpg treat image : temp/1754396426_2684437_1375303859_1e6ac8aab97710f7311240770678c273.jpg treat image : temp/1754396426_2684437_1375303856_ce98c5c2e4ca8e7a6dd04ed39db3fce8.jpg treat image : temp/1754396426_2684437_1375303844_c8847bc12d9067a829664909865cbac0.jpg treat image : temp/1754396426_2684437_1375303842_351c5e398f5bf735495deed6cb6b6f00.jpg treat image : temp/1754396426_2684437_1375303839_9ba7337abf221f76b7626d5c6a1eadac.jpg treat image : temp/1754396426_2684437_1375303835_13894658dbe64aba489fd0d6d03c82b4.jpg treat image : temp/1754396426_2684437_1375303833_4b8d05e5f18a9fbd3e3015509f394157.jpg treat image : temp/1754396426_2684437_1375303830_3b6599a606b60db7f4e71240a3209db9.jpg treat image : temp/1754396426_2684437_1375303665_7789937bbee46edd7103201ae322b8dc.jpg treat image : temp/1754396426_2684437_1375303656_d07f88ea30b94156e0a79d5500b7f6e0.jpg treat image : temp/1754396426_2684437_1375303632_e42b28f076f2faffb1746e4b6417d0a6.jpg treat image : temp/1754396426_2684437_1375303578_10ae70df3fb7b50639d0cb94e9bb252c.jpg treat image : temp/1754396426_2684437_1375304417_5bf6dda69f96a172ebb1261af860acbb_rle_crop_3903714034_0.png treat image : temp/1754396426_2684437_1375304410_6929cb2c93e6b1a193c3d396abe38cf3_rle_crop_3903714039_0.png treat image : temp/1754396426_2684437_1375304362_8a6ba32a00debe2267dc049e1bf15d0f_rle_crop_3903714054_0.png treat image : temp/1754396426_2684437_1375304356_299279f66d2d9fb18730bcbf47f50edb_rle_crop_3903714056_0.png treat image : temp/1754396426_2684437_1375304352_6d3a1d08df78a0a16a61eb59783bb61c_rle_crop_3903714060_0.png treat image : temp/1754396426_2684437_1375304352_6d3a1d08df78a0a16a61eb59783bb61c_rle_crop_3903714062_0.png treat image : temp/1754396426_2684437_1375303956_b5940449d0f3a8554f0009ea39bc6e68_rle_crop_3903714090_0.png treat image : temp/1754396426_2684437_1375303956_b5940449d0f3a8554f0009ea39bc6e68_rle_crop_3903714091_0.png treat image : temp/1754396426_2684437_1375303926_726a87d16d7cdf70de934f329f77c29d_rle_crop_3903714093_0.png treat image : temp/1754396426_2684437_1375303900_00a35dbd58a9966202395ce3ec56d413_rle_crop_3903714098_0.png treat image : temp/1754396426_2684437_1375303900_00a35dbd58a9966202395ce3ec56d413_rle_crop_3903714099_0.png treat image : temp/1754396426_2684437_1375303864_d5c370c7156e717a05769ce84f7e1a5d_rle_crop_3903714108_0.png treat image : temp/1754396426_2684437_1375303842_351c5e398f5bf735495deed6cb6b6f00_rle_crop_3903714116_0.png treat image : temp/1754396426_2684437_1375303839_9ba7337abf221f76b7626d5c6a1eadac_rle_crop_3903714119_0.png treat image : temp/1754396426_2684437_1375303835_13894658dbe64aba489fd0d6d03c82b4_rle_crop_3903714124_0.png treat image : temp/1754396426_2684437_1375303830_3b6599a606b60db7f4e71240a3209db9_rle_crop_3903714128_0.png treat image : temp/1754396426_2684437_1375303656_d07f88ea30b94156e0a79d5500b7f6e0_rle_crop_3903714131_0.png treat image : temp/1754396426_2684437_1375303656_d07f88ea30b94156e0a79d5500b7f6e0_rle_crop_3903714133_0.png treat image : temp/1754396426_2684437_1375303632_e42b28f076f2faffb1746e4b6417d0a6_rle_crop_3903714135_0.png treat image : temp/1754396426_2684437_1375304378_3337695f1b61cb9cc8ba4fc84ec3d11e_rle_crop_3903714045_0.png treat image : temp/1754396426_2684437_1375304276_5b322438ef5beb98c13a4453e0436094_rle_crop_3903714078_0.png treat image : temp/1754396426_2684437_1375304352_6d3a1d08df78a0a16a61eb59783bb61c_rle_crop_3903714064_0.png treat image : temp/1754396426_2684437_1375304276_5b322438ef5beb98c13a4453e0436094_rle_crop_3903714080_0.png treat image : temp/1754396426_2684437_1375303997_ea819b60a2ea4355a93446f09b7a4e51_rle_crop_3903714087_0.png treat image : temp/1754396426_2684437_1375303868_64c1a53e91b76d70e48ea98ad1fb1244_rle_crop_3903714104_0.png treat image : temp/1754396426_2684437_1375304419_265bae54c1ba2dc2f905be8185688043_rle_crop_3903714033_0.png treat image : temp/1754396426_2684437_1375304417_5bf6dda69f96a172ebb1261af860acbb_rle_crop_3903714035_0.png treat image : temp/1754396426_2684437_1375304417_5bf6dda69f96a172ebb1261af860acbb_rle_crop_3903714036_0.png treat image : temp/1754396426_2684437_1375304417_5bf6dda69f96a172ebb1261af860acbb_rle_crop_3903714038_0.png treat image : temp/1754396426_2684437_1375304409_e3ecf4bc41928a35bc288c2e5327831e_rle_crop_3903714041_0.png treat image : temp/1754396426_2684437_1375304409_e3ecf4bc41928a35bc288c2e5327831e_rle_crop_3903714042_0.png treat image : temp/1754396426_2684437_1375304383_d026fe6018dd9ed65fa9595942c87f0b_rle_crop_3903714043_0.png treat image : temp/1754396426_2684437_1375304383_d026fe6018dd9ed65fa9595942c87f0b_rle_crop_3903714044_0.png treat image : temp/1754396426_2684437_1375304378_3337695f1b61cb9cc8ba4fc84ec3d11e_rle_crop_3903714046_0.png treat image : temp/1754396426_2684437_1375304378_3337695f1b61cb9cc8ba4fc84ec3d11e_rle_crop_3903714047_0.png treat image : temp/1754396426_2684437_1375304371_44d8ac90fc72a3526ab0dde36b7d11eb_rle_crop_3903714048_0.png treat image : temp/1754396426_2684437_1375304371_44d8ac90fc72a3526ab0dde36b7d11eb_rle_crop_3903714049_0.png treat image : temp/1754396426_2684437_1375304371_44d8ac90fc72a3526ab0dde36b7d11eb_rle_crop_3903714050_0.png treat image : temp/1754396426_2684437_1375304371_44d8ac90fc72a3526ab0dde36b7d11eb_rle_crop_3903714051_0.png treat image : temp/1754396426_2684437_1375304362_8a6ba32a00debe2267dc049e1bf15d0f_rle_crop_3903714053_0.png treat image : temp/1754396426_2684437_1375304362_8a6ba32a00debe2267dc049e1bf15d0f_rle_crop_3903714055_0.png treat image : temp/1754396426_2684437_1375304356_299279f66d2d9fb18730bcbf47f50edb_rle_crop_3903714057_0.png treat image : temp/1754396426_2684437_1375304356_299279f66d2d9fb18730bcbf47f50edb_rle_crop_3903714058_0.png treat image : temp/1754396426_2684437_1375304356_299279f66d2d9fb18730bcbf47f50edb_rle_crop_3903714059_0.png treat image : temp/1754396426_2684437_1375304352_6d3a1d08df78a0a16a61eb59783bb61c_rle_crop_3903714061_0.png treat image : temp/1754396426_2684437_1375304352_6d3a1d08df78a0a16a61eb59783bb61c_rle_crop_3903714065_0.png treat image : temp/1754396426_2684437_1375304338_69e95bf4851938e0fb31f93f4300e88b_rle_crop_3903714066_0.png treat image : temp/1754396426_2684437_1375304338_69e95bf4851938e0fb31f93f4300e88b_rle_crop_3903714067_0.png treat image : temp/1754396426_2684437_1375304335_dfd1a91acc483d14c38fbf687b1cc5ea_rle_crop_3903714068_0.png treat image : temp/1754396426_2684437_1375304328_6c2753e8a8972c010ffd7d8cec24211f_rle_crop_3903714069_0.png treat image : temp/1754396426_2684437_1375304328_6c2753e8a8972c010ffd7d8cec24211f_rle_crop_3903714070_0.png treat image : temp/1754396426_2684437_1375304328_6c2753e8a8972c010ffd7d8cec24211f_rle_crop_3903714071_0.png treat image : temp/1754396426_2684437_1375304304_54af68eae9d5ae4522b8bb56115f8ba8_rle_crop_3903714072_0.png treat image : temp/1754396426_2684437_1375304304_54af68eae9d5ae4522b8bb56115f8ba8_rle_crop_3903714073_0.png treat image : temp/1754396426_2684437_1375304304_54af68eae9d5ae4522b8bb56115f8ba8_rle_crop_3903714074_0.png treat image : temp/1754396426_2684437_1375304276_5b322438ef5beb98c13a4453e0436094_rle_crop_3903714076_0.png treat image : temp/1754396426_2684437_1375304276_5b322438ef5beb98c13a4453e0436094_rle_crop_3903714077_0.png treat image : temp/1754396426_2684437_1375304276_5b322438ef5beb98c13a4453e0436094_rle_crop_3903714079_0.png treat image : temp/1754396426_2684437_1375304276_5b322438ef5beb98c13a4453e0436094_rle_crop_3903714081_0.png treat image : temp/1754396426_2684437_1375304055_b56c7b1ca0245ded41bd268ca3fda912_rle_crop_3903714082_0.png treat image : temp/1754396426_2684437_1375304055_b56c7b1ca0245ded41bd268ca3fda912_rle_crop_3903714083_0.png treat image : temp/1754396426_2684437_1375304055_b56c7b1ca0245ded41bd268ca3fda912_rle_crop_3903714084_0.png treat image : temp/1754396426_2684437_1375304029_834d650b9b6dd188702ca39f52cd4508_rle_crop_3903714085_0.png treat image : temp/1754396426_2684437_1375303997_ea819b60a2ea4355a93446f09b7a4e51_rle_crop_3903714086_0.png treat image : temp/1754396426_2684437_1375303997_ea819b60a2ea4355a93446f09b7a4e51_rle_crop_3903714088_0.png treat image : temp/1754396426_2684437_1375303997_ea819b60a2ea4355a93446f09b7a4e51_rle_crop_3903714089_0.png treat image : temp/1754396426_2684437_1375303956_b5940449d0f3a8554f0009ea39bc6e68_rle_crop_3903714092_0.png treat image : temp/1754396426_2684437_1375303926_726a87d16d7cdf70de934f329f77c29d_rle_crop_3903714094_0.png treat image : temp/1754396426_2684437_1375303926_726a87d16d7cdf70de934f329f77c29d_rle_crop_3903714095_0.png treat image : temp/1754396426_2684437_1375303926_726a87d16d7cdf70de934f329f77c29d_rle_crop_3903714096_0.png treat image : temp/1754396426_2684437_1375303900_00a35dbd58a9966202395ce3ec56d413_rle_crop_3903714097_0.png treat image : temp/1754396426_2684437_1375303900_00a35dbd58a9966202395ce3ec56d413_rle_crop_3903714101_0.png treat image : temp/1754396426_2684437_1375303868_64c1a53e91b76d70e48ea98ad1fb1244_rle_crop_3903714102_0.png treat image : temp/1754396426_2684437_1375303868_64c1a53e91b76d70e48ea98ad1fb1244_rle_crop_3903714103_0.png treat image : temp/1754396426_2684437_1375303868_64c1a53e91b76d70e48ea98ad1fb1244_rle_crop_3903714105_0.png treat image : temp/1754396426_2684437_1375303868_64c1a53e91b76d70e48ea98ad1fb1244_rle_crop_3903714106_0.png treat image : temp/1754396426_2684437_1375303866_6df282e6a83d0bb043531cc6c1d9c9af_rle_crop_3903714107_0.png treat image : temp/1754396426_2684437_1375303864_d5c370c7156e717a05769ce84f7e1a5d_rle_crop_3903714109_0.png treat image : temp/1754396426_2684437_1375303864_d5c370c7156e717a05769ce84f7e1a5d_rle_crop_3903714110_0.png treat image : temp/1754396426_2684437_1375303864_d5c370c7156e717a05769ce84f7e1a5d_rle_crop_3903714111_0.png treat image : temp/1754396426_2684437_1375303861_22109ca6cbcc4ca531bc87a1dc9bf8e5_rle_crop_3903714112_0.png treat image : temp/1754396426_2684437_1375303861_22109ca6cbcc4ca531bc87a1dc9bf8e5_rle_crop_3903714113_0.png treat image : temp/1754396426_2684437_1375303859_1e6ac8aab97710f7311240770678c273_rle_crop_3903714114_0.png treat image : temp/1754396426_2684437_1375303844_c8847bc12d9067a829664909865cbac0_rle_crop_3903714115_0.png treat image : temp/1754396426_2684437_1375303842_351c5e398f5bf735495deed6cb6b6f00_rle_crop_3903714117_0.png treat image : temp/1754396426_2684437_1375303842_351c5e398f5bf735495deed6cb6b6f00_rle_crop_3903714118_0.png treat image : temp/1754396426_2684437_1375303839_9ba7337abf221f76b7626d5c6a1eadac_rle_crop_3903714120_0.png treat image : temp/1754396426_2684437_1375303835_13894658dbe64aba489fd0d6d03c82b4_rle_crop_3903714121_0.png treat image : temp/1754396426_2684437_1375303835_13894658dbe64aba489fd0d6d03c82b4_rle_crop_3903714122_0.png treat image : temp/1754396426_2684437_1375303835_13894658dbe64aba489fd0d6d03c82b4_rle_crop_3903714123_0.png treat image : temp/1754396426_2684437_1375303830_3b6599a606b60db7f4e71240a3209db9_rle_crop_3903714126_0.png treat image : temp/1754396426_2684437_1375303830_3b6599a606b60db7f4e71240a3209db9_rle_crop_3903714127_0.png treat image : temp/1754396426_2684437_1375303830_3b6599a606b60db7f4e71240a3209db9_rle_crop_3903714129_0.png treat image : temp/1754396426_2684437_1375303665_7789937bbee46edd7103201ae322b8dc_rle_crop_3903714130_0.png treat image : temp/1754396426_2684437_1375303656_d07f88ea30b94156e0a79d5500b7f6e0_rle_crop_3903714132_0.png treat image : temp/1754396426_2684437_1375303656_d07f88ea30b94156e0a79d5500b7f6e0_rle_crop_3903714134_0.png treat image : temp/1754396426_2684437_1375303632_e42b28f076f2faffb1746e4b6417d0a6_rle_crop_3903714136_0.png treat image : temp/1754396426_2684437_1375303632_e42b28f076f2faffb1746e4b6417d0a6_rle_crop_3903714137_0.png treat image : temp/1754396426_2684437_1375303578_10ae70df3fb7b50639d0cb94e9bb252c_rle_crop_3903714138_0.png treat image : temp/1754396426_2684437_1375303578_10ae70df3fb7b50639d0cb94e9bb252c_rle_crop_3903714139_0.png treat image : temp/1754396426_2684437_1375304417_5bf6dda69f96a172ebb1261af860acbb_rle_crop_3903714037_0.png treat image : temp/1754396426_2684437_1375304410_6929cb2c93e6b1a193c3d396abe38cf3_rle_crop_3903714040_0.png treat image : temp/1754396426_2684437_1375304362_8a6ba32a00debe2267dc049e1bf15d0f_rle_crop_3903714052_0.png treat image : temp/1754396426_2684437_1375304352_6d3a1d08df78a0a16a61eb59783bb61c_rle_crop_3903714063_0.png treat image : temp/1754396426_2684437_1375304304_54af68eae9d5ae4522b8bb56115f8ba8_rle_crop_3903714075_0.png treat image : temp/1754396426_2684437_1375303900_00a35dbd58a9966202395ce3ec56d413_rle_crop_3903714100_0.png treat image : temp/1754396426_2684437_1375303835_13894658dbe64aba489fd0d6d03c82b4_rle_crop_3903714125_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 145 time used for this insertion : 0.0189511775970459 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 145 time used for this insertion : 0.03541970252990723 save missing photos in datou_result : time spend for datou_step_exec : 12.481088161468506 time spend to save output : 0.06025815010070801 total time spend for step 7 : 12.541346311569214 step8:velours_tree Tue Aug 5 14:25:11 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.8332393169403076 time spend to save output : 4.3392181396484375e-05 total time spend for step 8 : 0.8332827091217041 step9:send_mail_cod Tue Aug 5 14:25:12 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P25686587_05-08-2025_14_25_12.pdf 25687228 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette256872281754396712 25687229 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette256872291754396717 25687230 imagette256872301754396717 25687231 imagette256872311754396717 25687232 imagette256872321754396717 25687234 change filename to text .change filename to text .imagette256872341754396717 25687235 imagette256872351754396718 25687236 change filename to text .change filename to text .change filename to text .change filename to text .imagette256872361754396718 25687237 imagette256872371754396718 25687238 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette256872381754396718 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=25686587 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/25687228,25687229,25687230,25687231,25687232,25687233,25687234,25687235,25687236,25687237,25687238?tags=papier,autre,mal_croppe,pet_fonce,background,environnement,carton,flou,metal,pehd,pet_clair args[1375304419] : ((1375304419, -2.734327390891019, 492609224), (1375304419, 0.44659662888304774, 2107752395), '0.34968209368908376') We are sending mail with results at report@fotonower.com args[1375304417] : ((1375304417, -4.347085279631546, 492609224), (1375304417, 0.2722868859643752, 2107752395), '0.34968209368908376') We are sending mail with results at report@fotonower.com args[1375304410] : ((1375304410, -1.7797645248298113, 492688767), (1375304410, 0.2098109186240244, 2107752395), '0.34968209368908376') We are sending mail with results at report@fotonower.com args[1375304409] : ((1375304409, 0.2549845519497991, 492688767), (1375304409, 0.31910874124431, 2107752395), '0.34968209368908376') We are sending mail with results at report@fotonower.com args[1375304383] : ((1375304383, -1.635507100042786, 492688767), (1375304383, 0.502084004541802, 2107752395), '0.34968209368908376') We are sending mail with results at report@fotonower.com args[1375304378] : ((1375304378, -2.1473373454709765, 492609224), (1375304378, 0.48194892487715113, 2107752395), '0.34968209368908376') We are sending mail with results at report@fotonower.com args[1375304371] : ((1375304371, -0.5581984955909963, 492688767), (1375304371, 0.6167039336201225, 2107752395), '0.34968209368908376') We are sending mail with results at report@fotonower.com args[1375304362] : ((1375304362, -2.3566287809022457, 492609224), (1375304362, 0.5040046770421073, 2107752395), '0.34968209368908376') We are sending mail with results at report@fotonower.com args[1375304356] : ((1375304356, -2.726114724344888, 492609224), (1375304356, 0.5271611636236005, 2107752395), '0.34968209368908376') We are sending mail with results at report@fotonower.com args[1375304352] : ((1375304352, -2.548097383841598, 492609224), (1375304352, 0.375461283570327, 2107752395), '0.34968209368908376') We are sending mail with results at report@fotonower.com args[1375304338] : ((1375304338, -2.0424935183743265, 492609224), (1375304338, 0.5593109983409206, 2107752395), '0.34968209368908376') We are sending mail with results at report@fotonower.com args[1375304335] : ((1375304335, -1.0118619756234537, 492688767), (1375304335, 0.5251841342614645, 2107752395), '0.34968209368908376') We are sending mail with results at report@fotonower.com args[1375304332] : ((1375304332, -1.2752798809059502, 492688767), (1375304332, 0.5754412347160665, 2107752395), '0.34968209368908376') We are sending mail with results at report@fotonower.com args[1375304328] : ((1375304328, 0.2275481521028714, 492688767), (1375304328, 0.6205120512515847, 2107752395), '0.34968209368908376') We are sending mail with results at report@fotonower.com args[1375304304] : ((1375304304, -2.1854879638879012, 492609224), (1375304304, 0.5091914935876997, 2107752395), '0.34968209368908376') We are sending mail with results at report@fotonower.com args[1375304276] : ((1375304276, -2.5536096524523098, 492609224), (1375304276, 0.500106469311328, 2107752395), '0.34968209368908376') We are sending mail with results at report@fotonower.com args[1375304055] : ((1375304055, -2.0107264827864957, 492609224), (1375304055, 0.47922101285827273, 2107752395), '0.34968209368908376') We are sending mail with results at report@fotonower.com args[1375304029] : ((1375304029, -2.122162490480517, 492609224), (1375304029, 0.4649416674352789, 2107752395), '0.34968209368908376') We are sending mail with results at report@fotonower.com args[1375303997] : ((1375303997, -2.016432693046371, 492609224), (1375303997, 0.5392708026783442, 2107752395), '0.34968209368908376') We are sending mail with results at report@fotonower.com args[1375303956] : ((1375303956, -2.323291309964407, 492609224), (1375303956, 0.4984696156775776, 2107752395), '0.34968209368908376') We are sending mail with results at report@fotonower.com args[1375303926] : ((1375303926, -2.8257822894453515, 492609224), (1375303926, 0.6247296463649613, 2107752395), '0.34968209368908376') We are sending mail with results at report@fotonower.com args[1375303900] : ((1375303900, -4.418921785178734, 492609224), (1375303900, 0.35764431561420257, 2107752395), '0.34968209368908376') We are sending mail with results at report@fotonower.com args[1375303868] : ((1375303868, -2.569173108717434, 492609224), (1375303868, 0.5782387312900527, 2107752395), '0.34968209368908376') We are sending mail with results at report@fotonower.com args[1375303866] : ((1375303866, -1.990753388641721, 492688767), (1375303866, 0.5632733239071129, 2107752395), '0.34968209368908376') We are sending mail with results at report@fotonower.com args[1375303864] : ((1375303864, -0.16343887887316627, 492688767), (1375303864, 0.5473266774798058, 2107752395), '0.34968209368908376') We are sending mail with results at report@fotonower.com args[1375303861] : ((1375303861, -2.526406531008145, 492609224), (1375303861, 0.4382659107570085, 2107752395), '0.34968209368908376') We are sending mail with results at report@fotonower.com args[1375303859] : ((1375303859, -1.2702295282757963, 492688767), (1375303859, 0.5344686175039932, 2107752395), '0.34968209368908376') We are sending mail with results at report@fotonower.com args[1375303856] : ((1375303856, 3.836375122670119, 492688767), (1375303856, 0.4773794854145213, 2107752395), '0.34968209368908376') We are sending mail with results at report@fotonower.com args[1375303844] : ((1375303844, -2.3362466384681086, 492609224), (1375303844, 0.3797366075830106, 2107752395), '0.34968209368908376') We are sending mail with results at report@fotonower.com args[1375303842] : ((1375303842, -2.4520871479497584, 492609224), (1375303842, 0.35875455818890895, 2107752395), '0.34968209368908376') We are sending mail with results at report@fotonower.com args[1375303839] : ((1375303839, -1.0396586517287334, 492688767), (1375303839, 0.35579149748020217, 2107752395), '0.34968209368908376') We are sending mail with results at report@fotonower.com args[1375303835] : ((1375303835, -2.224651140094315, 492609224), (1375303835, 0.40517952825628817, 2107752395), '0.34968209368908376') We are sending mail with results at report@fotonower.com args[1375303833] : ((1375303833, -2.5001459201253264, 492609224), (1375303833, 0.5443742981172706, 2107752395), '0.34968209368908376') We are sending mail with results at report@fotonower.com args[1375303830] : ((1375303830, -0.5516238497236083, 492688767), (1375303830, 0.4686161801949384, 2107752395), '0.34968209368908376') We are sending mail with results at report@fotonower.com args[1375303665] : ((1375303665, -1.3076837260890815, 492688767), (1375303665, 0.5132970549801383, 2107752395), '0.34968209368908376') We are sending mail with results at report@fotonower.com args[1375303656] : ((1375303656, -2.451351775070157, 492609224), (1375303656, 0.5823671865862053, 2107752395), '0.34968209368908376') We are sending mail with results at report@fotonower.com args[1375303632] : ((1375303632, -2.242982940727533, 492609224), (1375303632, 0.601274744116228, 2107752395), '0.34968209368908376') We are sending mail with results at report@fotonower.com args[1375303578] : ((1375303578, -2.1497995769579994, 492609224), (1375303578, 0.476920551433836, 2107752395), '0.34968209368908376') We are sending mail with results at report@fotonower.com refus_total : 0.34968209368908376 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=25686587 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25686587_05-08-2025_14_25_12.pdf results_Auto_P25686587_05-08-2025_14_25_12.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25686587_05-08-2025_14_25_12.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','25686587','results_Auto_P25686587_05-08-2025_14_25_12.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25686587_05-08-2025_14_25_12.pdf','pdf','','0.85','0.34968209368908376') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/25686587

https://www.fotonower.com/image?json=false&list_photos_id=1375304419
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375304417
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375304410
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375304409
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375304383
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375304378
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375304371
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375304362
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375304356
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375304352
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375304338
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375304335
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375304332
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375304328
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375304304
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375304276
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375304055
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375304029
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375303997
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375303956
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375303926
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375303900
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375303868
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375303866
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375303864
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375303861
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375303859
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375303856
La photo est trop floue, merci de reprendre une photo.(avec le score = 3.836375122670119)
https://www.fotonower.com/image?json=false&list_photos_id=1375303844
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375303842
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375303839
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375303835
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375303833
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375303830
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375303665
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375303656
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375303632
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375303578
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 34.97%
Veuillez trouver les photos des contaminants.

exemples de contaminants: papier: https://www.fotonower.com/view/25687228?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/25687229?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/25687234?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/25687236?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/25687238?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25686587_05-08-2025_14_25_12.pdf.

Lien vers velours :https://www.fotonower.com/velours/25687228,25687229,25687230,25687231,25687232,25687233,25687234,25687235,25687236,25687237,25687238?tags=papier,autre,mal_croppe,pet_fonce,background,environnement,carton,flou,metal,pehd,pet_clair.


L'équipe Fotonower 202 b'' Server: nginx Date: Tue, 05 Aug 2025 12:25:22 GMT Content-Length: 0 Connection: close X-Message-Id: ultmOERJTaiK6z7doN9tBA Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1375304419, 1375304417, 1375304410, 1375304409, 1375304383, 1375304378, 1375304371, 1375304362, 1375304356, 1375304352, 1375304338, 1375304335, 1375304332, 1375304328, 1375304304, 1375304276, 1375304055, 1375304029, 1375303997, 1375303956, 1375303926, 1375303900, 1375303868, 1375303866, 1375303864, 1375303861, 1375303859, 1375303856, 1375303844, 1375303842, 1375303839, 1375303835, 1375303833, 1375303830, 1375303665, 1375303656, 1375303632, 1375303578] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304419', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304417', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304410', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304409', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304383', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304378', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304371', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304362', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304356', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304352', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304338', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304335', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304332', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304328', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304304', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304276', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304055', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304029', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303997', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303956', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303926', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303900', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303868', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303866', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303864', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303861', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303859', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303856', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303844', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303842', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303839', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303835', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303833', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303830', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303665', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303656', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303632', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303578', None, None, None, None, None, '3449335') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 38 time used for this insertion : 0.018651962280273438 save_final save missing photos in datou_result : time spend for datou_step_exec : 10.27704668045044 time spend to save output : 0.018980741500854492 total time spend for step 9 : 10.296027421951294 step10:split_time_score Tue Aug 5 14:25:22 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('13', 38),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 05082025 25686587 Nombre de photos uploadées : 38 / 23040 (0%) 05082025 25686587 Nombre de photos taguées (types de déchets): 0 / 38 (0%) 05082025 25686587 Nombre de photos taguées (volume) : 0 / 38 (0%) elapsed_time : load_data_split_time_score 1.1920928955078125e-06 elapsed_time : order_list_meta_photo_and_scores 4.291534423828125e-06 ?????????????????????????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0014111995697021484 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.2217855453491211 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25686583 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25683835 order by id desc limit 1 Qualite : 0.1160300925925926 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25678966_05-08-2025_11_32_55.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25678966 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25678966 AND mptpi.`type`=3594 To do Qualite : 0.08013306166409463 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25678972_05-08-2025_11_21_46.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25678972 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25678972 AND mptpi.`type`=3594 To do Qualite : 0.0701640866126543 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25683843_05-08-2025_13_03_05.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25683843 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25683843 AND mptpi.`type`=3594 To do Qualite : 0.09828667534722223 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25683845_05-08-2025_12_51_35.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25683845 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25683845 AND mptpi.`type`=3594 To do Qualite : 0.04753419978137861 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25683849_05-08-2025_12_41_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25683849 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25683849 AND mptpi.`type`=3594 To do Qualite : 0.122842399691358 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25685870_05-08-2025_13_51_38.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25685870 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25685870 AND mptpi.`type`=3594 To do Qualite : 0.03421862309129305 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25685872_05-08-2025_13_42_05.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25685872 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25685872 AND mptpi.`type`=3594 To do Qualite : 0.34968209368908376 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25686587_05-08-2025_14_25_12.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25686587 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25686587 AND mptpi.`type`=3594 To do Qualite : 0.274069637345679 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25686588_05-08-2025_14_11_58.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25686588 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25686588 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'05082025': {'nb_upload': 38, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1375304419, 1375304417, 1375304410, 1375304409, 1375304383, 1375304378, 1375304371, 1375304362, 1375304356, 1375304352, 1375304338, 1375304335, 1375304332, 1375304328, 1375304304, 1375304276, 1375304055, 1375304029, 1375303997, 1375303956, 1375303926, 1375303900, 1375303868, 1375303866, 1375303864, 1375303861, 1375303859, 1375303856, 1375303844, 1375303842, 1375303839, 1375303835, 1375303833, 1375303830, 1375303665, 1375303656, 1375303632, 1375303578] Looping around the photos to save general results len do output : 1 /25686587Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304419', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304417', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304410', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304409', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304383', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304378', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304371', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304362', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304356', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304352', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304338', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304335', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304332', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304328', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304304', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304276', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304055', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375304029', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303997', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303956', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303926', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303900', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303868', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303866', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303864', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303861', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303859', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303856', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303844', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303842', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303839', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303835', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303833', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303830', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303665', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303656', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303632', None, None, None, None, None, '3449335') ('3318', None, None, None, None, None, None, None, '3449335') ('3318', '25686587', '1375303578', None, None, None, None, None, '3449335') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 39 time used for this insertion : 0.018529653549194336 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.835219383239746 time spend to save output : 0.018932104110717773 total time spend for step 10 : 2.854151487350464 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 38 set_done_treatment 210.84user 48.85system 5:01.56elapsed 86%CPU (0avgtext+0avgdata 3378684maxresident)k 605736inputs+125440outputs (19031major+3523465minor)pagefaults 0swaps