python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1637281 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3547720'] with mtr_portfolio_ids : ['26026725'] and first list_photo_ids : [] new path : /proc/1637281/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 31 ; length of list_pids : 31 ; length of list_args : 31 time to download the photos : 6.059826135635376 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Fri Aug 15 16:50:34 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10174 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-08-15 16:50:37.615934: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-08-15 16:50:37.640603: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3492910000 Hz 2025-08-15 16:50:37.642367: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fb840000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-08-15 16:50:37.642420: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-08-15 16:50:37.645149: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-08-15 16:50:37.790205: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x74e7800 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-08-15 16:50:37.790249: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-08-15 16:50:37.791162: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-15 16:50:37.791469: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-15 16:50:37.793480: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-15 16:50:37.795720: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-15 16:50:37.796077: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-15 16:50:37.798498: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-15 16:50:37.799644: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-15 16:50:37.804294: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-15 16:50:37.805815: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-15 16:50:37.805908: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-15 16:50:37.806686: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-15 16:50:37.806702: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-15 16:50:37.806711: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-15 16:50:37.808079: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9421 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-08-15 16:50:38.106306: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-15 16:50:38.106402: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-15 16:50:38.106430: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-15 16:50:38.106455: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-15 16:50:38.106479: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-15 16:50:38.106503: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-15 16:50:38.106527: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-15 16:50:38.106551: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-15 16:50:38.108618: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-15 16:50:38.109905: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-15 16:50:38.109935: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-15 16:50:38.109951: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-15 16:50:38.109965: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-15 16:50:38.109978: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-15 16:50:38.109992: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-15 16:50:38.110006: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-15 16:50:38.110020: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-15 16:50:38.111271: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-15 16:50:38.111296: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-15 16:50:38.111305: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-15 16:50:38.111313: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-15 16:50:38.112621: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9421 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-08-15 16:50:45.750316: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-15 16:50:45.956649: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 31 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 21.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 22.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 23.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 23.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 33.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 21.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 21.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 33.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 Detection mask done ! Trying to reset tf kernel 1637460 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 4086 tf kernel not reseted sub process len(results) : 31 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 31 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 4885 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0003414154052734375 nb_pixel_total : 13478 time to create 1 rle with old method : 0.015553474426269531 length of segment : 195 time for calcul the mask position with numpy : 0.0015823841094970703 nb_pixel_total : 91254 time to create 1 rle with old method : 0.1068108081817627 length of segment : 486 time for calcul the mask position with numpy : 0.00014972686767578125 nb_pixel_total : 6233 time to create 1 rle with old method : 0.007401943206787109 length of segment : 94 time for calcul the mask position with numpy : 0.00022745132446289062 nb_pixel_total : 14706 time to create 1 rle with old method : 0.016919851303100586 length of segment : 116 time for calcul the mask position with numpy : 0.0015118122100830078 nb_pixel_total : 109989 time to create 1 rle with old method : 0.12384366989135742 length of segment : 521 time for calcul the mask position with numpy : 0.0002334117889404297 nb_pixel_total : 11372 time to create 1 rle with old method : 0.013327836990356445 length of segment : 186 time for calcul the mask position with numpy : 0.0003628730773925781 nb_pixel_total : 20636 time to create 1 rle with old method : 0.024056434631347656 length of segment : 177 time for calcul the mask position with numpy : 7.081031799316406e-05 nb_pixel_total : 2358 time to create 1 rle with old method : 0.0028939247131347656 length of segment : 46 time for calcul the mask position with numpy : 0.00011181831359863281 nb_pixel_total : 3935 time to create 1 rle with old method : 0.004746198654174805 length of segment : 95 time for calcul the mask position with numpy : 0.0027446746826171875 nb_pixel_total : 104126 time to create 1 rle with old method : 0.1175241470336914 length of segment : 515 time for calcul the mask position with numpy : 0.00032591819763183594 nb_pixel_total : 14992 time to create 1 rle with old method : 0.017400026321411133 length of segment : 200 time for calcul the mask position with numpy : 0.00019168853759765625 nb_pixel_total : 8576 time to create 1 rle with old method : 0.009565591812133789 length of segment : 146 time for calcul the mask position with numpy : 0.016222000122070312 nb_pixel_total : 733012 time to create 1 rle with new method : 0.03147768974304199 length of segment : 908 time for calcul the mask position with numpy : 0.00030350685119628906 nb_pixel_total : 11583 time to create 1 rle with old method : 0.012760639190673828 length of segment : 183 time for calcul the mask position with numpy : 0.011759519577026367 nb_pixel_total : 755890 time to create 1 rle with new method : 0.02484273910522461 length of segment : 981 time for calcul the mask position with numpy : 0.0004322528839111328 nb_pixel_total : 15776 time to create 1 rle with old method : 0.01798272132873535 length of segment : 160 time for calcul the mask position with numpy : 0.00015592575073242188 nb_pixel_total : 5589 time to create 1 rle with old method : 0.006552696228027344 length of segment : 37 time for calcul the mask position with numpy : 0.009770870208740234 nb_pixel_total : 586613 time to create 1 rle with new method : 0.01739811897277832 length of segment : 1510 time for calcul the mask position with numpy : 0.0007197856903076172 nb_pixel_total : 30768 time to create 1 rle with old method : 0.03357720375061035 length of segment : 171 time for calcul the mask position with numpy : 0.0002942085266113281 nb_pixel_total : 14180 time to create 1 rle with old method : 0.015922069549560547 length of segment : 136 time for calcul the mask position with numpy : 0.002899646759033203 nb_pixel_total : 89256 time to create 1 rle with old method : 0.09731030464172363 length of segment : 528 time for calcul the mask position with numpy : 0.0002498626708984375 nb_pixel_total : 4699 time to create 1 rle with old method : 0.005602598190307617 length of segment : 120 time for calcul the mask position with numpy : 0.011661291122436523 nb_pixel_total : 594738 time to create 1 rle with new method : 0.018625497817993164 length of segment : 1173 time for calcul the mask position with numpy : 0.0004954338073730469 nb_pixel_total : 10709 time to create 1 rle with old method : 0.014764785766601562 length of segment : 181 time for calcul the mask position with numpy : 0.0009737014770507812 nb_pixel_total : 36389 time to create 1 rle with old method : 0.04378962516784668 length of segment : 278 time for calcul the mask position with numpy : 0.0038678646087646484 nb_pixel_total : 122866 time to create 1 rle with old method : 0.1476285457611084 length of segment : 556 time for calcul the mask position with numpy : 0.0002651214599609375 nb_pixel_total : 5273 time to create 1 rle with old method : 0.006176948547363281 length of segment : 89 time for calcul the mask position with numpy : 0.0001666545867919922 nb_pixel_total : 4275 time to create 1 rle with old method : 0.0050601959228515625 length of segment : 106 time for calcul the mask position with numpy : 0.0012552738189697266 nb_pixel_total : 49541 time to create 1 rle with old method : 0.06071877479553223 length of segment : 451 time for calcul the mask position with numpy : 0.00032520294189453125 nb_pixel_total : 9360 time to create 1 rle with old method : 0.01099252700805664 length of segment : 86 time for calcul the mask position with numpy : 0.002277374267578125 nb_pixel_total : 98042 time to create 1 rle with old method : 0.11132025718688965 length of segment : 708 time for calcul the mask position with numpy : 0.00036525726318359375 nb_pixel_total : 7098 time to create 1 rle with old method : 0.00828862190246582 length of segment : 146 time for calcul the mask position with numpy : 0.00018644332885742188 nb_pixel_total : 3648 time to create 1 rle with old method : 0.004515886306762695 length of segment : 60 time for calcul the mask position with numpy : 0.017963171005249023 nb_pixel_total : 736416 time to create 1 rle with new method : 0.028028011322021484 length of segment : 931 time for calcul the mask position with numpy : 0.0004832744598388672 nb_pixel_total : 15254 time to create 1 rle with old method : 0.01776885986328125 length of segment : 157 time for calcul the mask position with numpy : 0.0028412342071533203 nb_pixel_total : 97133 time to create 1 rle with old method : 0.1084451675415039 length of segment : 542 time for calcul the mask position with numpy : 0.0005605220794677734 nb_pixel_total : 10466 time to create 1 rle with old method : 0.012096405029296875 length of segment : 177 time for calcul the mask position with numpy : 0.00034499168395996094 nb_pixel_total : 10842 time to create 1 rle with old method : 0.013056278228759766 length of segment : 108 time for calcul the mask position with numpy : 0.00031256675720214844 nb_pixel_total : 7209 time to create 1 rle with old method : 0.008481025695800781 length of segment : 120 time for calcul the mask position with numpy : 0.0025815963745117188 nb_pixel_total : 117294 time to create 1 rle with old method : 0.1320056915283203 length of segment : 547 time for calcul the mask position with numpy : 0.01878643035888672 nb_pixel_total : 808757 time to create 1 rle with new method : 0.026787757873535156 length of segment : 1128 time for calcul the mask position with numpy : 0.0002727508544921875 nb_pixel_total : 17116 time to create 1 rle with old method : 0.018674850463867188 length of segment : 206 time for calcul the mask position with numpy : 0.00030493736267089844 nb_pixel_total : 10078 time to create 1 rle with old method : 0.010795116424560547 length of segment : 177 time for calcul the mask position with numpy : 0.00015544891357421875 nb_pixel_total : 4219 time to create 1 rle with old method : 0.00469660758972168 length of segment : 69 time for calcul the mask position with numpy : 0.0002808570861816406 nb_pixel_total : 5942 time to create 1 rle with old method : 0.00642085075378418 length of segment : 126 time for calcul the mask position with numpy : 0.0003075599670410156 nb_pixel_total : 6411 time to create 1 rle with old method : 0.007145881652832031 length of segment : 168 time for calcul the mask position with numpy : 0.018190860748291016 nb_pixel_total : 1089403 time to create 1 rle with new method : 0.027864933013916016 length of segment : 1888 time for calcul the mask position with numpy : 0.0007462501525878906 nb_pixel_total : 19876 time to create 1 rle with old method : 0.021880388259887695 length of segment : 238 time for calcul the mask position with numpy : 0.002215862274169922 nb_pixel_total : 93136 time to create 1 rle with old method : 0.10441756248474121 length of segment : 498 time for calcul the mask position with numpy : 0.00026345252990722656 nb_pixel_total : 7448 time to create 1 rle with old method : 0.008770465850830078 length of segment : 77 time for calcul the mask position with numpy : 0.00042819976806640625 nb_pixel_total : 10451 time to create 1 rle with old method : 0.012189626693725586 length of segment : 179 time for calcul the mask position with numpy : 0.0002872943878173828 nb_pixel_total : 7218 time to create 1 rle with old method : 0.008514642715454102 length of segment : 115 time for calcul the mask position with numpy : 0.00021529197692871094 nb_pixel_total : 6157 time to create 1 rle with old method : 0.007231950759887695 length of segment : 84 time for calcul the mask position with numpy : 0.00043964385986328125 nb_pixel_total : 9954 time to create 1 rle with old method : 0.011005878448486328 length of segment : 172 time for calcul the mask position with numpy : 0.0004968643188476562 nb_pixel_total : 17188 time to create 1 rle with old method : 0.019631147384643555 length of segment : 150 time for calcul the mask position with numpy : 0.011863470077514648 nb_pixel_total : 659840 time to create 1 rle with new method : 0.021904468536376953 length of segment : 1019 time for calcul the mask position with numpy : 0.0005056858062744141 nb_pixel_total : 11414 time to create 1 rle with old method : 0.02039361000061035 length of segment : 181 time for calcul the mask position with numpy : 0.00045680999755859375 nb_pixel_total : 10037 time to create 1 rle with old method : 0.011702299118041992 length of segment : 168 time for calcul the mask position with numpy : 0.00044608116149902344 nb_pixel_total : 12126 time to create 1 rle with old method : 0.013831853866577148 length of segment : 184 time for calcul the mask position with numpy : 0.013259410858154297 nb_pixel_total : 736926 time to create 1 rle with new method : 0.023404359817504883 length of segment : 922 time for calcul the mask position with numpy : 0.011838436126708984 nb_pixel_total : 753607 time to create 1 rle with new method : 0.018440961837768555 length of segment : 991 time for calcul the mask position with numpy : 0.0007302761077880859 nb_pixel_total : 26488 time to create 1 rle with old method : 0.03029608726501465 length of segment : 255 time for calcul the mask position with numpy : 0.0004494190216064453 nb_pixel_total : 13983 time to create 1 rle with old method : 0.01655268669128418 length of segment : 123 time for calcul the mask position with numpy : 0.00011539459228515625 nb_pixel_total : 1799 time to create 1 rle with old method : 0.0022306442260742188 length of segment : 46 time for calcul the mask position with numpy : 0.0004012584686279297 nb_pixel_total : 15327 time to create 1 rle with old method : 0.01804494857788086 length of segment : 102 time for calcul the mask position with numpy : 0.0012352466583251953 nb_pixel_total : 62217 time to create 1 rle with old method : 0.07093548774719238 length of segment : 292 time for calcul the mask position with numpy : 0.0004980564117431641 nb_pixel_total : 10206 time to create 1 rle with old method : 0.012003660202026367 length of segment : 183 time for calcul the mask position with numpy : 0.0007312297821044922 nb_pixel_total : 28325 time to create 1 rle with old method : 0.03314852714538574 length of segment : 182 time for calcul the mask position with numpy : 0.00042128562927246094 nb_pixel_total : 10615 time to create 1 rle with old method : 0.012197494506835938 length of segment : 224 time for calcul the mask position with numpy : 0.0005300045013427734 nb_pixel_total : 14311 time to create 1 rle with old method : 0.01690387725830078 length of segment : 145 time for calcul the mask position with numpy : 0.0024836063385009766 nb_pixel_total : 102729 time to create 1 rle with old method : 0.11557292938232422 length of segment : 547 time for calcul the mask position with numpy : 0.01208806037902832 nb_pixel_total : 749593 time to create 1 rle with new method : 0.017067432403564453 length of segment : 925 time for calcul the mask position with numpy : 0.00011086463928222656 nb_pixel_total : 2738 time to create 1 rle with old method : 0.0033953189849853516 length of segment : 43 time for calcul the mask position with numpy : 0.0004863739013671875 nb_pixel_total : 10174 time to create 1 rle with old method : 0.016999244689941406 length of segment : 176 time for calcul the mask position with numpy : 0.00017786026000976562 nb_pixel_total : 4592 time to create 1 rle with old method : 0.005473613739013672 length of segment : 77 time for calcul the mask position with numpy : 0.000213623046875 nb_pixel_total : 6681 time to create 1 rle with old method : 0.007775545120239258 length of segment : 83 time for calcul the mask position with numpy : 0.002309083938598633 nb_pixel_total : 102380 time to create 1 rle with old method : 0.1138455867767334 length of segment : 617 time for calcul the mask position with numpy : 0.012156248092651367 nb_pixel_total : 748167 time to create 1 rle with new method : 0.01936054229736328 length of segment : 1004 time for calcul the mask position with numpy : 0.011984825134277344 nb_pixel_total : 710597 time to create 1 rle with new method : 0.018063068389892578 length of segment : 981 time spent for convertir_results : 6.494970798492432 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 79 chid ids of type : 3594 Number RLEs to save : 28672 save missing photos in datou_result : time spend for datou_step_exec : 30.75803852081299 time spend to save output : 1.620952844619751 total time spend for step 1 : 32.37899136543274 step2:crop_condition Fri Aug 15 16:51:07 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 31 ! batch 1 Loaded 79 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 19 About to insert : list_path_to_insert length 19 new photo from crops ! About to upload 19 photos upload in portfolio : 3736932 init cache_photo without model_param we have 19 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1755269469_1637281 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 19 photos in the portfolio 3736932 time of upload the photos Elapsed time : 6.039738655090332 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 11 About to insert : list_path_to_insert length 11 new photo from crops ! About to upload 11 photos upload in portfolio : 3736932 init cache_photo without model_param we have 11 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1755269476_1637281 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 11 photos in the portfolio 3736932 time of upload the photos Elapsed time : 3.5836966037750244 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1755269480_1637281 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.9974744319915771 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 47 About to insert : list_path_to_insert length 47 new photo from crops ! About to upload 47 photos upload in portfolio : 3736932 init cache_photo without model_param we have 47 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1755269526_1637281 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 47 photos in the portfolio 3736932 time of upload the photos Elapsed time : 16.113062143325806 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1377308862, 1377308859, 1377308788, 1377308755, 1377308744, 1377308742, 1377308670, 1377308577, 1377308441, 1377308439, 1377308438, 1377308435, 1377308432, 1377308428, 1377307864, 1377307769, 1377307682, 1377307580, 1377307494, 1377307406, 1377307401, 1377307399, 1377307397, 1377307394, 1377307391, 1377307388, 1377307378, 1377307375, 1377307373, 1377307369, 1377307366] Looping around the photos to save general results len do output : 79 /1377333963Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377333964Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377333965Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377333966Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377333967Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377333968Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377333969Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377333970Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377333971Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377333972Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377333973Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377333974Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377333975Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377333976Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377333977Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377333978Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377333979Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377333980Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377333981Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377333983Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377333984Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377333985Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377333986Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377333987Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377333988Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377333989Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377333990Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377333991Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377333992Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377333993Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377333994Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377333995Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377334080Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377334081Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377334082Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377334083Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377334084Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377334085Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377334086Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377334087Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377334088Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377334089Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377334090Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377334091Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377334092Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377334093Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377334094Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377334095Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377334096Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377334097Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377334098Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377334099Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377334100Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377334101Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377334102Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377334103Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377334104Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377334105Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377334106Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377334107Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377334108Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377334110Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377334111Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377334112Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377334113Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377334114Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377334115Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377334116Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377334117Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377334118Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377334119Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377334120Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377334121Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377334122Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377334123Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377334124Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377334125Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377334126Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377334127Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308862', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308859', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308788', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308755', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308744', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308742', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308670', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308577', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308441', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308439', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308438', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308435', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308432', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308428', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307864', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307769', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307682', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307580', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307494', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307406', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307401', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307399', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307397', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307394', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307391', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307388', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307378', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307375', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307373', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307369', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307366', None, None, None, None, None, '3547720') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 268 time used for this insertion : 0.26604175567626953 save_final save missing photos in datou_result : time spend for datou_step_exec : 74.65880846977234 time spend to save output : 0.26907777786254883 total time spend for step 2 : 74.92788624763489 step3:rle_unique_nms_with_priority Fri Aug 15 16:52:22 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 79 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 3 nb_hashtags : 3 time to prepare the origin masks : 0.08742523193359375 time for calcul the mask position with numpy : 0.023764848709106445 nb_pixel_total : 1962635 time to create 1 rle with new method : 0.0414891242980957 time for calcul the mask position with numpy : 0.006436586380004883 nb_pixel_total : 6233 time to create 1 rle with old method : 0.007008075714111328 time for calcul the mask position with numpy : 0.006422519683837891 nb_pixel_total : 91254 time to create 1 rle with old method : 0.09958243370056152 time for calcul the mask position with numpy : 0.006640195846557617 nb_pixel_total : 13478 time to create 1 rle with old method : 0.015056133270263672 create new chi : 0.21118617057800293 time to delete rle : 0.02574896812438965 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2630 TO DO : save crop sub photo not yet done ! save time : 0.17685699462890625 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.035900115966796875 time for calcul the mask position with numpy : 0.025624990463256836 nb_pixel_total : 2058894 time to create 1 rle with new method : 0.03201937675476074 time for calcul the mask position with numpy : 0.006354808807373047 nb_pixel_total : 14706 time to create 1 rle with old method : 0.018595457077026367 create new chi : 0.08373546600341797 time to delete rle : 0.0002467632293701172 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1312 TO DO : save crop sub photo not yet done ! save time : 0.22933578491210938 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.050473690032958984 time for calcul the mask position with numpy : 0.02583479881286621 nb_pixel_total : 1952239 time to create 1 rle with new method : 0.04732084274291992 time for calcul the mask position with numpy : 0.006783246994018555 nb_pixel_total : 11372 time to create 1 rle with old method : 0.014382600784301758 time for calcul the mask position with numpy : 0.0075113773345947266 nb_pixel_total : 109989 time to create 1 rle with old method : 0.13447308540344238 create new chi : 0.24173355102539062 time to delete rle : 0.00036025047302246094 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2494 TO DO : save crop sub photo not yet done ! save time : 0.16761422157287598 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03183245658874512 time for calcul the mask position with numpy : 0.024020910263061523 nb_pixel_total : 2052964 time to create 1 rle with new method : 0.029972076416015625 time for calcul the mask position with numpy : 0.00606083869934082 nb_pixel_total : 20636 time to create 1 rle with old method : 0.02244091033935547 create new chi : 0.08313131332397461 time to delete rle : 0.00027108192443847656 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1434 TO DO : save crop sub photo not yet done ! save time : 0.3343193531036377 nb_obj : 7 nb_hashtags : 4 time to prepare the origin masks : 0.13371682167053223 time for calcul the mask position with numpy : 0.01742386817932129 nb_pixel_total : 1198565 time to create 1 rle with new method : 0.04426288604736328 time for calcul the mask position with numpy : 0.006051540374755859 nb_pixel_total : 8036 time to create 1 rle with old method : 0.009097099304199219 time for calcul the mask position with numpy : 0.016218185424804688 nb_pixel_total : 733012 time to create 1 rle with new method : 0.03700089454650879 time for calcul the mask position with numpy : 0.006386280059814453 nb_pixel_total : 8576 time to create 1 rle with old method : 0.009517431259155273 time for calcul the mask position with numpy : 0.006299734115600586 nb_pixel_total : 14992 time to create 1 rle with old method : 0.016468524932861328 time for calcul the mask position with numpy : 0.006483554840087891 nb_pixel_total : 104126 time to create 1 rle with old method : 0.11357522010803223 time for calcul the mask position with numpy : 0.006126880645751953 nb_pixel_total : 3935 time to create 1 rle with old method : 0.00431370735168457 time for calcul the mask position with numpy : 0.005744218826293945 nb_pixel_total : 2358 time to create 1 rle with old method : 0.0026428699493408203 create new chi : 0.31292152404785156 time to delete rle : 0.0007648468017578125 batch 1 Loaded 15 chid ids of type : 3594 +++++++Number RLEs to save : 5186 TO DO : save crop sub photo not yet done ! save time : 0.5051164627075195 nb_obj : 3 nb_hashtags : 1 time to prepare the origin masks : 0.05634140968322754 time for calcul the mask position with numpy : 0.014578580856323242 nb_pixel_total : 1296345 time to create 1 rle with new method : 0.028041839599609375 time for calcul the mask position with numpy : 0.005928754806518555 nb_pixel_total : 5589 time to create 1 rle with old method : 0.0063097476959228516 time for calcul the mask position with numpy : 0.00621485710144043 nb_pixel_total : 15776 time to create 1 rle with old method : 0.017231225967407227 time for calcul the mask position with numpy : 0.016069412231445312 nb_pixel_total : 755890 time to create 1 rle with new method : 0.02640366554260254 create new chi : 0.12125396728515625 time to delete rle : 0.00032401084899902344 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 3436 TO DO : save crop sub photo not yet done ! save time : 0.2299516201019287 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.08901071548461914 time for calcul the mask position with numpy : 0.02185225486755371 nb_pixel_total : 1486987 time to create 1 rle with new method : 0.03667736053466797 time for calcul the mask position with numpy : 0.012152671813964844 nb_pixel_total : 586613 time to create 1 rle with new method : 0.035185813903808594 create new chi : 0.10648488998413086 time to delete rle : 0.00047087669372558594 batch 1 Loaded 3 chid ids of type : 3594 ++++Number RLEs to save : 4100 TO DO : save crop sub photo not yet done ! save time : 0.5386602878570557 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.07262921333312988 time for calcul the mask position with numpy : 0.03028249740600586 nb_pixel_total : 2028652 time to create 1 rle with new method : 0.048513174057006836 time for calcul the mask position with numpy : 0.0066280364990234375 nb_pixel_total : 14180 time to create 1 rle with old method : 0.023342132568359375 time for calcul the mask position with numpy : 0.0077075958251953125 nb_pixel_total : 30768 time to create 1 rle with old method : 0.050548553466796875 create new chi : 0.17179107666015625 time to delete rle : 0.0009799003601074219 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1694 TO DO : save crop sub photo not yet done ! save time : 0.13777899742126465 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.06217145919799805 time for calcul the mask position with numpy : 0.01950216293334961 nb_pixel_total : 1384907 time to create 1 rle with new method : 0.04389524459838867 time for calcul the mask position with numpy : 0.010270118713378906 nb_pixel_total : 594738 time to create 1 rle with new method : 0.05122709274291992 time for calcul the mask position with numpy : 0.010003805160522461 nb_pixel_total : 4699 time to create 1 rle with old method : 0.014564037322998047 time for calcul the mask position with numpy : 0.010637760162353516 nb_pixel_total : 89256 time to create 1 rle with old method : 0.10045123100280762 create new chi : 0.2676529884338379 time to delete rle : 0.0006997585296630859 batch 1 Loaded 7 chid ids of type : 3594 +++++Number RLEs to save : 4722 TO DO : save crop sub photo not yet done ! save time : 0.3055996894836426 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.039511680603027344 time for calcul the mask position with numpy : 0.019709110260009766 nb_pixel_total : 2026502 time to create 1 rle with new method : 0.03182220458984375 time for calcul the mask position with numpy : 0.007058620452880859 nb_pixel_total : 36389 time to create 1 rle with old method : 0.04408574104309082 time for calcul the mask position with numpy : 0.005990743637084961 nb_pixel_total : 10709 time to create 1 rle with old method : 0.01216745376586914 create new chi : 0.1238863468170166 time to delete rle : 0.00037217140197753906 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1998 TO DO : save crop sub photo not yet done ! save time : 0.14356780052185059 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.07328057289123535 time for calcul the mask position with numpy : 0.03011322021484375 nb_pixel_total : 1941186 time to create 1 rle with new method : 0.04554247856140137 time for calcul the mask position with numpy : 0.0067806243896484375 nb_pixel_total : 4275 time to create 1 rle with old method : 0.004790306091308594 time for calcul the mask position with numpy : 0.006270885467529297 nb_pixel_total : 5273 time to create 1 rle with old method : 0.005978822708129883 time for calcul the mask position with numpy : 0.006777763366699219 nb_pixel_total : 122866 time to create 1 rle with old method : 0.13484692573547363 create new chi : 0.24633145332336426 time to delete rle : 0.00043463706970214844 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2582 TO DO : save crop sub photo not yet done ! save time : 0.1811075210571289 nb_obj : 3 nb_hashtags : 1 time to prepare the origin masks : 0.0530850887298584 time for calcul the mask position with numpy : 0.019544363021850586 nb_pixel_total : 1916657 time to create 1 rle with new method : 0.042304277420043945 time for calcul the mask position with numpy : 0.007508516311645508 nb_pixel_total : 98042 time to create 1 rle with old method : 0.11273932456970215 time for calcul the mask position with numpy : 0.007197141647338867 nb_pixel_total : 9360 time to create 1 rle with old method : 0.01071929931640625 time for calcul the mask position with numpy : 0.006280660629272461 nb_pixel_total : 49541 time to create 1 rle with old method : 0.05626964569091797 create new chi : 0.26758718490600586 time to delete rle : 0.0007696151733398438 batch 1 Loaded 7 chid ids of type : 3594 ++++++Number RLEs to save : 3570 TO DO : save crop sub photo not yet done ! save time : 0.24761152267456055 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.05937790870666504 time for calcul the mask position with numpy : 0.01961684226989746 nb_pixel_total : 1326438 time to create 1 rle with new method : 0.045625925064086914 time for calcul the mask position with numpy : 0.013172626495361328 nb_pixel_total : 736416 time to create 1 rle with new method : 0.04879117012023926 time for calcul the mask position with numpy : 0.005944490432739258 nb_pixel_total : 3648 time to create 1 rle with old method : 0.004794120788574219 time for calcul the mask position with numpy : 0.0064067840576171875 nb_pixel_total : 7098 time to create 1 rle with old method : 0.01250600814819336 create new chi : 0.16234850883483887 time to delete rle : 0.0007371902465820312 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 3354 TO DO : save crop sub photo not yet done ! save time : 0.23676276206970215 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.0491940975189209 time for calcul the mask position with numpy : 0.029918909072875977 nb_pixel_total : 1961213 time to create 1 rle with new method : 0.04577779769897461 time for calcul the mask position with numpy : 0.007021665573120117 nb_pixel_total : 97133 time to create 1 rle with old method : 0.11848592758178711 time for calcul the mask position with numpy : 0.006493330001831055 nb_pixel_total : 15254 time to create 1 rle with old method : 0.01723313331604004 create new chi : 0.2299501895904541 time to delete rle : 0.0004508495330810547 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2478 TO DO : save crop sub photo not yet done ! save time : 0.1808009147644043 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.06917548179626465 time for calcul the mask position with numpy : 0.02382946014404297 nb_pixel_total : 1927789 time to create 1 rle with new method : 0.04561948776245117 time for calcul the mask position with numpy : 0.006870269775390625 nb_pixel_total : 117294 time to create 1 rle with old method : 0.13462352752685547 time for calcul the mask position with numpy : 0.006574153900146484 nb_pixel_total : 7209 time to create 1 rle with old method : 0.008480072021484375 time for calcul the mask position with numpy : 0.007105112075805664 nb_pixel_total : 10842 time to create 1 rle with old method : 0.012473583221435547 time for calcul the mask position with numpy : 0.006506919860839844 nb_pixel_total : 10466 time to create 1 rle with old method : 0.011949777603149414 create new chi : 0.2693018913269043 time to delete rle : 0.0005781650543212891 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 2984 TO DO : save crop sub photo not yet done ! save time : 0.2126452922821045 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.05839180946350098 time for calcul the mask position with numpy : 0.01815032958984375 nb_pixel_total : 1240782 time to create 1 rle with new method : 0.048441171646118164 time for calcul the mask position with numpy : 0.006176471710205078 nb_pixel_total : 8958 time to create 1 rle with old method : 0.01028585433959961 time for calcul the mask position with numpy : 0.006016969680786133 nb_pixel_total : 15103 time to create 1 rle with old method : 0.01882147789001465 time for calcul the mask position with numpy : 0.012179851531982422 nb_pixel_total : 808757 time to create 1 rle with new method : 0.04489946365356445 create new chi : 0.16988468170166016 time to delete rle : 0.0007183551788330078 batch 1 Loaded 7 chid ids of type : 3594 ++++Number RLEs to save : 3908 TO DO : save crop sub photo not yet done ! save time : 0.47991466522216797 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.0671079158782959 time for calcul the mask position with numpy : 0.026778697967529297 nb_pixel_total : 2057028 time to create 1 rle with new method : 0.04561305046081543 time for calcul the mask position with numpy : 0.00630640983581543 nb_pixel_total : 6411 time to create 1 rle with old method : 0.00729823112487793 time for calcul the mask position with numpy : 0.006306171417236328 nb_pixel_total : 5942 time to create 1 rle with old method : 0.006660938262939453 time for calcul the mask position with numpy : 0.006447315216064453 nb_pixel_total : 4219 time to create 1 rle with old method : 0.004756927490234375 create new chi : 0.11584138870239258 time to delete rle : 0.00040435791015625 batch 1 Loaded 7 chid ids of type : 3594 ++++Number RLEs to save : 1806 TO DO : save crop sub photo not yet done ! save time : 0.13644051551818848 nb_obj : 3 nb_hashtags : 1 time to prepare the origin masks : 0.05702495574951172 time for calcul the mask position with numpy : 0.012299776077270508 nb_pixel_total : 871185 time to create 1 rle with new method : 0.03980517387390137 time for calcul the mask position with numpy : 0.006815671920776367 nb_pixel_total : 93136 time to create 1 rle with old method : 0.10497331619262695 time for calcul the mask position with numpy : 0.006128549575805664 nb_pixel_total : 19876 time to create 1 rle with old method : 0.023906469345092773 time for calcul the mask position with numpy : 0.016074657440185547 nb_pixel_total : 1089403 time to create 1 rle with new method : 0.0386052131652832 create new chi : 0.25466060638427734 time to delete rle : 0.0009083747863769531 batch 1 Loaded 7 chid ids of type : 3594 ++++Number RLEs to save : 6328 TO DO : save crop sub photo not yet done ! save time : 0.5199215412139893 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.049103498458862305 time for calcul the mask position with numpy : 0.027038097381591797 nb_pixel_total : 2055701 time to create 1 rle with new method : 0.055441856384277344 time for calcul the mask position with numpy : 0.006184577941894531 nb_pixel_total : 10451 time to create 1 rle with old method : 0.011861562728881836 time for calcul the mask position with numpy : 0.006234407424926758 nb_pixel_total : 7448 time to create 1 rle with old method : 0.008433103561401367 create new chi : 0.1200709342956543 time to delete rle : 0.0004591941833496094 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1592 TO DO : save crop sub photo not yet done ! save time : 0.12903165817260742 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 0.08137893676757812 time for calcul the mask position with numpy : 0.019434690475463867 nb_pixel_total : 1373243 time to create 1 rle with new method : 0.04670095443725586 time for calcul the mask position with numpy : 0.011073112487792969 nb_pixel_total : 659840 time to create 1 rle with new method : 0.03860831260681152 time for calcul the mask position with numpy : 0.006272792816162109 nb_pixel_total : 17188 time to create 1 rle with old method : 0.019321918487548828 time for calcul the mask position with numpy : 0.0061838626861572266 nb_pixel_total : 9954 time to create 1 rle with old method : 0.01109457015991211 time for calcul the mask position with numpy : 0.0066220760345458984 nb_pixel_total : 6157 time to create 1 rle with old method : 0.006960630416870117 time for calcul the mask position with numpy : 0.0061299800872802734 nb_pixel_total : 7218 time to create 1 rle with old method : 0.008144855499267578 create new chi : 0.19195985794067383 time to delete rle : 0.0006537437438964844 batch 1 Loaded 11 chid ids of type : 3594 ++++++Number RLEs to save : 4160 TO DO : save crop sub photo not yet done ! save time : 0.3317906856536865 No data in photo_id : 1377307401 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.044008731842041016 time for calcul the mask position with numpy : 0.02729630470275879 nb_pixel_total : 2052149 time to create 1 rle with new method : 0.04249739646911621 time for calcul the mask position with numpy : 0.0061070919036865234 nb_pixel_total : 10037 time to create 1 rle with old method : 0.011197328567504883 time for calcul the mask position with numpy : 0.0061261653900146484 nb_pixel_total : 11414 time to create 1 rle with old method : 0.012478351593017578 create new chi : 0.10843801498413086 time to delete rle : 0.00034546852111816406 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1778 TO DO : save crop sub photo not yet done ! save time : 0.13117456436157227 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.04704856872558594 time for calcul the mask position with numpy : 0.018821001052856445 nb_pixel_total : 1325197 time to create 1 rle with new method : 0.042960405349731445 time for calcul the mask position with numpy : 0.011382341384887695 nb_pixel_total : 736277 time to create 1 rle with new method : 0.03660225868225098 time for calcul the mask position with numpy : 0.006055355072021484 nb_pixel_total : 12126 time to create 1 rle with old method : 0.013482332229614258 create new chi : 0.1341874599456787 time to delete rle : 0.0005443096160888672 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 3240 TO DO : save crop sub photo not yet done ! save time : 0.6373288631439209 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.037322282791137695 time for calcul the mask position with numpy : 0.015074014663696289 nb_pixel_total : 1319993 time to create 1 rle with new method : 0.042415618896484375 time for calcul the mask position with numpy : 0.011491537094116211 nb_pixel_total : 753607 time to create 1 rle with new method : 0.03145766258239746 create new chi : 0.10504388809204102 time to delete rle : 0.0003066062927246094 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 3062 TO DO : save crop sub photo not yet done ! save time : 0.21023082733154297 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.058359384536743164 time for calcul the mask position with numpy : 0.024220705032348633 nb_pixel_total : 2031330 time to create 1 rle with new method : 0.04577922821044922 time for calcul the mask position with numpy : 0.00623321533203125 nb_pixel_total : 1799 time to create 1 rle with old method : 0.0021696090698242188 time for calcul the mask position with numpy : 0.006181478500366211 nb_pixel_total : 13983 time to create 1 rle with old method : 0.0157010555267334 time for calcul the mask position with numpy : 0.006317615509033203 nb_pixel_total : 26488 time to create 1 rle with old method : 0.03017711639404297 create new chi : 0.14154624938964844 time to delete rle : 0.00044465065002441406 batch 1 Loaded 7 chid ids of type : 3594 ++++Number RLEs to save : 1928 TO DO : save crop sub photo not yet done ! save time : 0.13475298881530762 nb_obj : 6 nb_hashtags : 3 time to prepare the origin masks : 0.10499739646911621 time for calcul the mask position with numpy : 0.024970293045043945 nb_pixel_total : 1932599 time to create 1 rle with new method : 0.04512381553649902 time for calcul the mask position with numpy : 0.007416725158691406 nb_pixel_total : 14311 time to create 1 rle with old method : 0.017736196517944336 time for calcul the mask position with numpy : 0.0063097476959228516 nb_pixel_total : 10615 time to create 1 rle with old method : 0.01185297966003418 time for calcul the mask position with numpy : 0.006307125091552734 nb_pixel_total : 28325 time to create 1 rle with old method : 0.03174161911010742 time for calcul the mask position with numpy : 0.006192207336425781 nb_pixel_total : 10206 time to create 1 rle with old method : 0.011349678039550781 time for calcul the mask position with numpy : 0.006374359130859375 nb_pixel_total : 62217 time to create 1 rle with old method : 0.06918859481811523 time for calcul the mask position with numpy : 0.006186485290527344 nb_pixel_total : 15327 time to create 1 rle with old method : 0.022490739822387695 create new chi : 0.27847766876220703 time to delete rle : 0.0006172657012939453 batch 1 Loaded 13 chid ids of type : 3594 +++++++++Number RLEs to save : 3336 TO DO : save crop sub photo not yet done ! save time : 0.21955156326293945 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.05203747749328613 time for calcul the mask position with numpy : 0.014547348022460938 nb_pixel_total : 1218540 time to create 1 rle with new method : 0.0343928337097168 time for calcul the mask position with numpy : 0.006161689758300781 nb_pixel_total : 2738 time to create 1 rle with old method : 0.0031042098999023438 time for calcul the mask position with numpy : 0.011090993881225586 nb_pixel_total : 749593 time to create 1 rle with new method : 0.028612613677978516 time for calcul the mask position with numpy : 0.006510734558105469 nb_pixel_total : 102729 time to create 1 rle with old method : 0.1345205307006836 create new chi : 0.23956966400146484 time to delete rle : 0.0009374618530273438 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 4110 TO DO : save crop sub photo not yet done ! save time : 0.28279924392700195 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.033286333084106445 time for calcul the mask position with numpy : 0.019299745559692383 nb_pixel_total : 2063426 time to create 1 rle with new method : 0.03019094467163086 time for calcul the mask position with numpy : 0.005991697311401367 nb_pixel_total : 10174 time to create 1 rle with old method : 0.011209964752197266 create new chi : 0.0669240951538086 time to delete rle : 0.0002956390380859375 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1432 TO DO : save crop sub photo not yet done ! save time : 0.11085820198059082 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.040006399154663086 time for calcul the mask position with numpy : 0.02660393714904785 nb_pixel_total : 2069008 time to create 1 rle with new method : 0.04255986213684082 time for calcul the mask position with numpy : 0.006722927093505859 nb_pixel_total : 4592 time to create 1 rle with old method : 0.0053102970123291016 create new chi : 0.08566498756408691 time to delete rle : 0.00026679039001464844 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1234 TO DO : save crop sub photo not yet done ! save time : 0.10844182968139648 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.07410097122192383 time for calcul the mask position with numpy : 0.01862025260925293 nb_pixel_total : 1216372 time to create 1 rle with new method : 0.044335126876831055 time for calcul the mask position with numpy : 0.011376142501831055 nb_pixel_total : 748167 time to create 1 rle with new method : 0.03606605529785156 time for calcul the mask position with numpy : 0.006681680679321289 nb_pixel_total : 102380 time to create 1 rle with old method : 0.11327600479125977 time for calcul the mask position with numpy : 0.00627446174621582 nb_pixel_total : 6681 time to create 1 rle with old method : 0.007677555084228516 create new chi : 0.24896025657653809 time to delete rle : 0.0007901191711425781 batch 1 Loaded 7 chid ids of type : 3594 ++++Number RLEs to save : 4488 TO DO : save crop sub photo not yet done ! save time : 0.27010154724121094 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03740525245666504 time for calcul the mask position with numpy : 0.015593767166137695 nb_pixel_total : 1363003 time to create 1 rle with new method : 0.04166674613952637 time for calcul the mask position with numpy : 0.011596202850341797 nb_pixel_total : 710597 time to create 1 rle with new method : 0.02981710433959961 create new chi : 0.10279250144958496 time to delete rle : 0.0002913475036621094 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 3042 TO DO : save crop sub photo not yet done ! save time : 0.20264935493469238 map_output_result : {1377308862: (0.0, 'Should be the crop_list due to order', 0), 1377308859: (0.0, 'Should be the crop_list due to order', 0), 1377308788: (0.0, 'Should be the crop_list due to order', 0), 1377308755: (0.0, 'Should be the crop_list due to order', 0), 1377308744: (0.0, 'Should be the crop_list due to order', 0), 1377308742: (0.0, 'Should be the crop_list due to order', 0), 1377308670: (0.0, 'Should be the crop_list due to order', 0), 1377308577: (0.0, 'Should be the crop_list due to order', 0), 1377308441: (0.0, 'Should be the crop_list due to order', 0), 1377308439: (0.0, 'Should be the crop_list due to order', 0), 1377308438: (0.0, 'Should be the crop_list due to order', 0), 1377308435: (0.0, 'Should be the crop_list due to order', 0), 1377308432: (0.0, 'Should be the crop_list due to order', 0), 1377308428: (0.0, 'Should be the crop_list due to order', 0), 1377307864: (0.0, 'Should be the crop_list due to order', 0), 1377307769: (0.0, 'Should be the crop_list due to order', 0), 1377307682: (0.0, 'Should be the crop_list due to order', 0), 1377307580: (0.0, 'Should be the crop_list due to order', 0), 1377307494: (0.0, 'Should be the crop_list due to order', 0), 1377307406: (0.0, 'Should be the crop_list due to order', 0), 1377307401: (0.0, 'Should be the crop_list due to order', 0.0), 1377307399: (0.0, 'Should be the crop_list due to order', 0), 1377307397: (0.0, 'Should be the crop_list due to order', 0), 1377307394: (0.0, 'Should be the crop_list due to order', 0), 1377307391: (0.0, 'Should be the crop_list due to order', 0), 1377307388: (0.0, 'Should be the crop_list due to order', 0), 1377307378: (0.0, 'Should be the crop_list due to order', 0), 1377307375: (0.0, 'Should be the crop_list due to order', 0), 1377307373: (0.0, 'Should be the crop_list due to order', 0), 1377307369: (0.0, 'Should be the crop_list due to order', 0), 1377307366: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1377308862, 1377308859, 1377308788, 1377308755, 1377308744, 1377308742, 1377308670, 1377308577, 1377308441, 1377308439, 1377308438, 1377308435, 1377308432, 1377308428, 1377307864, 1377307769, 1377307682, 1377307580, 1377307494, 1377307406, 1377307401, 1377307399, 1377307397, 1377307394, 1377307391, 1377307388, 1377307378, 1377307375, 1377307373, 1377307369, 1377307366] Looping around the photos to save general results len do output : 31 /1377308862.Didn't retrieve data . /1377308859.Didn't retrieve data . /1377308788.Didn't retrieve data . /1377308755.Didn't retrieve data . /1377308744.Didn't retrieve data . /1377308742.Didn't retrieve data . /1377308670.Didn't retrieve data . /1377308577.Didn't retrieve data . /1377308441.Didn't retrieve data . /1377308439.Didn't retrieve data . /1377308438.Didn't retrieve data . /1377308435.Didn't retrieve data . /1377308432.Didn't retrieve data . /1377308428.Didn't retrieve data . /1377307864.Didn't retrieve data . /1377307769.Didn't retrieve data . /1377307682.Didn't retrieve data . /1377307580.Didn't retrieve data . /1377307494.Didn't retrieve data . /1377307406.Didn't retrieve data . /1377307401.Didn't retrieve data . /1377307399.Didn't retrieve data . /1377307397.Didn't retrieve data . /1377307394.Didn't retrieve data . /1377307391.Didn't retrieve data . /1377307388.Didn't retrieve data . /1377307378.Didn't retrieve data . /1377307375.Didn't retrieve data . /1377307373.Didn't retrieve data . /1377307369.Didn't retrieve data . /1377307366.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308862', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308859', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308788', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308755', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308744', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308742', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308670', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308577', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308441', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308439', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308438', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308435', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308432', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308428', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307864', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307769', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307682', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307580', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307494', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307406', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307401', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307399', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307397', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307394', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307391', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307388', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307378', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307375', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307373', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307369', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307366', None, None, None, None, None, '3547720') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 93 time used for this insertion : 0.1627497673034668 save_final save missing photos in datou_result : time spend for datou_step_exec : 15.746389865875244 time spend to save output : 0.1638014316558838 total time spend for step 3 : 15.910191297531128 step4:ventilate_hashtags_in_portfolio Fri Aug 15 16:52:38 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 26026725 get user id for portfolio 26026725 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26026725 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','metal','carton','papier','autre','mal_croppe','flou','background','pet_fonce','pehd','environnement')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26026725 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','metal','carton','papier','autre','mal_croppe','flou','background','pet_fonce','pehd','environnement')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26026725 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','metal','carton','papier','autre','mal_croppe','flou','background','pet_fonce','pehd','environnement')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/26027173,26027174,26027175,26027176,26027177,26027178,26027179,26027180,26027181,26027182,26027183?tags=pet_clair,metal,carton,papier,autre,mal_croppe,flou,background,pet_fonce,pehd,environnement Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1377308862, 1377308859, 1377308788, 1377308755, 1377308744, 1377308742, 1377308670, 1377308577, 1377308441, 1377308439, 1377308438, 1377308435, 1377308432, 1377308428, 1377307864, 1377307769, 1377307682, 1377307580, 1377307494, 1377307406, 1377307401, 1377307399, 1377307397, 1377307394, 1377307391, 1377307388, 1377307378, 1377307375, 1377307373, 1377307369, 1377307366] Looping around the photos to save general results len do output : 1 /26026725. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308862', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308859', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308788', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308755', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308744', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308742', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308670', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308577', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308441', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308439', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308438', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308435', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308432', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308428', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307864', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307769', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307682', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307580', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307494', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307406', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307401', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307399', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307397', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307394', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307391', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307388', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307378', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307375', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307373', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307369', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307366', None, None, None, None, None, '3547720') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 32 time used for this insertion : 0.01868295669555664 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.658036470413208 time spend to save output : 0.01910114288330078 total time spend for step 4 : 1.6771376132965088 step5:final Fri Aug 15 16:52:39 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1377308862: ('0.17884543944145767',), 1377308859: ('0.17884543944145767',), 1377308788: ('0.17884543944145767',), 1377308755: ('0.17884543944145767',), 1377308744: ('0.17884543944145767',), 1377308742: ('0.17884543944145767',), 1377308670: ('0.17884543944145767',), 1377308577: ('0.17884543944145767',), 1377308441: ('0.17884543944145767',), 1377308439: ('0.17884543944145767',), 1377308438: ('0.17884543944145767',), 1377308435: ('0.17884543944145767',), 1377308432: ('0.17884543944145767',), 1377308428: ('0.17884543944145767',), 1377307864: ('0.17884543944145767',), 1377307769: ('0.17884543944145767',), 1377307682: ('0.17884543944145767',), 1377307580: ('0.17884543944145767',), 1377307494: ('0.17884543944145767',), 1377307406: ('0.17884543944145767',), 1377307401: ('0.17884543944145767',), 1377307399: ('0.17884543944145767',), 1377307397: ('0.17884543944145767',), 1377307394: ('0.17884543944145767',), 1377307391: ('0.17884543944145767',), 1377307388: ('0.17884543944145767',), 1377307378: ('0.17884543944145767',), 1377307375: ('0.17884543944145767',), 1377307373: ('0.17884543944145767',), 1377307369: ('0.17884543944145767',), 1377307366: ('0.17884543944145767',)} new output for save of step final : {1377308862: ('0.17884543944145767',), 1377308859: ('0.17884543944145767',), 1377308788: ('0.17884543944145767',), 1377308755: ('0.17884543944145767',), 1377308744: ('0.17884543944145767',), 1377308742: ('0.17884543944145767',), 1377308670: ('0.17884543944145767',), 1377308577: ('0.17884543944145767',), 1377308441: ('0.17884543944145767',), 1377308439: ('0.17884543944145767',), 1377308438: ('0.17884543944145767',), 1377308435: ('0.17884543944145767',), 1377308432: ('0.17884543944145767',), 1377308428: ('0.17884543944145767',), 1377307864: ('0.17884543944145767',), 1377307769: ('0.17884543944145767',), 1377307682: ('0.17884543944145767',), 1377307580: ('0.17884543944145767',), 1377307494: ('0.17884543944145767',), 1377307406: ('0.17884543944145767',), 1377307401: ('0.17884543944145767',), 1377307399: ('0.17884543944145767',), 1377307397: ('0.17884543944145767',), 1377307394: ('0.17884543944145767',), 1377307391: ('0.17884543944145767',), 1377307388: ('0.17884543944145767',), 1377307378: ('0.17884543944145767',), 1377307375: ('0.17884543944145767',), 1377307373: ('0.17884543944145767',), 1377307369: ('0.17884543944145767',), 1377307366: ('0.17884543944145767',)} [1377308862, 1377308859, 1377308788, 1377308755, 1377308744, 1377308742, 1377308670, 1377308577, 1377308441, 1377308439, 1377308438, 1377308435, 1377308432, 1377308428, 1377307864, 1377307769, 1377307682, 1377307580, 1377307494, 1377307406, 1377307401, 1377307399, 1377307397, 1377307394, 1377307391, 1377307388, 1377307378, 1377307375, 1377307373, 1377307369, 1377307366] Looping around the photos to save general results len do output : 31 /1377308862.Didn't retrieve data . /1377308859.Didn't retrieve data . /1377308788.Didn't retrieve data . /1377308755.Didn't retrieve data . /1377308744.Didn't retrieve data . /1377308742.Didn't retrieve data . /1377308670.Didn't retrieve data . /1377308577.Didn't retrieve data . /1377308441.Didn't retrieve data . /1377308439.Didn't retrieve data . /1377308438.Didn't retrieve data . /1377308435.Didn't retrieve data . /1377308432.Didn't retrieve data . /1377308428.Didn't retrieve data . /1377307864.Didn't retrieve data . /1377307769.Didn't retrieve data . /1377307682.Didn't retrieve data . /1377307580.Didn't retrieve data . /1377307494.Didn't retrieve data . /1377307406.Didn't retrieve data . /1377307401.Didn't retrieve data . /1377307399.Didn't retrieve data . /1377307397.Didn't retrieve data . /1377307394.Didn't retrieve data . /1377307391.Didn't retrieve data . /1377307388.Didn't retrieve data . /1377307378.Didn't retrieve data . /1377307375.Didn't retrieve data . /1377307373.Didn't retrieve data . /1377307369.Didn't retrieve data . /1377307366.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308862', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308859', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308788', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308755', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308744', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308742', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308670', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308577', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308441', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308439', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308438', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308435', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308432', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308428', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307864', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307769', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307682', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307580', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307494', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307406', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307401', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307399', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307397', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307394', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307391', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307388', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307378', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307375', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307373', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307369', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307366', None, None, None, None, None, '3547720') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 93 time used for this insertion : 0.016693592071533203 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.12199115753173828 time spend to save output : 0.018042325973510742 total time spend for step 5 : 0.14003348350524902 step6:blur_detection Fri Aug 15 16:52:39 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1755269428_1637281_1377308862_4f4eeeceaea359adfa2556746148c382.jpg resize: (1080, 1920) 1377308862 -2.632836982020182 treat image : temp/1755269428_1637281_1377308859_828e4776041daadaf222a7a486f00cc6.jpg resize: (1080, 1920) 1377308859 -1.8365995350697673 treat image : temp/1755269428_1637281_1377308788_bbac40ea5fb7bba6446c1f5f08e61afb.jpg resize: (1080, 1920) 1377308788 -2.8042692625114825 treat image : temp/1755269428_1637281_1377308755_8aa92d19c8a25c78da39bf0b0be39b53.jpg resize: (1080, 1920) 1377308755 -1.2075087527258719 treat image : temp/1755269428_1637281_1377308744_cb7cd2a74eeb5f5f0a55bcfafac474e1.jpg resize: (1080, 1920) 1377308744 -3.0370804452536873 treat image : temp/1755269428_1637281_1377308742_9cf10ceb806d98574af48da727655098.jpg resize: (1080, 1920) 1377308742 -1.8580505883561802 treat image : temp/1755269428_1637281_1377308670_7bf12c6c958c2f7958ad7997c86da9b6.jpg resize: (1080, 1920) 1377308670 -2.3586262733260175 treat image : temp/1755269428_1637281_1377308577_45b6837f6fc47c61d9e4cc7e727f6573.jpg resize: (1080, 1920) 1377308577 -2.2237457601863393 treat image : temp/1755269428_1637281_1377308441_0ab39a915e02e3c85d84dbcf565ad190.jpg resize: (1080, 1920) 1377308441 -2.0872314462372716 treat image : temp/1755269428_1637281_1377308439_8d3dae596d54341ed9c373f88e05a6bf.jpg resize: (1080, 1920) 1377308439 -2.1976923352323587 treat image : temp/1755269428_1637281_1377308438_5f72c6d049898dfd1ff1490a35d19c87.jpg resize: (1080, 1920) 1377308438 -2.0180284685708 treat image : temp/1755269428_1637281_1377308435_9d687710fff00058903f045e4a0dfa67.jpg resize: (1080, 1920) 1377308435 -2.39068027359153 treat image : temp/1755269428_1637281_1377308432_e39e4fc37bb56a76f811d2afb4bc8300.jpg resize: (1080, 1920) 1377308432 -1.805611458579288 treat image : temp/1755269428_1637281_1377308428_6a1949221c413a6e9a06c0078077e9ac.jpg resize: (1080, 1920) 1377308428 -1.8941490912408008 treat image : temp/1755269428_1637281_1377307864_89f1db67c78e6d6f93a5bfe196c6fcb7.jpg resize: (1080, 1920) 1377307864 -2.3327349824427306 treat image : temp/1755269428_1637281_1377307769_f6ddb94e2aaa6559d8209c091065ca6b.jpg resize: (1080, 1920) 1377307769 -1.9344490776347276 treat image : temp/1755269428_1637281_1377307682_57c0b2ec4a37db1220d1b15f32587844.jpg resize: (1080, 1920) 1377307682 -1.0667846214995345 treat image : temp/1755269428_1637281_1377307580_6ae10e051fb74c54c8147a996068cedc.jpg resize: (1080, 1920) 1377307580 0.8993993694174462 treat image : temp/1755269428_1637281_1377307494_b5b0289f4784800998fe35a2138056dc.jpg resize: (1080, 1920) 1377307494 -2.2512083218650933 treat image : temp/1755269428_1637281_1377307406_80b2aa78e32da2e2571315f3de264c87.jpg resize: (1080, 1920) 1377307406 -2.1143825876793243 treat image : temp/1755269428_1637281_1377307401_44fc9183ada7e89273715bc020c06fa1.jpg resize: (1080, 1920) 1377307401 -2.4293591710932887 treat image : temp/1755269428_1637281_1377307399_ed0b03d19820500ab4e239223a9f8257.jpg resize: (1080, 1920) 1377307399 -2.6693122625268417 treat image : temp/1755269428_1637281_1377307397_5420032b373081c12f0f46ef8e51e254.jpg resize: (1080, 1920) 1377307397 -1.7109556176821168 treat image : temp/1755269428_1637281_1377307394_47954bc4f2e958f435fc6f40f1822d37.jpg resize: (1080, 1920) 1377307394 -2.1619143409799273 treat image : temp/1755269428_1637281_1377307391_1ced5c5314d304db74c1744a93e1a462.jpg resize: (1080, 1920) 1377307391 -1.836791902225818 treat image : temp/1755269428_1637281_1377307388_9b14fd34de1989916282823f6c7d294f.jpg resize: (1080, 1920) 1377307388 -1.905259164517263 treat image : temp/1755269428_1637281_1377307378_b29950021d2a77cb063b269c9a5afcde.jpg resize: (1080, 1920) 1377307378 -1.2903819377364576 treat image : temp/1755269428_1637281_1377307375_7638f6f316a501103e29197d56c060f7.jpg resize: (1080, 1920) 1377307375 -0.6584696319920494 treat image : temp/1755269428_1637281_1377307373_f5ed9a66d5dc25c53211af61131dcbc5.jpg resize: (1080, 1920) 1377307373 -1.6023999122379764 treat image : temp/1755269428_1637281_1377307369_b2e157e6a14c1494211cb74d52efca2c.jpg resize: (1080, 1920) 1377307369 0.319005511392033 treat image : temp/1755269428_1637281_1377307366_d9cef32aaf718287c2b1301e5f05c8c5.jpg resize: (1080, 1920) 1377307366 -3.2284184122331894 treat image : temp/1755269428_1637281_1377308862_4f4eeeceaea359adfa2556746148c382_rle_crop_3917062827_0.png resize: (194, 121) 1377333963 -0.3997303228332087 treat image : temp/1755269428_1637281_1377308788_bbac40ea5fb7bba6446c1f5f08e61afb_rle_crop_3917062832_0.png resize: (185, 111) 1377333964 -0.5326352151745516 treat image : temp/1755269428_1637281_1377308744_cb7cd2a74eeb5f5f0a55bcfafac474e1_rle_crop_3917062838_0.png resize: (146, 88) 1377333965 0.2989170997603097 treat image : temp/1755269428_1637281_1377308441_0ab39a915e02e3c85d84dbcf565ad190_rle_crop_3917062848_0.png resize: (120, 68) 1377333966 -1.8854467441344285 treat image : temp/1755269428_1637281_1377308439_8d3dae596d54341ed9c373f88e05a6bf_rle_crop_3917062850_0.png resize: (181, 115) 1377333967 -1.1871654273220282 treat image : temp/1755269428_1637281_1377308432_e39e4fc37bb56a76f811d2afb4bc8300_rle_crop_3917062858_0.png resize: (145, 55) 1377333968 3.532534797796123 treat image : temp/1755269428_1637281_1377307864_89f1db67c78e6d6f93a5bfe196c6fcb7_rle_crop_3917062863_0.png resize: (176, 104) 1377333969 -0.616407854159053 treat image : temp/1755269428_1637281_1377307864_89f1db67c78e6d6f93a5bfe196c6fcb7_rle_crop_3917062864_0.png resize: (102, 169) 1377333970 -1.9084869623147571 treat image : temp/1755269428_1637281_1377307769_f6ddb94e2aaa6559d8209c091065ca6b_rle_crop_3917062869_0.png resize: (177, 102) 1377333971 -0.8906467529576185 treat image : temp/1755269428_1637281_1377307682_57c0b2ec4a37db1220d1b15f32587844_rle_crop_3917062872_0.png resize: (134, 92) 1377333972 -3.4178208051379517 treat image : temp/1755269428_1637281_1377307494_b5b0289f4784800998fe35a2138056dc_rle_crop_3917062876_0.png resize: (77, 115) 1377333973 4.908423602528926 treat image : temp/1755269428_1637281_1377307494_b5b0289f4784800998fe35a2138056dc_rle_crop_3917062877_0.png resize: (178, 105) 1377333974 -0.45794141845554714 treat image : temp/1755269428_1637281_1377307406_80b2aa78e32da2e2571315f3de264c87_rle_crop_3917062880_0.png resize: (172, 102) 1377333975 -0.5123916569064753 treat image : temp/1755269428_1637281_1377307399_ed0b03d19820500ab4e239223a9f8257_rle_crop_3917062883_0.png resize: (181, 114) 1377333976 -0.5661421980753852 treat image : temp/1755269428_1637281_1377307397_5420032b373081c12f0f46ef8e51e254_rle_crop_3917062885_0.png resize: (184, 122) 1377333977 -0.511751796469571 treat image : temp/1755269428_1637281_1377307388_9b14fd34de1989916282823f6c7d294f_rle_crop_3917062893_0.png resize: (182, 104) 1377333978 -0.8678650078481462 treat image : temp/1755269428_1637281_1377307388_9b14fd34de1989916282823f6c7d294f_rle_crop_3917062895_0.png resize: (224, 65) 1377333979 -1.466274620144152 treat image : temp/1755269428_1637281_1377307375_7638f6f316a501103e29197d56c060f7_rle_crop_3917062900_0.png resize: (175, 105) 1377333980 -0.49974210084513243 treat image : temp/1755269428_1637281_1377307373_f5ed9a66d5dc25c53211af61131dcbc5_rle_crop_3917062901_0.png resize: (77, 87) 1377333981 -1.1850671613377464 treat image : temp/1755269428_1637281_1377308862_4f4eeeceaea359adfa2556746148c382_rle_crop_3917062829_0.png resize: (94, 84) 1377333983 -0.1597996790702025 treat image : temp/1755269428_1637281_1377308755_8aa92d19c8a25c78da39bf0b0be39b53_rle_crop_3917062833_0.png resize: (139, 231) 1377333984 -1.647121024526137 treat image : temp/1755269428_1637281_1377308744_cb7cd2a74eeb5f5f0a55bcfafac474e1_rle_crop_3917062835_0.png resize: (95, 62) 1377333985 -1.3034400906398909 treat image : temp/1755269428_1637281_1377308744_cb7cd2a74eeb5f5f0a55bcfafac474e1_rle_crop_3917062837_0.png resize: (200, 124) 1377333986 -1.9723906556353765 treat image : temp/1755269428_1637281_1377308744_cb7cd2a74eeb5f5f0a55bcfafac474e1_rle_crop_3917062840_0.png resize: (157, 130) 1377333987 -2.108411416329737 treat image : temp/1755269428_1637281_1377308438_5f72c6d049898dfd1ff1490a35d19c87_rle_crop_3917062854_0.png resize: (106, 58) 1377333988 -1.1162345079178253 treat image : temp/1755269428_1637281_1377308428_6a1949221c413a6e9a06c0078077e9ac_rle_crop_3917062861_0.png resize: (156, 177) 1377333989 -1.6553415703663006 treat image : temp/1755269428_1637281_1377307406_80b2aa78e32da2e2571315f3de264c87_rle_crop_3917062878_0.png resize: (115, 86) 1377333990 -0.42156089691579496 treat image : temp/1755269428_1637281_1377307391_1ced5c5314d304db74c1744a93e1a462_rle_crop_3917062890_0.png resize: (46, 45) 1377333991 20.0 treat image : temp/1755269428_1637281_1377307388_9b14fd34de1989916282823f6c7d294f_rle_crop_3917062896_0.png resize: (120, 183) 1377333992 -2.057627118720224 treat image : temp/1755269428_1637281_1377307369_b2e157e6a14c1494211cb74d52efca2c_rle_crop_3917062902_0.png resize: (81, 92) 1377333993 20.0 treat image : temp/1755269428_1637281_1377308744_cb7cd2a74eeb5f5f0a55bcfafac474e1_rle_crop_3917062834_0.png resize: (45, 66) 1377333994 -4.946674633925494 treat image : temp/1755269428_1637281_1377307378_b29950021d2a77cb063b269c9a5afcde_rle_crop_3917062899_0.png resize: (40, 86) 1377333995 -1.1657316471724068 treat image : temp/1755269428_1637281_1377308862_4f4eeeceaea359adfa2556746148c382_rle_crop_3917062828_0.png resize: (468, 339) 1377334080 -0.6489895694777683 treat image : temp/1755269428_1637281_1377308859_828e4776041daadaf222a7a486f00cc6_rle_crop_3917062830_0.png resize: (114, 168) 1377334081 -3.269555368072666 treat image : temp/1755269428_1637281_1377308788_bbac40ea5fb7bba6446c1f5f08e61afb_rle_crop_3917062831_0.png resize: (517, 357) 1377334082 -0.4516239196581091 treat image : temp/1755269428_1637281_1377308744_cb7cd2a74eeb5f5f0a55bcfafac474e1_rle_crop_3917062836_0.png resize: (506, 336) 1377334083 0.11739763050650821 treat image : temp/1755269428_1637281_1377308744_cb7cd2a74eeb5f5f0a55bcfafac474e1_rle_crop_3917062839_0.png resize: (907, 1083) 1377334084 -0.13902016558936264 treat image : temp/1755269428_1637281_1377308742_9cf10ceb806d98574af48da727655098_rle_crop_3917062841_0.png resize: (976, 1055) 1377334085 0.08115837059718736 treat image : temp/1755269428_1637281_1377308742_9cf10ceb806d98574af48da727655098_rle_crop_3917062842_0.png resize: (160, 168) 1377334086 -3.539747319646421 treat image : temp/1755269428_1637281_1377308742_9cf10ceb806d98574af48da727655098_rle_crop_3917062843_0.png resize: (35, 192) 1377334087 -2.8599777818399836 treat image : temp/1755269428_1637281_1377308670_7bf12c6c958c2f7958ad7997c86da9b6_rle_crop_3917062844_0.png resize: (887, 923) 1377334088 -0.7680405218416191 treat image : temp/1755269428_1637281_1377308577_45b6837f6fc47c61d9e4cc7e727f6573_rle_crop_3917062845_0.png resize: (163, 256) 1377334089 -1.245629052886491 treat image : temp/1755269428_1637281_1377308577_45b6837f6fc47c61d9e4cc7e727f6573_rle_crop_3917062846_0.png resize: (135, 141) 1377334090 -1.4020059875251154 treat image : temp/1755269428_1637281_1377308441_0ab39a915e02e3c85d84dbcf565ad190_rle_crop_3917062847_0.png resize: (516, 333) 1377334091 -0.40412167465512167 treat image : temp/1755269428_1637281_1377308441_0ab39a915e02e3c85d84dbcf565ad190_rle_crop_3917062849_0.png resize: (864, 893) 1377334092 -0.0705524932325514 treat image : temp/1755269428_1637281_1377308439_8d3dae596d54341ed9c373f88e05a6bf_rle_crop_3917062851_0.png resize: (277, 221) 1377334093 -1.8978513575395843 treat image : temp/1755269428_1637281_1377308438_5f72c6d049898dfd1ff1490a35d19c87_rle_crop_3917062852_0.png resize: (545, 372) 1377334094 -0.3561833011743416 treat image : temp/1755269428_1637281_1377308438_5f72c6d049898dfd1ff1490a35d19c87_rle_crop_3917062853_0.png resize: (89, 71) 1377334095 -0.7358347058242729 treat image : temp/1755269428_1637281_1377308435_9d687710fff00058903f045e4a0dfa67_rle_crop_3917062855_0.png resize: (368, 212) 1377334096 -2.639269923644107 treat image : temp/1755269428_1637281_1377308435_9d687710fff00058903f045e4a0dfa67_rle_crop_3917062856_0.png resize: (83, 148) 1377334097 -4.620873671660033 treat image : temp/1755269428_1637281_1377308435_9d687710fff00058903f045e4a0dfa67_rle_crop_3917062857_0.png resize: (497, 336) 1377334098 -0.9839469183756069 treat image : temp/1755269428_1637281_1377308432_e39e4fc37bb56a76f811d2afb4bc8300_rle_crop_3917062859_0.png resize: (60, 78) 1377334099 -1.9032857838401895 treat image : temp/1755269428_1637281_1377308432_e39e4fc37bb56a76f811d2afb4bc8300_rle_crop_3917062860_0.png resize: (925, 984) 1377334100 1.1248050737351265 treat image : temp/1755269428_1637281_1377308428_6a1949221c413a6e9a06c0078077e9ac_rle_crop_3917062862_0.png resize: (518, 354) 1377334101 -0.520390128043749 treat image : temp/1755269428_1637281_1377307864_89f1db67c78e6d6f93a5bfe196c6fcb7_rle_crop_3917062865_0.png resize: (118, 83) 1377334102 -3.5969976269138404 treat image : temp/1755269428_1637281_1377307864_89f1db67c78e6d6f93a5bfe196c6fcb7_rle_crop_3917062866_0.png resize: (535, 369) 1377334103 -0.2070594375478501 treat image : temp/1755269428_1637281_1377307769_f6ddb94e2aaa6559d8209c091065ca6b_rle_crop_3917062867_0.png resize: (985, 1167) 1377334104 -0.08267361560320893 treat image : temp/1755269428_1637281_1377307769_f6ddb94e2aaa6559d8209c091065ca6b_rle_crop_3917062868_0.png resize: (206, 105) 1377334105 -1.2284962843774165 treat image : temp/1755269428_1637281_1377307682_57c0b2ec4a37db1220d1b15f32587844_rle_crop_3917062870_0.png resize: (68, 70) 1377334106 -1.3156240166788147 treat image : temp/1755269428_1637281_1377307682_57c0b2ec4a37db1220d1b15f32587844_rle_crop_3917062871_0.png resize: (126, 62) 1377334107 -0.5818564897707115 treat image : temp/1755269428_1637281_1377307580_6ae10e051fb74c54c8147a996068cedc_rle_crop_3917062873_0.png resize: (996, 1308) 1377334108 -0.3818161963091284 treat image : temp/1755269428_1637281_1377307580_6ae10e051fb74c54c8147a996068cedc_rle_crop_3917062874_0.png resize: (238, 183) 1377334110 -2.120255301179098 treat image : temp/1755269428_1637281_1377307580_6ae10e051fb74c54c8147a996068cedc_rle_crop_3917062875_0.png resize: (481, 353) 1377334111 -0.4556599193039959 treat image : temp/1755269428_1637281_1377307406_80b2aa78e32da2e2571315f3de264c87_rle_crop_3917062879_0.png resize: (84, 95) 1377334112 -3.225902815724133 treat image : temp/1755269428_1637281_1377307406_80b2aa78e32da2e2571315f3de264c87_rle_crop_3917062881_0.png resize: (147, 162) 1377334113 -3.4975155923827894 treat image : temp/1755269428_1637281_1377307406_80b2aa78e32da2e2571315f3de264c87_rle_crop_3917062882_0.png resize: (906, 908) 1377334114 0.22453400409573776 treat image : temp/1755269428_1637281_1377307399_ed0b03d19820500ab4e239223a9f8257_rle_crop_3917062884_0.png resize: (168, 86) 1377334115 -2.354760050214454 treat image : temp/1755269428_1637281_1377307397_5420032b373081c12f0f46ef8e51e254_rle_crop_3917062886_0.png resize: (921, 1078) 1377334116 0.04582988368273853 treat image : temp/1755269428_1637281_1377307394_47954bc4f2e958f435fc6f40f1822d37_rle_crop_3917062887_0.png resize: (988, 1025) 1377334117 0.04470947425041959 treat image : temp/1755269428_1637281_1377307391_1ced5c5314d304db74c1744a93e1a462_rle_crop_3917062888_0.png resize: (246, 209) 1377334118 -1.3639579548520935 treat image : temp/1755269428_1637281_1377307391_1ced5c5314d304db74c1744a93e1a462_rle_crop_3917062889_0.png resize: (116, 180) 1377334119 -1.4641195734521886 treat image : temp/1755269428_1637281_1377307388_9b14fd34de1989916282823f6c7d294f_rle_crop_3917062891_0.png resize: (99, 177) 1377334120 -1.244473453175036 treat image : temp/1755269428_1637281_1377307388_9b14fd34de1989916282823f6c7d294f_rle_crop_3917062892_0.png resize: (225, 351) 1377334121 -2.0839293868630926 treat image : temp/1755269428_1637281_1377307388_9b14fd34de1989916282823f6c7d294f_rle_crop_3917062894_0.png resize: (179, 205) 1377334122 -0.0945066542634321 treat image : temp/1755269428_1637281_1377307378_b29950021d2a77cb063b269c9a5afcde_rle_crop_3917062897_0.png resize: (538, 329) 1377334123 -0.23257305716380913 treat image : temp/1755269428_1637281_1377307378_b29950021d2a77cb063b269c9a5afcde_rle_crop_3917062898_0.png resize: (925, 1033) 1377334124 1.188744918737 treat image : temp/1755269428_1637281_1377307369_b2e157e6a14c1494211cb74d52efca2c_rle_crop_3917062903_0.png resize: (562, 320) 1377334125 -0.5044978637471336 treat image : temp/1755269428_1637281_1377307369_b2e157e6a14c1494211cb74d52efca2c_rle_crop_3917062904_0.png resize: (997, 1045) 1377334126 1.5421863815321675 treat image : temp/1755269428_1637281_1377307366_d9cef32aaf718287c2b1301e5f05c8c5_rle_crop_3917062905_0.png resize: (977, 980) 1377334127 0.06286547695521164 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 110 time used for this insertion : 0.017081737518310547 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 110 time used for this insertion : 0.026888132095336914 save missing photos in datou_result : time spend for datou_step_exec : 30.283901691436768 time spend to save output : 0.049779415130615234 total time spend for step 6 : 30.333681106567383 step7:brightness Fri Aug 15 16:53:10 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1755269428_1637281_1377308862_4f4eeeceaea359adfa2556746148c382.jpg treat image : temp/1755269428_1637281_1377308859_828e4776041daadaf222a7a486f00cc6.jpg treat image : temp/1755269428_1637281_1377308788_bbac40ea5fb7bba6446c1f5f08e61afb.jpg treat image : temp/1755269428_1637281_1377308755_8aa92d19c8a25c78da39bf0b0be39b53.jpg treat image : temp/1755269428_1637281_1377308744_cb7cd2a74eeb5f5f0a55bcfafac474e1.jpg treat image : temp/1755269428_1637281_1377308742_9cf10ceb806d98574af48da727655098.jpg treat image : temp/1755269428_1637281_1377308670_7bf12c6c958c2f7958ad7997c86da9b6.jpg treat image : temp/1755269428_1637281_1377308577_45b6837f6fc47c61d9e4cc7e727f6573.jpg treat image : temp/1755269428_1637281_1377308441_0ab39a915e02e3c85d84dbcf565ad190.jpg treat image : temp/1755269428_1637281_1377308439_8d3dae596d54341ed9c373f88e05a6bf.jpg treat image : temp/1755269428_1637281_1377308438_5f72c6d049898dfd1ff1490a35d19c87.jpg treat image : temp/1755269428_1637281_1377308435_9d687710fff00058903f045e4a0dfa67.jpg treat image : temp/1755269428_1637281_1377308432_e39e4fc37bb56a76f811d2afb4bc8300.jpg treat image : temp/1755269428_1637281_1377308428_6a1949221c413a6e9a06c0078077e9ac.jpg treat image : temp/1755269428_1637281_1377307864_89f1db67c78e6d6f93a5bfe196c6fcb7.jpg treat image : temp/1755269428_1637281_1377307769_f6ddb94e2aaa6559d8209c091065ca6b.jpg treat image : temp/1755269428_1637281_1377307682_57c0b2ec4a37db1220d1b15f32587844.jpg treat image : temp/1755269428_1637281_1377307580_6ae10e051fb74c54c8147a996068cedc.jpg treat image : temp/1755269428_1637281_1377307494_b5b0289f4784800998fe35a2138056dc.jpg treat image : temp/1755269428_1637281_1377307406_80b2aa78e32da2e2571315f3de264c87.jpg treat image : temp/1755269428_1637281_1377307401_44fc9183ada7e89273715bc020c06fa1.jpg treat image : temp/1755269428_1637281_1377307399_ed0b03d19820500ab4e239223a9f8257.jpg treat image : temp/1755269428_1637281_1377307397_5420032b373081c12f0f46ef8e51e254.jpg treat image : temp/1755269428_1637281_1377307394_47954bc4f2e958f435fc6f40f1822d37.jpg treat image : temp/1755269428_1637281_1377307391_1ced5c5314d304db74c1744a93e1a462.jpg treat image : temp/1755269428_1637281_1377307388_9b14fd34de1989916282823f6c7d294f.jpg treat image : temp/1755269428_1637281_1377307378_b29950021d2a77cb063b269c9a5afcde.jpg treat image : temp/1755269428_1637281_1377307375_7638f6f316a501103e29197d56c060f7.jpg treat image : temp/1755269428_1637281_1377307373_f5ed9a66d5dc25c53211af61131dcbc5.jpg treat image : temp/1755269428_1637281_1377307369_b2e157e6a14c1494211cb74d52efca2c.jpg treat image : temp/1755269428_1637281_1377307366_d9cef32aaf718287c2b1301e5f05c8c5.jpg treat image : temp/1755269428_1637281_1377308862_4f4eeeceaea359adfa2556746148c382_rle_crop_3917062827_0.png treat image : temp/1755269428_1637281_1377308788_bbac40ea5fb7bba6446c1f5f08e61afb_rle_crop_3917062832_0.png treat image : temp/1755269428_1637281_1377308744_cb7cd2a74eeb5f5f0a55bcfafac474e1_rle_crop_3917062838_0.png treat image : temp/1755269428_1637281_1377308441_0ab39a915e02e3c85d84dbcf565ad190_rle_crop_3917062848_0.png treat image : temp/1755269428_1637281_1377308439_8d3dae596d54341ed9c373f88e05a6bf_rle_crop_3917062850_0.png treat image : temp/1755269428_1637281_1377308432_e39e4fc37bb56a76f811d2afb4bc8300_rle_crop_3917062858_0.png treat image : temp/1755269428_1637281_1377307864_89f1db67c78e6d6f93a5bfe196c6fcb7_rle_crop_3917062863_0.png treat image : temp/1755269428_1637281_1377307864_89f1db67c78e6d6f93a5bfe196c6fcb7_rle_crop_3917062864_0.png treat image : temp/1755269428_1637281_1377307769_f6ddb94e2aaa6559d8209c091065ca6b_rle_crop_3917062869_0.png treat image : temp/1755269428_1637281_1377307682_57c0b2ec4a37db1220d1b15f32587844_rle_crop_3917062872_0.png treat image : temp/1755269428_1637281_1377307494_b5b0289f4784800998fe35a2138056dc_rle_crop_3917062876_0.png treat image : temp/1755269428_1637281_1377307494_b5b0289f4784800998fe35a2138056dc_rle_crop_3917062877_0.png treat image : temp/1755269428_1637281_1377307406_80b2aa78e32da2e2571315f3de264c87_rle_crop_3917062880_0.png treat image : temp/1755269428_1637281_1377307399_ed0b03d19820500ab4e239223a9f8257_rle_crop_3917062883_0.png treat image : temp/1755269428_1637281_1377307397_5420032b373081c12f0f46ef8e51e254_rle_crop_3917062885_0.png treat image : temp/1755269428_1637281_1377307388_9b14fd34de1989916282823f6c7d294f_rle_crop_3917062893_0.png treat image : temp/1755269428_1637281_1377307388_9b14fd34de1989916282823f6c7d294f_rle_crop_3917062895_0.png treat image : temp/1755269428_1637281_1377307375_7638f6f316a501103e29197d56c060f7_rle_crop_3917062900_0.png treat image : temp/1755269428_1637281_1377307373_f5ed9a66d5dc25c53211af61131dcbc5_rle_crop_3917062901_0.png treat image : temp/1755269428_1637281_1377308862_4f4eeeceaea359adfa2556746148c382_rle_crop_3917062829_0.png treat image : temp/1755269428_1637281_1377308755_8aa92d19c8a25c78da39bf0b0be39b53_rle_crop_3917062833_0.png treat image : temp/1755269428_1637281_1377308744_cb7cd2a74eeb5f5f0a55bcfafac474e1_rle_crop_3917062835_0.png treat image : temp/1755269428_1637281_1377308744_cb7cd2a74eeb5f5f0a55bcfafac474e1_rle_crop_3917062837_0.png treat image : temp/1755269428_1637281_1377308744_cb7cd2a74eeb5f5f0a55bcfafac474e1_rle_crop_3917062840_0.png treat image : temp/1755269428_1637281_1377308438_5f72c6d049898dfd1ff1490a35d19c87_rle_crop_3917062854_0.png treat image : temp/1755269428_1637281_1377308428_6a1949221c413a6e9a06c0078077e9ac_rle_crop_3917062861_0.png treat image : temp/1755269428_1637281_1377307406_80b2aa78e32da2e2571315f3de264c87_rle_crop_3917062878_0.png treat image : temp/1755269428_1637281_1377307391_1ced5c5314d304db74c1744a93e1a462_rle_crop_3917062890_0.png treat image : temp/1755269428_1637281_1377307388_9b14fd34de1989916282823f6c7d294f_rle_crop_3917062896_0.png treat image : temp/1755269428_1637281_1377307369_b2e157e6a14c1494211cb74d52efca2c_rle_crop_3917062902_0.png treat image : temp/1755269428_1637281_1377308744_cb7cd2a74eeb5f5f0a55bcfafac474e1_rle_crop_3917062834_0.png treat image : temp/1755269428_1637281_1377307378_b29950021d2a77cb063b269c9a5afcde_rle_crop_3917062899_0.png treat image : temp/1755269428_1637281_1377308862_4f4eeeceaea359adfa2556746148c382_rle_crop_3917062828_0.png treat image : temp/1755269428_1637281_1377308859_828e4776041daadaf222a7a486f00cc6_rle_crop_3917062830_0.png treat image : temp/1755269428_1637281_1377308788_bbac40ea5fb7bba6446c1f5f08e61afb_rle_crop_3917062831_0.png treat image : temp/1755269428_1637281_1377308744_cb7cd2a74eeb5f5f0a55bcfafac474e1_rle_crop_3917062836_0.png treat image : temp/1755269428_1637281_1377308744_cb7cd2a74eeb5f5f0a55bcfafac474e1_rle_crop_3917062839_0.png treat image : temp/1755269428_1637281_1377308742_9cf10ceb806d98574af48da727655098_rle_crop_3917062841_0.png treat image : temp/1755269428_1637281_1377308742_9cf10ceb806d98574af48da727655098_rle_crop_3917062842_0.png treat image : temp/1755269428_1637281_1377308742_9cf10ceb806d98574af48da727655098_rle_crop_3917062843_0.png treat image : temp/1755269428_1637281_1377308670_7bf12c6c958c2f7958ad7997c86da9b6_rle_crop_3917062844_0.png treat image : temp/1755269428_1637281_1377308577_45b6837f6fc47c61d9e4cc7e727f6573_rle_crop_3917062845_0.png treat image : temp/1755269428_1637281_1377308577_45b6837f6fc47c61d9e4cc7e727f6573_rle_crop_3917062846_0.png treat image : temp/1755269428_1637281_1377308441_0ab39a915e02e3c85d84dbcf565ad190_rle_crop_3917062847_0.png treat image : temp/1755269428_1637281_1377308441_0ab39a915e02e3c85d84dbcf565ad190_rle_crop_3917062849_0.png treat image : temp/1755269428_1637281_1377308439_8d3dae596d54341ed9c373f88e05a6bf_rle_crop_3917062851_0.png treat image : temp/1755269428_1637281_1377308438_5f72c6d049898dfd1ff1490a35d19c87_rle_crop_3917062852_0.png treat image : temp/1755269428_1637281_1377308438_5f72c6d049898dfd1ff1490a35d19c87_rle_crop_3917062853_0.png treat image : temp/1755269428_1637281_1377308435_9d687710fff00058903f045e4a0dfa67_rle_crop_3917062855_0.png treat image : temp/1755269428_1637281_1377308435_9d687710fff00058903f045e4a0dfa67_rle_crop_3917062856_0.png treat image : temp/1755269428_1637281_1377308435_9d687710fff00058903f045e4a0dfa67_rle_crop_3917062857_0.png treat image : temp/1755269428_1637281_1377308432_e39e4fc37bb56a76f811d2afb4bc8300_rle_crop_3917062859_0.png treat image : temp/1755269428_1637281_1377308432_e39e4fc37bb56a76f811d2afb4bc8300_rle_crop_3917062860_0.png treat image : temp/1755269428_1637281_1377308428_6a1949221c413a6e9a06c0078077e9ac_rle_crop_3917062862_0.png treat image : temp/1755269428_1637281_1377307864_89f1db67c78e6d6f93a5bfe196c6fcb7_rle_crop_3917062865_0.png treat image : temp/1755269428_1637281_1377307864_89f1db67c78e6d6f93a5bfe196c6fcb7_rle_crop_3917062866_0.png treat image : temp/1755269428_1637281_1377307769_f6ddb94e2aaa6559d8209c091065ca6b_rle_crop_3917062867_0.png treat image : temp/1755269428_1637281_1377307769_f6ddb94e2aaa6559d8209c091065ca6b_rle_crop_3917062868_0.png treat image : temp/1755269428_1637281_1377307682_57c0b2ec4a37db1220d1b15f32587844_rle_crop_3917062870_0.png treat image : temp/1755269428_1637281_1377307682_57c0b2ec4a37db1220d1b15f32587844_rle_crop_3917062871_0.png treat image : temp/1755269428_1637281_1377307580_6ae10e051fb74c54c8147a996068cedc_rle_crop_3917062873_0.png treat image : temp/1755269428_1637281_1377307580_6ae10e051fb74c54c8147a996068cedc_rle_crop_3917062874_0.png treat image : temp/1755269428_1637281_1377307580_6ae10e051fb74c54c8147a996068cedc_rle_crop_3917062875_0.png treat image : temp/1755269428_1637281_1377307406_80b2aa78e32da2e2571315f3de264c87_rle_crop_3917062879_0.png treat image : temp/1755269428_1637281_1377307406_80b2aa78e32da2e2571315f3de264c87_rle_crop_3917062881_0.png treat image : temp/1755269428_1637281_1377307406_80b2aa78e32da2e2571315f3de264c87_rle_crop_3917062882_0.png treat image : temp/1755269428_1637281_1377307399_ed0b03d19820500ab4e239223a9f8257_rle_crop_3917062884_0.png treat image : temp/1755269428_1637281_1377307397_5420032b373081c12f0f46ef8e51e254_rle_crop_3917062886_0.png treat image : temp/1755269428_1637281_1377307394_47954bc4f2e958f435fc6f40f1822d37_rle_crop_3917062887_0.png treat image : temp/1755269428_1637281_1377307391_1ced5c5314d304db74c1744a93e1a462_rle_crop_3917062888_0.png treat image : temp/1755269428_1637281_1377307391_1ced5c5314d304db74c1744a93e1a462_rle_crop_3917062889_0.png treat image : temp/1755269428_1637281_1377307388_9b14fd34de1989916282823f6c7d294f_rle_crop_3917062891_0.png treat image : temp/1755269428_1637281_1377307388_9b14fd34de1989916282823f6c7d294f_rle_crop_3917062892_0.png treat image : temp/1755269428_1637281_1377307388_9b14fd34de1989916282823f6c7d294f_rle_crop_3917062894_0.png treat image : temp/1755269428_1637281_1377307378_b29950021d2a77cb063b269c9a5afcde_rle_crop_3917062897_0.png treat image : temp/1755269428_1637281_1377307378_b29950021d2a77cb063b269c9a5afcde_rle_crop_3917062898_0.png treat image : temp/1755269428_1637281_1377307369_b2e157e6a14c1494211cb74d52efca2c_rle_crop_3917062903_0.png treat image : temp/1755269428_1637281_1377307369_b2e157e6a14c1494211cb74d52efca2c_rle_crop_3917062904_0.png treat image : temp/1755269428_1637281_1377307366_d9cef32aaf718287c2b1301e5f05c8c5_rle_crop_3917062905_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 110 time used for this insertion : 0.018431663513183594 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 110 time used for this insertion : 0.029720306396484375 save missing photos in datou_result : time spend for datou_step_exec : 8.420366525650024 time spend to save output : 0.053568363189697266 total time spend for step 7 : 8.473934888839722 step8:velours_tree Fri Aug 15 16:53:18 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.08398962020874023 time spend to save output : 5.054473876953125e-05 total time spend for step 8 : 0.08404016494750977 step9:send_mail_cod Fri Aug 15 16:53:18 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P26026725_15-08-2025_16_53_18.pdf 26027173 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette260271731755269598 26027174 change filename to text .change filename to text .imagette260271741755269604 26027175 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette260271751755269604 26027176 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette260271761755269604 26027177 imagette260271771755269605 26027178 imagette260271781755269605 26027179 imagette260271791755269605 26027180 imagette260271801755269605 26027181 imagette260271811755269605 26027182 imagette260271821755269605 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=26026725 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/26027173,26027174,26027175,26027176,26027177,26027178,26027179,26027180,26027181,26027182,26027183?tags=pet_clair,metal,carton,papier,autre,mal_croppe,flou,background,pet_fonce,pehd,environnement args[1377308862] : ((1377308862, -2.632836982020182, 492609224), (1377308862, 0.5925181100833883, 2107752395), '0.17884543944145767') We are sending mail with results at report@fotonower.com args[1377308859] : ((1377308859, -1.8365995350697673, 492688767), (1377308859, 0.74492477062231, 2107752395), '0.17884543944145767') We are sending mail with results at report@fotonower.com args[1377308788] : ((1377308788, -2.8042692625114825, 492609224), (1377308788, 0.49101242345775314, 2107752395), '0.17884543944145767') We are sending mail with results at report@fotonower.com args[1377308755] : ((1377308755, -1.2075087527258719, 492688767), (1377308755, 0.41986947562483357, 2107752395), '0.17884543944145767') We are sending mail with results at report@fotonower.com args[1377308744] : ((1377308744, -3.0370804452536873, 492609224), (1377308744, 0.4322466051586863, 2107752395), '0.17884543944145767') We are sending mail with results at report@fotonower.com args[1377308742] : ((1377308742, -1.8580505883561802, 492688767), (1377308742, 0.552457495417194, 2107752395), '0.17884543944145767') We are sending mail with results at report@fotonower.com args[1377308670] : ((1377308670, -2.3586262733260175, 492609224), (1377308670, 0.607175132675732, 2107752395), '0.17884543944145767') We are sending mail with results at report@fotonower.com args[1377308577] : ((1377308577, -2.2237457601863393, 492609224), (1377308577, 0.5456285716005255, 2107752395), '0.17884543944145767') We are sending mail with results at report@fotonower.com args[1377308441] : ((1377308441, -2.0872314462372716, 492609224), (1377308441, 0.6723391675849346, 2107752395), '0.17884543944145767') We are sending mail with results at report@fotonower.com args[1377308439] : ((1377308439, -2.1976923352323587, 492609224), (1377308439, 0.6216744236698448, 2107752395), '0.17884543944145767') We are sending mail with results at report@fotonower.com args[1377308438] : ((1377308438, -2.0180284685708, 492609224), (1377308438, 0.6131337121163828, 2107752395), '0.17884543944145767') We are sending mail with results at report@fotonower.com args[1377308435] : ((1377308435, -2.39068027359153, 492609224), (1377308435, 0.6196370480696558, 2107752395), '0.17884543944145767') We are sending mail with results at report@fotonower.com args[1377308432] : ((1377308432, -1.805611458579288, 492688767), (1377308432, 0.6046735506214166, 2107752395), '0.17884543944145767') We are sending mail with results at report@fotonower.com args[1377308428] : ((1377308428, -1.8941490912408008, 492688767), (1377308428, 0.5413698932186654, 2107752395), '0.17884543944145767') We are sending mail with results at report@fotonower.com args[1377307864] : ((1377307864, -2.3327349824427306, 492609224), (1377307864, 0.6278221705456788, 2107752395), '0.17884543944145767') We are sending mail with results at report@fotonower.com args[1377307769] : ((1377307769, -1.9344490776347276, 492688767), (1377307769, 0.5336011970058503, 2107752395), '0.17884543944145767') We are sending mail with results at report@fotonower.com args[1377307682] : ((1377307682, -1.0667846214995345, 492688767), (1377307682, 0.4225393149732201, 2107752395), '0.17884543944145767') We are sending mail with results at report@fotonower.com args[1377307580] : ((1377307580, 0.8993993694174462, 492688767), (1377307580, 0.4178277491133272, 2107752395), '0.17884543944145767') We are sending mail with results at report@fotonower.com args[1377307494] : ((1377307494, -2.2512083218650933, 492609224), (1377307494, 0.7015755350561702, 2107752395), '0.17884543944145767') We are sending mail with results at report@fotonower.com args[1377307406] : ((1377307406, -2.1143825876793243, 492609224), (1377307406, 0.7193852164255223, 2107752395), '0.17884543944145767') We are sending mail with results at report@fotonower.com args[1377307401] : ((1377307401, -2.4293591710932887, 492609224), (1377307401, 0.632131163617309, 2107752395), '0.17884543944145767') We are sending mail with results at report@fotonower.com args[1377307399] : ((1377307399, -2.6693122625268417, 492609224), (1377307399, 0.5592307088227578, 2107752395), '0.17884543944145767') We are sending mail with results at report@fotonower.com args[1377307397] : ((1377307397, -1.7109556176821168, 492688767), (1377307397, 0.5717506790073079, 2107752395), '0.17884543944145767') We are sending mail with results at report@fotonower.com args[1377307394] : ((1377307394, -2.1619143409799273, 492609224), (1377307394, 0.6207374273324735, 2107752395), '0.17884543944145767') We are sending mail with results at report@fotonower.com args[1377307391] : ((1377307391, -1.836791902225818, 492688767), (1377307391, 0.4786357501904333, 2107752395), '0.17884543944145767') We are sending mail with results at report@fotonower.com args[1377307388] : ((1377307388, -1.905259164517263, 492688767), (1377307388, 0.5399445195414049, 2107752395), '0.17884543944145767') We are sending mail with results at report@fotonower.com args[1377307378] : ((1377307378, -1.2903819377364576, 492688767), (1377307378, 0.5097546902784729, 2107752395), '0.17884543944145767') We are sending mail with results at report@fotonower.com args[1377307375] : ((1377307375, -0.6584696319920494, 492688767), (1377307375, 0.6586305104872893, 2107752395), '0.17884543944145767') We are sending mail with results at report@fotonower.com args[1377307373] : ((1377307373, -1.6023999122379764, 492688767), (1377307373, 0.4948540890890859, 2107752395), '0.17884543944145767') We are sending mail with results at report@fotonower.com args[1377307369] : ((1377307369, 0.319005511392033, 492688767), (1377307369, 0.6940475867765442, 2107752395), '0.17884543944145767') We are sending mail with results at report@fotonower.com args[1377307366] : ((1377307366, -3.2284184122331894, 492609224), (1377307366, 0.802173452397943, 2107752395), '0.17884543944145767') We are sending mail with results at report@fotonower.com refus_total : 0.17884543944145767 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=26026725 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26026725_15-08-2025_16_53_18.pdf results_Auto_P26026725_15-08-2025_16_53_18.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26026725_15-08-2025_16_53_18.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','26026725','results_Auto_P26026725_15-08-2025_16_53_18.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26026725_15-08-2025_16_53_18.pdf','pdf','','0.68','0.17884543944145767') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/26026725

https://www.fotonower.com/image?json=false&list_photos_id=1377308862
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377308859
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377308788
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377308755
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377308744
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377308742
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377308670
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377308577
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377308441
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377308439
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377308438
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377308435
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377308432
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377308428
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377307864
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377307769
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377307682
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377307580
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377307494
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377307406
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377307401
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377307399
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377307397
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377307394
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377307391
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377307388
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377307378
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377307375
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377307373
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377307369
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377307366
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 17.88%
Veuillez trouver les photos des contaminants.

exemples de contaminants: pet_clair: https://www.fotonower.com/view/26027173?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/26027174?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/26027175?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/26027176?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26026725_15-08-2025_16_53_18.pdf.

Lien vers velours :https://www.fotonower.com/velours/26027173,26027174,26027175,26027176,26027177,26027178,26027179,26027180,26027181,26027182,26027183?tags=pet_clair,metal,carton,papier,autre,mal_croppe,flou,background,pet_fonce,pehd,environnement.


L'équipe Fotonower 202 b'' Server: nginx Date: Fri, 15 Aug 2025 14:53:28 GMT Content-Length: 0 Connection: close X-Message-Id: H0BAHJYrTLiBBcoDhgd1_w Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1377308862, 1377308859, 1377308788, 1377308755, 1377308744, 1377308742, 1377308670, 1377308577, 1377308441, 1377308439, 1377308438, 1377308435, 1377308432, 1377308428, 1377307864, 1377307769, 1377307682, 1377307580, 1377307494, 1377307406, 1377307401, 1377307399, 1377307397, 1377307394, 1377307391, 1377307388, 1377307378, 1377307375, 1377307373, 1377307369, 1377307366] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308862', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308859', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308788', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308755', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308744', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308742', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308670', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308577', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308441', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308439', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308438', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308435', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308432', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308428', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307864', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307769', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307682', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307580', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307494', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307406', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307401', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307399', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307397', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307394', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307391', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307388', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307378', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307375', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307373', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307369', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307366', None, None, None, None, None, '3547720') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 31 time used for this insertion : 0.08042430877685547 save_final save missing photos in datou_result : time spend for datou_step_exec : 10.178472757339478 time spend to save output : 0.08087706565856934 total time spend for step 9 : 10.259349822998047 step10:split_time_score Fri Aug 15 16:53:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('15', 31),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 15082025 26026725 Nombre de photos uploadées : 31 / 23040 (0%) 15082025 26026725 Nombre de photos taguées (types de déchets): 0 / 31 (0%) 15082025 26026725 Nombre de photos taguées (volume) : 0 / 31 (0%) elapsed_time : load_data_split_time_score 3.337860107421875e-06 elapsed_time : order_list_meta_photo_and_scores 1.0728836059570312e-05 ??????????????????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0014238357543945312 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.21195173263549805 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.11276655199759945 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26019369_15-08-2025_10_42_01.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26019369 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26019369 AND mptpi.`type`=3594 To do Qualite : 0.05719597387566139 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26022979_15-08-2025_12_31_42.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26022979 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26022979 AND mptpi.`type`=3594 To do Qualite : 0.08927492283950622 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26022984_15-08-2025_12_22_45.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26022984 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26022984 AND mptpi.`type`=3594 To do Qualite : 0.12801908516589508 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26023947_15-08-2025_12_41_30.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26023947 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26023947 AND mptpi.`type`=3594 To do Qualite : 0.037682996498100675 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26026724_15-08-2025_16_41_36.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26026724 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26026724 AND mptpi.`type`=3594 To do Qualite : 0.17884543944145767 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26026725_15-08-2025_16_53_18.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26026725 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26026725 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'15082025': {'nb_upload': 31, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1377308862, 1377308859, 1377308788, 1377308755, 1377308744, 1377308742, 1377308670, 1377308577, 1377308441, 1377308439, 1377308438, 1377308435, 1377308432, 1377308428, 1377307864, 1377307769, 1377307682, 1377307580, 1377307494, 1377307406, 1377307401, 1377307399, 1377307397, 1377307394, 1377307391, 1377307388, 1377307378, 1377307375, 1377307373, 1377307369, 1377307366] Looping around the photos to save general results len do output : 1 /26026725Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308862', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308859', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308788', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308755', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308744', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308742', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308670', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308577', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308441', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308439', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308438', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308435', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308432', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377308428', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307864', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307769', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307682', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307580', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307494', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307406', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307401', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307399', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307397', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307394', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307391', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307388', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307378', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307375', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307373', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307369', None, None, None, None, None, '3547720') ('3318', None, None, None, None, None, None, None, '3547720') ('3318', '26026725', '1377307366', None, None, None, None, None, '3547720') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 32 time used for this insertion : 0.017818927764892578 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.7622897624969482 time spend to save output : 0.018243074417114258 total time spend for step 10 : 0.7805328369140625 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 31 set_done_treatment 121.38user 21.40system 3:03.54elapsed 77%CPU (0avgtext+0avgdata 3253256maxresident)k 507992inputs+66528outputs (11major+1710052minor)pagefaults 0swaps