python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1178464 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3422341'] with mtr_portfolio_ids : ['25584297'] and first list_photo_ids : [] new path : /proc/1178464/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 34 ; length of list_pids : 34 ; length of list_args : 34 time to download the photos : 3.907238483428955 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Fri Aug 1 14:10:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10801 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-08-01 14:10:34.400531: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-08-01 14:10:34.431426: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493035000 Hz 2025-08-01 14:10:34.433332: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f7e94000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-08-01 14:10:34.433386: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-08-01 14:10:34.436210: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-08-01 14:10:34.576081: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x3159e6c0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-08-01 14:10:34.576144: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-08-01 14:10:34.577491: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-01 14:10:34.577948: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-01 14:10:34.580752: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-01 14:10:34.583387: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-01 14:10:34.583888: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-01 14:10:34.586728: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-01 14:10:34.588263: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-01 14:10:34.594294: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-01 14:10:34.596405: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-01 14:10:34.596556: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-01 14:10:34.597610: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-01 14:10:34.597633: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-01 14:10:34.597646: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-01 14:10:34.599527: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10011 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-08-01 14:10:34.908176: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-01 14:10:34.908275: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-01 14:10:34.908303: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-01 14:10:34.908329: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-01 14:10:34.908355: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-01 14:10:34.908378: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-01 14:10:34.908402: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-01 14:10:34.908427: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-01 14:10:34.910629: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-01 14:10:34.912143: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-01 14:10:34.912184: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-01 14:10:34.912200: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-01 14:10:34.912214: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-01 14:10:34.912228: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-01 14:10:34.912242: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-01 14:10:34.912255: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-01 14:10:34.912269: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-01 14:10:34.913569: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-01 14:10:34.913597: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-01 14:10:34.913605: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-01 14:10:34.913613: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-01 14:10:34.914959: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10011 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-08-01 14:10:44.584015: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-01 14:10:44.795815: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 34 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 22.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 15 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 31.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 33.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 32.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 44.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 45.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 38.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 39.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 32.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 34.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 15.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 21.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 37.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 14 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 32.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 22.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 16 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 32.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 32.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 22.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 34.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 35.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 49.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 38.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 15 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 23.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 Detection mask done ! Trying to reset tf kernel 1179155 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 695 tf kernel not reseted sub process len(results) : 34 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 34 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 7177 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0003943443298339844 nb_pixel_total : 13980 time to create 1 rle with old method : 0.017076969146728516 length of segment : 128 time for calcul the mask position with numpy : 0.00013113021850585938 nb_pixel_total : 5527 time to create 1 rle with old method : 0.0070362091064453125 length of segment : 77 time for calcul the mask position with numpy : 0.00015974044799804688 nb_pixel_total : 5645 time to create 1 rle with old method : 0.007139444351196289 length of segment : 79 time for calcul the mask position with numpy : 0.0004105567932128906 nb_pixel_total : 23465 time to create 1 rle with old method : 0.028623342514038086 length of segment : 216 time for calcul the mask position with numpy : 0.00013327598571777344 nb_pixel_total : 3706 time to create 1 rle with old method : 0.004779815673828125 length of segment : 88 time for calcul the mask position with numpy : 0.00024318695068359375 nb_pixel_total : 10371 time to create 1 rle with old method : 0.013365030288696289 length of segment : 128 time for calcul the mask position with numpy : 0.0002512931823730469 nb_pixel_total : 8236 time to create 1 rle with old method : 0.010392189025878906 length of segment : 110 time for calcul the mask position with numpy : 0.00027251243591308594 nb_pixel_total : 5995 time to create 1 rle with old method : 0.01800704002380371 length of segment : 80 time for calcul the mask position with numpy : 0.0005700588226318359 nb_pixel_total : 17458 time to create 1 rle with old method : 0.04296994209289551 length of segment : 133 time for calcul the mask position with numpy : 0.0004341602325439453 nb_pixel_total : 17073 time to create 1 rle with old method : 0.021181821823120117 length of segment : 177 time for calcul the mask position with numpy : 0.0002803802490234375 nb_pixel_total : 13605 time to create 1 rle with old method : 0.016597747802734375 length of segment : 298 time for calcul the mask position with numpy : 0.00035452842712402344 nb_pixel_total : 17664 time to create 1 rle with old method : 0.021779298782348633 length of segment : 164 time for calcul the mask position with numpy : 0.0001125335693359375 nb_pixel_total : 3907 time to create 1 rle with old method : 0.005029916763305664 length of segment : 65 time for calcul the mask position with numpy : 0.000244140625 nb_pixel_total : 12906 time to create 1 rle with old method : 0.015776634216308594 length of segment : 154 time for calcul the mask position with numpy : 0.00010156631469726562 nb_pixel_total : 2661 time to create 1 rle with old method : 0.0035583972930908203 length of segment : 61 time for calcul the mask position with numpy : 0.0002193450927734375 nb_pixel_total : 11587 time to create 1 rle with old method : 0.014510631561279297 length of segment : 140 time for calcul the mask position with numpy : 0.0005955696105957031 nb_pixel_total : 42233 time to create 1 rle with old method : 0.051464080810546875 length of segment : 173 time for calcul the mask position with numpy : 0.1371922492980957 nb_pixel_total : 1039053 time to create 1 rle with new method : 0.06666111946105957 length of segment : 1258 time for calcul the mask position with numpy : 0.00029921531677246094 nb_pixel_total : 16425 time to create 1 rle with old method : 0.01954174041748047 length of segment : 163 time for calcul the mask position with numpy : 0.00037169456481933594 nb_pixel_total : 18301 time to create 1 rle with old method : 0.02189183235168457 length of segment : 208 time for calcul the mask position with numpy : 0.0002899169921875 nb_pixel_total : 21209 time to create 1 rle with old method : 0.02590346336364746 length of segment : 103 time for calcul the mask position with numpy : 0.00021386146545410156 nb_pixel_total : 13505 time to create 1 rle with old method : 0.016383886337280273 length of segment : 150 time for calcul the mask position with numpy : 0.00022482872009277344 nb_pixel_total : 7955 time to create 1 rle with old method : 0.009840011596679688 length of segment : 174 time for calcul the mask position with numpy : 0.00022745132446289062 nb_pixel_total : 9345 time to create 1 rle with old method : 0.011431217193603516 length of segment : 171 time for calcul the mask position with numpy : 8.678436279296875e-05 nb_pixel_total : 2540 time to create 1 rle with old method : 0.0033605098724365234 length of segment : 48 time for calcul the mask position with numpy : 0.00032973289489746094 nb_pixel_total : 21232 time to create 1 rle with old method : 0.025838613510131836 length of segment : 251 time for calcul the mask position with numpy : 0.000255584716796875 nb_pixel_total : 11376 time to create 1 rle with old method : 0.014075994491577148 length of segment : 98 time for calcul the mask position with numpy : 0.00010156631469726562 nb_pixel_total : 3358 time to create 1 rle with old method : 0.0042629241943359375 length of segment : 81 time for calcul the mask position with numpy : 0.00020885467529296875 nb_pixel_total : 11380 time to create 1 rle with old method : 0.014399051666259766 length of segment : 162 time for calcul the mask position with numpy : 0.00010848045349121094 nb_pixel_total : 2868 time to create 1 rle with old method : 0.003802061080932617 length of segment : 70 time for calcul the mask position with numpy : 0.00016307830810546875 nb_pixel_total : 7488 time to create 1 rle with old method : 0.009845733642578125 length of segment : 114 time for calcul the mask position with numpy : 0.0015783309936523438 nb_pixel_total : 96521 time to create 1 rle with old method : 0.11903095245361328 length of segment : 492 time for calcul the mask position with numpy : 0.00021696090698242188 nb_pixel_total : 9871 time to create 1 rle with old method : 0.01216745376586914 length of segment : 167 time for calcul the mask position with numpy : 0.00017118453979492188 nb_pixel_total : 9079 time to create 1 rle with old method : 0.011046648025512695 length of segment : 163 time for calcul the mask position with numpy : 0.0002987384796142578 nb_pixel_total : 16317 time to create 1 rle with old method : 0.01984858512878418 length of segment : 175 time for calcul the mask position with numpy : 0.0002033710479736328 nb_pixel_total : 12197 time to create 1 rle with old method : 0.014863252639770508 length of segment : 140 time for calcul the mask position with numpy : 0.009863853454589844 nb_pixel_total : 751225 time to create 1 rle with new method : 0.021358013153076172 length of segment : 992 time for calcul the mask position with numpy : 0.00029587745666503906 nb_pixel_total : 8608 time to create 1 rle with old method : 0.010339498519897461 length of segment : 90 time for calcul the mask position with numpy : 0.0003199577331542969 nb_pixel_total : 6584 time to create 1 rle with old method : 0.008050918579101562 length of segment : 142 time for calcul the mask position with numpy : 0.0024900436401367188 nb_pixel_total : 93241 time to create 1 rle with old method : 0.10979819297790527 length of segment : 357 time for calcul the mask position with numpy : 0.011473894119262695 nb_pixel_total : 760337 time to create 1 rle with new method : 0.017904281616210938 length of segment : 1014 time for calcul the mask position with numpy : 0.00036978721618652344 nb_pixel_total : 10470 time to create 1 rle with old method : 0.012524604797363281 length of segment : 128 time for calcul the mask position with numpy : 0.00016188621520996094 nb_pixel_total : 4426 time to create 1 rle with old method : 0.005786895751953125 length of segment : 47 time for calcul the mask position with numpy : 0.0003292560577392578 nb_pixel_total : 8292 time to create 1 rle with old method : 0.010052204132080078 length of segment : 129 time for calcul the mask position with numpy : 0.0003154277801513672 nb_pixel_total : 12150 time to create 1 rle with old method : 0.016946792602539062 length of segment : 121 time for calcul the mask position with numpy : 0.00039386749267578125 nb_pixel_total : 12467 time to create 1 rle with old method : 0.01504063606262207 length of segment : 135 time for calcul the mask position with numpy : 0.0002028942108154297 nb_pixel_total : 6751 time to create 1 rle with old method : 0.00866842269897461 length of segment : 54 time for calcul the mask position with numpy : 0.010881662368774414 nb_pixel_total : 681323 time to create 1 rle with new method : 0.015490055084228516 length of segment : 1046 time for calcul the mask position with numpy : 0.00023555755615234375 nb_pixel_total : 12917 time to create 1 rle with old method : 0.015438556671142578 length of segment : 152 time for calcul the mask position with numpy : 8.106231689453125e-05 nb_pixel_total : 2986 time to create 1 rle with old method : 0.003662586212158203 length of segment : 65 time for calcul the mask position with numpy : 0.0011799335479736328 nb_pixel_total : 82961 time to create 1 rle with old method : 0.10303807258605957 length of segment : 284 time for calcul the mask position with numpy : 0.0013802051544189453 nb_pixel_total : 79625 time to create 1 rle with old method : 0.09834146499633789 length of segment : 404 time for calcul the mask position with numpy : 0.000568389892578125 nb_pixel_total : 15274 time to create 1 rle with old method : 0.018427371978759766 length of segment : 202 time for calcul the mask position with numpy : 0.00028443336486816406 nb_pixel_total : 7092 time to create 1 rle with old method : 0.008867502212524414 length of segment : 98 time for calcul the mask position with numpy : 0.0026285648345947266 nb_pixel_total : 91043 time to create 1 rle with old method : 0.10697698593139648 length of segment : 553 time for calcul the mask position with numpy : 0.00011157989501953125 nb_pixel_total : 1311 time to create 1 rle with old method : 0.001766204833984375 length of segment : 36 time for calcul the mask position with numpy : 0.0002319812774658203 nb_pixel_total : 6826 time to create 1 rle with old method : 0.00838780403137207 length of segment : 133 time for calcul the mask position with numpy : 0.0001785755157470703 nb_pixel_total : 8157 time to create 1 rle with old method : 0.010282754898071289 length of segment : 88 time for calcul the mask position with numpy : 0.00032448768615722656 nb_pixel_total : 6249 time to create 1 rle with old method : 0.008361339569091797 length of segment : 129 time for calcul the mask position with numpy : 0.0011515617370605469 nb_pixel_total : 49318 time to create 1 rle with old method : 0.06170964241027832 length of segment : 296 time for calcul the mask position with numpy : 0.0005736351013183594 nb_pixel_total : 14581 time to create 1 rle with old method : 0.017722368240356445 length of segment : 196 time for calcul the mask position with numpy : 0.00021600723266601562 nb_pixel_total : 5447 time to create 1 rle with old method : 0.007032155990600586 length of segment : 90 time for calcul the mask position with numpy : 0.0008599758148193359 nb_pixel_total : 32496 time to create 1 rle with old method : 0.03908944129943848 length of segment : 353 time for calcul the mask position with numpy : 0.0024344921112060547 nb_pixel_total : 102483 time to create 1 rle with old method : 0.129927396774292 length of segment : 515 time for calcul the mask position with numpy : 0.00041484832763671875 nb_pixel_total : 13942 time to create 1 rle with old method : 0.017332077026367188 length of segment : 142 time for calcul the mask position with numpy : 0.00028228759765625 nb_pixel_total : 10927 time to create 1 rle with old method : 0.014466524124145508 length of segment : 72 time for calcul the mask position with numpy : 0.0004458427429199219 nb_pixel_total : 12025 time to create 1 rle with old method : 0.014576196670532227 length of segment : 155 time for calcul the mask position with numpy : 0.00047707557678222656 nb_pixel_total : 14771 time to create 1 rle with old method : 0.02060675621032715 length of segment : 194 time for calcul the mask position with numpy : 0.0002181529998779297 nb_pixel_total : 10342 time to create 1 rle with old method : 0.013082027435302734 length of segment : 101 time for calcul the mask position with numpy : 0.00014162063598632812 nb_pixel_total : 6207 time to create 1 rle with old method : 0.007744789123535156 length of segment : 97 time for calcul the mask position with numpy : 8.511543273925781e-05 nb_pixel_total : 3201 time to create 1 rle with old method : 0.004107952117919922 length of segment : 66 time for calcul the mask position with numpy : 0.00022602081298828125 nb_pixel_total : 14213 time to create 1 rle with old method : 0.01743173599243164 length of segment : 154 time for calcul the mask position with numpy : 0.0008337497711181641 nb_pixel_total : 28402 time to create 1 rle with old method : 0.03537869453430176 length of segment : 269 time for calcul the mask position with numpy : 0.0005700588226318359 nb_pixel_total : 10833 time to create 1 rle with old method : 0.013514041900634766 length of segment : 235 time for calcul the mask position with numpy : 0.0025658607482910156 nb_pixel_total : 105507 time to create 1 rle with old method : 0.13730645179748535 length of segment : 656 time for calcul the mask position with numpy : 0.0004296302795410156 nb_pixel_total : 12344 time to create 1 rle with old method : 0.014734268188476562 length of segment : 133 time for calcul the mask position with numpy : 0.0010936260223388672 nb_pixel_total : 50725 time to create 1 rle with old method : 0.05837655067443848 length of segment : 201 time for calcul the mask position with numpy : 0.0010569095611572266 nb_pixel_total : 35727 time to create 1 rle with old method : 0.03972935676574707 length of segment : 251 time for calcul the mask position with numpy : 0.0006232261657714844 nb_pixel_total : 17998 time to create 1 rle with old method : 0.020479440689086914 length of segment : 144 time for calcul the mask position with numpy : 0.0003921985626220703 nb_pixel_total : 9557 time to create 1 rle with old method : 0.010892152786254883 length of segment : 142 time for calcul the mask position with numpy : 0.0004248619079589844 nb_pixel_total : 19932 time to create 1 rle with old method : 0.022370100021362305 length of segment : 187 time for calcul the mask position with numpy : 0.00032782554626464844 nb_pixel_total : 12681 time to create 1 rle with old method : 0.014850616455078125 length of segment : 125 time for calcul the mask position with numpy : 0.0002238750457763672 nb_pixel_total : 6554 time to create 1 rle with old method : 0.007771492004394531 length of segment : 71 time for calcul the mask position with numpy : 0.00027751922607421875 nb_pixel_total : 8091 time to create 1 rle with old method : 0.009630918502807617 length of segment : 81 time for calcul the mask position with numpy : 0.00023889541625976562 nb_pixel_total : 6335 time to create 1 rle with old method : 0.00735926628112793 length of segment : 95 time for calcul the mask position with numpy : 0.0026483535766601562 nb_pixel_total : 108271 time to create 1 rle with old method : 0.11975789070129395 length of segment : 510 time for calcul the mask position with numpy : 0.0005335807800292969 nb_pixel_total : 21271 time to create 1 rle with old method : 0.024448156356811523 length of segment : 156 time for calcul the mask position with numpy : 0.0005500316619873047 nb_pixel_total : 11547 time to create 1 rle with old method : 0.013032913208007812 length of segment : 225 time for calcul the mask position with numpy : 0.00019478797912597656 nb_pixel_total : 4085 time to create 1 rle with old method : 0.0051097869873046875 length of segment : 73 time for calcul the mask position with numpy : 0.0001735687255859375 nb_pixel_total : 4210 time to create 1 rle with old method : 0.004924774169921875 length of segment : 102 time for calcul the mask position with numpy : 0.00018024444580078125 nb_pixel_total : 6814 time to create 1 rle with old method : 0.008290290832519531 length of segment : 75 time for calcul the mask position with numpy : 0.0004019737243652344 nb_pixel_total : 11681 time to create 1 rle with old method : 0.013365745544433594 length of segment : 132 time for calcul the mask position with numpy : 0.00037479400634765625 nb_pixel_total : 9225 time to create 1 rle with old method : 0.010483026504516602 length of segment : 142 time for calcul the mask position with numpy : 0.0002684593200683594 nb_pixel_total : 5421 time to create 1 rle with old method : 0.00674128532409668 length of segment : 96 time for calcul the mask position with numpy : 0.0002162456512451172 nb_pixel_total : 4887 time to create 1 rle with old method : 0.0056989192962646484 length of segment : 82 time for calcul the mask position with numpy : 0.0004718303680419922 nb_pixel_total : 14269 time to create 1 rle with old method : 0.01625680923461914 length of segment : 181 time for calcul the mask position with numpy : 0.008053064346313477 nb_pixel_total : 237398 time to create 1 rle with new method : 0.023980140686035156 length of segment : 1146 time for calcul the mask position with numpy : 0.0002865791320800781 nb_pixel_total : 12680 time to create 1 rle with old method : 0.01420140266418457 length of segment : 135 time for calcul the mask position with numpy : 0.0005941390991210938 nb_pixel_total : 13980 time to create 1 rle with old method : 0.015535593032836914 length of segment : 138 time for calcul the mask position with numpy : 0.00023698806762695312 nb_pixel_total : 6574 time to create 1 rle with old method : 0.007556438446044922 length of segment : 73 time for calcul the mask position with numpy : 0.0004134178161621094 nb_pixel_total : 10063 time to create 1 rle with old method : 0.011265993118286133 length of segment : 184 time for calcul the mask position with numpy : 0.002448558807373047 nb_pixel_total : 109546 time to create 1 rle with old method : 0.1219935417175293 length of segment : 502 time for calcul the mask position with numpy : 0.0007026195526123047 nb_pixel_total : 36981 time to create 1 rle with old method : 0.043509483337402344 length of segment : 167 time for calcul the mask position with numpy : 0.0001571178436279297 nb_pixel_total : 5317 time to create 1 rle with old method : 0.006422281265258789 length of segment : 93 time for calcul the mask position with numpy : 0.0003082752227783203 nb_pixel_total : 8711 time to create 1 rle with old method : 0.01015925407409668 length of segment : 109 time for calcul the mask position with numpy : 0.00022220611572265625 nb_pixel_total : 5741 time to create 1 rle with old method : 0.0067615509033203125 length of segment : 78 time for calcul the mask position with numpy : 0.0006220340728759766 nb_pixel_total : 19886 time to create 1 rle with old method : 0.022746801376342773 length of segment : 160 time for calcul the mask position with numpy : 0.0003197193145751953 nb_pixel_total : 4986 time to create 1 rle with old method : 0.005835056304931641 length of segment : 82 time for calcul the mask position with numpy : 0.00035643577575683594 nb_pixel_total : 7364 time to create 1 rle with old method : 0.008529901504516602 length of segment : 105 time for calcul the mask position with numpy : 0.00019931793212890625 nb_pixel_total : 4180 time to create 1 rle with old method : 0.004790067672729492 length of segment : 68 time for calcul the mask position with numpy : 0.00045609474182128906 nb_pixel_total : 12220 time to create 1 rle with old method : 0.01383519172668457 length of segment : 143 time for calcul the mask position with numpy : 0.0005695819854736328 nb_pixel_total : 12256 time to create 1 rle with old method : 0.013795614242553711 length of segment : 187 time for calcul the mask position with numpy : 0.0004611015319824219 nb_pixel_total : 13769 time to create 1 rle with old method : 0.015474557876586914 length of segment : 180 time for calcul the mask position with numpy : 0.0003955364227294922 nb_pixel_total : 13217 time to create 1 rle with old method : 0.014923810958862305 length of segment : 143 time spent for convertir_results : 6.161576509475708 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 114 chid ids of type : 3594 Number RLEs to save : 23346 save missing photos in datou_result : time spend for datou_step_exec : 40.65620732307434 time spend to save output : 1.4882981777191162 total time spend for step 1 : 42.14450550079346 step2:crop_condition Fri Aug 1 14:11:13 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 34 ! batch 1 Loaded 114 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 45 About to insert : list_path_to_insert length 45 new photo from crops ! About to upload 45 photos upload in portfolio : 3736932 init cache_photo without model_param we have 45 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1754050277_1178464 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 45 photos in the portfolio 3736932 time of upload the photos Elapsed time : 11.33233642578125 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 17 About to insert : list_path_to_insert length 17 new photo from crops ! About to upload 17 photos upload in portfolio : 3736932 init cache_photo without model_param we have 17 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1754050290_1178464 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 17 photos in the portfolio 3736932 time of upload the photos Elapsed time : 4.363239049911499 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1754050295_1178464 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.1260178089141846 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 38 About to insert : list_path_to_insert length 38 new photo from crops ! About to upload 38 photos upload in portfolio : 3736932 init cache_photo without model_param we have 38 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1754050315_1178464 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 38 photos in the portfolio 3736932 time of upload the photos Elapsed time : 9.79076886177063 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 9 About to insert : list_path_to_insert length 9 new photo from crops ! About to upload 9 photos upload in portfolio : 3736932 init cache_photo without model_param we have 9 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1754050325_1178464 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 9 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.587698459625244 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1754050329_1178464 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.601395845413208 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1754050330_1178464 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.6317026615142822 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1374774101, 1374774098, 1374774095, 1374774077, 1374774075, 1374774072, 1374774069, 1374774067, 1374774065, 1374774051, 1374774048, 1374774044, 1374774041, 1374774039, 1374774037, 1374774027, 1374773998, 1374773992, 1374773989, 1374773973, 1374773955, 1374773889, 1374773863, 1374773833, 1374773803, 1374773776, 1374773751, 1374773611, 1374773608, 1374773603, 1374773599, 1374773596, 1374773593, 1374773566] Looping around the photos to save general results len do output : 114 /1374779125Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779126Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779127Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779128Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779129Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779130Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779131Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779132Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779133Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779134Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779135Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779136Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779137Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779138Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779139Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779141Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779142Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779143Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779144Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779145Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779146Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779147Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779148Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779149Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779150Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779151Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779152Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779153Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779154Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779155Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779156Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779157Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779158Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779159Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779160Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779161Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779162Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779163Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779164Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779165Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779166Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779167Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779168Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779169Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779170Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779173Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779174Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779175Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779177Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779178Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779179Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779180Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779181Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779182Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779183Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779184Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779185Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779186Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779187Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779188Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779189Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779191Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779193Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779194Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779195Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779208Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779209Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779210Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779211Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779212Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779213Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779214Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779215Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779216Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779217Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779218Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779219Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779220Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779221Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779222Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779223Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779224Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779225Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779226Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779227Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779228Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779229Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779230Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779231Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779232Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779233Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779234Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779235Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779236Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779237Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779238Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779239Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779240Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779241Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779242Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779244Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779246Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779248Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779253Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779254Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779255Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779256Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779257Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779258Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779259Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779260Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779261Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779267Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1374779269Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774101', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774098', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774095', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774077', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774075', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774072', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774069', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774067', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774065', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774051', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774048', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774044', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774041', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774039', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774037', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774027', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773998', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773992', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773989', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773973', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773955', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773889', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773863', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773833', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773803', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773776', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773751', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773611', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773608', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773603', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773599', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773596', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773593', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773566', None, None, None, None, None, '3422341') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 376 time used for this insertion : 0.030148029327392578 save_final save missing photos in datou_result : time spend for datou_step_exec : 57.12730622291565 time spend to save output : 0.03481626510620117 total time spend for step 2 : 57.16212248802185 step3:rle_unique_nms_with_priority Fri Aug 1 14:12:11 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 114 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 0.36939096450805664 time for calcul the mask position with numpy : 0.3880183696746826 nb_pixel_total : 2021277 time to create 1 rle with new method : 0.38526296615600586 time for calcul the mask position with numpy : 0.006390571594238281 nb_pixel_total : 3706 time to create 1 rle with old method : 0.004358053207397461 time for calcul the mask position with numpy : 0.007343292236328125 nb_pixel_total : 23465 time to create 1 rle with old method : 0.026529550552368164 time for calcul the mask position with numpy : 0.006000041961669922 nb_pixel_total : 5645 time to create 1 rle with old method : 0.006399631500244141 time for calcul the mask position with numpy : 0.005747079849243164 nb_pixel_total : 5527 time to create 1 rle with old method : 0.006212472915649414 time for calcul the mask position with numpy : 0.006185293197631836 nb_pixel_total : 13980 time to create 1 rle with old method : 0.015602350234985352 create new chi : 0.8733565807342529 time to delete rle : 0.012585639953613281 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 2256 TO DO : save crop sub photo not yet done ! save time : 0.18157434463500977 nb_obj : 8 nb_hashtags : 3 time to prepare the origin masks : 0.4041717052459717 time for calcul the mask position with numpy : 0.07075095176696777 nb_pixel_total : 1979316 time to create 1 rle with new method : 0.825303316116333 time for calcul the mask position with numpy : 0.005861759185791016 nb_pixel_total : 3893 time to create 1 rle with old method : 0.004315376281738281 time for calcul the mask position with numpy : 0.005676746368408203 nb_pixel_total : 17653 time to create 1 rle with old method : 0.019350528717041016 time for calcul the mask position with numpy : 0.006250143051147461 nb_pixel_total : 13605 time to create 1 rle with old method : 0.015484809875488281 time for calcul the mask position with numpy : 0.005723714828491211 nb_pixel_total : 17073 time to create 1 rle with old method : 0.018715620040893555 time for calcul the mask position with numpy : 0.005720615386962891 nb_pixel_total : 17458 time to create 1 rle with old method : 0.018968820571899414 time for calcul the mask position with numpy : 0.005806684494018555 nb_pixel_total : 5995 time to create 1 rle with old method : 0.006469249725341797 time for calcul the mask position with numpy : 0.005955696105957031 nb_pixel_total : 8236 time to create 1 rle with old method : 0.009249687194824219 time for calcul the mask position with numpy : 0.005675792694091797 nb_pixel_total : 10371 time to create 1 rle with old method : 0.01122140884399414 create new chi : 1.055727481842041 time to delete rle : 0.0004811286926269531 batch 1 Loaded 17 chid ids of type : 3594 ++++++++++++Number RLEs to save : 3373 TO DO : save crop sub photo not yet done ! save time : 0.2427537441253662 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.04753255844116211 time for calcul the mask position with numpy : 0.018899202346801758 nb_pixel_total : 2046446 time to create 1 rle with new method : 0.027111530303955078 time for calcul the mask position with numpy : 0.0056993961334228516 nb_pixel_total : 11587 time to create 1 rle with old method : 0.012784957885742188 time for calcul the mask position with numpy : 0.005652666091918945 nb_pixel_total : 2661 time to create 1 rle with old method : 0.0029795169830322266 time for calcul the mask position with numpy : 0.0057332515716552734 nb_pixel_total : 12906 time to create 1 rle with old method : 0.014444589614868164 create new chi : 0.093658447265625 time to delete rle : 0.0002541542053222656 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1790 TO DO : save crop sub photo not yet done ! save time : 0.14254522323608398 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.05100083351135254 time for calcul the mask position with numpy : 0.012413501739501953 nb_pixel_total : 982902 time to create 1 rle with new method : 0.028162479400634766 time for calcul the mask position with numpy : 0.0060503482818603516 nb_pixel_total : 9412 time to create 1 rle with old method : 0.010559797286987305 time for calcul the mask position with numpy : 0.01271510124206543 nb_pixel_total : 1039053 time to create 1 rle with new method : 0.08758306503295898 time for calcul the mask position with numpy : 0.006213188171386719 nb_pixel_total : 42233 time to create 1 rle with old method : 0.04634571075439453 create new chi : 0.21802377700805664 time to delete rle : 0.0005364418029785156 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 4111 TO DO : save crop sub photo not yet done ! save time : 0.25778746604919434 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.04621529579162598 time for calcul the mask position with numpy : 0.01830744743347168 nb_pixel_total : 2020585 time to create 1 rle with new method : 0.226959228515625 time for calcul the mask position with numpy : 0.006176948547363281 nb_pixel_total : 13505 time to create 1 rle with old method : 0.014637470245361328 time for calcul the mask position with numpy : 0.005690336227416992 nb_pixel_total : 21209 time to create 1 rle with old method : 0.022768259048461914 time for calcul the mask position with numpy : 0.0058023929595947266 nb_pixel_total : 18301 time to create 1 rle with old method : 0.019614219665527344 create new chi : 0.32814812660217285 time to delete rle : 0.0002956390380859375 batch 1 Loaded 7 chid ids of type : 3594 ++++Number RLEs to save : 2002 TO DO : save crop sub photo not yet done ! save time : 0.16153359413146973 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03160810470581055 time for calcul the mask position with numpy : 0.018673419952392578 nb_pixel_total : 2065645 time to create 1 rle with new method : 0.2782151699066162 time for calcul the mask position with numpy : 0.005747079849243164 nb_pixel_total : 7955 time to create 1 rle with old method : 0.008828163146972656 create new chi : 0.3116881847381592 time to delete rle : 0.00022912025451660156 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1428 TO DO : save crop sub photo not yet done ! save time : 0.12177801132202148 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.04063892364501953 time for calcul the mask position with numpy : 0.01870584487915039 nb_pixel_total : 2061715 time to create 1 rle with new method : 0.05629920959472656 time for calcul the mask position with numpy : 0.005753755569458008 nb_pixel_total : 2540 time to create 1 rle with old method : 0.002838611602783203 time for calcul the mask position with numpy : 0.005747556686401367 nb_pixel_total : 9345 time to create 1 rle with old method : 0.010307073593139648 create new chi : 0.09991836547851562 time to delete rle : 0.0002410411834716797 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1518 TO DO : save crop sub photo not yet done ! save time : 0.13914155960083008 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.04447221755981445 time for calcul the mask position with numpy : 0.01917719841003418 nb_pixel_total : 2040992 time to create 1 rle with new method : 0.028613805770874023 time for calcul the mask position with numpy : 0.006105899810791016 nb_pixel_total : 11376 time to create 1 rle with old method : 0.01313924789428711 time for calcul the mask position with numpy : 0.006103992462158203 nb_pixel_total : 21232 time to create 1 rle with old method : 0.024408340454101562 create new chi : 0.09783792495727539 time to delete rle : 0.0002925395965576172 batch 1 Loaded 5 chid ids of type : 3594 ++++Number RLEs to save : 1778 TO DO : save crop sub photo not yet done ! save time : 0.1627485752105713 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.04170560836791992 time for calcul the mask position with numpy : 0.018695354461669922 nb_pixel_total : 2058862 time to create 1 rle with new method : 0.027385234832763672 time for calcul the mask position with numpy : 0.005934238433837891 nb_pixel_total : 11380 time to create 1 rle with old method : 0.012959003448486328 time for calcul the mask position with numpy : 0.00574946403503418 nb_pixel_total : 3358 time to create 1 rle with old method : 0.0038154125213623047 create new chi : 0.07483792304992676 time to delete rle : 0.00025582313537597656 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1566 TO DO : save crop sub photo not yet done ! save time : 0.14639496803283691 nb_obj : 6 nb_hashtags : 4 time to prepare the origin masks : 0.09782624244689941 time for calcul the mask position with numpy : 0.259183406829834 nb_pixel_total : 1931456 time to create 1 rle with new method : 0.32848501205444336 time for calcul the mask position with numpy : 0.006151676177978516 nb_pixel_total : 16317 time to create 1 rle with old method : 0.018547773361206055 time for calcul the mask position with numpy : 0.005963325500488281 nb_pixel_total : 9079 time to create 1 rle with old method : 0.010158777236938477 time for calcul the mask position with numpy : 0.005823373794555664 nb_pixel_total : 9871 time to create 1 rle with old method : 0.011744976043701172 time for calcul the mask position with numpy : 0.0078046321868896484 nb_pixel_total : 96521 time to create 1 rle with old method : 0.10813641548156738 time for calcul the mask position with numpy : 0.006357431411743164 nb_pixel_total : 7488 time to create 1 rle with old method : 0.008412599563598633 time for calcul the mask position with numpy : 0.005956172943115234 nb_pixel_total : 2868 time to create 1 rle with old method : 0.003410816192626953 create new chi : 0.7957384586334229 time to delete rle : 0.00047326087951660156 batch 1 Loaded 13 chid ids of type : 3594 +++++++++++Number RLEs to save : 3442 TO DO : save crop sub photo not yet done ! save time : 0.24316167831420898 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.04399466514587402 time for calcul the mask position with numpy : 0.017484426498413086 nb_pixel_total : 1310698 time to create 1 rle with new method : 0.03980231285095215 time for calcul the mask position with numpy : 0.017488956451416016 nb_pixel_total : 750705 time to create 1 rle with new method : 0.027451753616333008 time for calcul the mask position with numpy : 0.00601506233215332 nb_pixel_total : 12197 time to create 1 rle with old method : 0.013654470443725586 create new chi : 0.1223595142364502 time to delete rle : 0.0005147457122802734 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 3314 TO DO : save crop sub photo not yet done ! save time : 0.21846938133239746 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.08686590194702148 time for calcul the mask position with numpy : 0.014454364776611328 nb_pixel_total : 1207212 time to create 1 rle with new method : 0.05871272087097168 time for calcul the mask position with numpy : 0.011243104934692383 nb_pixel_total : 757955 time to create 1 rle with new method : 0.027427196502685547 time for calcul the mask position with numpy : 0.006747722625732422 nb_pixel_total : 93241 time to create 1 rle with old method : 0.10418820381164551 time for calcul the mask position with numpy : 0.005891561508178711 nb_pixel_total : 6584 time to create 1 rle with old method : 0.007439374923706055 time for calcul the mask position with numpy : 0.006017446517944336 nb_pixel_total : 8608 time to create 1 rle with old method : 0.009558677673339844 create new chi : 0.2523207664489746 time to delete rle : 0.0006396770477294922 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 4204 TO DO : save crop sub photo not yet done ! save time : 0.27167415618896484 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 0.06336212158203125 time for calcul the mask position with numpy : 0.27066826820373535 nb_pixel_total : 2038262 time to create 1 rle with new method : 0.09954571723937988 time for calcul the mask position with numpy : 0.006117343902587891 nb_pixel_total : 12150 time to create 1 rle with old method : 0.013810157775878906 time for calcul the mask position with numpy : 0.005959033966064453 nb_pixel_total : 8292 time to create 1 rle with old method : 0.00937032699584961 time for calcul the mask position with numpy : 0.005891323089599609 nb_pixel_total : 4426 time to create 1 rle with old method : 0.005023956298828125 time for calcul the mask position with numpy : 0.006051778793334961 nb_pixel_total : 10470 time to create 1 rle with old method : 0.011824607849121094 create new chi : 0.44495677947998047 time to delete rle : 0.0003113746643066406 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 1930 TO DO : save crop sub photo not yet done ! save time : 0.15374422073364258 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.05173325538635254 time for calcul the mask position with numpy : 0.014697551727294922 nb_pixel_total : 1373059 time to create 1 rle with new method : 0.2985997200012207 time for calcul the mask position with numpy : 0.010679244995117188 nb_pixel_total : 681323 time to create 1 rle with new method : 0.08390998840332031 time for calcul the mask position with numpy : 0.0056531429290771484 nb_pixel_total : 6751 time to create 1 rle with old method : 0.007306337356567383 time for calcul the mask position with numpy : 0.005820274353027344 nb_pixel_total : 12467 time to create 1 rle with old method : 0.013414144515991211 create new chi : 0.44704580307006836 time to delete rle : 0.0005280971527099609 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 3550 TO DO : save crop sub photo not yet done ! save time : 0.23695111274719238 nb_obj : 5 nb_hashtags : 4 time to prepare the origin masks : 0.12027430534362793 time for calcul the mask position with numpy : 0.06886792182922363 nb_pixel_total : 1879837 time to create 1 rle with new method : 0.3220500946044922 time for calcul the mask position with numpy : 0.006114006042480469 nb_pixel_total : 15274 time to create 1 rle with old method : 0.01726698875427246 time for calcul the mask position with numpy : 0.006585836410522461 nb_pixel_total : 79625 time to create 1 rle with old method : 0.08652734756469727 time for calcul the mask position with numpy : 0.006566047668457031 nb_pixel_total : 82961 time to create 1 rle with old method : 0.09120488166809082 time for calcul the mask position with numpy : 0.005872488021850586 nb_pixel_total : 2986 time to create 1 rle with old method : 0.0033261775970458984 time for calcul the mask position with numpy : 0.005882740020751953 nb_pixel_total : 12917 time to create 1 rle with old method : 0.014641046524047852 create new chi : 0.6448793411254883 time to delete rle : 0.0005483627319335938 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 3294 TO DO : save crop sub photo not yet done ! save time : 0.2380509376525879 nb_obj : 5 nb_hashtags : 4 time to prepare the origin masks : 0.06061124801635742 time for calcul the mask position with numpy : 0.30107569694519043 nb_pixel_total : 1959210 time to create 1 rle with new method : 0.09368228912353516 time for calcul the mask position with numpy : 0.006033182144165039 nb_pixel_total : 8118 time to create 1 rle with old method : 0.009401798248291016 time for calcul the mask position with numpy : 0.006099700927734375 nb_pixel_total : 6826 time to create 1 rle with old method : 0.007566213607788086 time for calcul the mask position with numpy : 0.005914926528930664 nb_pixel_total : 1311 time to create 1 rle with old method : 0.001611948013305664 time for calcul the mask position with numpy : 0.00638580322265625 nb_pixel_total : 91043 time to create 1 rle with old method : 0.10582351684570312 time for calcul the mask position with numpy : 0.006978034973144531 nb_pixel_total : 7092 time to create 1 rle with old method : 0.008408784866333008 create new chi : 0.5696384906768799 time to delete rle : 0.0005147457122802734 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 2861 TO DO : save crop sub photo not yet done ! save time : 0.21193170547485352 nb_obj : 3 nb_hashtags : 1 time to prepare the origin masks : 0.05135679244995117 time for calcul the mask position with numpy : 0.018939971923828125 nb_pixel_total : 2003452 time to create 1 rle with new method : 0.11030960083007812 time for calcul the mask position with numpy : 0.006021261215209961 nb_pixel_total : 14581 time to create 1 rle with old method : 0.016535520553588867 time for calcul the mask position with numpy : 0.006371021270751953 nb_pixel_total : 49318 time to create 1 rle with old method : 0.0590057373046875 time for calcul the mask position with numpy : 0.006436824798583984 nb_pixel_total : 6249 time to create 1 rle with old method : 0.0071599483489990234 create new chi : 0.23117899894714355 time to delete rle : 0.00037980079650878906 batch 1 Loaded 7 chid ids of type : 3594 +++++Number RLEs to save : 2322 TO DO : save crop sub photo not yet done ! save time : 0.17995858192443848 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.0470890998840332 time for calcul the mask position with numpy : 0.023882389068603516 nb_pixel_total : 2035657 time to create 1 rle with new method : 0.10599064826965332 time for calcul the mask position with numpy : 0.006871461868286133 nb_pixel_total : 32496 time to create 1 rle with old method : 0.04440021514892578 time for calcul the mask position with numpy : 0.0061266422271728516 nb_pixel_total : 5447 time to create 1 rle with old method : 0.006303548812866211 create new chi : 0.20267558097839355 time to delete rle : 0.0003342628479003906 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1966 TO DO : save crop sub photo not yet done ! save time : 0.13746929168701172 No data in photo_id : 1374773989 nb_obj : 5 nb_hashtags : 2 time to prepare the origin masks : 0.3301198482513428 time for calcul the mask position with numpy : 0.07218813896179199 nb_pixel_total : 1919452 time to create 1 rle with new method : 0.3722853660583496 time for calcul the mask position with numpy : 0.006463527679443359 nb_pixel_total : 14771 time to create 1 rle with old method : 0.017345190048217773 time for calcul the mask position with numpy : 0.006963253021240234 nb_pixel_total : 12025 time to create 1 rle with old method : 0.013967514038085938 time for calcul the mask position with numpy : 0.0063228607177734375 nb_pixel_total : 10927 time to create 1 rle with old method : 0.012705326080322266 time for calcul the mask position with numpy : 0.006330728530883789 nb_pixel_total : 13942 time to create 1 rle with old method : 0.016306161880493164 time for calcul the mask position with numpy : 0.0071468353271484375 nb_pixel_total : 102483 time to create 1 rle with old method : 0.11514806747436523 create new chi : 0.6635055541992188 time to delete rle : 0.0004980564117431641 batch 1 Loaded 11 chid ids of type : 3594 ++++++Number RLEs to save : 3236 TO DO : save crop sub photo not yet done ! save time : 0.22893357276916504 nb_obj : 7 nb_hashtags : 2 time to prepare the origin masks : 0.2509117126464844 time for calcul the mask position with numpy : 0.17356348037719727 nb_pixel_total : 1894895 time to create 1 rle with new method : 0.10586953163146973 time for calcul the mask position with numpy : 0.006587982177734375 nb_pixel_total : 105507 time to create 1 rle with old method : 0.11609983444213867 time for calcul the mask position with numpy : 0.0061647891998291016 nb_pixel_total : 10833 time to create 1 rle with old method : 0.01310873031616211 time for calcul the mask position with numpy : 0.0063838958740234375 nb_pixel_total : 28402 time to create 1 rle with old method : 0.03311896324157715 time for calcul the mask position with numpy : 0.00667119026184082 nb_pixel_total : 14213 time to create 1 rle with old method : 0.01658487319946289 time for calcul the mask position with numpy : 0.0062639713287353516 nb_pixel_total : 3201 time to create 1 rle with old method : 0.0036547183990478516 time for calcul the mask position with numpy : 0.006619930267333984 nb_pixel_total : 6207 time to create 1 rle with old method : 0.00751948356628418 time for calcul the mask position with numpy : 0.006670236587524414 nb_pixel_total : 10342 time to create 1 rle with old method : 0.01229715347290039 create new chi : 0.5380275249481201 time to delete rle : 0.0007383823394775391 batch 1 Loaded 15 chid ids of type : 3594 ++++++++++++Number RLEs to save : 4236 TO DO : save crop sub photo not yet done ! save time : 0.2980997562408447 nb_obj : 6 nb_hashtags : 3 time to prepare the origin masks : 0.22095918655395508 time for calcul the mask position with numpy : 0.4698154926300049 nb_pixel_total : 1927317 time to create 1 rle with new method : 0.4708836078643799 time for calcul the mask position with numpy : 0.007224559783935547 nb_pixel_total : 19932 time to create 1 rle with old method : 0.023579835891723633 time for calcul the mask position with numpy : 0.006868839263916016 nb_pixel_total : 9557 time to create 1 rle with old method : 0.011884450912475586 time for calcul the mask position with numpy : 0.007720470428466797 nb_pixel_total : 17998 time to create 1 rle with old method : 0.021718978881835938 time for calcul the mask position with numpy : 0.006933927536010742 nb_pixel_total : 35727 time to create 1 rle with old method : 0.04421639442443848 time for calcul the mask position with numpy : 0.00730133056640625 nb_pixel_total : 50725 time to create 1 rle with old method : 0.059670448303222656 time for calcul the mask position with numpy : 0.006676912307739258 nb_pixel_total : 12344 time to create 1 rle with old method : 0.01590442657470703 create new chi : 1.1706764698028564 time to delete rle : 0.0006694793701171875 batch 1 Loaded 13 chid ids of type : 3594 ++++++Number RLEs to save : 3196 TO DO : save crop sub photo not yet done ! save time : 0.23190021514892578 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.033885955810546875 time for calcul the mask position with numpy : 0.01923346519470215 nb_pixel_total : 2060919 time to create 1 rle with new method : 0.027697324752807617 time for calcul the mask position with numpy : 0.005983829498291016 nb_pixel_total : 12681 time to create 1 rle with old method : 0.014327526092529297 create new chi : 0.06747722625732422 time to delete rle : 0.00021195411682128906 batch 1 Loaded 3 chid ids of type : 3594 ++Number RLEs to save : 1330 TO DO : save crop sub photo not yet done ! save time : 0.12193441390991211 No data in photo_id : 1374773833 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.051157474517822266 time for calcul the mask position with numpy : 0.022948503494262695 nb_pixel_total : 2052620 time to create 1 rle with new method : 0.11073994636535645 time for calcul the mask position with numpy : 0.006944179534912109 nb_pixel_total : 6335 time to create 1 rle with old method : 0.010360240936279297 time for calcul the mask position with numpy : 0.006604433059692383 nb_pixel_total : 8091 time to create 1 rle with old method : 0.013329744338989258 time for calcul the mask position with numpy : 0.006531715393066406 nb_pixel_total : 6554 time to create 1 rle with old method : 0.007350921630859375 create new chi : 0.1959395408630371 time to delete rle : 0.0003120899200439453 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1574 TO DO : save crop sub photo not yet done ! save time : 0.1413888931274414 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.047745704650878906 time for calcul the mask position with numpy : 0.019931793212890625 nb_pixel_total : 1944058 time to create 1 rle with new method : 0.2396247386932373 time for calcul the mask position with numpy : 0.0066721439361572266 nb_pixel_total : 21271 time to create 1 rle with old method : 0.02635788917541504 time for calcul the mask position with numpy : 0.00652003288269043 nb_pixel_total : 108271 time to create 1 rle with old method : 0.12442255020141602 create new chi : 0.42397093772888184 time to delete rle : 0.0003762245178222656 batch 1 Loaded 5 chid ids of type : 3594 +++Number RLEs to save : 2412 TO DO : save crop sub photo not yet done ! save time : 0.1939845085144043 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.05793571472167969 time for calcul the mask position with numpy : 0.020609617233276367 nb_pixel_total : 2046944 time to create 1 rle with new method : 0.33755970001220703 time for calcul the mask position with numpy : 0.006783962249755859 nb_pixel_total : 6814 time to create 1 rle with old method : 0.007994651794433594 time for calcul the mask position with numpy : 0.006415605545043945 nb_pixel_total : 4210 time to create 1 rle with old method : 0.004979372024536133 time for calcul the mask position with numpy : 0.006418466567993164 nb_pixel_total : 4085 time to create 1 rle with old method : 0.004937887191772461 time for calcul the mask position with numpy : 0.006353855133056641 nb_pixel_total : 11547 time to create 1 rle with old method : 0.013736724853515625 create new chi : 0.42927050590515137 time to delete rle : 0.0004711151123046875 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 2030 TO DO : save crop sub photo not yet done ! save time : 0.17564678192138672 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.05134415626525879 time for calcul the mask position with numpy : 0.31096601486206055 nb_pixel_total : 2047273 time to create 1 rle with new method : 0.1807856559753418 time for calcul the mask position with numpy : 0.0068187713623046875 nb_pixel_total : 5421 time to create 1 rle with old method : 0.006431102752685547 time for calcul the mask position with numpy : 0.0065424442291259766 nb_pixel_total : 9225 time to create 1 rle with old method : 0.010850906372070312 time for calcul the mask position with numpy : 0.006478548049926758 nb_pixel_total : 11681 time to create 1 rle with old method : 0.01373291015625 create new chi : 0.5537972450256348 time to delete rle : 0.0004038810729980469 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1820 TO DO : save crop sub photo not yet done ! save time : 0.157212495803833 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.032642364501953125 time for calcul the mask position with numpy : 0.01907181739807129 nb_pixel_total : 2068713 time to create 1 rle with new method : 0.3101828098297119 time for calcul the mask position with numpy : 0.005856037139892578 nb_pixel_total : 4887 time to create 1 rle with old method : 0.005832195281982422 create new chi : 0.34114837646484375 time to delete rle : 0.00021409988403320312 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1244 TO DO : save crop sub photo not yet done ! save time : 0.12385821342468262 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.04976034164428711 time for calcul the mask position with numpy : 0.018869876861572266 nb_pixel_total : 1820174 time to create 1 rle with new method : 0.15088558197021484 time for calcul the mask position with numpy : 0.008274078369140625 nb_pixel_total : 12680 time to create 1 rle with old method : 0.02028632164001465 time for calcul the mask position with numpy : 0.008444786071777344 nb_pixel_total : 226477 time to create 1 rle with new method : 0.1773076057434082 time for calcul the mask position with numpy : 0.0061798095703125 nb_pixel_total : 14269 time to create 1 rle with old method : 0.016272783279418945 create new chi : 0.41998910903930664 time to delete rle : 0.0006432533264160156 batch 1 Loaded 7 chid ids of type : 3594 +++++Number RLEs to save : 4001 TO DO : save crop sub photo not yet done ! save time : 0.29331302642822266 nb_obj : 6 nb_hashtags : 3 time to prepare the origin masks : 0.10305356979370117 time for calcul the mask position with numpy : 0.4300720691680908 nb_pixel_total : 1891139 time to create 1 rle with new method : 0.23238396644592285 time for calcul the mask position with numpy : 0.010041475296020508 nb_pixel_total : 5317 time to create 1 rle with old method : 0.006804943084716797 time for calcul the mask position with numpy : 0.006398916244506836 nb_pixel_total : 36981 time to create 1 rle with old method : 0.04178619384765625 time for calcul the mask position with numpy : 0.006628990173339844 nb_pixel_total : 109546 time to create 1 rle with old method : 0.12158465385437012 time for calcul the mask position with numpy : 0.006009340286254883 nb_pixel_total : 10063 time to create 1 rle with old method : 0.01108860969543457 time for calcul the mask position with numpy : 0.010053396224975586 nb_pixel_total : 6574 time to create 1 rle with old method : 0.007318735122680664 time for calcul the mask position with numpy : 0.010055065155029297 nb_pixel_total : 13980 time to create 1 rle with old method : 0.016003847122192383 create new chi : 0.9268443584442139 time to delete rle : 0.0005371570587158203 batch 1 Loaded 13 chid ids of type : 3594 ++++++Number RLEs to save : 3394 TO DO : save crop sub photo not yet done ! save time : 0.23474907875061035 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.06977725028991699 time for calcul the mask position with numpy : 0.021580219268798828 nb_pixel_total : 2059148 time to create 1 rle with new method : 0.061034202575683594 time for calcul the mask position with numpy : 0.006381511688232422 nb_pixel_total : 5741 time to create 1 rle with old method : 0.006765604019165039 time for calcul the mask position with numpy : 0.006211042404174805 nb_pixel_total : 8711 time to create 1 rle with old method : 0.010253190994262695 create new chi : 0.1125030517578125 time to delete rle : 0.00033402442932128906 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1454 TO DO : save crop sub photo not yet done ! save time : 0.1323246955871582 nb_obj : 6 nb_hashtags : 4 time to prepare the origin masks : 0.21297788619995117 time for calcul the mask position with numpy : 0.23813486099243164 nb_pixel_total : 2012708 time to create 1 rle with new method : 0.23800349235534668 time for calcul the mask position with numpy : 0.007111310958862305 nb_pixel_total : 12256 time to create 1 rle with old method : 0.0203092098236084 time for calcul the mask position with numpy : 0.006610393524169922 nb_pixel_total : 12220 time to create 1 rle with old method : 0.014209508895874023 time for calcul the mask position with numpy : 0.007572174072265625 nb_pixel_total : 4180 time to create 1 rle with old method : 0.0073659420013427734 time for calcul the mask position with numpy : 0.006548643112182617 nb_pixel_total : 7364 time to create 1 rle with old method : 0.008618593215942383 time for calcul the mask position with numpy : 0.006537675857543945 nb_pixel_total : 4986 time to create 1 rle with old method : 0.0058324337005615234 time for calcul the mask position with numpy : 0.007154226303100586 nb_pixel_total : 19886 time to create 1 rle with old method : 0.023355484008789062 create new chi : 0.6099138259887695 time to delete rle : 0.0004639625549316406 batch 1 Loaded 13 chid ids of type : 3594 ++++++++++Number RLEs to save : 2570 TO DO : save crop sub photo not yet done ! save time : 0.20277094841003418 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.039220571517944336 time for calcul the mask position with numpy : 0.018830537796020508 nb_pixel_total : 2046614 time to create 1 rle with new method : 0.027532339096069336 time for calcul the mask position with numpy : 0.005955219268798828 nb_pixel_total : 13217 time to create 1 rle with old method : 0.015635251998901367 time for calcul the mask position with numpy : 0.006498813629150391 nb_pixel_total : 13769 time to create 1 rle with old method : 0.016276121139526367 create new chi : 0.09105467796325684 time to delete rle : 0.0003235340118408203 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1726 TO DO : save crop sub photo not yet done ! save time : 0.13835811614990234 map_output_result : {1374774101: (0.0, 'Should be the crop_list due to order', 0), 1374774098: (0.0, 'Should be the crop_list due to order', 0), 1374774095: (0.0, 'Should be the crop_list due to order', 0), 1374774077: (0.0, 'Should be the crop_list due to order', 0), 1374774075: (0.0, 'Should be the crop_list due to order', 0), 1374774072: (0.0, 'Should be the crop_list due to order', 0), 1374774069: (0.0, 'Should be the crop_list due to order', 0), 1374774067: (0.0, 'Should be the crop_list due to order', 0), 1374774065: (0.0, 'Should be the crop_list due to order', 0), 1374774051: (0.0, 'Should be the crop_list due to order', 0), 1374774048: (0.0, 'Should be the crop_list due to order', 0), 1374774044: (0.0, 'Should be the crop_list due to order', 0), 1374774041: (0.0, 'Should be the crop_list due to order', 0), 1374774039: (0.0, 'Should be the crop_list due to order', 0), 1374774037: (0.0, 'Should be the crop_list due to order', 0), 1374774027: (0.0, 'Should be the crop_list due to order', 0), 1374773998: (0.0, 'Should be the crop_list due to order', 0), 1374773992: (0.0, 'Should be the crop_list due to order', 0), 1374773989: (0.0, 'Should be the crop_list due to order', 0.0), 1374773973: (0.0, 'Should be the crop_list due to order', 0), 1374773955: (0.0, 'Should be the crop_list due to order', 0), 1374773889: (0.0, 'Should be the crop_list due to order', 0), 1374773863: (0.0, 'Should be the crop_list due to order', 0), 1374773833: (0.0, 'Should be the crop_list due to order', 0.0), 1374773803: (0.0, 'Should be the crop_list due to order', 0), 1374773776: (0.0, 'Should be the crop_list due to order', 0), 1374773751: (0.0, 'Should be the crop_list due to order', 0), 1374773611: (0.0, 'Should be the crop_list due to order', 0), 1374773608: (0.0, 'Should be the crop_list due to order', 0), 1374773603: (0.0, 'Should be the crop_list due to order', 0), 1374773599: (0.0, 'Should be the crop_list due to order', 0), 1374773596: (0.0, 'Should be the crop_list due to order', 0), 1374773593: (0.0, 'Should be the crop_list due to order', 0), 1374773566: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1374774101, 1374774098, 1374774095, 1374774077, 1374774075, 1374774072, 1374774069, 1374774067, 1374774065, 1374774051, 1374774048, 1374774044, 1374774041, 1374774039, 1374774037, 1374774027, 1374773998, 1374773992, 1374773989, 1374773973, 1374773955, 1374773889, 1374773863, 1374773833, 1374773803, 1374773776, 1374773751, 1374773611, 1374773608, 1374773603, 1374773599, 1374773596, 1374773593, 1374773566] Looping around the photos to save general results len do output : 34 /1374774101.Didn't retrieve data . /1374774098.Didn't retrieve data . /1374774095.Didn't retrieve data . /1374774077.Didn't retrieve data . /1374774075.Didn't retrieve data . /1374774072.Didn't retrieve data . /1374774069.Didn't retrieve data . /1374774067.Didn't retrieve data . /1374774065.Didn't retrieve data . /1374774051.Didn't retrieve data . /1374774048.Didn't retrieve data . /1374774044.Didn't retrieve data . /1374774041.Didn't retrieve data . /1374774039.Didn't retrieve data . /1374774037.Didn't retrieve data . /1374774027.Didn't retrieve data . /1374773998.Didn't retrieve data . /1374773992.Didn't retrieve data . /1374773989.Didn't retrieve data . /1374773973.Didn't retrieve data . /1374773955.Didn't retrieve data . /1374773889.Didn't retrieve data . /1374773863.Didn't retrieve data . /1374773833.Didn't retrieve data . /1374773803.Didn't retrieve data . /1374773776.Didn't retrieve data . /1374773751.Didn't retrieve data . /1374773611.Didn't retrieve data . /1374773608.Didn't retrieve data . /1374773603.Didn't retrieve data . /1374773599.Didn't retrieve data . /1374773596.Didn't retrieve data . /1374773593.Didn't retrieve data . /1374773566.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774101', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774098', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774095', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774077', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774075', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774072', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774069', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774067', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774065', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774051', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774048', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774044', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774041', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774039', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774037', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774027', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773998', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773992', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773989', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773973', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773955', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773889', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773863', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773833', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773803', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773776', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773751', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773611', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773608', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773603', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773599', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773596', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773593', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773566', None, None, None, None, None, '3422341') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 102 time used for this insertion : 0.018398284912109375 save_final save missing photos in datou_result : time spend for datou_step_exec : 23.677074193954468 time spend to save output : 0.019330263137817383 total time spend for step 3 : 23.696404457092285 step4:ventilate_hashtags_in_portfolio Fri Aug 1 14:12:34 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 25584297 get user id for portfolio 25584297 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25584297 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','flou','pet_clair','mal_croppe','background','papier','autre','metal','environnement','carton','pehd')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25584297 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','flou','pet_clair','mal_croppe','background','papier','autre','metal','environnement','carton','pehd')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25584297 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','flou','pet_clair','mal_croppe','background','papier','autre','metal','environnement','carton','pehd')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/25584333,25584334,25584335,25584336,25584337,25584338,25584339,25584340,25584341,25584342,25584343?tags=pet_fonce,flou,pet_clair,mal_croppe,background,papier,autre,metal,environnement,carton,pehd Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1374774101, 1374774098, 1374774095, 1374774077, 1374774075, 1374774072, 1374774069, 1374774067, 1374774065, 1374774051, 1374774048, 1374774044, 1374774041, 1374774039, 1374774037, 1374774027, 1374773998, 1374773992, 1374773989, 1374773973, 1374773955, 1374773889, 1374773863, 1374773833, 1374773803, 1374773776, 1374773751, 1374773611, 1374773608, 1374773603, 1374773599, 1374773596, 1374773593, 1374773566] Looping around the photos to save general results len do output : 1 /25584297. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774101', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774098', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774095', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774077', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774075', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774072', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774069', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774067', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774065', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774051', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774048', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774044', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774041', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774039', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774037', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774027', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773998', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773992', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773989', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773973', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773955', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773889', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773863', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773833', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773803', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773776', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773751', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773611', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773608', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773603', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773599', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773596', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773593', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773566', None, None, None, None, None, '3422341') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 35 time used for this insertion : 0.017403841018676758 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.646881341934204 time spend to save output : 0.017769336700439453 total time spend for step 4 : 1.6646506786346436 step5:final Fri Aug 1 14:12:36 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1374774101: ('0.07867310900054467',), 1374774098: ('0.07867310900054467',), 1374774095: ('0.07867310900054467',), 1374774077: ('0.07867310900054467',), 1374774075: ('0.07867310900054467',), 1374774072: ('0.07867310900054467',), 1374774069: ('0.07867310900054467',), 1374774067: ('0.07867310900054467',), 1374774065: ('0.07867310900054467',), 1374774051: ('0.07867310900054467',), 1374774048: ('0.07867310900054467',), 1374774044: ('0.07867310900054467',), 1374774041: ('0.07867310900054467',), 1374774039: ('0.07867310900054467',), 1374774037: ('0.07867310900054467',), 1374774027: ('0.07867310900054467',), 1374773998: ('0.07867310900054467',), 1374773992: ('0.07867310900054467',), 1374773989: ('0.07867310900054467',), 1374773973: ('0.07867310900054467',), 1374773955: ('0.07867310900054467',), 1374773889: ('0.07867310900054467',), 1374773863: ('0.07867310900054467',), 1374773833: ('0.07867310900054467',), 1374773803: ('0.07867310900054467',), 1374773776: ('0.07867310900054467',), 1374773751: ('0.07867310900054467',), 1374773611: ('0.07867310900054467',), 1374773608: ('0.07867310900054467',), 1374773603: ('0.07867310900054467',), 1374773599: ('0.07867310900054467',), 1374773596: ('0.07867310900054467',), 1374773593: ('0.07867310900054467',), 1374773566: ('0.07867310900054467',)} new output for save of step final : {1374774101: ('0.07867310900054467',), 1374774098: ('0.07867310900054467',), 1374774095: ('0.07867310900054467',), 1374774077: ('0.07867310900054467',), 1374774075: ('0.07867310900054467',), 1374774072: ('0.07867310900054467',), 1374774069: ('0.07867310900054467',), 1374774067: ('0.07867310900054467',), 1374774065: ('0.07867310900054467',), 1374774051: ('0.07867310900054467',), 1374774048: ('0.07867310900054467',), 1374774044: ('0.07867310900054467',), 1374774041: ('0.07867310900054467',), 1374774039: ('0.07867310900054467',), 1374774037: ('0.07867310900054467',), 1374774027: ('0.07867310900054467',), 1374773998: ('0.07867310900054467',), 1374773992: ('0.07867310900054467',), 1374773989: ('0.07867310900054467',), 1374773973: ('0.07867310900054467',), 1374773955: ('0.07867310900054467',), 1374773889: ('0.07867310900054467',), 1374773863: ('0.07867310900054467',), 1374773833: ('0.07867310900054467',), 1374773803: ('0.07867310900054467',), 1374773776: ('0.07867310900054467',), 1374773751: ('0.07867310900054467',), 1374773611: ('0.07867310900054467',), 1374773608: ('0.07867310900054467',), 1374773603: ('0.07867310900054467',), 1374773599: ('0.07867310900054467',), 1374773596: ('0.07867310900054467',), 1374773593: ('0.07867310900054467',), 1374773566: ('0.07867310900054467',)} [1374774101, 1374774098, 1374774095, 1374774077, 1374774075, 1374774072, 1374774069, 1374774067, 1374774065, 1374774051, 1374774048, 1374774044, 1374774041, 1374774039, 1374774037, 1374774027, 1374773998, 1374773992, 1374773989, 1374773973, 1374773955, 1374773889, 1374773863, 1374773833, 1374773803, 1374773776, 1374773751, 1374773611, 1374773608, 1374773603, 1374773599, 1374773596, 1374773593, 1374773566] Looping around the photos to save general results len do output : 34 /1374774101.Didn't retrieve data . /1374774098.Didn't retrieve data . /1374774095.Didn't retrieve data . /1374774077.Didn't retrieve data . /1374774075.Didn't retrieve data . /1374774072.Didn't retrieve data . /1374774069.Didn't retrieve data . /1374774067.Didn't retrieve data . /1374774065.Didn't retrieve data . /1374774051.Didn't retrieve data . /1374774048.Didn't retrieve data . /1374774044.Didn't retrieve data . /1374774041.Didn't retrieve data . /1374774039.Didn't retrieve data . /1374774037.Didn't retrieve data . /1374774027.Didn't retrieve data . /1374773998.Didn't retrieve data . /1374773992.Didn't retrieve data . /1374773989.Didn't retrieve data . /1374773973.Didn't retrieve data . /1374773955.Didn't retrieve data . /1374773889.Didn't retrieve data . /1374773863.Didn't retrieve data . /1374773833.Didn't retrieve data . /1374773803.Didn't retrieve data . /1374773776.Didn't retrieve data . /1374773751.Didn't retrieve data . /1374773611.Didn't retrieve data . /1374773608.Didn't retrieve data . /1374773603.Didn't retrieve data . /1374773599.Didn't retrieve data . /1374773596.Didn't retrieve data . /1374773593.Didn't retrieve data . /1374773566.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774101', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774098', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774095', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774077', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774075', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774072', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774069', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774067', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774065', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774051', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774048', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774044', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774041', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774039', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774037', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774027', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773998', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773992', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773989', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773973', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773955', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773889', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773863', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773833', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773803', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773776', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773751', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773611', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773608', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773603', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773599', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773596', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773593', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773566', None, None, None, None, None, '3422341') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 102 time used for this insertion : 0.020979642868041992 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.12084460258483887 time spend to save output : 0.02213001251220703 total time spend for step 5 : 0.1429746150970459 step6:blur_detection Fri Aug 1 14:12:36 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1754050227_1178464_1374774101_c8c1d3016720744527ad1f1705b2634e.jpg resize: (1080, 1920) 1374774101 -0.8917639031019186 treat image : temp/1754050227_1178464_1374774098_a5ced166fc59ec87a24f7b3a70c506ec.jpg resize: (1080, 1920) 1374774098 -0.6043996437949607 treat image : temp/1754050227_1178464_1374774095_320987331ab71b6360070b1cf71ce3c8.jpg resize: (1080, 1920) 1374774095 0.7537860146713259 treat image : temp/1754050227_1178464_1374774077_6490a4df4cb65f9772420e4d8efabe23.jpg resize: (1080, 1920) 1374774077 0.504547986229238 treat image : temp/1754050227_1178464_1374774075_927cae4cd36d3947a2127c454b28acbf.jpg resize: (1080, 1920) 1374774075 0.26570094382978077 treat image : temp/1754050227_1178464_1374774072_cf1b75caa96ffc959a9c88f77db7f473.jpg resize: (1080, 1920) 1374774072 0.11189433452624921 treat image : temp/1754050227_1178464_1374774069_4a4cc8ec8e8e0c5ffce4c59cbeca3fc7.jpg resize: (1080, 1920) 1374774069 -0.34039258863861327 treat image : temp/1754050227_1178464_1374774067_58484f61466b4780601329d21d605622.jpg resize: (1080, 1920) 1374774067 -1.1868817224572268 treat image : temp/1754050227_1178464_1374774065_43528825b567decc79ac278165a7ab51.jpg resize: (1080, 1920) 1374774065 0.22134300114498864 treat image : temp/1754050227_1178464_1374774051_f1c9e9bdc2e96c9c0c444bbf1666341c.jpg resize: (1080, 1920) 1374774051 -0.06605077822439519 treat image : temp/1754050227_1178464_1374774048_770a60d547221865b859b26d3a8616f2.jpg resize: (1080, 1920) 1374774048 -0.9437625700403957 treat image : temp/1754050227_1178464_1374774044_d16bd94970c0cfc221c0cd3130af2d86.jpg resize: (1080, 1920) 1374774044 -0.35321654610566666 treat image : temp/1754050227_1178464_1374774041_78a7fe5920b560146c0bb8bac9e69e4d.jpg resize: (1080, 1920) 1374774041 -0.860651499298263 treat image : temp/1754050227_1178464_1374774039_3e7c7dcf69986b1f123aec23b5c7aedf.jpg resize: (1080, 1920) 1374774039 -0.2596393022708814 treat image : temp/1754050227_1178464_1374774037_ae24e0857f70aec17ddb8df7f3b4d308.jpg resize: (1080, 1920) 1374774037 0.20032091540964145 treat image : temp/1754050227_1178464_1374774027_61e272b0498b7bb990700378f22d80b5.jpg resize: (1080, 1920) 1374774027 -0.6513285767909659 treat image : temp/1754050227_1178464_1374773998_3daf5f2e9c155ce769488e8162dacea1.jpg resize: (1080, 1920) 1374773998 2.514786948782625 treat image : temp/1754050227_1178464_1374773992_57e021344554f21992588af9c273e41e.jpg resize: (1080, 1920) 1374773992 -1.0145785304403137 treat image : temp/1754050227_1178464_1374773989_7b743953c5310cc6ec5c8977816a6816.jpg resize: (1080, 1920) 1374773989 1.0365483919952645 treat image : temp/1754050227_1178464_1374773973_7548a9904777d1185cb7701e4a7d564e.jpg resize: (1080, 1920) 1374773973 0.5532853268574971 treat image : temp/1754050227_1178464_1374773955_8ea4080059a88f68a1d0c59e520a6d4f.jpg resize: (1080, 1920) 1374773955 0.7021362962472746 treat image : temp/1754050227_1178464_1374773889_20c831b42f2339629efaed8472d4c184.jpg resize: (1080, 1920) 1374773889 1.010882898080989 treat image : temp/1754050227_1178464_1374773863_9b84fbaf1704cc8b8d635a77e78485cc.jpg resize: (1080, 1920) 1374773863 0.5973855422706785 treat image : temp/1754050227_1178464_1374773833_0d01ada217925aadcdc2f57bf01fd00d.jpg resize: (1080, 1920) 1374773833 0.3970864552930348 treat image : temp/1754050227_1178464_1374773803_319c69232117e86dc18c018190fd737d.jpg resize: (1080, 1920) 1374773803 0.09903485900706752 treat image : temp/1754050227_1178464_1374773776_4765e01f2bf469af38c271f9f02914ee.jpg resize: (1080, 1920) 1374773776 -1.3127718823041914 treat image : temp/1754050227_1178464_1374773751_c21ab387f632f27dcb488dec9d2d75b6.jpg resize: (1080, 1920) 1374773751 0.42099060152367845 treat image : temp/1754050227_1178464_1374773611_ec0d79cd111960a8af557086d7ebe673.jpg resize: (1080, 1920) 1374773611 0.6596622447448998 treat image : temp/1754050227_1178464_1374773608_bb6e1669de99c1c637129b798399d70a.jpg resize: (1080, 1920) 1374773608 1.6859264931652056 treat image : temp/1754050227_1178464_1374773603_a5978f9e63aefdf858f367611918e20f.jpg resize: (1080, 1920) 1374773603 2.906880628011953 treat image : temp/1754050227_1178464_1374773599_dd2089503ca7d1b38c5725bdd6beaa90.jpg resize: (1080, 1920) 1374773599 0.7977240588167903 treat image : temp/1754050227_1178464_1374773596_0431f22db99bc18e469c63dd4964b4ce.jpg resize: (1080, 1920) 1374773596 -0.035091453059511515 treat image : temp/1754050227_1178464_1374773593_bf341a9c4d192a115123e4ade1b58831.jpg resize: (1080, 1920) 1374773593 -0.37213503758903976 treat image : temp/1754050227_1178464_1374773566_0afb6e0df6f1e7bf71eeca7480527b70.jpg resize: (1080, 1920) 1374773566 1.0109604783599837 treat image : temp/1754050227_1178464_1374774101_c8c1d3016720744527ad1f1705b2634e_rle_crop_3900448774_0.png resize: (128, 192) 1374779125 -0.31336689434742754 treat image : temp/1754050227_1178464_1374774101_c8c1d3016720744527ad1f1705b2634e_rle_crop_3900448775_0.png resize: (77, 99) 1374779126 -1.9969148930212 treat image : temp/1754050227_1178464_1374774098_a5ced166fc59ec87a24f7b3a70c506ec_rle_crop_3900448779_0.png resize: (128, 128) 1374779127 -1.7228002207210293 treat image : temp/1754050227_1178464_1374774098_a5ced166fc59ec87a24f7b3a70c506ec_rle_crop_3900448780_0.png resize: (108, 122) 1374779128 1.3703494363937012 treat image : temp/1754050227_1178464_1374774098_a5ced166fc59ec87a24f7b3a70c506ec_rle_crop_3900448781_0.png resize: (80, 96) 1374779129 0.8580285424577978 treat image : temp/1754050227_1178464_1374774098_a5ced166fc59ec87a24f7b3a70c506ec_rle_crop_3900448782_0.png resize: (118, 191) 1374779130 -1.3023865569265967 treat image : temp/1754050227_1178464_1374774098_a5ced166fc59ec87a24f7b3a70c506ec_rle_crop_3900448786_0.png resize: (64, 82) 1374779131 -2.047952614777226 treat image : temp/1754050227_1178464_1374774075_927cae4cd36d3947a2127c454b28acbf_rle_crop_3900448793_0.png resize: (191, 195) 1374779132 -1.500450678680511 treat image : temp/1754050227_1178464_1374774075_927cae4cd36d3947a2127c454b28acbf_rle_crop_3900448795_0.png resize: (146, 121) 1374779133 -1.031432866963547 treat image : temp/1754050227_1178464_1374774072_cf1b75caa96ffc959a9c88f77db7f473_rle_crop_3900448796_0.png resize: (173, 109) 1374779134 -2.246803373955932 treat image : temp/1754050227_1178464_1374774069_4a4cc8ec8e8e0c5ffce4c59cbeca3fc7_rle_crop_3900448797_0.png resize: (170, 103) 1374779135 -0.9019237376017788 treat image : temp/1754050227_1178464_1374774069_4a4cc8ec8e8e0c5ffce4c59cbeca3fc7_rle_crop_3900448798_0.png resize: (46, 90) 1374779136 -1.5935194848444387 treat image : temp/1754050227_1178464_1374774065_43528825b567decc79ac278165a7ab51_rle_crop_3900448801_0.png resize: (81, 68) 1374779137 -1.9970166806381715 treat image : temp/1754050227_1178464_1374774065_43528825b567decc79ac278165a7ab51_rle_crop_3900448802_0.png resize: (162, 93) 1374779138 0.41203700414220273 treat image : temp/1754050227_1178464_1374774051_f1c9e9bdc2e96c9c0c444bbf1666341c_rle_crop_3900448803_0.png resize: (70, 69) 1374779139 -3.589806933437198 treat image : temp/1754050227_1178464_1374774051_f1c9e9bdc2e96c9c0c444bbf1666341c_rle_crop_3900448804_0.png resize: (114, 98) 1374779141 -1.590980803885355 treat image : temp/1754050227_1178464_1374774044_d16bd94970c0cfc221c0cd3130af2d86_rle_crop_3900448812_0.png resize: (137, 86) 1374779142 -1.0845962159599631 treat image : temp/1754050227_1178464_1374774041_78a7fe5920b560146c0bb8bac9e69e4d_rle_crop_3900448815_0.png resize: (127, 97) 1374779143 3.0352717406706695 treat image : temp/1754050227_1178464_1374774041_78a7fe5920b560146c0bb8bac9e69e4d_rle_crop_3900448816_0.png resize: (45, 140) 1374779144 -0.48257289485581956 treat image : temp/1754050227_1178464_1374774037_ae24e0857f70aec17ddb8df7f3b4d308_rle_crop_3900448824_0.png resize: (282, 396) 1374779145 -0.1991919448053132 treat image : temp/1754050227_1178464_1374774027_61e272b0498b7bb990700378f22d80b5_rle_crop_3900448830_0.png resize: (133, 75) 1374779146 0.017809152566921185 treat image : temp/1754050227_1178464_1374773998_3daf5f2e9c155ce769488e8162dacea1_rle_crop_3900448832_0.png resize: (129, 95) 1374779147 -1.5371305034984997 treat image : temp/1754050227_1178464_1374773998_3daf5f2e9c155ce769488e8162dacea1_rle_crop_3900448833_0.png resize: (247, 313) 1374779148 0.24708203905023918 treat image : temp/1754050227_1178464_1374773998_3daf5f2e9c155ce769488e8162dacea1_rle_crop_3900448834_0.png resize: (196, 156) 1374779149 -1.6208777980501783 treat image : temp/1754050227_1178464_1374773992_57e021344554f21992588af9c273e41e_rle_crop_3900448835_0.png resize: (90, 89) 1374779150 0.11509385277623882 treat image : temp/1754050227_1178464_1374773973_7548a9904777d1185cb7701e4a7d564e_rle_crop_3900448838_0.png resize: (139, 228) 1374779151 -0.4986987488780006 treat image : temp/1754050227_1178464_1374773973_7548a9904777d1185cb7701e4a7d564e_rle_crop_3900448841_0.png resize: (168, 134) 1374779152 -1.6923610729847718 treat image : temp/1754050227_1178464_1374773955_8ea4080059a88f68a1d0c59e520a6d4f_rle_crop_3900448844_0.png resize: (66, 67) 1374779153 2.112009245615402 treat image : temp/1754050227_1178464_1374773955_8ea4080059a88f68a1d0c59e520a6d4f_rle_crop_3900448845_0.png resize: (145, 125) 1374779154 -1.325984890821064 treat image : temp/1754050227_1178464_1374773955_8ea4080059a88f68a1d0c59e520a6d4f_rle_crop_3900448847_0.png resize: (157, 201) 1374779155 -1.2561122634501416 treat image : temp/1754050227_1178464_1374773889_20c831b42f2339629efaed8472d4c184_rle_crop_3900448851_0.png resize: (250, 335) 1374779156 -0.2661997875361918 treat image : temp/1754050227_1178464_1374773863_9b84fbaf1704cc8b8d635a77e78485cc_rle_crop_3900448855_0.png resize: (118, 134) 1374779157 -0.30176639603832944 treat image : temp/1754050227_1178464_1374773803_319c69232117e86dc18c018190fd737d_rle_crop_3900448857_0.png resize: (78, 156) 1374779158 -1.010558759619324 treat image : temp/1754050227_1178464_1374773751_c21ab387f632f27dcb488dec9d2d75b6_rle_crop_3900448861_0.png resize: (194, 114) 1374779159 -3.223162127954436 treat image : temp/1754050227_1178464_1374773751_c21ab387f632f27dcb488dec9d2d75b6_rle_crop_3900448862_0.png resize: (67, 105) 1374779160 -3.7630911585611178 treat image : temp/1754050227_1178464_1374773751_c21ab387f632f27dcb488dec9d2d75b6_rle_crop_3900448863_0.png resize: (101, 51) 1374779161 0.40792817271825293 treat image : temp/1754050227_1178464_1374773611_ec0d79cd111960a8af557086d7ebe673_rle_crop_3900448866_0.png resize: (142, 103) 1374779162 -1.2449842055655223 treat image : temp/1754050227_1178464_1374773603_a5978f9e63aefdf858f367611918e20f_rle_crop_3900448871_0.png resize: (132, 158) 1374779163 -0.21382640199237113 treat image : temp/1754050227_1178464_1374773599_dd2089503ca7d1b38c5725bdd6beaa90_rle_crop_3900448872_0.png resize: (133, 153) 1374779164 -1.7709656780710448 treat image : temp/1754050227_1178464_1374773599_dd2089503ca7d1b38c5725bdd6beaa90_rle_crop_3900448874_0.png resize: (184, 83) 1374779165 -0.46480270699242454 treat image : temp/1754050227_1178464_1374773599_dd2089503ca7d1b38c5725bdd6beaa90_rle_crop_3900448877_0.png resize: (93, 94) 1374779166 -1.8085889757440736 treat image : temp/1754050227_1178464_1374773596_0431f22db99bc18e469c63dd4964b4ce_rle_crop_3900448878_0.png resize: (102, 152) 1374779167 -1.2463218413966124 treat image : temp/1754050227_1178464_1374773593_bf341a9c4d192a115123e4ade1b58831_rle_crop_3900448880_0.png resize: (156, 196) 1374779168 -1.8135513822261273 treat image : temp/1754050227_1178464_1374773593_bf341a9c4d192a115123e4ade1b58831_rle_crop_3900448881_0.png resize: (82, 98) 1374779169 -1.597547889980822 treat image : temp/1754050227_1178464_1374773593_bf341a9c4d192a115123e4ade1b58831_rle_crop_3900448885_0.png resize: (160, 174) 1374779170 -2.5143944282731723 treat image : temp/1754050227_1178464_1374774101_c8c1d3016720744527ad1f1705b2634e_rle_crop_3900448776_0.png resize: (79, 95) 1374779173 0.1788010125823386 treat image : temp/1754050227_1178464_1374774101_c8c1d3016720744527ad1f1705b2634e_rle_crop_3900448778_0.png resize: (88, 65) 1374779174 -1.777575910242205 treat image : temp/1754050227_1178464_1374774095_320987331ab71b6360070b1cf71ce3c8_rle_crop_3900448787_0.png resize: (154, 111) 1374779175 0.5158489408217506 treat image : temp/1754050227_1178464_1374774095_320987331ab71b6360070b1cf71ce3c8_rle_crop_3900448788_0.png resize: (61, 70) 1374779177 0.5292812899784534 treat image : temp/1754050227_1178464_1374774051_f1c9e9bdc2e96c9c0c444bbf1666341c_rle_crop_3900448808_0.png resize: (173, 169) 1374779178 -1.3846532192775656 treat image : temp/1754050227_1178464_1374774041_78a7fe5920b560146c0bb8bac9e69e4d_rle_crop_3900448818_0.png resize: (93, 188) 1374779179 -2.478208025870847 treat image : temp/1754050227_1178464_1374774037_ae24e0857f70aec17ddb8df7f3b4d308_rle_crop_3900448822_0.png resize: (151, 111) 1374779180 -0.5886951445218512 treat image : temp/1754050227_1178464_1374773955_8ea4080059a88f68a1d0c59e520a6d4f_rle_crop_3900448842_0.png resize: (99, 149) 1374779181 -0.439097106817152 treat image : temp/1754050227_1178464_1374773955_8ea4080059a88f68a1d0c59e520a6d4f_rle_crop_3900448843_0.png resize: (97, 89) 1374779182 -1.2023169597986938 treat image : temp/1754050227_1178464_1374773955_8ea4080059a88f68a1d0c59e520a6d4f_rle_crop_3900448846_0.png resize: (290, 247) 1374779183 -1.732438606664661 treat image : temp/1754050227_1178464_1374773955_8ea4080059a88f68a1d0c59e520a6d4f_rle_crop_3900448848_0.png resize: (525, 338) 1374779184 -0.3306390378044312 treat image : temp/1754050227_1178464_1374773889_20c831b42f2339629efaed8472d4c184_rle_crop_3900448852_0.png resize: (142, 186) 1374779185 -1.562213444159994 treat image : temp/1754050227_1178464_1374773803_319c69232117e86dc18c018190fd737d_rle_crop_3900448856_0.png resize: (69, 142) 1374779186 -2.0038578857988845 treat image : temp/1754050227_1178464_1374773803_319c69232117e86dc18c018190fd737d_rle_crop_3900448858_0.png resize: (95, 89) 1374779187 -0.7973444063994277 treat image : temp/1754050227_1178464_1374773599_dd2089503ca7d1b38c5725bdd6beaa90_rle_crop_3900448873_0.png resize: (69, 109) 1374779188 0.9029747992369338 treat image : temp/1754050227_1178464_1374773593_bf341a9c4d192a115123e4ade1b58831_rle_crop_3900448882_0.png resize: (105, 119) 1374779189 -1.7674131302122358 treat image : temp/1754050227_1178464_1374773566_0afb6e0df6f1e7bf71eeca7480527b70_rle_crop_3900448886_0.png resize: (180, 100) 1374779191 -0.9063094053394247 treat image : temp/1754050227_1178464_1374774041_78a7fe5920b560146c0bb8bac9e69e4d_rle_crop_3900448817_0.png resize: (125, 91) 1374779193 -1.5411727544692209 treat image : temp/1754050227_1178464_1374774027_61e272b0498b7bb990700378f22d80b5_rle_crop_3900448831_0.png resize: (88, 125) 1374779194 -4.617587468723651 treat image : temp/1754050227_1178464_1374773596_0431f22db99bc18e469c63dd4964b4ce_rle_crop_3900448879_0.png resize: (78, 102) 1374779195 -1.133600990199061 treat image : temp/1754050227_1178464_1374774101_c8c1d3016720744527ad1f1705b2634e_rle_crop_3900448777_0.png resize: (216, 146) 1374779208 -3.320310084098533 treat image : temp/1754050227_1178464_1374774098_a5ced166fc59ec87a24f7b3a70c506ec_rle_crop_3900448783_0.png resize: (151, 221) 1374779209 -1.8717514976673124 treat image : temp/1754050227_1178464_1374774098_a5ced166fc59ec87a24f7b3a70c506ec_rle_crop_3900448785_0.png resize: (164, 175) 1374779210 -0.42015851128008025 treat image : temp/1754050227_1178464_1374774077_6490a4df4cb65f9772420e4d8efabe23_rle_crop_3900448790_0.png resize: (169, 305) 1374779211 0.0741563618062006 treat image : temp/1754050227_1178464_1374774077_6490a4df4cb65f9772420e4d8efabe23_rle_crop_3900448791_0.png resize: (1004, 1095) 1374779212 -1.2992725015144093 treat image : temp/1754050227_1178464_1374774075_927cae4cd36d3947a2127c454b28acbf_rle_crop_3900448794_0.png resize: (102, 282) 1374779213 -0.6269129679765433 treat image : temp/1754050227_1178464_1374774067_58484f61466b4780601329d21d605622_rle_crop_3900448799_0.png resize: (154, 225) 1374779214 -2.217243908891525 treat image : temp/1754050227_1178464_1374774067_58484f61466b4780601329d21d605622_rle_crop_3900448800_0.png resize: (84, 195) 1374779215 -2.567776731755715 treat image : temp/1754050227_1178464_1374774051_f1c9e9bdc2e96c9c0c444bbf1666341c_rle_crop_3900448805_0.png resize: (475, 327) 1374779216 -0.30075361597800215 treat image : temp/1754050227_1178464_1374774051_f1c9e9bdc2e96c9c0c444bbf1666341c_rle_crop_3900448806_0.png resize: (93, 163) 1374779217 -3.5357047367602585 treat image : temp/1754050227_1178464_1374774048_770a60d547221865b859b26d3a8616f2_rle_crop_3900448809_0.png resize: (140, 107) 1374779218 -3.25352253475143 treat image : temp/1754050227_1178464_1374774048_770a60d547221865b859b26d3a8616f2_rle_crop_3900448810_0.png resize: (989, 1009) 1374779219 -0.1649694910166257 treat image : temp/1754050227_1178464_1374774044_d16bd94970c0cfc221c0cd3130af2d86_rle_crop_3900448811_0.png resize: (89, 113) 1374779220 -2.0168495817029006 treat image : temp/1754050227_1178464_1374774044_d16bd94970c0cfc221c0cd3130af2d86_rle_crop_3900448813_0.png resize: (340, 527) 1374779221 -1.2713509329487678 treat image : temp/1754050227_1178464_1374774044_d16bd94970c0cfc221c0cd3130af2d86_rle_crop_3900448814_0.png resize: (990, 1020) 1374779222 -0.4234472170004539 treat image : temp/1754050227_1178464_1374774039_3e7c7dcf69986b1f123aec23b5c7aedf_rle_crop_3900448820_0.png resize: (53, 172) 1374779223 -2.357280470547495 treat image : temp/1754050227_1178464_1374774039_3e7c7dcf69986b1f123aec23b5c7aedf_rle_crop_3900448821_0.png resize: (959, 924) 1374779224 0.04669997044986526 treat image : temp/1754050227_1178464_1374774037_ae24e0857f70aec17ddb8df7f3b4d308_rle_crop_3900448825_0.png resize: (402, 327) 1374779225 -0.38630559684014926 treat image : temp/1754050227_1178464_1374774037_ae24e0857f70aec17ddb8df7f3b4d308_rle_crop_3900448826_0.png resize: (196, 108) 1374779226 -1.895295439496703 treat image : temp/1754050227_1178464_1374774027_61e272b0498b7bb990700378f22d80b5_rle_crop_3900448828_0.png resize: (546, 344) 1374779227 -0.3201484508784037 treat image : temp/1754050227_1178464_1374773992_57e021344554f21992588af9c273e41e_rle_crop_3900448836_0.png resize: (352, 125) 1374779228 -5.298978708321573 treat image : temp/1754050227_1178464_1374773973_7548a9904777d1185cb7701e4a7d564e_rle_crop_3900448837_0.png resize: (502, 345) 1374779229 -0.535907146662039 treat image : temp/1754050227_1178464_1374773973_7548a9904777d1185cb7701e4a7d564e_rle_crop_3900448839_0.png resize: (71, 224) 1374779230 -0.6917381934082479 treat image : temp/1754050227_1178464_1374773973_7548a9904777d1185cb7701e4a7d564e_rle_crop_3900448840_0.png resize: (140, 103) 1374779231 -3.069323517795907 treat image : temp/1754050227_1178464_1374773889_20c831b42f2339629efaed8472d4c184_rle_crop_3900448849_0.png resize: (133, 123) 1374779232 -2.3087964809110724 treat image : temp/1754050227_1178464_1374773889_20c831b42f2339629efaed8472d4c184_rle_crop_3900448850_0.png resize: (179, 389) 1374779233 -1.1413242434340065 treat image : temp/1754050227_1178464_1374773889_20c831b42f2339629efaed8472d4c184_rle_crop_3900448853_0.png resize: (137, 85) 1374779234 -1.612181866606074 treat image : temp/1754050227_1178464_1374773889_20c831b42f2339629efaed8472d4c184_rle_crop_3900448854_0.png resize: (179, 152) 1374779235 -0.407546763888367 treat image : temp/1754050227_1178464_1374773776_4765e01f2bf469af38c271f9f02914ee_rle_crop_3900448859_0.png resize: (510, 351) 1374779236 -0.26118558018621624 treat image : temp/1754050227_1178464_1374773776_4765e01f2bf469af38c271f9f02914ee_rle_crop_3900448860_0.png resize: (123, 258) 1374779237 -3.1219900243140937 treat image : temp/1754050227_1178464_1374773611_ec0d79cd111960a8af557086d7ebe673_rle_crop_3900448865_0.png resize: (132, 111) 1374779238 -1.2895148031580894 treat image : temp/1754050227_1178464_1374773611_ec0d79cd111960a8af557086d7ebe673_rle_crop_3900448867_0.png resize: (96, 76) 1374779239 -2.0307604394985646 treat image : temp/1754050227_1178464_1374773603_a5978f9e63aefdf858f367611918e20f_rle_crop_3900448869_0.png resize: (138, 194) 1374779240 -0.5028978938175602 treat image : temp/1754050227_1178464_1374773603_a5978f9e63aefdf858f367611918e20f_rle_crop_3900448870_0.png resize: (899, 636) 1374779241 -0.867238933842868 treat image : temp/1754050227_1178464_1374773599_dd2089503ca7d1b38c5725bdd6beaa90_rle_crop_3900448875_0.png resize: (502, 333) 1374779242 0.35878117955968664 treat image : temp/1754050227_1178464_1374773599_dd2089503ca7d1b38c5725bdd6beaa90_rle_crop_3900448876_0.png resize: (148, 299) 1374779244 -1.4890983752411184 treat image : temp/1754050227_1178464_1374773593_bf341a9c4d192a115123e4ade1b58831_rle_crop_3900448884_0.png resize: (137, 110) 1374779246 -1.9459864302331638 treat image : temp/1754050227_1178464_1374773566_0afb6e0df6f1e7bf71eeca7480527b70_rle_crop_3900448887_0.png resize: (143, 117) 1374779248 -2.1983349980500133 treat image : temp/1754050227_1178464_1374774098_a5ced166fc59ec87a24f7b3a70c506ec_rle_crop_3900448784_0.png resize: (175, 134) 1374779253 -2.9543574964769026 treat image : temp/1754050227_1178464_1374774095_320987331ab71b6360070b1cf71ce3c8_rle_crop_3900448789_0.png resize: (138, 114) 1374779254 -1.954722493983741 treat image : temp/1754050227_1178464_1374774051_f1c9e9bdc2e96c9c0c444bbf1666341c_rle_crop_3900448807_0.png resize: (139, 85) 1374779255 -2.7741888035505107 treat image : temp/1754050227_1178464_1374774039_3e7c7dcf69986b1f123aec23b5c7aedf_rle_crop_3900448819_0.png resize: (135, 127) 1374779256 0.37207906205098623 treat image : temp/1754050227_1178464_1374774037_ae24e0857f70aec17ddb8df7f3b4d308_rle_crop_3900448823_0.png resize: (65, 56) 1374779257 1.2633593800011615 treat image : temp/1754050227_1178464_1374774027_61e272b0498b7bb990700378f22d80b5_rle_crop_3900448827_0.png resize: (96, 113) 1374779258 -2.506589072262468 treat image : temp/1754050227_1178464_1374774027_61e272b0498b7bb990700378f22d80b5_rle_crop_3900448829_0.png resize: (36, 46) 1374779259 1.3785895074256627 treat image : temp/1754050227_1178464_1374773608_bb6e1669de99c1c637129b798399d70a_rle_crop_3900448868_0.png resize: (82, 101) 1374779260 -0.25072899850122315 treat image : temp/1754050227_1178464_1374773593_bf341a9c4d192a115123e4ade1b58831_rle_crop_3900448883_0.png resize: (68, 71) 1374779261 2.0130514561380384 treat image : temp/1754050227_1178464_1374774077_6490a4df4cb65f9772420e4d8efabe23_rle_crop_3900448792_0.png resize: (163, 139) 1374779267 -1.0098982858037882 treat image : temp/1754050227_1178464_1374773751_c21ab387f632f27dcb488dec9d2d75b6_rle_crop_3900448864_0.png resize: (73, 120) 1374779269 -0.9002392933045913 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 148 time used for this insertion : 0.016744375228881836 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 148 time used for this insertion : 0.02996373176574707 save missing photos in datou_result : time spend for datou_step_exec : 28.48287558555603 time spend to save output : 0.05194807052612305 total time spend for step 6 : 28.534823656082153 step7:brightness Fri Aug 1 14:13:05 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1754050227_1178464_1374774101_c8c1d3016720744527ad1f1705b2634e.jpg treat image : temp/1754050227_1178464_1374774098_a5ced166fc59ec87a24f7b3a70c506ec.jpg treat image : temp/1754050227_1178464_1374774095_320987331ab71b6360070b1cf71ce3c8.jpg treat image : temp/1754050227_1178464_1374774077_6490a4df4cb65f9772420e4d8efabe23.jpg treat image : temp/1754050227_1178464_1374774075_927cae4cd36d3947a2127c454b28acbf.jpg treat image : temp/1754050227_1178464_1374774072_cf1b75caa96ffc959a9c88f77db7f473.jpg treat image : temp/1754050227_1178464_1374774069_4a4cc8ec8e8e0c5ffce4c59cbeca3fc7.jpg treat image : temp/1754050227_1178464_1374774067_58484f61466b4780601329d21d605622.jpg treat image : temp/1754050227_1178464_1374774065_43528825b567decc79ac278165a7ab51.jpg treat image : temp/1754050227_1178464_1374774051_f1c9e9bdc2e96c9c0c444bbf1666341c.jpg treat image : temp/1754050227_1178464_1374774048_770a60d547221865b859b26d3a8616f2.jpg treat image : temp/1754050227_1178464_1374774044_d16bd94970c0cfc221c0cd3130af2d86.jpg treat image : temp/1754050227_1178464_1374774041_78a7fe5920b560146c0bb8bac9e69e4d.jpg treat image : temp/1754050227_1178464_1374774039_3e7c7dcf69986b1f123aec23b5c7aedf.jpg treat image : temp/1754050227_1178464_1374774037_ae24e0857f70aec17ddb8df7f3b4d308.jpg treat image : temp/1754050227_1178464_1374774027_61e272b0498b7bb990700378f22d80b5.jpg treat image : temp/1754050227_1178464_1374773998_3daf5f2e9c155ce769488e8162dacea1.jpg treat image : temp/1754050227_1178464_1374773992_57e021344554f21992588af9c273e41e.jpg treat image : temp/1754050227_1178464_1374773989_7b743953c5310cc6ec5c8977816a6816.jpg treat image : temp/1754050227_1178464_1374773973_7548a9904777d1185cb7701e4a7d564e.jpg treat image : temp/1754050227_1178464_1374773955_8ea4080059a88f68a1d0c59e520a6d4f.jpg treat image : temp/1754050227_1178464_1374773889_20c831b42f2339629efaed8472d4c184.jpg treat image : temp/1754050227_1178464_1374773863_9b84fbaf1704cc8b8d635a77e78485cc.jpg treat image : temp/1754050227_1178464_1374773833_0d01ada217925aadcdc2f57bf01fd00d.jpg treat image : temp/1754050227_1178464_1374773803_319c69232117e86dc18c018190fd737d.jpg treat image : temp/1754050227_1178464_1374773776_4765e01f2bf469af38c271f9f02914ee.jpg treat image : temp/1754050227_1178464_1374773751_c21ab387f632f27dcb488dec9d2d75b6.jpg treat image : temp/1754050227_1178464_1374773611_ec0d79cd111960a8af557086d7ebe673.jpg treat image : temp/1754050227_1178464_1374773608_bb6e1669de99c1c637129b798399d70a.jpg treat image : temp/1754050227_1178464_1374773603_a5978f9e63aefdf858f367611918e20f.jpg treat image : temp/1754050227_1178464_1374773599_dd2089503ca7d1b38c5725bdd6beaa90.jpg treat image : temp/1754050227_1178464_1374773596_0431f22db99bc18e469c63dd4964b4ce.jpg treat image : temp/1754050227_1178464_1374773593_bf341a9c4d192a115123e4ade1b58831.jpg treat image : temp/1754050227_1178464_1374773566_0afb6e0df6f1e7bf71eeca7480527b70.jpg treat image : temp/1754050227_1178464_1374774101_c8c1d3016720744527ad1f1705b2634e_rle_crop_3900448774_0.png treat image : temp/1754050227_1178464_1374774101_c8c1d3016720744527ad1f1705b2634e_rle_crop_3900448775_0.png treat image : temp/1754050227_1178464_1374774098_a5ced166fc59ec87a24f7b3a70c506ec_rle_crop_3900448779_0.png treat image : temp/1754050227_1178464_1374774098_a5ced166fc59ec87a24f7b3a70c506ec_rle_crop_3900448780_0.png treat image : temp/1754050227_1178464_1374774098_a5ced166fc59ec87a24f7b3a70c506ec_rle_crop_3900448781_0.png treat image : temp/1754050227_1178464_1374774098_a5ced166fc59ec87a24f7b3a70c506ec_rle_crop_3900448782_0.png treat image : temp/1754050227_1178464_1374774098_a5ced166fc59ec87a24f7b3a70c506ec_rle_crop_3900448786_0.png treat image : temp/1754050227_1178464_1374774075_927cae4cd36d3947a2127c454b28acbf_rle_crop_3900448793_0.png treat image : temp/1754050227_1178464_1374774075_927cae4cd36d3947a2127c454b28acbf_rle_crop_3900448795_0.png treat image : temp/1754050227_1178464_1374774072_cf1b75caa96ffc959a9c88f77db7f473_rle_crop_3900448796_0.png treat image : temp/1754050227_1178464_1374774069_4a4cc8ec8e8e0c5ffce4c59cbeca3fc7_rle_crop_3900448797_0.png treat image : temp/1754050227_1178464_1374774069_4a4cc8ec8e8e0c5ffce4c59cbeca3fc7_rle_crop_3900448798_0.png treat image : temp/1754050227_1178464_1374774065_43528825b567decc79ac278165a7ab51_rle_crop_3900448801_0.png treat image : temp/1754050227_1178464_1374774065_43528825b567decc79ac278165a7ab51_rle_crop_3900448802_0.png treat image : temp/1754050227_1178464_1374774051_f1c9e9bdc2e96c9c0c444bbf1666341c_rle_crop_3900448803_0.png treat image : temp/1754050227_1178464_1374774051_f1c9e9bdc2e96c9c0c444bbf1666341c_rle_crop_3900448804_0.png treat image : temp/1754050227_1178464_1374774044_d16bd94970c0cfc221c0cd3130af2d86_rle_crop_3900448812_0.png treat image : temp/1754050227_1178464_1374774041_78a7fe5920b560146c0bb8bac9e69e4d_rle_crop_3900448815_0.png treat image : temp/1754050227_1178464_1374774041_78a7fe5920b560146c0bb8bac9e69e4d_rle_crop_3900448816_0.png treat image : temp/1754050227_1178464_1374774037_ae24e0857f70aec17ddb8df7f3b4d308_rle_crop_3900448824_0.png treat image : temp/1754050227_1178464_1374774027_61e272b0498b7bb990700378f22d80b5_rle_crop_3900448830_0.png treat image : temp/1754050227_1178464_1374773998_3daf5f2e9c155ce769488e8162dacea1_rle_crop_3900448832_0.png treat image : temp/1754050227_1178464_1374773998_3daf5f2e9c155ce769488e8162dacea1_rle_crop_3900448833_0.png treat image : temp/1754050227_1178464_1374773998_3daf5f2e9c155ce769488e8162dacea1_rle_crop_3900448834_0.png treat image : temp/1754050227_1178464_1374773992_57e021344554f21992588af9c273e41e_rle_crop_3900448835_0.png treat image : temp/1754050227_1178464_1374773973_7548a9904777d1185cb7701e4a7d564e_rle_crop_3900448838_0.png treat image : temp/1754050227_1178464_1374773973_7548a9904777d1185cb7701e4a7d564e_rle_crop_3900448841_0.png treat image : temp/1754050227_1178464_1374773955_8ea4080059a88f68a1d0c59e520a6d4f_rle_crop_3900448844_0.png treat image : temp/1754050227_1178464_1374773955_8ea4080059a88f68a1d0c59e520a6d4f_rle_crop_3900448845_0.png treat image : temp/1754050227_1178464_1374773955_8ea4080059a88f68a1d0c59e520a6d4f_rle_crop_3900448847_0.png treat image : temp/1754050227_1178464_1374773889_20c831b42f2339629efaed8472d4c184_rle_crop_3900448851_0.png treat image : temp/1754050227_1178464_1374773863_9b84fbaf1704cc8b8d635a77e78485cc_rle_crop_3900448855_0.png treat image : temp/1754050227_1178464_1374773803_319c69232117e86dc18c018190fd737d_rle_crop_3900448857_0.png treat image : temp/1754050227_1178464_1374773751_c21ab387f632f27dcb488dec9d2d75b6_rle_crop_3900448861_0.png treat image : temp/1754050227_1178464_1374773751_c21ab387f632f27dcb488dec9d2d75b6_rle_crop_3900448862_0.png treat image : temp/1754050227_1178464_1374773751_c21ab387f632f27dcb488dec9d2d75b6_rle_crop_3900448863_0.png treat image : temp/1754050227_1178464_1374773611_ec0d79cd111960a8af557086d7ebe673_rle_crop_3900448866_0.png treat image : temp/1754050227_1178464_1374773603_a5978f9e63aefdf858f367611918e20f_rle_crop_3900448871_0.png treat image : temp/1754050227_1178464_1374773599_dd2089503ca7d1b38c5725bdd6beaa90_rle_crop_3900448872_0.png treat image : temp/1754050227_1178464_1374773599_dd2089503ca7d1b38c5725bdd6beaa90_rle_crop_3900448874_0.png treat image : temp/1754050227_1178464_1374773599_dd2089503ca7d1b38c5725bdd6beaa90_rle_crop_3900448877_0.png treat image : temp/1754050227_1178464_1374773596_0431f22db99bc18e469c63dd4964b4ce_rle_crop_3900448878_0.png treat image : temp/1754050227_1178464_1374773593_bf341a9c4d192a115123e4ade1b58831_rle_crop_3900448880_0.png treat image : temp/1754050227_1178464_1374773593_bf341a9c4d192a115123e4ade1b58831_rle_crop_3900448881_0.png treat image : temp/1754050227_1178464_1374773593_bf341a9c4d192a115123e4ade1b58831_rle_crop_3900448885_0.png treat image : temp/1754050227_1178464_1374774101_c8c1d3016720744527ad1f1705b2634e_rle_crop_3900448776_0.png treat image : temp/1754050227_1178464_1374774101_c8c1d3016720744527ad1f1705b2634e_rle_crop_3900448778_0.png treat image : temp/1754050227_1178464_1374774095_320987331ab71b6360070b1cf71ce3c8_rle_crop_3900448787_0.png treat image : temp/1754050227_1178464_1374774095_320987331ab71b6360070b1cf71ce3c8_rle_crop_3900448788_0.png treat image : temp/1754050227_1178464_1374774051_f1c9e9bdc2e96c9c0c444bbf1666341c_rle_crop_3900448808_0.png treat image : temp/1754050227_1178464_1374774041_78a7fe5920b560146c0bb8bac9e69e4d_rle_crop_3900448818_0.png treat image : temp/1754050227_1178464_1374774037_ae24e0857f70aec17ddb8df7f3b4d308_rle_crop_3900448822_0.png treat image : temp/1754050227_1178464_1374773955_8ea4080059a88f68a1d0c59e520a6d4f_rle_crop_3900448842_0.png treat image : temp/1754050227_1178464_1374773955_8ea4080059a88f68a1d0c59e520a6d4f_rle_crop_3900448843_0.png treat image : temp/1754050227_1178464_1374773955_8ea4080059a88f68a1d0c59e520a6d4f_rle_crop_3900448846_0.png treat image : temp/1754050227_1178464_1374773955_8ea4080059a88f68a1d0c59e520a6d4f_rle_crop_3900448848_0.png treat image : temp/1754050227_1178464_1374773889_20c831b42f2339629efaed8472d4c184_rle_crop_3900448852_0.png treat image : temp/1754050227_1178464_1374773803_319c69232117e86dc18c018190fd737d_rle_crop_3900448856_0.png treat image : temp/1754050227_1178464_1374773803_319c69232117e86dc18c018190fd737d_rle_crop_3900448858_0.png treat image : temp/1754050227_1178464_1374773599_dd2089503ca7d1b38c5725bdd6beaa90_rle_crop_3900448873_0.png treat image : temp/1754050227_1178464_1374773593_bf341a9c4d192a115123e4ade1b58831_rle_crop_3900448882_0.png treat image : temp/1754050227_1178464_1374773566_0afb6e0df6f1e7bf71eeca7480527b70_rle_crop_3900448886_0.png treat image : temp/1754050227_1178464_1374774041_78a7fe5920b560146c0bb8bac9e69e4d_rle_crop_3900448817_0.png treat image : temp/1754050227_1178464_1374774027_61e272b0498b7bb990700378f22d80b5_rle_crop_3900448831_0.png treat image : temp/1754050227_1178464_1374773596_0431f22db99bc18e469c63dd4964b4ce_rle_crop_3900448879_0.png treat image : temp/1754050227_1178464_1374774101_c8c1d3016720744527ad1f1705b2634e_rle_crop_3900448777_0.png treat image : temp/1754050227_1178464_1374774098_a5ced166fc59ec87a24f7b3a70c506ec_rle_crop_3900448783_0.png treat image : temp/1754050227_1178464_1374774098_a5ced166fc59ec87a24f7b3a70c506ec_rle_crop_3900448785_0.png treat image : temp/1754050227_1178464_1374774077_6490a4df4cb65f9772420e4d8efabe23_rle_crop_3900448790_0.png treat image : temp/1754050227_1178464_1374774077_6490a4df4cb65f9772420e4d8efabe23_rle_crop_3900448791_0.png treat image : temp/1754050227_1178464_1374774075_927cae4cd36d3947a2127c454b28acbf_rle_crop_3900448794_0.png treat image : temp/1754050227_1178464_1374774067_58484f61466b4780601329d21d605622_rle_crop_3900448799_0.png treat image : temp/1754050227_1178464_1374774067_58484f61466b4780601329d21d605622_rle_crop_3900448800_0.png treat image : temp/1754050227_1178464_1374774051_f1c9e9bdc2e96c9c0c444bbf1666341c_rle_crop_3900448805_0.png treat image : temp/1754050227_1178464_1374774051_f1c9e9bdc2e96c9c0c444bbf1666341c_rle_crop_3900448806_0.png treat image : temp/1754050227_1178464_1374774048_770a60d547221865b859b26d3a8616f2_rle_crop_3900448809_0.png treat image : temp/1754050227_1178464_1374774048_770a60d547221865b859b26d3a8616f2_rle_crop_3900448810_0.png treat image : temp/1754050227_1178464_1374774044_d16bd94970c0cfc221c0cd3130af2d86_rle_crop_3900448811_0.png treat image : temp/1754050227_1178464_1374774044_d16bd94970c0cfc221c0cd3130af2d86_rle_crop_3900448813_0.png treat image : temp/1754050227_1178464_1374774044_d16bd94970c0cfc221c0cd3130af2d86_rle_crop_3900448814_0.png treat image : temp/1754050227_1178464_1374774039_3e7c7dcf69986b1f123aec23b5c7aedf_rle_crop_3900448820_0.png treat image : temp/1754050227_1178464_1374774039_3e7c7dcf69986b1f123aec23b5c7aedf_rle_crop_3900448821_0.png treat image : temp/1754050227_1178464_1374774037_ae24e0857f70aec17ddb8df7f3b4d308_rle_crop_3900448825_0.png treat image : temp/1754050227_1178464_1374774037_ae24e0857f70aec17ddb8df7f3b4d308_rle_crop_3900448826_0.png treat image : temp/1754050227_1178464_1374774027_61e272b0498b7bb990700378f22d80b5_rle_crop_3900448828_0.png treat image : temp/1754050227_1178464_1374773992_57e021344554f21992588af9c273e41e_rle_crop_3900448836_0.png treat image : temp/1754050227_1178464_1374773973_7548a9904777d1185cb7701e4a7d564e_rle_crop_3900448837_0.png treat image : temp/1754050227_1178464_1374773973_7548a9904777d1185cb7701e4a7d564e_rle_crop_3900448839_0.png treat image : temp/1754050227_1178464_1374773973_7548a9904777d1185cb7701e4a7d564e_rle_crop_3900448840_0.png treat image : temp/1754050227_1178464_1374773889_20c831b42f2339629efaed8472d4c184_rle_crop_3900448849_0.png treat image : temp/1754050227_1178464_1374773889_20c831b42f2339629efaed8472d4c184_rle_crop_3900448850_0.png treat image : temp/1754050227_1178464_1374773889_20c831b42f2339629efaed8472d4c184_rle_crop_3900448853_0.png treat image : temp/1754050227_1178464_1374773889_20c831b42f2339629efaed8472d4c184_rle_crop_3900448854_0.png treat image : temp/1754050227_1178464_1374773776_4765e01f2bf469af38c271f9f02914ee_rle_crop_3900448859_0.png treat image : temp/1754050227_1178464_1374773776_4765e01f2bf469af38c271f9f02914ee_rle_crop_3900448860_0.png treat image : temp/1754050227_1178464_1374773611_ec0d79cd111960a8af557086d7ebe673_rle_crop_3900448865_0.png treat image : temp/1754050227_1178464_1374773611_ec0d79cd111960a8af557086d7ebe673_rle_crop_3900448867_0.png treat image : temp/1754050227_1178464_1374773603_a5978f9e63aefdf858f367611918e20f_rle_crop_3900448869_0.png treat image : temp/1754050227_1178464_1374773603_a5978f9e63aefdf858f367611918e20f_rle_crop_3900448870_0.png treat image : temp/1754050227_1178464_1374773599_dd2089503ca7d1b38c5725bdd6beaa90_rle_crop_3900448875_0.png treat image : temp/1754050227_1178464_1374773599_dd2089503ca7d1b38c5725bdd6beaa90_rle_crop_3900448876_0.png treat image : temp/1754050227_1178464_1374773593_bf341a9c4d192a115123e4ade1b58831_rle_crop_3900448884_0.png treat image : temp/1754050227_1178464_1374773566_0afb6e0df6f1e7bf71eeca7480527b70_rle_crop_3900448887_0.png treat image : temp/1754050227_1178464_1374774098_a5ced166fc59ec87a24f7b3a70c506ec_rle_crop_3900448784_0.png treat image : temp/1754050227_1178464_1374774095_320987331ab71b6360070b1cf71ce3c8_rle_crop_3900448789_0.png treat image : temp/1754050227_1178464_1374774051_f1c9e9bdc2e96c9c0c444bbf1666341c_rle_crop_3900448807_0.png treat image : temp/1754050227_1178464_1374774039_3e7c7dcf69986b1f123aec23b5c7aedf_rle_crop_3900448819_0.png treat image : temp/1754050227_1178464_1374774037_ae24e0857f70aec17ddb8df7f3b4d308_rle_crop_3900448823_0.png treat image : temp/1754050227_1178464_1374774027_61e272b0498b7bb990700378f22d80b5_rle_crop_3900448827_0.png treat image : temp/1754050227_1178464_1374774027_61e272b0498b7bb990700378f22d80b5_rle_crop_3900448829_0.png treat image : temp/1754050227_1178464_1374773608_bb6e1669de99c1c637129b798399d70a_rle_crop_3900448868_0.png treat image : temp/1754050227_1178464_1374773593_bf341a9c4d192a115123e4ade1b58831_rle_crop_3900448883_0.png treat image : temp/1754050227_1178464_1374774077_6490a4df4cb65f9772420e4d8efabe23_rle_crop_3900448792_0.png treat image : temp/1754050227_1178464_1374773751_c21ab387f632f27dcb488dec9d2d75b6_rle_crop_3900448864_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 148 time used for this insertion : 0.02064228057861328 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 148 time used for this insertion : 0.04149794578552246 save missing photos in datou_result : time spend for datou_step_exec : 7.981461524963379 time spend to save output : 0.06710600852966309 total time spend for step 7 : 8.048567533493042 step8:velours_tree Fri Aug 1 14:13:13 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.08016514778137207 time spend to save output : 3.552436828613281e-05 total time spend for step 8 : 0.0802006721496582 step9:send_mail_cod Fri Aug 1 14:13:13 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P25584297_01-08-2025_14_13_13.pdf 25584333 change filename to text .imagette255843331754050393 25584334 imagette255843341754050393 25584335 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette255843351754050393 25584336 imagette255843361754050394 25584337 imagette255843371754050394 25584338 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette255843381754050394 25584339 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette255843391754050395 25584340 change filename to text .change filename to text .change filename to text .imagette255843401754050396 25584342 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette255843421754050396 25584343 change filename to text .imagette255843431754050397 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=25584297 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/25584333,25584334,25584335,25584336,25584337,25584338,25584339,25584340,25584341,25584342,25584343?tags=pet_fonce,flou,pet_clair,mal_croppe,background,papier,autre,metal,environnement,carton,pehd args[1374774101] : ((1374774101, -0.8917639031019186, 492688767), (1374774101, 0.7742432719259857, 2107752395), '0.07867310900054467') We are sending mail with results at report@fotonower.com args[1374774098] : ((1374774098, -0.6043996437949607, 492688767), (1374774098, 0.4187922787431166, 2107752395), '0.07867310900054467') We are sending mail with results at report@fotonower.com args[1374774095] : ((1374774095, 0.7537860146713259, 492688767), (1374774095, 0.6910048583741623, 2107752395), '0.07867310900054467') We are sending mail with results at report@fotonower.com args[1374774077] : ((1374774077, 0.504547986229238, 492688767), (1374774077, 0.6630672535878743, 2107752395), '0.07867310900054467') We are sending mail with results at report@fotonower.com args[1374774075] : ((1374774075, 0.26570094382978077, 492688767), (1374774075, 0.5388364542250761, 2107752395), '0.07867310900054467') We are sending mail with results at report@fotonower.com args[1374774072] : ((1374774072, 0.11189433452624921, 492688767), (1374774072, 0.6485718324145145, 2107752395), '0.07867310900054467') We are sending mail with results at report@fotonower.com args[1374774069] : ((1374774069, -0.34039258863861327, 492688767), (1374774069, 0.8394298538649638, 2107752395), '0.07867310900054467') We are sending mail with results at report@fotonower.com args[1374774067] : ((1374774067, -1.1868817224572268, 492688767), (1374774067, 0.8773467715280048, 2107752395), '0.07867310900054467') We are sending mail with results at report@fotonower.com args[1374774065] : ((1374774065, 0.22134300114498864, 492688767), (1374774065, 0.6380722209782604, 2107752395), '0.07867310900054467') We are sending mail with results at report@fotonower.com args[1374774051] : ((1374774051, -0.06605077822439519, 492688767), (1374774051, 0.4543352551857323, 2107752395), '0.07867310900054467') We are sending mail with results at report@fotonower.com args[1374774048] : ((1374774048, -0.9437625700403957, 492688767), (1374774048, 0.8708570177581808, 2107752395), '0.07867310900054467') We are sending mail with results at report@fotonower.com args[1374774044] : ((1374774044, -0.35321654610566666, 492688767), (1374774044, 1.0381055084254749, 2107752395), '0.07867310900054467') We are sending mail with results at report@fotonower.com args[1374774041] : ((1374774041, -0.860651499298263, 492688767), (1374774041, 0.34482022676328916, 2107752395), '0.07867310900054467') We are sending mail with results at report@fotonower.com args[1374774039] : ((1374774039, -0.2596393022708814, 492688767), (1374774039, 0.4064412311093228, 2107752395), '0.07867310900054467') We are sending mail with results at report@fotonower.com args[1374774037] : ((1374774037, 0.20032091540964145, 492688767), (1374774037, 0.6826419665892955, 2107752395), '0.07867310900054467') We are sending mail with results at report@fotonower.com args[1374774027] : ((1374774027, -0.6513285767909659, 492688767), (1374774027, 0.5878535776272511, 2107752395), '0.07867310900054467') We are sending mail with results at report@fotonower.com args[1374773998] : ((1374773998, 2.514786948782625, 492688767), (1374773998, 0.5872219438177118, 2107752395), '0.07867310900054467') We are sending mail with results at report@fotonower.com args[1374773992] : ((1374773992, -1.0145785304403137, 492688767), (1374773992, 0.7182632795637578, 2107752395), '0.07867310900054467') We are sending mail with results at report@fotonower.com args[1374773989] : ((1374773989, 1.0365483919952645, 492688767), (1374773989, 0.4106059722668207, 2107752395), '0.07867310900054467') We are sending mail with results at report@fotonower.com args[1374773973] : ((1374773973, 0.5532853268574971, 492688767), (1374773973, 0.2769648736783274, 2107752395), '0.07867310900054467') We are sending mail with results at report@fotonower.com args[1374773955] : ((1374773955, 0.7021362962472746, 492688767), (1374773955, 0.48317826713444045, 2107752395), '0.07867310900054467') We are sending mail with results at report@fotonower.com args[1374773889] : ((1374773889, 1.010882898080989, 492688767), (1374773889, 0.548473243810692, 2107752395), '0.07867310900054467') We are sending mail with results at report@fotonower.com args[1374773863] : ((1374773863, 0.5973855422706785, 492688767), (1374773863, 0.8485870091846881, 2107752395), '0.07867310900054467') We are sending mail with results at report@fotonower.com args[1374773833] : ((1374773833, 0.3970864552930348, 492688767), (1374773833, 0.5341130667096546, 2107752395), '0.07867310900054467') We are sending mail with results at report@fotonower.com args[1374773803] : ((1374773803, 0.09903485900706752, 492688767), (1374773803, 0.47931052794045914, 2107752395), '0.07867310900054467') We are sending mail with results at report@fotonower.com args[1374773776] : ((1374773776, -1.3127718823041914, 492688767), (1374773776, 0.6754796377748237, 2107752395), '0.07867310900054467') We are sending mail with results at report@fotonower.com args[1374773751] : ((1374773751, 0.42099060152367845, 492688767), (1374773751, 0.4471464861275559, 2107752395), '0.07867310900054467') We are sending mail with results at report@fotonower.com args[1374773611] : ((1374773611, 0.6596622447448998, 492688767), (1374773611, 0.6167516609151529, 2107752395), '0.07867310900054467') We are sending mail with results at report@fotonower.com args[1374773608] : ((1374773608, 1.6859264931652056, 492688767), (1374773608, 0.8320408362862739, 2107752395), '0.07867310900054467') We are sending mail with results at report@fotonower.com args[1374773603] : ((1374773603, 2.906880628011953, 492688767), (1374773603, 0.6638072984900674, 2107752395), '0.07867310900054467') We are sending mail with results at report@fotonower.com args[1374773599] : ((1374773599, 0.7977240588167903, 492688767), (1374773599, 0.36514924199873566, 2107752395), '0.07867310900054467') We are sending mail with results at report@fotonower.com args[1374773596] : ((1374773596, -0.035091453059511515, 492688767), (1374773596, 0.8042563844289404, 2107752395), '0.07867310900054467') We are sending mail with results at report@fotonower.com args[1374773593] : ((1374773593, -0.37213503758903976, 492688767), (1374773593, 0.6005054166842981, 2107752395), '0.07867310900054467') We are sending mail with results at report@fotonower.com args[1374773566] : ((1374773566, 1.0109604783599837, 492688767), (1374773566, 0.5393703022282448, 2107752395), '0.07867310900054467') We are sending mail with results at report@fotonower.com refus_total : 0.07867310900054467 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=25584297 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25584297_01-08-2025_14_13_13.pdf results_Auto_P25584297_01-08-2025_14_13_13.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25584297_01-08-2025_14_13_13.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','25584297','results_Auto_P25584297_01-08-2025_14_13_13.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25584297_01-08-2025_14_13_13.pdf','pdf','','0.44','0.07867310900054467') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/25584297

https://www.fotonower.com/image?json=false&list_photos_id=1374774101
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1374774098
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1374774095
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1374774077
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1374774075
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1374774072
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1374774069
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1374774067
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1374774065
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1374774051
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1374774048
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1374774044
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1374774041
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1374774039
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1374774037
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1374774027
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1374773998
La photo est trop floue, merci de reprendre une photo.(avec le score = 2.514786948782625)
https://www.fotonower.com/image?json=false&list_photos_id=1374773992
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1374773989
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.0365483919952645)
https://www.fotonower.com/image?json=false&list_photos_id=1374773973
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1374773955
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1374773889
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.010882898080989)
https://www.fotonower.com/image?json=false&list_photos_id=1374773863
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1374773833
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1374773803
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1374773776
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1374773751
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1374773611
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1374773608
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.6859264931652056)
https://www.fotonower.com/image?json=false&list_photos_id=1374773603
La photo est trop floue, merci de reprendre une photo.(avec le score = 2.906880628011953)
https://www.fotonower.com/image?json=false&list_photos_id=1374773599
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1374773596
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1374773593
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1374773566
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.0109604783599837)

Dans ces conditions,le taux de refus est: 7.87%
Veuillez trouver les photos des contaminants.

exemples de contaminants: pet_fonce: https://www.fotonower.com/view/25584333?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/25584335?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/25584338?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/25584339?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/25584340?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/25584342?limit=200
exemples de contaminants: pehd: https://www.fotonower.com/view/25584343?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25584297_01-08-2025_14_13_13.pdf.

Lien vers velours :https://www.fotonower.com/velours/25584333,25584334,25584335,25584336,25584337,25584338,25584339,25584340,25584341,25584342,25584343?tags=pet_fonce,flou,pet_clair,mal_croppe,background,papier,autre,metal,environnement,carton,pehd.


L'équipe Fotonower 202 b'' Server: nginx Date: Fri, 01 Aug 2025 12:13:20 GMT Content-Length: 0 Connection: close X-Message-Id: EJiWD_wmSVOwoHr9xah6nw Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1374774101, 1374774098, 1374774095, 1374774077, 1374774075, 1374774072, 1374774069, 1374774067, 1374774065, 1374774051, 1374774048, 1374774044, 1374774041, 1374774039, 1374774037, 1374774027, 1374773998, 1374773992, 1374773989, 1374773973, 1374773955, 1374773889, 1374773863, 1374773833, 1374773803, 1374773776, 1374773751, 1374773611, 1374773608, 1374773603, 1374773599, 1374773596, 1374773593, 1374773566] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774101', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774098', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774095', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774077', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774075', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774072', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774069', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774067', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774065', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774051', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774048', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774044', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774041', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774039', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774037', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774027', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773998', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773992', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773989', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773973', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773955', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773889', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773863', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773833', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773803', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773776', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773751', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773611', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773608', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773603', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773599', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773596', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773593', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773566', None, None, None, None, None, '3422341') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 34 time used for this insertion : 0.01731705665588379 save_final save missing photos in datou_result : time spend for datou_step_exec : 6.866113662719727 time spend to save output : 0.017650127410888672 total time spend for step 9 : 6.883763790130615 step10:split_time_score Fri Aug 1 14:13:20 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('13', 34),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 01082025 25584297 Nombre de photos uploadées : 34 / 23040 (0%) 01082025 25584297 Nombre de photos taguées (types de déchets): 0 / 34 (0%) 01082025 25584297 Nombre de photos taguées (volume) : 0 / 34 (0%) elapsed_time : load_data_split_time_score 1.6689300537109375e-06 elapsed_time : order_list_meta_photo_and_scores 5.0067901611328125e-06 ?????????????????????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.002115011215209961 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.2039651870727539 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.129726261091821 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25581210_01-08-2025_11_21_35.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25581210 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25581210 AND mptpi.`type`=3594 To do Qualite : 0.08000464168595678 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25582614_01-08-2025_12_41_33.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25582614 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25582614 AND mptpi.`type`=3594 To do Qualite : 0.20749459187610225 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25581212_01-08-2025_11_12_16.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25581212 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25581212 AND mptpi.`type`=3594 To do Qualite : 0.24190254870756175 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25581213_01-08-2025_12_42_49.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25581213 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25581213 AND mptpi.`type`=3594 To do Qualite : 0.05313503689236112 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25581215_01-08-2025_10_42_17.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25581215 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25581215 AND mptpi.`type`=3594 To do Qualite : 0.0346822193287037 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25582617_01-08-2025_12_32_26.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25582617 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25582617 AND mptpi.`type`=3594 To do Qualite : 0.05554378419612791 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25582619_01-08-2025_12_22_48.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25582619 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25582619 AND mptpi.`type`=3594 To do Qualite : 0.11536986132544579 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25582621_01-08-2025_12_12_19.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25582621 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25582621 AND mptpi.`type`=3594 To do Qualite : 0.10505108438051147 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25583539_01-08-2025_13_21_53.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25583539 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25583539 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25583540 order by id desc limit 1 Qualite : 0.07867310900054467 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25584297_01-08-2025_14_13_13.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25584297 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25584297 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'01082025': {'nb_upload': 34, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1374774101, 1374774098, 1374774095, 1374774077, 1374774075, 1374774072, 1374774069, 1374774067, 1374774065, 1374774051, 1374774048, 1374774044, 1374774041, 1374774039, 1374774037, 1374774027, 1374773998, 1374773992, 1374773989, 1374773973, 1374773955, 1374773889, 1374773863, 1374773833, 1374773803, 1374773776, 1374773751, 1374773611, 1374773608, 1374773603, 1374773599, 1374773596, 1374773593, 1374773566] Looping around the photos to save general results len do output : 1 /25584297Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774101', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774098', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774095', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774077', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774075', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774072', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774069', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774067', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774065', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774051', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774048', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774044', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774041', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774039', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774037', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374774027', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773998', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773992', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773989', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773973', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773955', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773889', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773863', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773833', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773803', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773776', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773751', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773611', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773608', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773603', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773599', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773596', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773593', None, None, None, None, None, '3422341') ('3318', None, None, None, None, None, None, None, '3422341') ('3318', '25584297', '1374773566', None, None, None, None, None, '3422341') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 35 time used for this insertion : 0.02001643180847168 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.8743689060211182 time spend to save output : 0.020406007766723633 total time spend for step 10 : 1.8947749137878418 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 34 set_done_treatment 98.85user 38.89system 2:57.53elapsed 77%CPU (0avgtext+0avgdata 3463108maxresident)k 148512inputs+46544outputs (34major+2643847minor)pagefaults 0swaps