python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2296190 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3343664'] with mtr_portfolio_ids : ['25290433'] and first list_photo_ids : [] new path : /proc/2296190/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 8 ; length of list_pids : 8 ; length of list_args : 8 time to download the photos : 1.5397491455078125 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Thu Jul 24 20:10:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10957 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-07-24 20:10:33.468724: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-07-24 20:10:33.495324: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493035000 Hz 2025-07-24 20:10:33.497440: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fb3dc000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-07-24 20:10:33.497497: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-07-24 20:10:33.501303: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-07-24 20:10:33.700606: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x3adfb5a0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-07-24 20:10:33.700657: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-07-24 20:10:33.702702: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-07-24 20:10:33.703102: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-07-24 20:10:33.706088: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-07-24 20:10:33.708911: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-07-24 20:10:33.709395: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-07-24 20:10:33.712678: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-07-24 20:10:33.713714: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-07-24 20:10:33.717988: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-07-24 20:10:33.719481: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-07-24 20:10:33.719556: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-07-24 20:10:33.720364: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-07-24 20:10:33.720380: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-07-24 20:10:33.720389: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-07-24 20:10:33.721709: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10011 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-07-24 20:10:33.974751: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-07-24 20:10:33.974878: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-07-24 20:10:33.974907: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-07-24 20:10:33.974933: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-07-24 20:10:33.974957: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-07-24 20:10:33.974981: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-07-24 20:10:33.975005: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-07-24 20:10:33.975029: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-07-24 20:10:33.976740: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-07-24 20:10:33.977821: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-07-24 20:10:33.977849: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-07-24 20:10:33.977864: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-07-24 20:10:33.977876: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-07-24 20:10:33.977889: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-07-24 20:10:33.977901: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-07-24 20:10:33.977914: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-07-24 20:10:33.977926: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-07-24 20:10:33.979086: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-07-24 20:10:33.979117: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-07-24 20:10:33.979125: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-07-24 20:10:33.979132: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-07-24 20:10:33.980355: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10011 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-07-24 20:10:45.274415: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-07-24 20:10:45.446835: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 8 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 37 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 52 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 50 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 45 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 44 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 27 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 21 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 11 Detection mask done ! Trying to reset tf kernel 2296782 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5665 tf kernel not reseted sub process len(results) : 8 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 8 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10957 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0028870105743408203 nb_pixel_total : 100748 time to create 1 rle with old method : 0.10750055313110352 length of segment : 426 time for calcul the mask position with numpy : 0.004152536392211914 nb_pixel_total : 147386 time to create 1 rle with old method : 0.17749714851379395 length of segment : 438 time for calcul the mask position with numpy : 0.00715947151184082 nb_pixel_total : 249580 time to create 1 rle with new method : 0.01935887336730957 length of segment : 606 time for calcul the mask position with numpy : 0.0044939517974853516 nb_pixel_total : 230336 time to create 1 rle with new method : 0.016714811325073242 length of segment : 520 time for calcul the mask position with numpy : 0.0017440319061279297 nb_pixel_total : 103210 time to create 1 rle with old method : 0.10703563690185547 length of segment : 360 time for calcul the mask position with numpy : 0.0004928112030029297 nb_pixel_total : 24739 time to create 1 rle with old method : 0.026698827743530273 length of segment : 134 time for calcul the mask position with numpy : 0.00043272972106933594 nb_pixel_total : 22523 time to create 1 rle with old method : 0.024660587310791016 length of segment : 168 time for calcul the mask position with numpy : 0.004152059555053711 nb_pixel_total : 240189 time to create 1 rle with new method : 0.020670652389526367 length of segment : 561 time for calcul the mask position with numpy : 0.001495361328125 nb_pixel_total : 62314 time to create 1 rle with old method : 0.06538152694702148 length of segment : 330 time for calcul the mask position with numpy : 0.0005655288696289062 nb_pixel_total : 15238 time to create 1 rle with old method : 0.01717686653137207 length of segment : 116 time for calcul the mask position with numpy : 0.0012671947479248047 nb_pixel_total : 52357 time to create 1 rle with old method : 0.05783367156982422 length of segment : 348 time for calcul the mask position with numpy : 0.0003981590270996094 nb_pixel_total : 24526 time to create 1 rle with old method : 0.030248165130615234 length of segment : 115 time for calcul the mask position with numpy : 0.0008845329284667969 nb_pixel_total : 32403 time to create 1 rle with old method : 0.040160417556762695 length of segment : 304 time for calcul the mask position with numpy : 0.001619577407836914 nb_pixel_total : 92891 time to create 1 rle with old method : 0.10616779327392578 length of segment : 330 time for calcul the mask position with numpy : 0.0007104873657226562 nb_pixel_total : 42496 time to create 1 rle with old method : 0.04661917686462402 length of segment : 346 time for calcul the mask position with numpy : 0.0011932849884033203 nb_pixel_total : 70579 time to create 1 rle with old method : 0.07979917526245117 length of segment : 290 time for calcul the mask position with numpy : 0.0014526844024658203 nb_pixel_total : 90844 time to create 1 rle with old method : 0.10049581527709961 length of segment : 390 time for calcul the mask position with numpy : 0.0009002685546875 nb_pixel_total : 35184 time to create 1 rle with old method : 0.04059886932373047 length of segment : 253 time for calcul the mask position with numpy : 0.002722024917602539 nb_pixel_total : 125086 time to create 1 rle with old method : 0.166029691696167 length of segment : 409 time for calcul the mask position with numpy : 0.0010957717895507812 nb_pixel_total : 55250 time to create 1 rle with old method : 0.07490038871765137 length of segment : 190 time for calcul the mask position with numpy : 0.002246379852294922 nb_pixel_total : 108392 time to create 1 rle with old method : 0.1353168487548828 length of segment : 576 time for calcul the mask position with numpy : 0.0011768341064453125 nb_pixel_total : 54323 time to create 1 rle with old method : 0.08379864692687988 length of segment : 258 time for calcul the mask position with numpy : 0.0025098323822021484 nb_pixel_total : 101990 time to create 1 rle with old method : 0.13065195083618164 length of segment : 738 time for calcul the mask position with numpy : 0.0015289783477783203 nb_pixel_total : 69340 time to create 1 rle with old method : 0.08838701248168945 length of segment : 421 time for calcul the mask position with numpy : 0.0006973743438720703 nb_pixel_total : 32802 time to create 1 rle with old method : 0.04660487174987793 length of segment : 136 time for calcul the mask position with numpy : 0.0034325122833251953 nb_pixel_total : 184900 time to create 1 rle with new method : 0.013291597366333008 length of segment : 356 time for calcul the mask position with numpy : 0.0011591911315917969 nb_pixel_total : 38454 time to create 1 rle with old method : 0.04690718650817871 length of segment : 313 time for calcul the mask position with numpy : 0.0005800724029541016 nb_pixel_total : 18273 time to create 1 rle with old method : 0.022773027420043945 length of segment : 177 time for calcul the mask position with numpy : 0.0022499561309814453 nb_pixel_total : 83847 time to create 1 rle with old method : 0.10653948783874512 length of segment : 334 time for calcul the mask position with numpy : 0.0029726028442382812 nb_pixel_total : 82059 time to create 1 rle with old method : 0.09006905555725098 length of segment : 342 time for calcul the mask position with numpy : 0.0012354850769042969 nb_pixel_total : 27561 time to create 1 rle with old method : 0.03299736976623535 length of segment : 166 time for calcul the mask position with numpy : 0.0011022090911865234 nb_pixel_total : 19875 time to create 1 rle with old method : 0.021735429763793945 length of segment : 175 time for calcul the mask position with numpy : 0.003361940383911133 nb_pixel_total : 91222 time to create 1 rle with old method : 0.09911370277404785 length of segment : 438 time for calcul the mask position with numpy : 0.005029201507568359 nb_pixel_total : 86165 time to create 1 rle with old method : 0.09506869316101074 length of segment : 528 time for calcul the mask position with numpy : 0.004305839538574219 nb_pixel_total : 119080 time to create 1 rle with old method : 0.12726330757141113 length of segment : 400 time for calcul the mask position with numpy : 0.001363992691040039 nb_pixel_total : 19348 time to create 1 rle with old method : 0.02571415901184082 length of segment : 230 time for calcul the mask position with numpy : 0.003208637237548828 nb_pixel_total : 70526 time to create 1 rle with old method : 0.07434487342834473 length of segment : 464 time for calcul the mask position with numpy : 0.0011725425720214844 nb_pixel_total : 22854 time to create 1 rle with old method : 0.02466106414794922 length of segment : 269 time for calcul the mask position with numpy : 0.0008282661437988281 nb_pixel_total : 16135 time to create 1 rle with old method : 0.018297195434570312 length of segment : 140 time for calcul the mask position with numpy : 0.007178544998168945 nb_pixel_total : 156485 time to create 1 rle with new method : 0.015539884567260742 length of segment : 752 time for calcul the mask position with numpy : 0.007810115814208984 nb_pixel_total : 146145 time to create 1 rle with old method : 0.1601717472076416 length of segment : 679 time for calcul the mask position with numpy : 0.0010962486267089844 nb_pixel_total : 20741 time to create 1 rle with old method : 0.02303314208984375 length of segment : 173 time for calcul the mask position with numpy : 0.003325223922729492 nb_pixel_total : 39946 time to create 1 rle with old method : 0.043593645095825195 length of segment : 587 time for calcul the mask position with numpy : 0.002295255661010742 nb_pixel_total : 46517 time to create 1 rle with old method : 0.04899239540100098 length of segment : 241 time for calcul the mask position with numpy : 0.0006246566772460938 nb_pixel_total : 28379 time to create 1 rle with old method : 0.030345678329467773 length of segment : 264 time for calcul the mask position with numpy : 0.004029273986816406 nb_pixel_total : 68156 time to create 1 rle with old method : 0.07342863082885742 length of segment : 468 time for calcul the mask position with numpy : 0.0033750534057617188 nb_pixel_total : 153957 time to create 1 rle with new method : 0.014038801193237305 length of segment : 672 time for calcul the mask position with numpy : 0.0049479007720947266 nb_pixel_total : 141567 time to create 1 rle with old method : 0.15615439414978027 length of segment : 533 time for calcul the mask position with numpy : 0.0015347003936767578 nb_pixel_total : 36120 time to create 1 rle with old method : 0.03848433494567871 length of segment : 427 time for calcul the mask position with numpy : 0.0055065155029296875 nb_pixel_total : 151340 time to create 1 rle with new method : 0.010908365249633789 length of segment : 563 time for calcul the mask position with numpy : 0.0034890174865722656 nb_pixel_total : 67337 time to create 1 rle with old method : 0.0733344554901123 length of segment : 943 time for calcul the mask position with numpy : 0.0002377033233642578 nb_pixel_total : 5546 time to create 1 rle with old method : 0.006247043609619141 length of segment : 81 time for calcul the mask position with numpy : 0.004753828048706055 nb_pixel_total : 79567 time to create 1 rle with old method : 0.08548641204833984 length of segment : 394 time for calcul the mask position with numpy : 0.00042510032653808594 nb_pixel_total : 17973 time to create 1 rle with old method : 0.01998424530029297 length of segment : 152 time for calcul the mask position with numpy : 0.002077341079711914 nb_pixel_total : 61853 time to create 1 rle with old method : 0.0665743350982666 length of segment : 660 time for calcul the mask position with numpy : 0.0030667781829833984 nb_pixel_total : 68500 time to create 1 rle with old method : 0.07252168655395508 length of segment : 374 time for calcul the mask position with numpy : 0.0020439624786376953 nb_pixel_total : 44108 time to create 1 rle with old method : 0.047553300857543945 length of segment : 336 time for calcul the mask position with numpy : 0.00537419319152832 nb_pixel_total : 156132 time to create 1 rle with new method : 0.008531332015991211 length of segment : 681 time for calcul the mask position with numpy : 0.000789642333984375 nb_pixel_total : 22760 time to create 1 rle with old method : 0.024430274963378906 length of segment : 155 time for calcul the mask position with numpy : 0.0068585872650146484 nb_pixel_total : 112763 time to create 1 rle with old method : 0.1207418441772461 length of segment : 485 time for calcul the mask position with numpy : 0.001834869384765625 nb_pixel_total : 48556 time to create 1 rle with old method : 0.05332779884338379 length of segment : 292 time for calcul the mask position with numpy : 0.0008766651153564453 nb_pixel_total : 17555 time to create 1 rle with old method : 0.020154237747192383 length of segment : 120 time for calcul the mask position with numpy : 0.0009136199951171875 nb_pixel_total : 13715 time to create 1 rle with old method : 0.01548910140991211 length of segment : 197 time for calcul the mask position with numpy : 0.0013995170593261719 nb_pixel_total : 31285 time to create 1 rle with old method : 0.03506779670715332 length of segment : 144 time for calcul the mask position with numpy : 0.008172273635864258 nb_pixel_total : 152570 time to create 1 rle with new method : 0.015398025512695312 length of segment : 946 time for calcul the mask position with numpy : 0.001882314682006836 nb_pixel_total : 49254 time to create 1 rle with old method : 0.05438089370727539 length of segment : 164 time for calcul the mask position with numpy : 0.0029625892639160156 nb_pixel_total : 57970 time to create 1 rle with old method : 0.06044197082519531 length of segment : 557 time for calcul the mask position with numpy : 0.0014400482177734375 nb_pixel_total : 35674 time to create 1 rle with old method : 0.0379025936126709 length of segment : 214 time for calcul the mask position with numpy : 0.0024650096893310547 nb_pixel_total : 55141 time to create 1 rle with old method : 0.060540199279785156 length of segment : 290 time for calcul the mask position with numpy : 0.0034284591674804688 nb_pixel_total : 68038 time to create 1 rle with old method : 0.07586264610290527 length of segment : 369 time for calcul the mask position with numpy : 0.012216806411743164 nb_pixel_total : 306358 time to create 1 rle with new method : 0.01774740219116211 length of segment : 898 time for calcul the mask position with numpy : 0.0033719539642333984 nb_pixel_total : 114685 time to create 1 rle with old method : 0.11855244636535645 length of segment : 534 time for calcul the mask position with numpy : 0.0012080669403076172 nb_pixel_total : 25928 time to create 1 rle with old method : 0.027298927307128906 length of segment : 319 time for calcul the mask position with numpy : 0.00179290771484375 nb_pixel_total : 26045 time to create 1 rle with old method : 0.02902817726135254 length of segment : 316 time for calcul the mask position with numpy : 0.0016434192657470703 nb_pixel_total : 45725 time to create 1 rle with old method : 0.04961347579956055 length of segment : 269 time for calcul the mask position with numpy : 0.0045316219329833984 nb_pixel_total : 112964 time to create 1 rle with old method : 0.1210031509399414 length of segment : 417 time for calcul the mask position with numpy : 0.01103520393371582 nb_pixel_total : 330338 time to create 1 rle with new method : 0.01779770851135254 length of segment : 658 time for calcul the mask position with numpy : 0.01123046875 nb_pixel_total : 189070 time to create 1 rle with new method : 0.01770758628845215 length of segment : 827 time for calcul the mask position with numpy : 0.0008854866027832031 nb_pixel_total : 20852 time to create 1 rle with old method : 0.02164602279663086 length of segment : 298 time for calcul the mask position with numpy : 0.004355192184448242 nb_pixel_total : 104503 time to create 1 rle with old method : 0.10971617698669434 length of segment : 429 time for calcul the mask position with numpy : 0.0038585662841796875 nb_pixel_total : 105160 time to create 1 rle with old method : 0.1086423397064209 length of segment : 428 time for calcul the mask position with numpy : 0.003892660140991211 nb_pixel_total : 78658 time to create 1 rle with old method : 0.08602166175842285 length of segment : 546 time for calcul the mask position with numpy : 0.002081632614135742 nb_pixel_total : 95268 time to create 1 rle with old method : 0.10031962394714355 length of segment : 417 time for calcul the mask position with numpy : 0.0010476112365722656 nb_pixel_total : 20098 time to create 1 rle with old method : 0.02154397964477539 length of segment : 226 time for calcul the mask position with numpy : 0.0030379295349121094 nb_pixel_total : 91318 time to create 1 rle with old method : 0.09647250175476074 length of segment : 506 time for calcul the mask position with numpy : 0.00035834312438964844 nb_pixel_total : 19301 time to create 1 rle with old method : 0.02059459686279297 length of segment : 250 time for calcul the mask position with numpy : 0.0003554821014404297 nb_pixel_total : 15457 time to create 1 rle with old method : 0.0166318416595459 length of segment : 141 time for calcul the mask position with numpy : 0.0010924339294433594 nb_pixel_total : 42639 time to create 1 rle with old method : 0.0458836555480957 length of segment : 282 time for calcul the mask position with numpy : 0.00037407875061035156 nb_pixel_total : 6981 time to create 1 rle with old method : 0.0076520442962646484 length of segment : 346 time for calcul the mask position with numpy : 0.001138448715209961 nb_pixel_total : 31626 time to create 1 rle with old method : 0.03329324722290039 length of segment : 240 time for calcul the mask position with numpy : 0.0014362335205078125 nb_pixel_total : 43752 time to create 1 rle with old method : 0.04613685607910156 length of segment : 221 time for calcul the mask position with numpy : 0.0004999637603759766 nb_pixel_total : 12846 time to create 1 rle with old method : 0.01386404037475586 length of segment : 124 time for calcul the mask position with numpy : 0.008119583129882812 nb_pixel_total : 107358 time to create 1 rle with old method : 0.1293783187866211 length of segment : 525 time for calcul the mask position with numpy : 0.005528450012207031 nb_pixel_total : 140509 time to create 1 rle with old method : 0.15030193328857422 length of segment : 801 time for calcul the mask position with numpy : 0.0011391639709472656 nb_pixel_total : 25863 time to create 1 rle with old method : 0.027712345123291016 length of segment : 166 time for calcul the mask position with numpy : 0.011411428451538086 nb_pixel_total : 309265 time to create 1 rle with new method : 0.017720937728881836 length of segment : 687 time for calcul the mask position with numpy : 0.009785652160644531 nb_pixel_total : 247234 time to create 1 rle with new method : 0.016619205474853516 length of segment : 509 time for calcul the mask position with numpy : 0.001552581787109375 nb_pixel_total : 22631 time to create 1 rle with old method : 0.024740219116210938 length of segment : 244 time for calcul the mask position with numpy : 0.002968311309814453 nb_pixel_total : 56321 time to create 1 rle with old method : 0.0601043701171875 length of segment : 443 time for calcul the mask position with numpy : 0.009580612182617188 nb_pixel_total : 167686 time to create 1 rle with new method : 0.016881227493286133 length of segment : 1258 time for calcul the mask position with numpy : 0.003151416778564453 nb_pixel_total : 99939 time to create 1 rle with old method : 0.10652017593383789 length of segment : 361 time for calcul the mask position with numpy : 0.0007159709930419922 nb_pixel_total : 14047 time to create 1 rle with old method : 0.016750812530517578 length of segment : 162 time for calcul the mask position with numpy : 0.012273550033569336 nb_pixel_total : 216133 time to create 1 rle with new method : 0.026383161544799805 length of segment : 811 time for calcul the mask position with numpy : 0.0004734992980957031 nb_pixel_total : 9733 time to create 1 rle with old method : 0.010648727416992188 length of segment : 90 time for calcul the mask position with numpy : 0.001817941665649414 nb_pixel_total : 66858 time to create 1 rle with old method : 0.07111072540283203 length of segment : 724 time for calcul the mask position with numpy : 0.0002028942108154297 nb_pixel_total : 10402 time to create 1 rle with old method : 0.011259317398071289 length of segment : 113 time for calcul the mask position with numpy : 0.001245260238647461 nb_pixel_total : 58897 time to create 1 rle with old method : 0.06430840492248535 length of segment : 276 time for calcul the mask position with numpy : 0.0002834796905517578 nb_pixel_total : 4380 time to create 1 rle with old method : 0.0050508975982666016 length of segment : 87 time for calcul the mask position with numpy : 0.0008628368377685547 nb_pixel_total : 42651 time to create 1 rle with old method : 0.04688000679016113 length of segment : 374 time for calcul the mask position with numpy : 0.0008091926574707031 nb_pixel_total : 30513 time to create 1 rle with old method : 0.032799482345581055 length of segment : 134 time for calcul the mask position with numpy : 0.001874685287475586 nb_pixel_total : 47399 time to create 1 rle with old method : 0.05270838737487793 length of segment : 587 time for calcul the mask position with numpy : 0.0017199516296386719 nb_pixel_total : 52114 time to create 1 rle with old method : 0.05582833290100098 length of segment : 386 time for calcul the mask position with numpy : 0.00046372413635253906 nb_pixel_total : 14480 time to create 1 rle with old method : 0.015465736389160156 length of segment : 133 time for calcul the mask position with numpy : 0.0005781650543212891 nb_pixel_total : 22043 time to create 1 rle with old method : 0.023947954177856445 length of segment : 261 time for calcul the mask position with numpy : 0.002739429473876953 nb_pixel_total : 69947 time to create 1 rle with old method : 0.07361054420471191 length of segment : 339 time for calcul the mask position with numpy : 0.0012695789337158203 nb_pixel_total : 31180 time to create 1 rle with old method : 0.032637834548950195 length of segment : 311 time for calcul the mask position with numpy : 0.0021638870239257812 nb_pixel_total : 49567 time to create 1 rle with old method : 0.053287506103515625 length of segment : 323 time for calcul the mask position with numpy : 0.0032529830932617188 nb_pixel_total : 79753 time to create 1 rle with old method : 0.08430194854736328 length of segment : 467 time for calcul the mask position with numpy : 0.0008003711700439453 nb_pixel_total : 19994 time to create 1 rle with old method : 0.021589040756225586 length of segment : 212 time for calcul the mask position with numpy : 0.006407260894775391 nb_pixel_total : 150401 time to create 1 rle with new method : 0.013521194458007812 length of segment : 566 time for calcul the mask position with numpy : 0.012539386749267578 nb_pixel_total : 495209 time to create 1 rle with new method : 0.018795251846313477 length of segment : 840 time for calcul the mask position with numpy : 0.005196332931518555 nb_pixel_total : 233175 time to create 1 rle with new method : 0.010398387908935547 length of segment : 402 time for calcul the mask position with numpy : 0.0009305477142333984 nb_pixel_total : 31771 time to create 1 rle with old method : 0.033498287200927734 length of segment : 188 time for calcul the mask position with numpy : 0.0066509246826171875 nb_pixel_total : 229585 time to create 1 rle with new method : 0.014548063278198242 length of segment : 1198 time for calcul the mask position with numpy : 0.0019578933715820312 nb_pixel_total : 114971 time to create 1 rle with old method : 0.11951780319213867 length of segment : 416 time for calcul the mask position with numpy : 0.0008225440979003906 nb_pixel_total : 40686 time to create 1 rle with old method : 0.04340505599975586 length of segment : 266 time for calcul the mask position with numpy : 0.00063323974609375 nb_pixel_total : 28723 time to create 1 rle with old method : 0.03131699562072754 length of segment : 168 time for calcul the mask position with numpy : 0.0034148693084716797 nb_pixel_total : 106830 time to create 1 rle with old method : 0.11309480667114258 length of segment : 597 time for calcul the mask position with numpy : 0.002392292022705078 nb_pixel_total : 63459 time to create 1 rle with old method : 0.06746411323547363 length of segment : 465 time for calcul the mask position with numpy : 0.0013780593872070312 nb_pixel_total : 49739 time to create 1 rle with old method : 0.05264854431152344 length of segment : 270 time for calcul the mask position with numpy : 0.0032987594604492188 nb_pixel_total : 193427 time to create 1 rle with new method : 0.01006007194519043 length of segment : 627 time for calcul the mask position with numpy : 0.00040602684020996094 nb_pixel_total : 21882 time to create 1 rle with old method : 0.024018287658691406 length of segment : 107 time for calcul the mask position with numpy : 0.001734018325805664 nb_pixel_total : 71082 time to create 1 rle with old method : 0.07538104057312012 length of segment : 270 time for calcul the mask position with numpy : 0.0021333694458007812 nb_pixel_total : 75690 time to create 1 rle with old method : 0.07850933074951172 length of segment : 674 time for calcul the mask position with numpy : 0.0009589195251464844 nb_pixel_total : 42048 time to create 1 rle with old method : 0.04537153244018555 length of segment : 203 time for calcul the mask position with numpy : 0.000335693359375 nb_pixel_total : 11349 time to create 1 rle with old method : 0.01226353645324707 length of segment : 121 time for calcul the mask position with numpy : 0.004385471343994141 nb_pixel_total : 198644 time to create 1 rle with new method : 0.008322000503540039 length of segment : 833 time for calcul the mask position with numpy : 0.002785205841064453 nb_pixel_total : 151037 time to create 1 rle with new method : 0.005532026290893555 length of segment : 404 time for calcul the mask position with numpy : 0.004847049713134766 nb_pixel_total : 282022 time to create 1 rle with new method : 0.011078357696533203 length of segment : 324 time for calcul the mask position with numpy : 0.004805564880371094 nb_pixel_total : 195161 time to create 1 rle with new method : 0.013109922409057617 length of segment : 858 time for calcul the mask position with numpy : 0.0011706352233886719 nb_pixel_total : 74461 time to create 1 rle with old method : 0.08259129524230957 length of segment : 294 time for calcul the mask position with numpy : 0.0004436969757080078 nb_pixel_total : 28155 time to create 1 rle with old method : 0.031157732009887695 length of segment : 241 time spent for convertir_results : 15.629750728607178 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 142 chid ids of type : 3594 Number RLEs to save : 55816 save missing photos in datou_result : time spend for datou_step_exec : 89.87620091438293 time spend to save output : 3.386892557144165 total time spend for step 1 : 93.2630934715271 step2:crop_condition Thu Jul 24 20:12:04 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 8 ! batch 1 Loaded 142 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 110 About to insert : list_path_to_insert length 110 new photo from crops ! About to upload 110 photos upload in portfolio : 3736932 init cache_photo without model_param we have 110 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1753380766_2296190 This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! we have uploaded 110 photos in the portfolio 3736932 time of upload the photos Elapsed time : 28.439674615859985 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 14 About to insert : list_path_to_insert length 14 new photo from crops ! About to upload 14 photos upload in portfolio : 3736932 init cache_photo without model_param we have 14 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1753380800_2296190 This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! we have uploaded 14 photos in the portfolio 3736932 time of upload the photos Elapsed time : 5.38186502456665 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1753380807_2296190 This is a hack ! This is a hack ! we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.8091473579406738 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 15 About to insert : list_path_to_insert length 15 new photo from crops ! About to upload 15 photos upload in portfolio : 3736932 init cache_photo without model_param we have 15 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1753380813_2296190 This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! This is a hack ! we have uploaded 15 photos in the portfolio 3736932 time of upload the photos Elapsed time : 4.545309543609619 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1753380819_2296190 This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.5561501979827881 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1373555555, 1373555541, 1373555535, 1373555521, 1373555513, 1373555501, 1373555488, 1373555443] Looping around the photos to save general results len do output : 142 /1373579492Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579493Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579494Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579495Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579496Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579497Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579498Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579499Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579500Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579501Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579502Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579503Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579504Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579505Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579506Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579507Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579508Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579509Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579510Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579511Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579512Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579513Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579514Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579515Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579516Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579517Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579518Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579519Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579520Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579521Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579522Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579523Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579524Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579525Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579526Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579527Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579528Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579529Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579530Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579531Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579532Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579533Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579534Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579536Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579537Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579538Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579540Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579541Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579542Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579544Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579545Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579546Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579548Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579549Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579550Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579552Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579553Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579555Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579556Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579557Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579559Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579561Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579562Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579563Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579565Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579566Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579567Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579569Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579570Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579571Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579573Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579574Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579575Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579577Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579578Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579579Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579581Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579582Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579583Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579585Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579586Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579587Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579589Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579590Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579591Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579593Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579594Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579595Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579597Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579598Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579599Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579601Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579602Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579603Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579605Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579606Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579607Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579609Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579610Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579611Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579613Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579614Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579615Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579617Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579618Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579619Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579621Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579622Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579623Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579625Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579689Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579690Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579692Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579693Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579694Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579696Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579697Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579698Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579699Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579701Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579702Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579703Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579705Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579706Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579719Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579720Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579778Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579779Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579781Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579782Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579784Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579785Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579786Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579787Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579789Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579790Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579791Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579793Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579794Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579795Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579797Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1373579809Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3343664') ('3318', '25290433', '1373555555', None, None, None, None, None, '3343664') ('3318', None, None, None, None, None, None, None, '3343664') ('3318', '25290433', '1373555541', None, None, None, None, None, '3343664') ('3318', None, None, None, None, None, None, None, '3343664') ('3318', '25290433', '1373555535', None, None, None, None, None, '3343664') ('3318', None, None, None, None, None, None, None, '3343664') ('3318', '25290433', '1373555521', None, None, None, None, None, '3343664') ('3318', None, None, None, None, None, None, None, '3343664') ('3318', '25290433', '1373555513', None, None, None, None, None, '3343664') ('3318', None, None, None, None, None, None, None, '3343664') ('3318', '25290433', '1373555501', None, None, None, None, None, '3343664') ('3318', None, None, None, None, None, None, None, '3343664') ('3318', '25290433', '1373555488', None, None, None, None, None, '3343664') ('3318', None, None, None, None, None, None, None, '3343664') ('3318', '25290433', '1373555443', None, None, None, None, None, '3343664') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 434 time used for this insertion : 0.04687952995300293 save_final save missing photos in datou_result : time spend for datou_step_exec : 95.71658897399902 time spend to save output : 0.05111980438232422 total time spend for step 2 : 95.76770877838135 step3:rle_unique_nms_with_priority Thu Jul 24 20:13:39 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 142 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 22 nb_hashtags : 2 time to prepare the origin masks : 11.322382926940918 time for calcul the mask position with numpy : 0.521975040435791 nb_pixel_total : 6313806 time to create 1 rle with new method : 0.8507776260375977 time for calcul the mask position with numpy : 0.025740623474121094 nb_pixel_total : 54323 time to create 1 rle with old method : 0.060117244720458984 time for calcul the mask position with numpy : 0.032738447189331055 nb_pixel_total : 108392 time to create 1 rle with old method : 0.11660480499267578 time for calcul the mask position with numpy : 0.025057554244995117 nb_pixel_total : 55250 time to create 1 rle with old method : 0.05939221382141113 time for calcul the mask position with numpy : 0.025478839874267578 nb_pixel_total : 125086 time to create 1 rle with old method : 0.1333608627319336 time for calcul the mask position with numpy : 0.02492833137512207 nb_pixel_total : 35184 time to create 1 rle with old method : 0.03811001777648926 time for calcul the mask position with numpy : 0.025333642959594727 nb_pixel_total : 90844 time to create 1 rle with old method : 0.09747076034545898 time for calcul the mask position with numpy : 0.024739503860473633 nb_pixel_total : 70579 time to create 1 rle with old method : 0.07481694221496582 time for calcul the mask position with numpy : 0.025234222412109375 nb_pixel_total : 42496 time to create 1 rle with old method : 0.045598745346069336 time for calcul the mask position with numpy : 0.024790048599243164 nb_pixel_total : 92891 time to create 1 rle with old method : 0.09978342056274414 time for calcul the mask position with numpy : 0.024721622467041016 nb_pixel_total : 32403 time to create 1 rle with old method : 0.03468203544616699 time for calcul the mask position with numpy : 0.025784015655517578 nb_pixel_total : 24526 time to create 1 rle with old method : 0.026206016540527344 time for calcul the mask position with numpy : 0.02693653106689453 nb_pixel_total : 52357 time to create 1 rle with old method : 0.055654048919677734 time for calcul the mask position with numpy : 0.024509429931640625 nb_pixel_total : 15238 time to create 1 rle with old method : 0.016231060028076172 time for calcul the mask position with numpy : 0.02479267120361328 nb_pixel_total : 62314 time to create 1 rle with old method : 0.06736922264099121 time for calcul the mask position with numpy : 0.0258944034576416 nb_pixel_total : 240189 time to create 1 rle with new method : 0.8925304412841797 time for calcul the mask position with numpy : 0.025050640106201172 nb_pixel_total : 22523 time to create 1 rle with old method : 0.024286985397338867 time for calcul the mask position with numpy : 0.02439260482788086 nb_pixel_total : 24739 time to create 1 rle with old method : 0.02665233612060547 time for calcul the mask position with numpy : 0.02518153190612793 nb_pixel_total : 103210 time to create 1 rle with old method : 0.11088991165161133 time for calcul the mask position with numpy : 0.025822877883911133 nb_pixel_total : 230336 time to create 1 rle with new method : 0.6729328632354736 time for calcul the mask position with numpy : 0.025562047958374023 nb_pixel_total : 249580 time to create 1 rle with new method : 0.791748046875 time for calcul the mask position with numpy : 0.02978229522705078 nb_pixel_total : 147386 time to create 1 rle with old method : 0.17029500007629395 time for calcul the mask position with numpy : 0.029378414154052734 nb_pixel_total : 100748 time to create 1 rle with old method : 0.11594986915588379 create new chi : 5.785016298294067 time to delete rle : 0.023664236068725586 batch 1 Loaded 45 chid ids of type : 3594 +++++++++++++++++++++++Number RLEs to save : 17096 TO DO : save crop sub photo not yet done ! save time : 0.993377685546875 nb_obj : 25 nb_hashtags : 3 time to prepare the origin masks : 10.250910520553589 time for calcul the mask position with numpy : 0.6268799304962158 nb_pixel_total : 6865574 time to create 1 rle with new method : 0.9605603218078613 time for calcul the mask position with numpy : 0.02543783187866211 nb_pixel_total : 7077 time to create 1 rle with old method : 0.008506298065185547 time for calcul the mask position with numpy : 0.025809288024902344 nb_pixel_total : 68156 time to create 1 rle with old method : 0.07404017448425293 time for calcul the mask position with numpy : 0.025604248046875 nb_pixel_total : 8472 time to create 1 rle with old method : 0.009637117385864258 time for calcul the mask position with numpy : 0.025710344314575195 nb_pixel_total : 46517 time to create 1 rle with old method : 0.05047965049743652 time for calcul the mask position with numpy : 0.02558755874633789 nb_pixel_total : 39946 time to create 1 rle with old method : 0.0440061092376709 time for calcul the mask position with numpy : 0.02538275718688965 nb_pixel_total : 20741 time to create 1 rle with old method : 0.022573232650756836 time for calcul the mask position with numpy : 0.02646803855895996 nb_pixel_total : 145780 time to create 1 rle with old method : 0.16518282890319824 time for calcul the mask position with numpy : 0.028875350952148438 nb_pixel_total : 87440 time to create 1 rle with old method : 0.0955052375793457 time for calcul the mask position with numpy : 0.026209354400634766 nb_pixel_total : 16135 time to create 1 rle with old method : 0.017269134521484375 time for calcul the mask position with numpy : 0.025490760803222656 nb_pixel_total : 22854 time to create 1 rle with old method : 0.024064064025878906 time for calcul the mask position with numpy : 0.025800704956054688 nb_pixel_total : 70526 time to create 1 rle with old method : 0.07744503021240234 time for calcul the mask position with numpy : 0.025829792022705078 nb_pixel_total : 19348 time to create 1 rle with old method : 0.02079916000366211 time for calcul the mask position with numpy : 0.02657032012939453 nb_pixel_total : 119080 time to create 1 rle with old method : 0.13042879104614258 time for calcul the mask position with numpy : 0.027117490768432617 nb_pixel_total : 86165 time to create 1 rle with old method : 0.09630370140075684 time for calcul the mask position with numpy : 0.027263402938842773 nb_pixel_total : 11492 time to create 1 rle with old method : 0.013321161270141602 time for calcul the mask position with numpy : 0.025938034057617188 nb_pixel_total : 19875 time to create 1 rle with old method : 0.021753549575805664 time for calcul the mask position with numpy : 0.025929689407348633 nb_pixel_total : 27561 time to create 1 rle with old method : 0.029398441314697266 time for calcul the mask position with numpy : 0.0270235538482666 nb_pixel_total : 82059 time to create 1 rle with old method : 0.09650802612304688 time for calcul the mask position with numpy : 0.02860116958618164 nb_pixel_total : 83847 time to create 1 rle with old method : 0.09358882904052734 time for calcul the mask position with numpy : 0.026836872100830078 nb_pixel_total : 18273 time to create 1 rle with old method : 0.020451784133911133 time for calcul the mask position with numpy : 0.026629924774169922 nb_pixel_total : 38450 time to create 1 rle with old method : 0.043288230895996094 time for calcul the mask position with numpy : 0.02945113182067871 nb_pixel_total : 184900 time to create 1 rle with new method : 0.8737609386444092 time for calcul the mask position with numpy : 0.025181055068969727 nb_pixel_total : 32802 time to create 1 rle with old method : 0.03566169738769531 time for calcul the mask position with numpy : 0.025084495544433594 nb_pixel_total : 69340 time to create 1 rle with old method : 0.0739283561706543 time for calcul the mask position with numpy : 0.026921749114990234 nb_pixel_total : 101990 time to create 1 rle with old method : 0.10884952545166016 create new chi : 4.567530393600464 time to delete rle : 0.0024814605712890625 batch 1 Loaded 51 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 19705 TO DO : save crop sub photo not yet done ! save time : 1.1784248352050781 nb_obj : 19 nb_hashtags : 4 time to prepare the origin masks : 9.043976306915283 time for calcul the mask position with numpy : 0.7556488513946533 nb_pixel_total : 7031571 time to create 1 rle with new method : 0.9601058959960938 time for calcul the mask position with numpy : 0.025299787521362305 nb_pixel_total : 49254 time to create 1 rle with old method : 0.052843570709228516 time for calcul the mask position with numpy : 0.025838613510131836 nb_pixel_total : 137016 time to create 1 rle with old method : 0.14707040786743164 time for calcul the mask position with numpy : 0.024812698364257812 nb_pixel_total : 31285 time to create 1 rle with old method : 0.033988237380981445 time for calcul the mask position with numpy : 0.02497267723083496 nb_pixel_total : 13715 time to create 1 rle with old method : 0.016813278198242188 time for calcul the mask position with numpy : 0.024366378784179688 nb_pixel_total : 17555 time to create 1 rle with old method : 0.01960611343383789 time for calcul the mask position with numpy : 0.02449202537536621 nb_pixel_total : 48556 time to create 1 rle with old method : 0.05457735061645508 time for calcul the mask position with numpy : 0.028127193450927734 nb_pixel_total : 112763 time to create 1 rle with old method : 0.23117518424987793 time for calcul the mask position with numpy : 0.029874563217163086 nb_pixel_total : 22760 time to create 1 rle with old method : 0.02649664878845215 time for calcul the mask position with numpy : 0.030237674713134766 nb_pixel_total : 156014 time to create 1 rle with new method : 1.2997639179229736 time for calcul the mask position with numpy : 0.025447368621826172 nb_pixel_total : 44108 time to create 1 rle with old method : 0.04906010627746582 time for calcul the mask position with numpy : 0.03083324432373047 nb_pixel_total : 68500 time to create 1 rle with old method : 0.07420516014099121 time for calcul the mask position with numpy : 0.02435922622680664 nb_pixel_total : 61853 time to create 1 rle with old method : 0.0675039291381836 time for calcul the mask position with numpy : 0.025146007537841797 nb_pixel_total : 17973 time to create 1 rle with old method : 0.020275354385375977 time for calcul the mask position with numpy : 0.024151086807250977 nb_pixel_total : 79567 time to create 1 rle with old method : 0.08446121215820312 time for calcul the mask position with numpy : 0.025851726531982422 nb_pixel_total : 5546 time to create 1 rle with old method : 0.008906364440917969 time for calcul the mask position with numpy : 0.03480076789855957 nb_pixel_total : 67337 time to create 1 rle with old method : 0.08337163925170898 time for calcul the mask position with numpy : 0.025931358337402344 nb_pixel_total : 151340 time to create 1 rle with new method : 0.8844361305236816 time for calcul the mask position with numpy : 0.025310993194580078 nb_pixel_total : 36120 time to create 1 rle with old method : 0.040056467056274414 time for calcul the mask position with numpy : 0.025413990020751953 nb_pixel_total : 141567 time to create 1 rle with old method : 0.15530109405517578 create new chi : 5.6669721603393555 time to delete rle : 0.0026106834411621094 batch 1 Loaded 39 chid ids of type : 3594 ++++++++++++++++++++++++++++++++Number RLEs to save : 17186 TO DO : save crop sub photo not yet done ! save time : 1.099534511566162 nb_obj : 23 nb_hashtags : 3 time to prepare the origin masks : 8.740137577056885 time for calcul the mask position with numpy : 0.6200675964355469 nb_pixel_total : 6326229 time to create 1 rle with new method : 0.7271633148193359 time for calcul the mask position with numpy : 0.040038108825683594 nb_pixel_total : 6981 time to create 1 rle with old method : 0.007963180541992188 time for calcul the mask position with numpy : 0.04157257080078125 nb_pixel_total : 42639 time to create 1 rle with old method : 0.04675412178039551 time for calcul the mask position with numpy : 0.04029202461242676 nb_pixel_total : 15457 time to create 1 rle with old method : 0.016933441162109375 time for calcul the mask position with numpy : 0.039517879486083984 nb_pixel_total : 19301 time to create 1 rle with old method : 0.02165699005126953 time for calcul the mask position with numpy : 0.04338574409484863 nb_pixel_total : 91318 time to create 1 rle with old method : 0.10146188735961914 time for calcul the mask position with numpy : 0.039895057678222656 nb_pixel_total : 20098 time to create 1 rle with old method : 0.022277355194091797 time for calcul the mask position with numpy : 0.040738821029663086 nb_pixel_total : 95268 time to create 1 rle with old method : 0.10509395599365234 time for calcul the mask position with numpy : 0.04037189483642578 nb_pixel_total : 78658 time to create 1 rle with old method : 0.1130976676940918 time for calcul the mask position with numpy : 0.041092634201049805 nb_pixel_total : 105160 time to create 1 rle with old method : 0.1117708683013916 time for calcul the mask position with numpy : 0.03882741928100586 nb_pixel_total : 104503 time to create 1 rle with old method : 0.11585235595703125 time for calcul the mask position with numpy : 0.03958868980407715 nb_pixel_total : 20852 time to create 1 rle with old method : 0.022956132888793945 time for calcul the mask position with numpy : 0.040396690368652344 nb_pixel_total : 189070 time to create 1 rle with new method : 0.9429209232330322 time for calcul the mask position with numpy : 0.042177677154541016 nb_pixel_total : 330338 time to create 1 rle with new method : 0.7916526794433594 time for calcul the mask position with numpy : 0.04040694236755371 nb_pixel_total : 112964 time to create 1 rle with old method : 0.12203526496887207 time for calcul the mask position with numpy : 0.039682865142822266 nb_pixel_total : 45725 time to create 1 rle with old method : 0.05269360542297363 time for calcul the mask position with numpy : 0.03930211067199707 nb_pixel_total : 26045 time to create 1 rle with old method : 0.027957677841186523 time for calcul the mask position with numpy : 0.03850388526916504 nb_pixel_total : 25928 time to create 1 rle with old method : 0.03744912147521973 time for calcul the mask position with numpy : 0.04560232162475586 nb_pixel_total : 114685 time to create 1 rle with old method : 0.12455916404724121 time for calcul the mask position with numpy : 0.03980231285095215 nb_pixel_total : 306358 time to create 1 rle with new method : 0.8241090774536133 time for calcul the mask position with numpy : 0.03941631317138672 nb_pixel_total : 68038 time to create 1 rle with old method : 0.07249021530151367 time for calcul the mask position with numpy : 0.04043173789978027 nb_pixel_total : 55141 time to create 1 rle with old method : 0.058695316314697266 time for calcul the mask position with numpy : 0.03843235969543457 nb_pixel_total : 35674 time to create 1 rle with old method : 0.03771686553955078 time for calcul the mask position with numpy : 0.03889012336730957 nb_pixel_total : 57970 time to create 1 rle with old method : 0.062152862548828125 create new chi : 6.246058464050293 time to delete rle : 0.005028963088989258 batch 1 Loaded 47 chid ids of type : 3594 +++++++++++++++++++++++++++Number RLEs to save : 21234 TO DO : save crop sub photo not yet done ! save time : 1.235395908355713 nb_obj : 27 nb_hashtags : 4 time to prepare the origin masks : 4.542299032211304 time for calcul the mask position with numpy : 0.5167319774627686 nb_pixel_total : 6447286 time to create 1 rle with new method : 0.5971553325653076 time for calcul the mask position with numpy : 0.031501054763793945 nb_pixel_total : 9733 time to create 1 rle with old method : 0.010093212127685547 time for calcul the mask position with numpy : 0.03129172325134277 nb_pixel_total : 12846 time to create 1 rle with old method : 0.01335906982421875 time for calcul the mask position with numpy : 0.03190803527832031 nb_pixel_total : 31626 time to create 1 rle with old method : 0.03274345397949219 time for calcul the mask position with numpy : 0.031815290451049805 nb_pixel_total : 69947 time to create 1 rle with old method : 0.07308506965637207 time for calcul the mask position with numpy : 0.03277087211608887 nb_pixel_total : 167686 time to create 1 rle with new method : 0.49166083335876465 time for calcul the mask position with numpy : 0.031883955001831055 nb_pixel_total : 140509 time to create 1 rle with old method : 0.14421534538269043 time for calcul the mask position with numpy : 0.03144025802612305 nb_pixel_total : 25863 time to create 1 rle with old method : 0.02639484405517578 time for calcul the mask position with numpy : 0.031645774841308594 nb_pixel_total : 22631 time to create 1 rle with old method : 0.023331642150878906 time for calcul the mask position with numpy : 0.03131413459777832 nb_pixel_total : 4380 time to create 1 rle with old method : 0.00457310676574707 time for calcul the mask position with numpy : 0.03175234794616699 nb_pixel_total : 43752 time to create 1 rle with old method : 0.04453158378601074 time for calcul the mask position with numpy : 0.03165245056152344 nb_pixel_total : 14480 time to create 1 rle with old method : 0.01493072509765625 time for calcul the mask position with numpy : 0.031533002853393555 nb_pixel_total : 47399 time to create 1 rle with old method : 0.04979228973388672 time for calcul the mask position with numpy : 0.032441139221191406 nb_pixel_total : 99939 time to create 1 rle with old method : 0.10470390319824219 time for calcul the mask position with numpy : 0.03208446502685547 nb_pixel_total : 215174 time to create 1 rle with new method : 0.4818878173828125 time for calcul the mask position with numpy : 0.03159046173095703 nb_pixel_total : 52114 time to create 1 rle with old method : 0.053987979888916016 time for calcul the mask position with numpy : 0.03215336799621582 nb_pixel_total : 31180 time to create 1 rle with old method : 0.03228640556335449 time for calcul the mask position with numpy : 0.03286385536193848 nb_pixel_total : 309265 time to create 1 rle with new method : 0.4831972122192383 time for calcul the mask position with numpy : 0.032839298248291016 nb_pixel_total : 13189 time to create 1 rle with old method : 0.015252828598022461 time for calcul the mask position with numpy : 0.03224992752075195 nb_pixel_total : 14573 time to create 1 rle with old method : 0.015613317489624023 time for calcul the mask position with numpy : 0.03259468078613281 nb_pixel_total : 107358 time to create 1 rle with old method : 0.11461877822875977 time for calcul the mask position with numpy : 0.03502941131591797 nb_pixel_total : 247234 time to create 1 rle with new method : 0.395855188369751 time for calcul the mask position with numpy : 0.03654289245605469 nb_pixel_total : 14047 time to create 1 rle with old method : 0.0236051082611084 time for calcul the mask position with numpy : 0.0348663330078125 nb_pixel_total : 56317 time to create 1 rle with old method : 0.062415122985839844 time for calcul the mask position with numpy : 0.03363656997680664 nb_pixel_total : 2189 time to create 1 rle with old method : 0.0024542808532714844 time for calcul the mask position with numpy : 0.03290057182312012 nb_pixel_total : 4273 time to create 1 rle with old method : 0.004917621612548828 time for calcul the mask position with numpy : 0.03357982635498047 nb_pixel_total : 58897 time to create 1 rle with old method : 0.06228041648864746 time for calcul the mask position with numpy : 0.03197932243347168 nb_pixel_total : 30513 time to create 1 rle with old method : 0.03137564659118652 create new chi : 4.920574903488159 time to delete rle : 0.0027794837951660156 batch 1 Loaded 55 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 20853 TO DO : save crop sub photo not yet done ! save time : 1.2177777290344238 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 1.7049636840820312 time for calcul the mask position with numpy : 0.6042497158050537 nb_pixel_total : 7994685 time to create 1 rle with new method : 0.8499300479888916 time for calcul the mask position with numpy : 0.03152823448181152 nb_pixel_total : 150401 time to create 1 rle with new method : 0.9739418029785156 time for calcul the mask position with numpy : 0.023719072341918945 nb_pixel_total : 19994 time to create 1 rle with old method : 0.021060466766357422 time for calcul the mask position with numpy : 0.024177074432373047 nb_pixel_total : 79753 time to create 1 rle with old method : 0.08494210243225098 time for calcul the mask position with numpy : 0.02435755729675293 nb_pixel_total : 49567 time to create 1 rle with old method : 0.05185198783874512 create new chi : 2.7509918212890625 time to delete rle : 0.0007882118225097656 batch 1 Loaded 9 chid ids of type : 3594 +++++Number RLEs to save : 5296 TO DO : save crop sub photo not yet done ! save time : 0.3451082706451416 nb_obj : 15 nb_hashtags : 3 time to prepare the origin masks : 5.963892936706543 time for calcul the mask position with numpy : 0.6193838119506836 nb_pixel_total : 6498429 time to create 1 rle with new method : 0.8284914493560791 time for calcul the mask position with numpy : 0.023751258850097656 nb_pixel_total : 42048 time to create 1 rle with old method : 0.04486393928527832 time for calcul the mask position with numpy : 0.024341821670532227 nb_pixel_total : 73483 time to create 1 rle with old method : 0.07813262939453125 time for calcul the mask position with numpy : 0.024118423461914062 nb_pixel_total : 71082 time to create 1 rle with old method : 0.07501459121704102 time for calcul the mask position with numpy : 0.0239870548248291 nb_pixel_total : 21882 time to create 1 rle with old method : 0.02343916893005371 time for calcul the mask position with numpy : 0.02476644515991211 nb_pixel_total : 193427 time to create 1 rle with new method : 0.7420299053192139 time for calcul the mask position with numpy : 0.025505781173706055 nb_pixel_total : 49739 time to create 1 rle with old method : 0.052980661392211914 time for calcul the mask position with numpy : 0.027233123779296875 nb_pixel_total : 63459 time to create 1 rle with old method : 0.06810212135314941 time for calcul the mask position with numpy : 0.038765907287597656 nb_pixel_total : 106830 time to create 1 rle with old method : 0.11879611015319824 time for calcul the mask position with numpy : 0.039255380630493164 nb_pixel_total : 28723 time to create 1 rle with old method : 0.03099989891052246 time for calcul the mask position with numpy : 0.03802371025085449 nb_pixel_total : 40686 time to create 1 rle with old method : 0.04378962516784668 time for calcul the mask position with numpy : 0.02837514877319336 nb_pixel_total : 114872 time to create 1 rle with old method : 0.12355756759643555 time for calcul the mask position with numpy : 0.027647972106933594 nb_pixel_total : 229585 time to create 1 rle with new method : 0.8814725875854492 time for calcul the mask position with numpy : 0.024178028106689453 nb_pixel_total : 31771 time to create 1 rle with old method : 0.033449411392211914 time for calcul the mask position with numpy : 0.02416205406188965 nb_pixel_total : 233175 time to create 1 rle with new method : 0.8080084323883057 time for calcul the mask position with numpy : 0.028290987014770508 nb_pixel_total : 495209 time to create 1 rle with new method : 0.715367317199707 create new chi : 5.8501060009002686 time to delete rle : 0.0021872520446777344 batch 1 Loaded 31 chid ids of type : 3594 +++++++++++++++++++++++++++++++Number RLEs to save : 15287 TO DO : save crop sub photo not yet done ! save time : 0.9007306098937988 nb_obj : 7 nb_hashtags : 3 time to prepare the origin masks : 3.0779919624328613 time for calcul the mask position with numpy : 0.6114931106567383 nb_pixel_total : 7355754 time to create 1 rle with new method : 0.8751602172851562 time for calcul the mask position with numpy : 0.024612903594970703 nb_pixel_total : 25972 time to create 1 rle with old method : 0.028423309326171875 time for calcul the mask position with numpy : 0.025138139724731445 nb_pixel_total : 74461 time to create 1 rle with old method : 0.07992959022521973 time for calcul the mask position with numpy : 0.025636911392211914 nb_pixel_total : 195161 time to create 1 rle with new method : 0.8163261413574219 time for calcul the mask position with numpy : 0.024488449096679688 nb_pixel_total : 282022 time to create 1 rle with new method : 0.8399600982666016 time for calcul the mask position with numpy : 0.025475502014160156 nb_pixel_total : 151037 time to create 1 rle with new method : 0.7335460186004639 time for calcul the mask position with numpy : 0.02549910545349121 nb_pixel_total : 198644 time to create 1 rle with new method : 0.7522497177124023 time for calcul the mask position with numpy : 0.023482799530029297 nb_pixel_total : 11349 time to create 1 rle with old method : 0.011995315551757812 create new chi : 5.060592174530029 time to delete rle : 0.0012197494506835938 batch 1 Loaded 15 chid ids of type : 3594 +++++++++Number RLEs to save : 8234 TO DO : save crop sub photo not yet done ! save time : 0.509390115737915 map_output_result : {1373555555: (0.0, 'Should be the crop_list due to order', 0), 1373555541: (0.0, 'Should be the crop_list due to order', 0), 1373555535: (0.0, 'Should be the crop_list due to order', 0), 1373555521: (0.0, 'Should be the crop_list due to order', 0), 1373555513: (0.0, 'Should be the crop_list due to order', 0), 1373555501: (0.0, 'Should be the crop_list due to order', 0), 1373555488: (0.0, 'Should be the crop_list due to order', 0), 1373555443: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1373555555, 1373555541, 1373555535, 1373555521, 1373555513, 1373555501, 1373555488, 1373555443] Looping around the photos to save general results len do output : 8 /1373555555.Didn't retrieve data . /1373555541.Didn't retrieve data . /1373555535.Didn't retrieve data . /1373555521.Didn't retrieve data . /1373555513.Didn't retrieve data . /1373555501.Didn't retrieve data . /1373555488.Didn't retrieve data . /1373555443.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3343664') ('3318', '25290433', '1373555555', None, None, None, None, None, '3343664') ('3318', None, None, None, None, None, None, None, '3343664') ('3318', '25290433', '1373555541', None, None, None, None, None, '3343664') ('3318', None, None, None, None, None, None, None, '3343664') ('3318', '25290433', '1373555535', None, None, None, None, None, '3343664') ('3318', None, None, None, None, None, None, None, '3343664') ('3318', '25290433', '1373555521', None, None, None, None, None, '3343664') ('3318', None, None, None, None, None, None, None, '3343664') ('3318', '25290433', '1373555513', None, None, None, None, None, '3343664') ('3318', None, None, None, None, None, None, None, '3343664') ('3318', '25290433', '1373555501', None, None, None, None, None, '3343664') ('3318', None, None, None, None, None, None, None, '3343664') ('3318', '25290433', '1373555488', None, None, None, None, None, '3343664') ('3318', None, None, None, None, None, None, None, '3343664') ('3318', '25290433', '1373555443', None, None, None, None, None, '3343664') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.01381993293762207 save_final save missing photos in datou_result : time spend for datou_step_exec : 104.09699749946594 time spend to save output : 0.014923572540283203 total time spend for step 3 : 104.11192107200623 step4:ventilate_hashtags_in_portfolio Thu Jul 24 20:15:23 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 25290433 get user id for portfolio 25290433 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25290433 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('flou','metal','papier','pehd','environnement','pet_fonce','carton','mal_croppe','background','pet_clair','autre')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25290433 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('flou','metal','papier','pehd','environnement','pet_fonce','carton','mal_croppe','background','pet_clair','autre')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25290433 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('flou','metal','papier','pehd','environnement','pet_fonce','carton','mal_croppe','background','pet_clair','autre')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/25290789,25290790,25290791,25290792,25290793,25290794,25290795,25290796,25290797,25290798,25290799?tags=flou,metal,papier,pehd,environnement,pet_fonce,carton,mal_croppe,background,pet_clair,autre Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1373555555, 1373555541, 1373555535, 1373555521, 1373555513, 1373555501, 1373555488, 1373555443] Looping around the photos to save general results len do output : 1 /25290433. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3343664') ('3318', '25290433', '1373555555', None, None, None, None, None, '3343664') ('3318', None, None, None, None, None, None, None, '3343664') ('3318', '25290433', '1373555541', None, None, None, None, None, '3343664') ('3318', None, None, None, None, None, None, None, '3343664') ('3318', '25290433', '1373555535', None, None, None, None, None, '3343664') ('3318', None, None, None, None, None, None, None, '3343664') ('3318', '25290433', '1373555521', None, None, None, None, None, '3343664') ('3318', None, None, None, None, None, None, None, '3343664') ('3318', '25290433', '1373555513', None, None, None, None, None, '3343664') ('3318', None, None, None, None, None, None, None, '3343664') ('3318', '25290433', '1373555501', None, None, None, None, None, '3343664') ('3318', None, None, None, None, None, None, None, '3343664') ('3318', '25290433', '1373555488', None, None, None, None, None, '3343664') ('3318', None, None, None, None, None, None, None, '3343664') ('3318', '25290433', '1373555443', None, None, None, None, None, '3343664') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.014078617095947266 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.728281021118164 time spend to save output : 0.01753854751586914 total time spend for step 4 : 1.7458195686340332 step5:final Thu Jul 24 20:15:25 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1373555555: ('0.17363923249421298',), 1373555541: ('0.17363923249421298',), 1373555535: ('0.17363923249421298',), 1373555521: ('0.17363923249421298',), 1373555513: ('0.17363923249421298',), 1373555501: ('0.17363923249421298',), 1373555488: ('0.17363923249421298',), 1373555443: ('0.17363923249421298',)} new output for save of step final : {1373555555: ('0.17363923249421298',), 1373555541: ('0.17363923249421298',), 1373555535: ('0.17363923249421298',), 1373555521: ('0.17363923249421298',), 1373555513: ('0.17363923249421298',), 1373555501: ('0.17363923249421298',), 1373555488: ('0.17363923249421298',), 1373555443: ('0.17363923249421298',)} [1373555555, 1373555541, 1373555535, 1373555521, 1373555513, 1373555501, 1373555488, 1373555443] Looping around the photos to save general results len do output : 8 /1373555555.Didn't retrieve data . /1373555541.Didn't retrieve data . /1373555535.Didn't retrieve data . /1373555521.Didn't retrieve data . /1373555513.Didn't retrieve data . /1373555501.Didn't retrieve data . /1373555488.Didn't retrieve data . /1373555443.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3343664') ('3318', '25290433', '1373555555', None, None, None, None, None, '3343664') ('3318', None, None, None, None, None, None, None, '3343664') ('3318', '25290433', '1373555541', None, None, None, None, None, '3343664') ('3318', None, None, None, None, None, None, None, '3343664') ('3318', '25290433', '1373555535', None, None, None, None, None, '3343664') ('3318', None, None, None, None, None, None, None, '3343664') ('3318', '25290433', '1373555521', None, None, None, None, None, '3343664') ('3318', None, None, None, None, None, None, None, '3343664') ('3318', '25290433', '1373555513', None, None, None, None, None, '3343664') ('3318', None, None, None, None, None, None, None, '3343664') ('3318', '25290433', '1373555501', None, None, None, None, None, '3343664') ('3318', None, None, None, None, None, None, None, '3343664') ('3318', '25290433', '1373555488', None, None, None, None, None, '3343664') ('3318', None, None, None, None, None, None, None, '3343664') ('3318', '25290433', '1373555443', None, None, None, None, None, '3343664') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.012145280838012695 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.15707683563232422 time spend to save output : 0.012727022171020508 total time spend for step 5 : 0.16980385780334473 step6:blur_detection Thu Jul 24 20:15:25 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1753380629_2296190_1373555555_5c78c632c4bca75b8484865b4644c065.jpg resize: (2160, 3840) 1373555555 -7.27848675043777 treat image : temp/1753380629_2296190_1373555541_7d2d3a092a1479f4de715a58cc6a2cce.jpg resize: (2160, 3840) 1373555541 -7.507753866741287 treat image : temp/1753380629_2296190_1373555535_bd1fadbc1db1eb8fc580feef51532838.jpg resize: (2160, 3840) 1373555535 -6.980581334253767 treat image : temp/1753380629_2296190_1373555521_a74456a08a0cae3d6cea3ab26d602a5b.jpg resize: (2160, 3840) 1373555521 -7.196129092578744 treat image : temp/1753380629_2296190_1373555513_61018b3413a8b8249e48923458e19912.jpg resize: (2160, 3840) 1373555513 -7.111477468395342 treat image : temp/1753380629_2296190_1373555501_5722aae0345feb088343abd5fcd4c37e.jpg resize: (2160, 3840) 1373555501 -5.965298062520791 treat image : temp/1753380629_2296190_1373555488_173182ca91b27ce98820a356dd687666.jpg resize: (2160, 3840) 1373555488 -6.283455189558232 treat image : temp/1753380629_2296190_1373555443_976e5bce1556afcf9670cf2d6845bc3f.jpg resize: (2160, 3840) 1373555443 -5.788093291794426 treat image : temp/1753380629_2296190_1373555555_5c78c632c4bca75b8484865b4644c065_rle_crop_3892839085_0.png resize: (397, 300) 1373579492 -2.054255039083261 treat image : temp/1753380629_2296190_1373555555_5c78c632c4bca75b8484865b4644c065_rle_crop_3892839086_0.png resize: (437, 495) 1373579493 -5.580354240336588 treat image : temp/1753380629_2296190_1373555555_5c78c632c4bca75b8484865b4644c065_rle_crop_3892839087_0.png resize: (605, 640) 1373579494 -2.354352537129361 treat image : temp/1753380629_2296190_1373555555_5c78c632c4bca75b8484865b4644c065_rle_crop_3892839088_0.png resize: (520, 632) 1373579495 -5.536055893500204 treat image : temp/1753380629_2296190_1373555555_5c78c632c4bca75b8484865b4644c065_rle_crop_3892839089_0.png resize: (360, 352) 1373579496 -2.8604824058924225 treat image : temp/1753380629_2296190_1373555555_5c78c632c4bca75b8484865b4644c065_rle_crop_3892839090_0.png resize: (133, 282) 1373579497 -4.7451775038913295 treat image : temp/1753380629_2296190_1373555555_5c78c632c4bca75b8484865b4644c065_rle_crop_3892839091_0.png resize: (162, 166) 1373579498 -1.6361620272055928 treat image : temp/1753380629_2296190_1373555555_5c78c632c4bca75b8484865b4644c065_rle_crop_3892839092_0.png resize: (561, 583) 1373579499 -4.854125894723557 treat image : temp/1753380629_2296190_1373555555_5c78c632c4bca75b8484865b4644c065_rle_crop_3892839094_0.png resize: (113, 167) 1373579500 -2.0089672827924487 treat image : temp/1753380629_2296190_1373555555_5c78c632c4bca75b8484865b4644c065_rle_crop_3892839095_0.png resize: (348, 269) 1373579501 -4.748636489007629 treat image : temp/1753380629_2296190_1373555555_5c78c632c4bca75b8484865b4644c065_rle_crop_3892839097_0.png resize: (262, 281) 1373579502 -3.3881910016641656 treat image : temp/1753380629_2296190_1373555555_5c78c632c4bca75b8484865b4644c065_rle_crop_3892839099_0.png resize: (343, 145) 1373579503 -3.7774550658154094 treat image : temp/1753380629_2296190_1373555555_5c78c632c4bca75b8484865b4644c065_rle_crop_3892839100_0.png resize: (283, 324) 1373579504 -3.648953605947836 treat image : temp/1753380629_2296190_1373555555_5c78c632c4bca75b8484865b4644c065_rle_crop_3892839101_0.png resize: (388, 360) 1373579505 -1.8959229907761892 treat image : temp/1753380629_2296190_1373555555_5c78c632c4bca75b8484865b4644c065_rle_crop_3892839102_0.png resize: (245, 280) 1373579506 -4.887043861101148 treat image : temp/1753380629_2296190_1373555555_5c78c632c4bca75b8484865b4644c065_rle_crop_3892839103_0.png resize: (406, 376) 1373579507 -4.90908394659825 treat image : temp/1753380629_2296190_1373555555_5c78c632c4bca75b8484865b4644c065_rle_crop_3892839104_0.png resize: (185, 409) 1373579508 -3.925482021108646 treat image : temp/1753380629_2296190_1373555555_5c78c632c4bca75b8484865b4644c065_rle_crop_3892839105_0.png resize: (467, 339) 1373579509 -5.030601358603503 treat image : temp/1753380629_2296190_1373555555_5c78c632c4bca75b8484865b4644c065_rle_crop_3892839106_0.png resize: (256, 287) 1373579510 -4.650280435408621 treat image : temp/1753380629_2296190_1373555541_7d2d3a092a1479f4de715a58cc6a2cce_rle_crop_3892839107_0.png resize: (498, 392) 1373579511 -2.3406698732414286 treat image : temp/1753380629_2296190_1373555541_7d2d3a092a1479f4de715a58cc6a2cce_rle_crop_3892839108_0.png resize: (421, 221) 1373579512 -1.5321750308789774 treat image : temp/1753380629_2296190_1373555541_7d2d3a092a1479f4de715a58cc6a2cce_rle_crop_3892839109_0.png resize: (133, 309) 1373579513 -0.9870723740757928 treat image : temp/1753380629_2296190_1373555541_7d2d3a092a1479f4de715a58cc6a2cce_rle_crop_3892839110_0.png resize: (330, 801) 1373579514 -4.313262460894805 treat image : temp/1753380629_2296190_1373555541_7d2d3a092a1479f4de715a58cc6a2cce_rle_crop_3892839111_0.png resize: (308, 196) 1373579515 -4.63914606801211 treat image : temp/1753380629_2296190_1373555541_7d2d3a092a1479f4de715a58cc6a2cce_rle_crop_3892839112_0.png resize: (171, 168) 1373579516 -4.019663866578444 treat image : temp/1753380629_2296190_1373555541_7d2d3a092a1479f4de715a58cc6a2cce_rle_crop_3892839114_0.png resize: (330, 298) 1373579517 -4.461014965587383 treat image : temp/1753380629_2296190_1373555541_7d2d3a092a1479f4de715a58cc6a2cce_rle_crop_3892839116_0.png resize: (175, 211) 1373579518 -3.343405791903251 treat image : temp/1753380629_2296190_1373555541_7d2d3a092a1479f4de715a58cc6a2cce_rle_crop_3892839117_0.png resize: (418, 629) 1373579519 -3.5807808365038345 treat image : temp/1753380629_2296190_1373555541_7d2d3a092a1479f4de715a58cc6a2cce_rle_crop_3892839118_0.png resize: (336, 580) 1373579520 -3.1565833625868125 treat image : temp/1753380629_2296190_1373555541_7d2d3a092a1479f4de715a58cc6a2cce_rle_crop_3892839119_0.png resize: (387, 422) 1373579521 -3.3869193421514203 treat image : temp/1753380629_2296190_1373555541_7d2d3a092a1479f4de715a58cc6a2cce_rle_crop_3892839120_0.png resize: (230, 205) 1373579522 -4.032153217788342 treat image : temp/1753380629_2296190_1373555541_7d2d3a092a1479f4de715a58cc6a2cce_rle_crop_3892839121_0.png resize: (441, 209) 1373579523 -5.240052638900502 treat image : temp/1753380629_2296190_1373555541_7d2d3a092a1479f4de715a58cc6a2cce_rle_crop_3892839123_0.png resize: (122, 206) 1373579524 -4.300707941655347 treat image : temp/1753380629_2296190_1373555541_7d2d3a092a1479f4de715a58cc6a2cce_rle_crop_3892839124_0.png resize: (677, 496) 1373579525 -4.749090139087208 treat image : temp/1753380629_2296190_1373555541_7d2d3a092a1479f4de715a58cc6a2cce_rle_crop_3892839125_0.png resize: (662, 304) 1373579526 -4.957757816952356 treat image : temp/1753380629_2296190_1373555541_7d2d3a092a1479f4de715a58cc6a2cce_rle_crop_3892839126_0.png resize: (173, 247) 1373579527 -2.7961592063159775 treat image : temp/1753380629_2296190_1373555541_7d2d3a092a1479f4de715a58cc6a2cce_rle_crop_3892839127_0.png resize: (365, 209) 1373579528 -5.121907091244106 treat image : temp/1753380629_2296190_1373555541_7d2d3a092a1479f4de715a58cc6a2cce_rle_crop_3892839129_0.png resize: (269, 170) 1373579529 -0.6443700656490224 treat image : temp/1753380629_2296190_1373555541_7d2d3a092a1479f4de715a58cc6a2cce_rle_crop_3892839130_0.png resize: (467, 335) 1373579530 -4.664322587878118 treat image : temp/1753380629_2296190_1373555535_bd1fadbc1db1eb8fc580feef51532838_rle_crop_3892839132_0.png resize: (533, 527) 1373579531 -2.811848788713648 treat image : temp/1753380629_2296190_1373555535_bd1fadbc1db1eb8fc580feef51532838_rle_crop_3892839133_0.png resize: (427, 127) 1373579532 -3.690164761310972 treat image : temp/1753380629_2296190_1373555535_bd1fadbc1db1eb8fc580feef51532838_rle_crop_3892839134_0.png resize: (489, 482) 1373579533 -4.713336603911943 treat image : temp/1753380629_2296190_1373555535_bd1fadbc1db1eb8fc580feef51532838_rle_crop_3892839135_0.png resize: (619, 321) 1373579534 -3.24795992220262 treat image : temp/1753380629_2296190_1373555535_bd1fadbc1db1eb8fc580feef51532838_rle_crop_3892839137_0.png resize: (381, 477) 1373579536 -2.315464113602731 treat image : temp/1753380629_2296190_1373555535_bd1fadbc1db1eb8fc580feef51532838_rle_crop_3892839138_0.png resize: (152, 177) 1373579537 -0.23160056442646124 treat image : temp/1753380629_2296190_1373555535_bd1fadbc1db1eb8fc580feef51532838_rle_crop_3892839139_0.png resize: (394, 340) 1373579538 -4.855424089265567 treat image : temp/1753380629_2296190_1373555535_bd1fadbc1db1eb8fc580feef51532838_rle_crop_3892839140_0.png resize: (342, 320) 1373579540 -1.0597944985419772 treat image : temp/1753380629_2296190_1373555535_bd1fadbc1db1eb8fc580feef51532838_rle_crop_3892839141_0.png resize: (327, 182) 1373579541 -4.824134545631688 treat image : temp/1753380629_2296190_1373555535_bd1fadbc1db1eb8fc580feef51532838_rle_crop_3892839142_0.png resize: (539, 393) 1373579542 -3.4620601165417146 treat image : temp/1753380629_2296190_1373555535_bd1fadbc1db1eb8fc580feef51532838_rle_crop_3892839144_0.png resize: (414, 541) 1373579544 -4.134016644674952 treat image : temp/1753380629_2296190_1373555535_bd1fadbc1db1eb8fc580feef51532838_rle_crop_3892839147_0.png resize: (119, 214) 1373579545 -2.940232336279799 treat image : temp/1753380629_2296190_1373555535_bd1fadbc1db1eb8fc580feef51532838_rle_crop_3892839148_0.png resize: (143, 373) 1373579546 -0.6220483234738122 treat image : temp/1753380629_2296190_1373555535_bd1fadbc1db1eb8fc580feef51532838_rle_crop_3892839150_0.png resize: (143, 541) 1373579548 -1.866902921426645 treat image : temp/1753380629_2296190_1373555521_a74456a08a0cae3d6cea3ab26d602a5b_rle_crop_3892839151_0.png resize: (548, 203) 1373579549 -0.27533406791505877 treat image : temp/1753380629_2296190_1373555521_a74456a08a0cae3d6cea3ab26d602a5b_rle_crop_3892839154_0.png resize: (369, 389) 1373579550 0.33234498113374056 treat image : temp/1753380629_2296190_1373555521_a74456a08a0cae3d6cea3ab26d602a5b_rle_crop_3892839155_0.png resize: (644, 748) 1373579552 -5.166479778779286 treat image : temp/1753380629_2296190_1373555521_a74456a08a0cae3d6cea3ab26d602a5b_rle_crop_3892839156_0.png resize: (454, 401) 1373579553 -2.7711699294886225 treat image : temp/1753380629_2296190_1373555521_a74456a08a0cae3d6cea3ab26d602a5b_rle_crop_3892839157_0.png resize: (319, 109) 1373579555 -4.269354582280524 treat image : temp/1753380629_2296190_1373555521_a74456a08a0cae3d6cea3ab26d602a5b_rle_crop_3892839158_0.png resize: (298, 174) 1373579556 -3.424209265443193 treat image : temp/1753380629_2296190_1373555521_a74456a08a0cae3d6cea3ab26d602a5b_rle_crop_3892839160_0.png resize: (304, 584) 1373579557 -5.064558302240957 treat image : temp/1753380629_2296190_1373555521_a74456a08a0cae3d6cea3ab26d602a5b_rle_crop_3892839161_0.png resize: (607, 712) 1373579559 -0.019097499322110047 treat image : temp/1753380629_2296190_1373555521_a74456a08a0cae3d6cea3ab26d602a5b_rle_crop_3892839162_0.png resize: (709, 585) 1373579561 -3.552451577508265 treat image : temp/1753380629_2296190_1373555521_a74456a08a0cae3d6cea3ab26d602a5b_rle_crop_3892839163_0.png resize: (298, 99) 1373579562 -2.5410190639288905 treat image : temp/1753380629_2296190_1373555521_a74456a08a0cae3d6cea3ab26d602a5b_rle_crop_3892839164_0.png resize: (375, 488) 1373579563 -2.0133670184957997 treat image : temp/1753380629_2296190_1373555521_a74456a08a0cae3d6cea3ab26d602a5b_rle_crop_3892839165_0.png resize: (369, 444) 1373579565 3.38079144210094 treat image : temp/1753380629_2296190_1373555521_a74456a08a0cae3d6cea3ab26d602a5b_rle_crop_3892839166_0.png resize: (536, 253) 1373579566 -4.123611128070082 treat image : temp/1753380629_2296190_1373555521_a74456a08a0cae3d6cea3ab26d602a5b_rle_crop_3892839167_0.png resize: (417, 339) 1373579567 3.3162223923798675 treat image : temp/1753380629_2296190_1373555521_a74456a08a0cae3d6cea3ab26d602a5b_rle_crop_3892839168_0.png resize: (215, 161) 1373579569 -4.2097295676633575 treat image : temp/1753380629_2296190_1373555521_a74456a08a0cae3d6cea3ab26d602a5b_rle_crop_3892839170_0.png resize: (238, 110) 1373579570 -4.070704350523244 treat image : temp/1753380629_2296190_1373555521_a74456a08a0cae3d6cea3ab26d602a5b_rle_crop_3892839173_0.png resize: (245, 64) 1373579571 -4.900602090550793 treat image : temp/1753380629_2296190_1373555513_61018b3413a8b8249e48923458e19912_rle_crop_3892839174_0.png resize: (239, 161) 1373579573 -1.5677332969672646 treat image : temp/1753380629_2296190_1373555513_61018b3413a8b8249e48923458e19912_rle_crop_3892839175_0.png resize: (219, 270) 1373579574 -4.301559652598497 treat image : temp/1753380629_2296190_1373555513_61018b3413a8b8249e48923458e19912_rle_crop_3892839177_0.png resize: (501, 480) 1373579575 -3.9206076825877214 treat image : temp/1753380629_2296190_1373555513_61018b3413a8b8249e48923458e19912_rle_crop_3892839178_0.png resize: (543, 426) 1373579577 -3.8559409822925024 treat image : temp/1753380629_2296190_1373555513_61018b3413a8b8249e48923458e19912_rle_crop_3892839179_0.png resize: (166, 203) 1373579578 -3.130870277788078 treat image : temp/1753380629_2296190_1373555513_61018b3413a8b8249e48923458e19912_rle_crop_3892839180_0.png resize: (687, 740) 1373579579 -3.7403618637053255 treat image : temp/1753380629_2296190_1373555513_61018b3413a8b8249e48923458e19912_rle_crop_3892839181_0.png resize: (497, 793) 1373579581 -4.585613279771307 treat image : temp/1753380629_2296190_1373555513_61018b3413a8b8249e48923458e19912_rle_crop_3892839182_0.png resize: (252, 198) 1373579582 -2.302674635794629 treat image : temp/1753380629_2296190_1373555513_61018b3413a8b8249e48923458e19912_rle_crop_3892839183_0.png resize: (352, 365) 1373579583 -3.8663297145728217 treat image : temp/1753380629_2296190_1373555513_61018b3413a8b8249e48923458e19912_rle_crop_3892839184_0.png resize: (823, 483) 1373579585 -3.1164852253129807 treat image : temp/1753380629_2296190_1373555513_61018b3413a8b8249e48923458e19912_rle_crop_3892839185_0.png resize: (351, 384) 1373579586 -4.350794485935141 treat image : temp/1753380629_2296190_1373555513_61018b3413a8b8249e48923458e19912_rle_crop_3892839187_0.png resize: (817, 830) 1373579587 -4.409975306637732 treat image : temp/1753380629_2296190_1373555513_61018b3413a8b8249e48923458e19912_rle_crop_3892839189_0.png resize: (369, 392) 1373579589 -5.060683196272207 treat image : temp/1753380629_2296190_1373555513_61018b3413a8b8249e48923458e19912_rle_crop_3892839191_0.png resize: (246, 362) 1373579590 -4.852163929510313 treat image : temp/1753380629_2296190_1373555513_61018b3413a8b8249e48923458e19912_rle_crop_3892839193_0.png resize: (374, 153) 1373579591 -4.605492183537495 treat image : temp/1753380629_2296190_1373555513_61018b3413a8b8249e48923458e19912_rle_crop_3892839194_0.png resize: (134, 288) 1373579593 -4.084837684630753 treat image : temp/1753380629_2296190_1373555513_61018b3413a8b8249e48923458e19912_rle_crop_3892839196_0.png resize: (379, 332) 1373579594 -4.672464561241207 treat image : temp/1753380629_2296190_1373555513_61018b3413a8b8249e48923458e19912_rle_crop_3892839197_0.png resize: (133, 143) 1373579595 -3.4580092226100247 treat image : temp/1753380629_2296190_1373555513_61018b3413a8b8249e48923458e19912_rle_crop_3892839198_0.png resize: (251, 224) 1373579597 -4.587755702494996 treat image : temp/1753380629_2296190_1373555513_61018b3413a8b8249e48923458e19912_rle_crop_3892839200_0.png resize: (251, 203) 1373579598 -4.11161426136904 treat image : temp/1753380629_2296190_1373555501_5722aae0345feb088343abd5fcd4c37e_rle_crop_3892839201_0.png resize: (318, 388) 1373579599 -2.3687203017144562 treat image : temp/1753380629_2296190_1373555501_5722aae0345feb088343abd5fcd4c37e_rle_crop_3892839202_0.png resize: (346, 541) 1373579601 -3.427722523120476 treat image : temp/1753380629_2296190_1373555501_5722aae0345feb088343abd5fcd4c37e_rle_crop_3892839203_0.png resize: (203, 142) 1373579602 -3.209065765353091 treat image : temp/1753380629_2296190_1373555488_173182ca91b27ce98820a356dd687666_rle_crop_3892839206_0.png resize: (377, 792) 1373579603 -5.338309585131926 treat image : temp/1753380629_2296190_1373555488_173182ca91b27ce98820a356dd687666_rle_crop_3892839207_0.png resize: (184, 278) 1373579605 -4.257730424004237 treat image : temp/1753380629_2296190_1373555488_173182ca91b27ce98820a356dd687666_rle_crop_3892839208_0.png resize: (621, 644) 1373579606 -4.758278876447714 treat image : temp/1753380629_2296190_1373555488_173182ca91b27ce98820a356dd687666_rle_crop_3892839209_0.png resize: (274, 560) 1373579607 -2.9518164014577377 treat image : temp/1753380629_2296190_1373555488_173182ca91b27ce98820a356dd687666_rle_crop_3892839210_0.png resize: (229, 278) 1373579609 -3.0082810411764327 treat image : temp/1753380629_2296190_1373555488_173182ca91b27ce98820a356dd687666_rle_crop_3892839212_0.png resize: (434, 583) 1373579610 -3.624568362425192 treat image : temp/1753380629_2296190_1373555488_173182ca91b27ce98820a356dd687666_rle_crop_3892839213_0.png resize: (363, 378) 1373579611 -3.567623134131264 treat image : temp/1753380629_2296190_1373555488_173182ca91b27ce98820a356dd687666_rle_crop_3892839215_0.png resize: (417, 731) 1373579613 -4.837845688420104 treat image : temp/1753380629_2296190_1373555488_173182ca91b27ce98820a356dd687666_rle_crop_3892839216_0.png resize: (100, 284) 1373579614 -4.729071096739088 treat image : temp/1753380629_2296190_1373555488_173182ca91b27ce98820a356dd687666_rle_crop_3892839217_0.png resize: (255, 464) 1373579615 -4.393278501952473 treat image : temp/1753380629_2296190_1373555488_173182ca91b27ce98820a356dd687666_rle_crop_3892839218_0.png resize: (488, 305) 1373579617 -4.429323272139253 treat image : temp/1753380629_2296190_1373555488_173182ca91b27ce98820a356dd687666_rle_crop_3892839219_0.png resize: (202, 275) 1373579618 -3.6157025230378026 treat image : temp/1753380629_2296190_1373555443_976e5bce1556afcf9670cf2d6845bc3f_rle_crop_3892839220_0.png resize: (121, 142) 1373579619 -4.392272710284056 treat image : temp/1753380629_2296190_1373555443_976e5bce1556afcf9670cf2d6845bc3f_rle_crop_3892839221_0.png resize: (609, 644) 1373579621 -4.309818816581776 treat image : temp/1753380629_2296190_1373555443_976e5bce1556afcf9670cf2d6845bc3f_rle_crop_3892839222_0.png resize: (403, 544) 1373579622 -4.516367799081699 treat image : temp/1753380629_2296190_1373555443_976e5bce1556afcf9670cf2d6845bc3f_rle_crop_3892839224_0.png resize: (774, 606) 1373579623 -3.948075880623373 treat image : temp/1753380629_2296190_1373555443_976e5bce1556afcf9670cf2d6845bc3f_rle_crop_3892839225_0.png resize: (267, 430) 1373579625 -4.494914217264808 treat image : temp/1753380629_2296190_1373555541_7d2d3a092a1479f4de715a58cc6a2cce_rle_crop_3892839122_0.png resize: (248, 167) 1373579689 -3.970579227596845 treat image : temp/1753380629_2296190_1373555541_7d2d3a092a1479f4de715a58cc6a2cce_rle_crop_3892839131_0.png resize: (610, 512) 1373579690 -4.941980307405805 treat image : temp/1753380629_2296190_1373555535_bd1fadbc1db1eb8fc580feef51532838_rle_crop_3892839145_0.png resize: (229, 279) 1373579692 -4.803838583913068 treat image : temp/1753380629_2296190_1373555535_bd1fadbc1db1eb8fc580feef51532838_rle_crop_3892839146_0.png resize: (120, 246) 1373579693 -2.111472929086454 treat image : temp/1753380629_2296190_1373555521_a74456a08a0cae3d6cea3ab26d602a5b_rle_crop_3892839153_0.png resize: (264, 359) 1373579694 -1.5287740451020742 treat image : temp/1753380629_2296190_1373555521_a74456a08a0cae3d6cea3ab26d602a5b_rle_crop_3892839172_0.png resize: (282, 227) 1373579696 -3.8772440010839473 treat image : temp/1753380629_2296190_1373555513_61018b3413a8b8249e48923458e19912_rle_crop_3892839176_0.png resize: (124, 147) 1373579697 -4.136150587640244 treat image : temp/1753380629_2296190_1373555513_61018b3413a8b8249e48923458e19912_rle_crop_3892839186_0.png resize: (162, 146) 1373579698 -2.3579276569419694 treat image : temp/1753380629_2296190_1373555513_61018b3413a8b8249e48923458e19912_rle_crop_3892839192_0.png resize: (84, 71) 1373579699 -2.0392357191958133 treat image : temp/1753380629_2296190_1373555513_61018b3413a8b8249e48923458e19912_rle_crop_3892839195_0.png resize: (310, 287) 1373579701 -4.598609723803412 treat image : temp/1753380629_2296190_1373555501_5722aae0345feb088343abd5fcd4c37e_rle_crop_3892839204_0.png resize: (558, 592) 1373579702 -3.1547802855739366 treat image : temp/1753380629_2296190_1373555488_173182ca91b27ce98820a356dd687666_rle_crop_3892839205_0.png resize: (840, 802) 1373579703 -4.307900369068858 treat image : temp/1753380629_2296190_1373555488_173182ca91b27ce98820a356dd687666_rle_crop_3892839214_0.png resize: (256, 259) 1373579705 -3.153256837112537 treat image : temp/1753380629_2296190_1373555443_976e5bce1556afcf9670cf2d6845bc3f_rle_crop_3892839226_0.png resize: (207, 202) 1373579706 -4.688549000039388 treat image : temp/1753380629_2296190_1373555535_bd1fadbc1db1eb8fc580feef51532838_rle_crop_3892839136_0.png resize: (81, 114) 1373579719 -4.994762629138604 treat image : temp/1753380629_2296190_1373555488_173182ca91b27ce98820a356dd687666_rle_crop_3892839211_0.png resize: (168, 229) 1373579720 -4.868004934194985 treat image : temp/1753380629_2296190_1373555555_5c78c632c4bca75b8484865b4644c065_rle_crop_3892839093_0.png resize: (317, 258) 1373579778 -5.448673846194011 treat image : temp/1753380629_2296190_1373555555_5c78c632c4bca75b8484865b4644c065_rle_crop_3892839096_0.png resize: (112, 293) 1373579779 -3.2518462070201317 treat image : temp/1753380629_2296190_1373555555_5c78c632c4bca75b8484865b4644c065_rle_crop_3892839098_0.png resize: (330, 356) 1373579781 -5.325330601979986 treat image : temp/1753380629_2296190_1373555541_7d2d3a092a1479f4de715a58cc6a2cce_rle_crop_3892839113_0.png resize: (258, 634) 1373579782 -3.9912583722424024 treat image : temp/1753380629_2296190_1373555541_7d2d3a092a1479f4de715a58cc6a2cce_rle_crop_3892839115_0.png resize: (165, 218) 1373579784 -3.8116045883876164 treat image : temp/1753380629_2296190_1373555541_7d2d3a092a1479f4de715a58cc6a2cce_rle_crop_3892839128_0.png resize: (221, 305) 1373579785 -3.6784593656953772 treat image : temp/1753380629_2296190_1373555535_bd1fadbc1db1eb8fc580feef51532838_rle_crop_3892839143_0.png resize: (131, 193) 1373579786 -3.7484492116195396 treat image : temp/1753380629_2296190_1373555535_bd1fadbc1db1eb8fc580feef51532838_rle_crop_3892839149_0.png resize: (724, 426) 1373579787 -2.6243839715955035 treat image : temp/1753380629_2296190_1373555521_a74456a08a0cae3d6cea3ab26d602a5b_rle_crop_3892839152_0.png resize: (208, 250) 1373579789 -4.961401668942369 treat image : temp/1753380629_2296190_1373555521_a74456a08a0cae3d6cea3ab26d602a5b_rle_crop_3892839159_0.png resize: (266, 221) 1373579790 -5.055873825813136 treat image : temp/1753380629_2296190_1373555521_a74456a08a0cae3d6cea3ab26d602a5b_rle_crop_3892839169_0.png resize: (500, 258) 1373579791 -5.3848978887092604 treat image : temp/1753380629_2296190_1373555521_a74456a08a0cae3d6cea3ab26d602a5b_rle_crop_3892839171_0.png resize: (133, 140) 1373579793 -5.038170041350989 treat image : temp/1753380629_2296190_1373555513_61018b3413a8b8249e48923458e19912_rle_crop_3892839188_0.png resize: (90, 148) 1373579794 -1.871490669518146 treat image : temp/1753380629_2296190_1373555513_61018b3413a8b8249e48923458e19912_rle_crop_3892839199_0.png resize: (339, 279) 1373579795 -4.959916224844495 treat image : temp/1753380629_2296190_1373555443_976e5bce1556afcf9670cf2d6845bc3f_rle_crop_3892839223_0.png resize: (315, 1409) 1373579797 -4.307396782797685 treat image : temp/1753380629_2296190_1373555513_61018b3413a8b8249e48923458e19912_rle_crop_3892839190_0.png resize: (108, 125) 1373579809 -3.3523393420288516 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 150 time used for this insertion : 0.020455121994018555 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 150 time used for this insertion : 0.031042814254760742 save missing photos in datou_result : time spend for datou_step_exec : 34.732643604278564 time spend to save output : 0.061003684997558594 total time spend for step 6 : 34.79364728927612 step7:brightness Thu Jul 24 20:16:00 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1753380629_2296190_1373555555_5c78c632c4bca75b8484865b4644c065.jpg treat image : temp/1753380629_2296190_1373555541_7d2d3a092a1479f4de715a58cc6a2cce.jpg treat image : temp/1753380629_2296190_1373555535_bd1fadbc1db1eb8fc580feef51532838.jpg treat image : temp/1753380629_2296190_1373555521_a74456a08a0cae3d6cea3ab26d602a5b.jpg treat image : temp/1753380629_2296190_1373555513_61018b3413a8b8249e48923458e19912.jpg treat image : temp/1753380629_2296190_1373555501_5722aae0345feb088343abd5fcd4c37e.jpg treat image : temp/1753380629_2296190_1373555488_173182ca91b27ce98820a356dd687666.jpg treat image : temp/1753380629_2296190_1373555443_976e5bce1556afcf9670cf2d6845bc3f.jpg treat image : temp/1753380629_2296190_1373555555_5c78c632c4bca75b8484865b4644c065_rle_crop_3892839085_0.png treat image : temp/1753380629_2296190_1373555555_5c78c632c4bca75b8484865b4644c065_rle_crop_3892839086_0.png treat image : temp/1753380629_2296190_1373555555_5c78c632c4bca75b8484865b4644c065_rle_crop_3892839087_0.png treat image : temp/1753380629_2296190_1373555555_5c78c632c4bca75b8484865b4644c065_rle_crop_3892839088_0.png treat image : temp/1753380629_2296190_1373555555_5c78c632c4bca75b8484865b4644c065_rle_crop_3892839089_0.png treat image : temp/1753380629_2296190_1373555555_5c78c632c4bca75b8484865b4644c065_rle_crop_3892839090_0.png treat image : temp/1753380629_2296190_1373555555_5c78c632c4bca75b8484865b4644c065_rle_crop_3892839091_0.png treat image : temp/1753380629_2296190_1373555555_5c78c632c4bca75b8484865b4644c065_rle_crop_3892839092_0.png treat image : temp/1753380629_2296190_1373555555_5c78c632c4bca75b8484865b4644c065_rle_crop_3892839094_0.png treat image : temp/1753380629_2296190_1373555555_5c78c632c4bca75b8484865b4644c065_rle_crop_3892839095_0.png treat image : temp/1753380629_2296190_1373555555_5c78c632c4bca75b8484865b4644c065_rle_crop_3892839097_0.png treat image : temp/1753380629_2296190_1373555555_5c78c632c4bca75b8484865b4644c065_rle_crop_3892839099_0.png treat image : temp/1753380629_2296190_1373555555_5c78c632c4bca75b8484865b4644c065_rle_crop_3892839100_0.png treat image : temp/1753380629_2296190_1373555555_5c78c632c4bca75b8484865b4644c065_rle_crop_3892839101_0.png treat image : temp/1753380629_2296190_1373555555_5c78c632c4bca75b8484865b4644c065_rle_crop_3892839102_0.png treat image : temp/1753380629_2296190_1373555555_5c78c632c4bca75b8484865b4644c065_rle_crop_3892839103_0.png treat image : temp/1753380629_2296190_1373555555_5c78c632c4bca75b8484865b4644c065_rle_crop_3892839104_0.png treat image : temp/1753380629_2296190_1373555555_5c78c632c4bca75b8484865b4644c065_rle_crop_3892839105_0.png treat image : temp/1753380629_2296190_1373555555_5c78c632c4bca75b8484865b4644c065_rle_crop_3892839106_0.png treat image : temp/1753380629_2296190_1373555541_7d2d3a092a1479f4de715a58cc6a2cce_rle_crop_3892839107_0.png treat image : temp/1753380629_2296190_1373555541_7d2d3a092a1479f4de715a58cc6a2cce_rle_crop_3892839108_0.png treat image : temp/1753380629_2296190_1373555541_7d2d3a092a1479f4de715a58cc6a2cce_rle_crop_3892839109_0.png treat image : temp/1753380629_2296190_1373555541_7d2d3a092a1479f4de715a58cc6a2cce_rle_crop_3892839110_0.png treat image : temp/1753380629_2296190_1373555541_7d2d3a092a1479f4de715a58cc6a2cce_rle_crop_3892839111_0.png treat image : temp/1753380629_2296190_1373555541_7d2d3a092a1479f4de715a58cc6a2cce_rle_crop_3892839112_0.png treat image : temp/1753380629_2296190_1373555541_7d2d3a092a1479f4de715a58cc6a2cce_rle_crop_3892839114_0.png treat image : temp/1753380629_2296190_1373555541_7d2d3a092a1479f4de715a58cc6a2cce_rle_crop_3892839116_0.png treat image : temp/1753380629_2296190_1373555541_7d2d3a092a1479f4de715a58cc6a2cce_rle_crop_3892839117_0.png treat image : temp/1753380629_2296190_1373555541_7d2d3a092a1479f4de715a58cc6a2cce_rle_crop_3892839118_0.png treat image : temp/1753380629_2296190_1373555541_7d2d3a092a1479f4de715a58cc6a2cce_rle_crop_3892839119_0.png treat image : temp/1753380629_2296190_1373555541_7d2d3a092a1479f4de715a58cc6a2cce_rle_crop_3892839120_0.png treat image : temp/1753380629_2296190_1373555541_7d2d3a092a1479f4de715a58cc6a2cce_rle_crop_3892839121_0.png treat image : temp/1753380629_2296190_1373555541_7d2d3a092a1479f4de715a58cc6a2cce_rle_crop_3892839123_0.png treat image : temp/1753380629_2296190_1373555541_7d2d3a092a1479f4de715a58cc6a2cce_rle_crop_3892839124_0.png treat image : temp/1753380629_2296190_1373555541_7d2d3a092a1479f4de715a58cc6a2cce_rle_crop_3892839125_0.png treat image : temp/1753380629_2296190_1373555541_7d2d3a092a1479f4de715a58cc6a2cce_rle_crop_3892839126_0.png treat image : temp/1753380629_2296190_1373555541_7d2d3a092a1479f4de715a58cc6a2cce_rle_crop_3892839127_0.png treat image : temp/1753380629_2296190_1373555541_7d2d3a092a1479f4de715a58cc6a2cce_rle_crop_3892839129_0.png treat image : temp/1753380629_2296190_1373555541_7d2d3a092a1479f4de715a58cc6a2cce_rle_crop_3892839130_0.png treat image : temp/1753380629_2296190_1373555535_bd1fadbc1db1eb8fc580feef51532838_rle_crop_3892839132_0.png treat image : temp/1753380629_2296190_1373555535_bd1fadbc1db1eb8fc580feef51532838_rle_crop_3892839133_0.png treat image : temp/1753380629_2296190_1373555535_bd1fadbc1db1eb8fc580feef51532838_rle_crop_3892839134_0.png treat image : temp/1753380629_2296190_1373555535_bd1fadbc1db1eb8fc580feef51532838_rle_crop_3892839135_0.png treat image : temp/1753380629_2296190_1373555535_bd1fadbc1db1eb8fc580feef51532838_rle_crop_3892839137_0.png treat image : temp/1753380629_2296190_1373555535_bd1fadbc1db1eb8fc580feef51532838_rle_crop_3892839138_0.png treat image : temp/1753380629_2296190_1373555535_bd1fadbc1db1eb8fc580feef51532838_rle_crop_3892839139_0.png treat image : temp/1753380629_2296190_1373555535_bd1fadbc1db1eb8fc580feef51532838_rle_crop_3892839140_0.png treat image : temp/1753380629_2296190_1373555535_bd1fadbc1db1eb8fc580feef51532838_rle_crop_3892839141_0.png treat image : temp/1753380629_2296190_1373555535_bd1fadbc1db1eb8fc580feef51532838_rle_crop_3892839142_0.png treat image : temp/1753380629_2296190_1373555535_bd1fadbc1db1eb8fc580feef51532838_rle_crop_3892839144_0.png treat image : temp/1753380629_2296190_1373555535_bd1fadbc1db1eb8fc580feef51532838_rle_crop_3892839147_0.png treat image : temp/1753380629_2296190_1373555535_bd1fadbc1db1eb8fc580feef51532838_rle_crop_3892839148_0.png treat image : temp/1753380629_2296190_1373555535_bd1fadbc1db1eb8fc580feef51532838_rle_crop_3892839150_0.png treat image : temp/1753380629_2296190_1373555521_a74456a08a0cae3d6cea3ab26d602a5b_rle_crop_3892839151_0.png treat image : temp/1753380629_2296190_1373555521_a74456a08a0cae3d6cea3ab26d602a5b_rle_crop_3892839154_0.png treat image : temp/1753380629_2296190_1373555521_a74456a08a0cae3d6cea3ab26d602a5b_rle_crop_3892839155_0.png treat image : temp/1753380629_2296190_1373555521_a74456a08a0cae3d6cea3ab26d602a5b_rle_crop_3892839156_0.png treat image : temp/1753380629_2296190_1373555521_a74456a08a0cae3d6cea3ab26d602a5b_rle_crop_3892839157_0.png treat image : temp/1753380629_2296190_1373555521_a74456a08a0cae3d6cea3ab26d602a5b_rle_crop_3892839158_0.png treat image : temp/1753380629_2296190_1373555521_a74456a08a0cae3d6cea3ab26d602a5b_rle_crop_3892839160_0.png treat image : temp/1753380629_2296190_1373555521_a74456a08a0cae3d6cea3ab26d602a5b_rle_crop_3892839161_0.png treat image : temp/1753380629_2296190_1373555521_a74456a08a0cae3d6cea3ab26d602a5b_rle_crop_3892839162_0.png treat image : temp/1753380629_2296190_1373555521_a74456a08a0cae3d6cea3ab26d602a5b_rle_crop_3892839163_0.png treat image : temp/1753380629_2296190_1373555521_a74456a08a0cae3d6cea3ab26d602a5b_rle_crop_3892839164_0.png treat image : temp/1753380629_2296190_1373555521_a74456a08a0cae3d6cea3ab26d602a5b_rle_crop_3892839165_0.png treat image : temp/1753380629_2296190_1373555521_a74456a08a0cae3d6cea3ab26d602a5b_rle_crop_3892839166_0.png treat image : temp/1753380629_2296190_1373555521_a74456a08a0cae3d6cea3ab26d602a5b_rle_crop_3892839167_0.png treat image : temp/1753380629_2296190_1373555521_a74456a08a0cae3d6cea3ab26d602a5b_rle_crop_3892839168_0.png treat image : temp/1753380629_2296190_1373555521_a74456a08a0cae3d6cea3ab26d602a5b_rle_crop_3892839170_0.png treat image : temp/1753380629_2296190_1373555521_a74456a08a0cae3d6cea3ab26d602a5b_rle_crop_3892839173_0.png treat image : temp/1753380629_2296190_1373555513_61018b3413a8b8249e48923458e19912_rle_crop_3892839174_0.png treat image : temp/1753380629_2296190_1373555513_61018b3413a8b8249e48923458e19912_rle_crop_3892839175_0.png treat image : temp/1753380629_2296190_1373555513_61018b3413a8b8249e48923458e19912_rle_crop_3892839177_0.png treat image : temp/1753380629_2296190_1373555513_61018b3413a8b8249e48923458e19912_rle_crop_3892839178_0.png treat image : temp/1753380629_2296190_1373555513_61018b3413a8b8249e48923458e19912_rle_crop_3892839179_0.png treat image : temp/1753380629_2296190_1373555513_61018b3413a8b8249e48923458e19912_rle_crop_3892839180_0.png treat image : temp/1753380629_2296190_1373555513_61018b3413a8b8249e48923458e19912_rle_crop_3892839181_0.png treat image : temp/1753380629_2296190_1373555513_61018b3413a8b8249e48923458e19912_rle_crop_3892839182_0.png treat image : temp/1753380629_2296190_1373555513_61018b3413a8b8249e48923458e19912_rle_crop_3892839183_0.png treat image : temp/1753380629_2296190_1373555513_61018b3413a8b8249e48923458e19912_rle_crop_3892839184_0.png treat image : temp/1753380629_2296190_1373555513_61018b3413a8b8249e48923458e19912_rle_crop_3892839185_0.png treat image : temp/1753380629_2296190_1373555513_61018b3413a8b8249e48923458e19912_rle_crop_3892839187_0.png treat image : temp/1753380629_2296190_1373555513_61018b3413a8b8249e48923458e19912_rle_crop_3892839189_0.png treat image : temp/1753380629_2296190_1373555513_61018b3413a8b8249e48923458e19912_rle_crop_3892839191_0.png treat image : temp/1753380629_2296190_1373555513_61018b3413a8b8249e48923458e19912_rle_crop_3892839193_0.png treat image : temp/1753380629_2296190_1373555513_61018b3413a8b8249e48923458e19912_rle_crop_3892839194_0.png treat image : temp/1753380629_2296190_1373555513_61018b3413a8b8249e48923458e19912_rle_crop_3892839196_0.png treat image : temp/1753380629_2296190_1373555513_61018b3413a8b8249e48923458e19912_rle_crop_3892839197_0.png treat image : temp/1753380629_2296190_1373555513_61018b3413a8b8249e48923458e19912_rle_crop_3892839198_0.png treat image : temp/1753380629_2296190_1373555513_61018b3413a8b8249e48923458e19912_rle_crop_3892839200_0.png treat image : temp/1753380629_2296190_1373555501_5722aae0345feb088343abd5fcd4c37e_rle_crop_3892839201_0.png treat image : temp/1753380629_2296190_1373555501_5722aae0345feb088343abd5fcd4c37e_rle_crop_3892839202_0.png treat image : temp/1753380629_2296190_1373555501_5722aae0345feb088343abd5fcd4c37e_rle_crop_3892839203_0.png treat image : temp/1753380629_2296190_1373555488_173182ca91b27ce98820a356dd687666_rle_crop_3892839206_0.png treat image : temp/1753380629_2296190_1373555488_173182ca91b27ce98820a356dd687666_rle_crop_3892839207_0.png treat image : temp/1753380629_2296190_1373555488_173182ca91b27ce98820a356dd687666_rle_crop_3892839208_0.png treat image : temp/1753380629_2296190_1373555488_173182ca91b27ce98820a356dd687666_rle_crop_3892839209_0.png treat image : temp/1753380629_2296190_1373555488_173182ca91b27ce98820a356dd687666_rle_crop_3892839210_0.png treat image : temp/1753380629_2296190_1373555488_173182ca91b27ce98820a356dd687666_rle_crop_3892839212_0.png treat image : temp/1753380629_2296190_1373555488_173182ca91b27ce98820a356dd687666_rle_crop_3892839213_0.png treat image : temp/1753380629_2296190_1373555488_173182ca91b27ce98820a356dd687666_rle_crop_3892839215_0.png treat image : temp/1753380629_2296190_1373555488_173182ca91b27ce98820a356dd687666_rle_crop_3892839216_0.png treat image : temp/1753380629_2296190_1373555488_173182ca91b27ce98820a356dd687666_rle_crop_3892839217_0.png treat image : temp/1753380629_2296190_1373555488_173182ca91b27ce98820a356dd687666_rle_crop_3892839218_0.png treat image : temp/1753380629_2296190_1373555488_173182ca91b27ce98820a356dd687666_rle_crop_3892839219_0.png treat image : temp/1753380629_2296190_1373555443_976e5bce1556afcf9670cf2d6845bc3f_rle_crop_3892839220_0.png treat image : temp/1753380629_2296190_1373555443_976e5bce1556afcf9670cf2d6845bc3f_rle_crop_3892839221_0.png treat image : temp/1753380629_2296190_1373555443_976e5bce1556afcf9670cf2d6845bc3f_rle_crop_3892839222_0.png treat image : temp/1753380629_2296190_1373555443_976e5bce1556afcf9670cf2d6845bc3f_rle_crop_3892839224_0.png treat image : temp/1753380629_2296190_1373555443_976e5bce1556afcf9670cf2d6845bc3f_rle_crop_3892839225_0.png treat image : temp/1753380629_2296190_1373555541_7d2d3a092a1479f4de715a58cc6a2cce_rle_crop_3892839122_0.png treat image : temp/1753380629_2296190_1373555541_7d2d3a092a1479f4de715a58cc6a2cce_rle_crop_3892839131_0.png treat image : temp/1753380629_2296190_1373555535_bd1fadbc1db1eb8fc580feef51532838_rle_crop_3892839145_0.png treat image : temp/1753380629_2296190_1373555535_bd1fadbc1db1eb8fc580feef51532838_rle_crop_3892839146_0.png treat image : temp/1753380629_2296190_1373555521_a74456a08a0cae3d6cea3ab26d602a5b_rle_crop_3892839153_0.png treat image : temp/1753380629_2296190_1373555521_a74456a08a0cae3d6cea3ab26d602a5b_rle_crop_3892839172_0.png treat image : temp/1753380629_2296190_1373555513_61018b3413a8b8249e48923458e19912_rle_crop_3892839176_0.png treat image : temp/1753380629_2296190_1373555513_61018b3413a8b8249e48923458e19912_rle_crop_3892839186_0.png treat image : temp/1753380629_2296190_1373555513_61018b3413a8b8249e48923458e19912_rle_crop_3892839192_0.png treat image : temp/1753380629_2296190_1373555513_61018b3413a8b8249e48923458e19912_rle_crop_3892839195_0.png treat image : temp/1753380629_2296190_1373555501_5722aae0345feb088343abd5fcd4c37e_rle_crop_3892839204_0.png treat image : temp/1753380629_2296190_1373555488_173182ca91b27ce98820a356dd687666_rle_crop_3892839205_0.png treat image : temp/1753380629_2296190_1373555488_173182ca91b27ce98820a356dd687666_rle_crop_3892839214_0.png treat image : temp/1753380629_2296190_1373555443_976e5bce1556afcf9670cf2d6845bc3f_rle_crop_3892839226_0.png treat image : temp/1753380629_2296190_1373555535_bd1fadbc1db1eb8fc580feef51532838_rle_crop_3892839136_0.png treat image : temp/1753380629_2296190_1373555488_173182ca91b27ce98820a356dd687666_rle_crop_3892839211_0.png treat image : temp/1753380629_2296190_1373555555_5c78c632c4bca75b8484865b4644c065_rle_crop_3892839093_0.png treat image : temp/1753380629_2296190_1373555555_5c78c632c4bca75b8484865b4644c065_rle_crop_3892839096_0.png treat image : temp/1753380629_2296190_1373555555_5c78c632c4bca75b8484865b4644c065_rle_crop_3892839098_0.png treat image : temp/1753380629_2296190_1373555541_7d2d3a092a1479f4de715a58cc6a2cce_rle_crop_3892839113_0.png treat image : temp/1753380629_2296190_1373555541_7d2d3a092a1479f4de715a58cc6a2cce_rle_crop_3892839115_0.png treat image : temp/1753380629_2296190_1373555541_7d2d3a092a1479f4de715a58cc6a2cce_rle_crop_3892839128_0.png treat image : temp/1753380629_2296190_1373555535_bd1fadbc1db1eb8fc580feef51532838_rle_crop_3892839143_0.png treat image : temp/1753380629_2296190_1373555535_bd1fadbc1db1eb8fc580feef51532838_rle_crop_3892839149_0.png treat image : temp/1753380629_2296190_1373555521_a74456a08a0cae3d6cea3ab26d602a5b_rle_crop_3892839152_0.png treat image : temp/1753380629_2296190_1373555521_a74456a08a0cae3d6cea3ab26d602a5b_rle_crop_3892839159_0.png treat image : temp/1753380629_2296190_1373555521_a74456a08a0cae3d6cea3ab26d602a5b_rle_crop_3892839169_0.png treat image : temp/1753380629_2296190_1373555521_a74456a08a0cae3d6cea3ab26d602a5b_rle_crop_3892839171_0.png treat image : temp/1753380629_2296190_1373555513_61018b3413a8b8249e48923458e19912_rle_crop_3892839188_0.png treat image : temp/1753380629_2296190_1373555513_61018b3413a8b8249e48923458e19912_rle_crop_3892839199_0.png treat image : temp/1753380629_2296190_1373555443_976e5bce1556afcf9670cf2d6845bc3f_rle_crop_3892839223_0.png treat image : temp/1753380629_2296190_1373555513_61018b3413a8b8249e48923458e19912_rle_crop_3892839190_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 150 time used for this insertion : 0.019745826721191406 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 150 time used for this insertion : 0.04094886779785156 save missing photos in datou_result : time spend for datou_step_exec : 9.54034948348999 time spend to save output : 0.06568002700805664 total time spend for step 7 : 9.606029510498047 step8:velours_tree Thu Jul 24 20:16:10 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 1.101043462753296 time spend to save output : 4.839897155761719e-05 total time spend for step 8 : 1.1010918617248535 step9:send_mail_cod Thu Jul 24 20:16:11 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P25290433_24-07-2025_20_16_11.pdf 25290789 imagette252907891753380971 25290790 change filename to text .change filename to text .imagette252907901753380971 25290791 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette252907911753380971 25290792 imagette252907921753380973 25290794 change filename to text .imagette252907941753380973 25290795 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette252907951753380973 25290796 imagette252907961753380974 25290797 imagette252907971753380974 25290798 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette252907981753380974 25290799 imagette252907991753380975 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=25290433 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/25290789,25290790,25290791,25290792,25290793,25290794,25290795,25290796,25290797,25290798,25290799?tags=flou,metal,papier,pehd,environnement,pet_fonce,carton,mal_croppe,background,pet_clair,autre args[1373555555] : ((1373555555, -7.27848675043777, 492609224), (1373555555, 0.8171211235552852, 2107752395), '0.17363923249421298') We are sending mail with results at report@fotonower.com args[1373555541] : ((1373555541, -7.507753866741287, 492609224), (1373555541, 1.0074700791717832, 2107752395), '0.17363923249421298') We are sending mail with results at report@fotonower.com args[1373555535] : ((1373555535, -6.980581334253767, 492609224), (1373555535, 0.8070748063953441, 2107752395), '0.17363923249421298') We are sending mail with results at report@fotonower.com args[1373555521] : ((1373555521, -7.196129092578744, 492609224), (1373555521, 1.0922554704454606, 2107752395), '0.17363923249421298') We are sending mail with results at report@fotonower.com args[1373555513] : ((1373555513, -7.111477468395342, 492609224), (1373555513, 0.7750747202704543, 2107752395), '0.17363923249421298') We are sending mail with results at report@fotonower.com args[1373555501] : ((1373555501, -5.965298062520791, 492609224), (1373555501, 0.07008406189428401, 2107752395), '0.17363923249421298') We are sending mail with results at report@fotonower.com args[1373555488] : ((1373555488, -6.283455189558232, 492609224), (1373555488, 0.22763140503515325, 2107752395), '0.17363923249421298') We are sending mail with results at report@fotonower.com args[1373555443] : ((1373555443, -5.788093291794426, 492609224), (1373555443, -0.13756017529260003, 496442774), '0.17363923249421298') We are sending mail with results at report@fotonower.com refus_total : 0.17363923249421298 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=25290433 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25290433_24-07-2025_20_16_11.pdf results_Auto_P25290433_24-07-2025_20_16_11.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25290433_24-07-2025_20_16_11.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','25290433','results_Auto_P25290433_24-07-2025_20_16_11.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25290433_24-07-2025_20_16_11.pdf','pdf','','0.76','0.17363923249421298') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/25290433

https://www.fotonower.com/image?json=false&list_photos_id=1373555555
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1373555541
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1373555535
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1373555521
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1373555513
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1373555501
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1373555488
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1373555443
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 17.36%
Veuillez trouver les photos des contaminants.

exemples de contaminants: metal: https://www.fotonower.com/view/25290790?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/25290791?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/25290794?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/25290795?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/25290798?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25290433_24-07-2025_20_16_11.pdf.

Lien vers velours :https://www.fotonower.com/velours/25290789,25290790,25290791,25290792,25290793,25290794,25290795,25290796,25290797,25290798,25290799?tags=flou,metal,papier,pehd,environnement,pet_fonce,carton,mal_croppe,background,pet_clair,autre.


L'équipe Fotonower 202 b'' Server: nginx Date: Thu, 24 Jul 2025 18:16:18 GMT Content-Length: 0 Connection: close X-Message-Id: pnbhUOF1QJifajmSytW06g Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1373555555, 1373555541, 1373555535, 1373555521, 1373555513, 1373555501, 1373555488, 1373555443] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3343664') ('3318', '25290433', '1373555555', None, None, None, None, None, '3343664') ('3318', None, None, None, None, None, None, None, '3343664') ('3318', '25290433', '1373555541', None, None, None, None, None, '3343664') ('3318', None, None, None, None, None, None, None, '3343664') ('3318', '25290433', '1373555535', None, None, None, None, None, '3343664') ('3318', None, None, None, None, None, None, None, '3343664') ('3318', '25290433', '1373555521', None, None, None, None, None, '3343664') ('3318', None, None, None, None, None, None, None, '3343664') ('3318', '25290433', '1373555513', None, None, None, None, None, '3343664') ('3318', None, None, None, None, None, None, None, '3343664') ('3318', '25290433', '1373555501', None, None, None, None, None, '3343664') ('3318', None, None, None, None, None, None, None, '3343664') ('3318', '25290433', '1373555488', None, None, None, None, None, '3343664') ('3318', None, None, None, None, None, None, None, '3343664') ('3318', '25290433', '1373555443', None, None, None, None, None, '3343664') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.015427112579345703 save_final save missing photos in datou_result : time spend for datou_step_exec : 7.3052568435668945 time spend to save output : 0.01568293571472168 total time spend for step 9 : 7.320939779281616 step10:split_time_score Thu Jul 24 20:16:18 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('16', 8),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 24072025 25290433 Nombre de photos uploadées : 8 / 23040 (0%) 24072025 25290433 Nombre de photos taguées (types de déchets): 0 / 8 (0%) 24072025 25290433 Nombre de photos taguées (volume) : 0 / 8 (0%) elapsed_time : load_data_split_time_score 1.6689300537109375e-06 elapsed_time : order_list_meta_photo_and_scores 4.0531158447265625e-06 ???????? elapsed_time : fill_and_build_computed_from_old_data 0.0005328655242919922 elapsed_time : insert_dashboard_record_day_entry 0.024145126342773438 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.03791742956327484 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25257554_24-07-2025_07_23_41.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25257554 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25257554 AND mptpi.`type`=3726 To do Qualite : 0.10505730774176954 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25259010_24-07-2025_07_44_45.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25259010 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25259010 AND mptpi.`type`=3594 To do Qualite : 0.04335163885612093 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25276721_24-07-2025_15_31_46.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25276721 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25276721 AND mptpi.`type`=3726 To do Qualite : 0.12378780864197533 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25266815_24-07-2025_10_24_51.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25266815 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25266815 AND mptpi.`type`=3594 To do Qualite : 0.12490388093171298 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25266836_24-07-2025_10_16_25.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25266836 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25266836 AND mptpi.`type`=3594 To do Qualite : 0.05351430509837652 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25273144_24-07-2025_12_52_55.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25273144 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25273144 AND mptpi.`type`=3726 To do Qualite : 0.12226962081128746 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25274163_24-07-2025_13_15_39.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25274163 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25274163 AND mptpi.`type`=3594 To do Qualite : 0.13087009417087547 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25280290_24-07-2025_15_55_59.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25280290 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25280290 AND mptpi.`type`=3594 To do Qualite : 0.044165865575539455 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25281395_24-07-2025_16_07_42.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25281395 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25281395 AND mptpi.`type`=3726 To do Qualite : 0.19874398523233885 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25283502_24-07-2025_17_18_36.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25283502 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25283502 AND mptpi.`type`=3594 To do Qualite : 0.03888441997047287 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25283504_24-07-2025_17_12_42.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25283504 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25283504 AND mptpi.`type`=3726 To do Qualite : 0.17363923249421298 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25290433_24-07-2025_20_16_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25290433 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25290433 AND mptpi.`type`=3594 To do Qualite : 0.11010059232026151 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25286606_24-07-2025_20_01_15.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25286606 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25286606 AND mptpi.`type`=3594 To do Qualite : 0.047649078853588496 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25290455_24-07-2025_20_13_09.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25290455 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25290455 AND mptpi.`type`=3726 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'24072025': {'nb_upload': 8, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1373555555, 1373555541, 1373555535, 1373555521, 1373555513, 1373555501, 1373555488, 1373555443] Looping around the photos to save general results len do output : 1 /25290433Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3343664') ('3318', '25290433', '1373555555', None, None, None, None, None, '3343664') ('3318', None, None, None, None, None, None, None, '3343664') ('3318', '25290433', '1373555541', None, None, None, None, None, '3343664') ('3318', None, None, None, None, None, None, None, '3343664') ('3318', '25290433', '1373555535', None, None, None, None, None, '3343664') ('3318', None, None, None, None, None, None, None, '3343664') ('3318', '25290433', '1373555521', None, None, None, None, None, '3343664') ('3318', None, None, None, None, None, None, None, '3343664') ('3318', '25290433', '1373555513', None, None, None, None, None, '3343664') ('3318', None, None, None, None, None, None, None, '3343664') ('3318', '25290433', '1373555501', None, None, None, None, None, '3343664') ('3318', None, None, None, None, None, None, None, '3343664') ('3318', '25290433', '1373555488', None, None, None, None, None, '3343664') ('3318', None, None, None, None, None, None, None, '3343664') ('3318', '25290433', '1373555443', None, None, None, None, None, '3343664') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.0162661075592041 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.087090015411377 time spend to save output : 0.016425609588623047 total time spend for step 10 : 1.103515625 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 8 set_done_treatment 164.26user 138.92system 5:54.60elapsed 85%CPU (0avgtext+0avgdata 5549376maxresident)k 643232inputs+177640outputs (13369major+14523664minor)pagefaults 0swaps