python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1798438 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2808713'] with mtr_portfolio_ids : ['22802746'] and first list_photo_ids : [] new path : /proc/1798438/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 11 ; length of list_pids : 11 ; length of list_args : 11 time to download the photos : 1.570586919784546 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Thu May 8 19:20:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 4330 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-08 19:20:32.964697: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-08 19:20:32.992644: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-08 19:20:32.994715: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fc2bc000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-08 19:20:32.994776: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-08 19:20:32.999160: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-08 19:20:33.266470: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x2f250b30 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-08 19:20:33.266518: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-08 19:20:33.268155: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-08 19:20:33.268556: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-08 19:20:33.271627: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-08 19:20:33.274477: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-08 19:20:33.274996: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-08 19:20:33.277657: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-08 19:20:33.278932: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-08 19:20:33.284074: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-08 19:20:33.285385: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-08 19:20:33.285466: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-08 19:20:33.286158: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-08 19:20:33.286176: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-08 19:20:33.286188: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-08 19:20:33.287406: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 3725 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-08 19:20:33.585398: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-08 19:20:33.585535: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-08 19:20:33.585561: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-08 19:20:33.585583: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-08 19:20:33.585604: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-08 19:20:33.585625: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-08 19:20:33.585645: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-08 19:20:33.585667: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-08 19:20:33.586718: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-08 19:20:33.587922: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-08 19:20:33.587968: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-08 19:20:33.587990: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-08 19:20:33.588010: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-08 19:20:33.588029: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-08 19:20:33.588049: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-08 19:20:33.588068: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-08 19:20:33.588088: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-08 19:20:33.589154: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-08 19:20:33.589195: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-08 19:20:33.589206: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-08 19:20:33.589215: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-08 19:20:33.590359: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 3725 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-05-08 19:20:46.929325: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-08 19:20:47.097810: E tensorflow/stream_executor/cuda/cuda_blas.cc:238] failed to create cublas handle: CUBLAS_STATUS_NOT_INITIALIZED 2025-05-08 19:20:47.103449: E tensorflow/stream_executor/cuda/cuda_blas.cc:238] failed to create cublas handle: CUBLAS_STATUS_NOT_INITIALIZED 2025-05-08 19:20:47.115601: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-08 19:20:47.119296: E tensorflow/stream_executor/cuda/cuda_dnn.cc:329] Could not create cudnn handle: CUDNN_STATUS_INTERNAL_ERROR 2025-05-08 19:20:47.120654: E tensorflow/stream_executor/cuda/cuda_dnn.cc:329] Could not create cudnn handle: CUDNN_STATUS_INTERNAL_ERROR 2025-05-08 19:20:51.013750: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.14G (3371040768 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-08 19:20:51.830470: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 3.29GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-08 19:20:51.830683: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 3.29GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 11 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 error in detect the image : temp/1746724828_1798438_1357031864_5d34f5c2d2613086dca59b1d6de934ea.jpg 2 root error(s) found. (0) Unknown: Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above. [[node conv1/convolution (defined at /usr/local/lib/python3.8/dist-packages/keras/backend/tensorflow_backend.py:3007) ]] [[ROI/strided_slice_20/_22]] (1) Unknown: Failed to get convolution algorithm. This is probably because cuDNN failed to initialize, so try looking to see if a warning log message was printed above. [[node conv1/convolution (defined at /usr/local/lib/python3.8/dist-packages/keras/backend/tensorflow_backend.py:3007) ]] 0 successful operations. 0 derived errors ignored. [Op:__inference_keras_scratch_graph_13584] Function call stack: keras_scratch_graph -> keras_scratch_graph NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 19.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 27 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 39 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 34 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 13.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 24 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 15 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 39 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 38 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 18 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 8.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 25 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 17.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 24 Detection mask done ! Trying to reset tf kernel 1799002 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 227 tf kernel not reseted sub process len(results) : 10 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 10 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 4330 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0010929107666015625 nb_pixel_total : 28622 time to create 1 rle with old method : 0.03457832336425781 length of segment : 239 time for calcul the mask position with numpy : 0.0010879039764404297 nb_pixel_total : 47012 time to create 1 rle with old method : 0.05488920211791992 length of segment : 260 time for calcul the mask position with numpy : 0.0041654109954833984 nb_pixel_total : 161845 time to create 1 rle with new method : 0.010313034057617188 length of segment : 322 time for calcul the mask position with numpy : 0.0003020763397216797 nb_pixel_total : 16404 time to create 1 rle with old method : 0.018622875213623047 length of segment : 103 time for calcul the mask position with numpy : 0.014908790588378906 nb_pixel_total : 351408 time to create 1 rle with new method : 0.11850953102111816 length of segment : 555 time for calcul the mask position with numpy : 0.0005083084106445312 nb_pixel_total : 19789 time to create 1 rle with old method : 0.025714874267578125 length of segment : 181 time for calcul the mask position with numpy : 0.001058340072631836 nb_pixel_total : 40654 time to create 1 rle with old method : 0.04504871368408203 length of segment : 424 time for calcul the mask position with numpy : 0.002218008041381836 nb_pixel_total : 147889 time to create 1 rle with old method : 0.16420602798461914 length of segment : 492 time for calcul the mask position with numpy : 0.0005705356597900391 nb_pixel_total : 36227 time to create 1 rle with old method : 0.04117131233215332 length of segment : 193 time for calcul the mask position with numpy : 0.00031566619873046875 nb_pixel_total : 11816 time to create 1 rle with old method : 0.014046669006347656 length of segment : 103 time for calcul the mask position with numpy : 0.0016093254089355469 nb_pixel_total : 78074 time to create 1 rle with old method : 0.08790159225463867 length of segment : 379 time for calcul the mask position with numpy : 0.0008237361907958984 nb_pixel_total : 35501 time to create 1 rle with old method : 0.03992295265197754 length of segment : 585 time for calcul the mask position with numpy : 0.002050161361694336 nb_pixel_total : 84292 time to create 1 rle with old method : 0.11993789672851562 length of segment : 342 time for calcul the mask position with numpy : 0.0015645027160644531 nb_pixel_total : 110307 time to create 1 rle with old method : 0.1285998821258545 length of segment : 242 time for calcul the mask position with numpy : 0.006140470504760742 nb_pixel_total : 314668 time to create 1 rle with new method : 0.020131587982177734 length of segment : 520 time for calcul the mask position with numpy : 0.0016949176788330078 nb_pixel_total : 31697 time to create 1 rle with old method : 0.05188775062561035 length of segment : 205 time for calcul the mask position with numpy : 0.0006630420684814453 nb_pixel_total : 11272 time to create 1 rle with old method : 0.013015508651733398 length of segment : 127 time for calcul the mask position with numpy : 0.003528118133544922 nb_pixel_total : 84073 time to create 1 rle with old method : 0.10086488723754883 length of segment : 398 time for calcul the mask position with numpy : 0.0012884140014648438 nb_pixel_total : 21213 time to create 1 rle with old method : 0.024005413055419922 length of segment : 199 time for calcul the mask position with numpy : 0.0013127326965332031 nb_pixel_total : 29535 time to create 1 rle with old method : 0.03331112861633301 length of segment : 223 time for calcul the mask position with numpy : 0.001947641372680664 nb_pixel_total : 41196 time to create 1 rle with old method : 0.051531314849853516 length of segment : 249 time for calcul the mask position with numpy : 0.0011343955993652344 nb_pixel_total : 26991 time to create 1 rle with old method : 0.029415130615234375 length of segment : 156 time for calcul the mask position with numpy : 0.008437633514404297 nb_pixel_total : 158014 time to create 1 rle with new method : 0.016294002532958984 length of segment : 945 time for calcul the mask position with numpy : 0.0008859634399414062 nb_pixel_total : 14165 time to create 1 rle with old method : 0.01620769500732422 length of segment : 179 time for calcul the mask position with numpy : 0.0006351470947265625 nb_pixel_total : 16983 time to create 1 rle with old method : 0.019326448440551758 length of segment : 153 time for calcul the mask position with numpy : 0.0006983280181884766 nb_pixel_total : 19495 time to create 1 rle with old method : 0.02213883399963379 length of segment : 185 time for calcul the mask position with numpy : 0.00041747093200683594 nb_pixel_total : 20839 time to create 1 rle with old method : 0.023840904235839844 length of segment : 196 time for calcul the mask position with numpy : 0.0010883808135986328 nb_pixel_total : 19028 time to create 1 rle with old method : 0.031007051467895508 length of segment : 177 time for calcul the mask position with numpy : 0.0013840198516845703 nb_pixel_total : 28454 time to create 1 rle with old method : 0.0347599983215332 length of segment : 174 time for calcul the mask position with numpy : 0.0002994537353515625 nb_pixel_total : 10818 time to create 1 rle with old method : 0.012146949768066406 length of segment : 140 time for calcul the mask position with numpy : 0.001794576644897461 nb_pixel_total : 60368 time to create 1 rle with old method : 0.06989240646362305 length of segment : 250 time for calcul the mask position with numpy : 0.0012683868408203125 nb_pixel_total : 27496 time to create 1 rle with old method : 0.031531572341918945 length of segment : 183 time for calcul the mask position with numpy : 0.0015938282012939453 nb_pixel_total : 35937 time to create 1 rle with old method : 0.042334556579589844 length of segment : 149 time for calcul the mask position with numpy : 0.0009691715240478516 nb_pixel_total : 25484 time to create 1 rle with old method : 0.029245853424072266 length of segment : 157 time for calcul the mask position with numpy : 0.0002853870391845703 nb_pixel_total : 6557 time to create 1 rle with old method : 0.007736682891845703 length of segment : 113 time for calcul the mask position with numpy : 0.0007450580596923828 nb_pixel_total : 15064 time to create 1 rle with old method : 0.019196748733520508 length of segment : 175 time for calcul the mask position with numpy : 0.0008308887481689453 nb_pixel_total : 16946 time to create 1 rle with old method : 0.02069544792175293 length of segment : 138 time for calcul the mask position with numpy : 0.007061958312988281 nb_pixel_total : 129730 time to create 1 rle with old method : 0.1537339687347412 length of segment : 378 time for calcul the mask position with numpy : 0.0563817024230957 nb_pixel_total : 450719 time to create 1 rle with new method : 0.027150392532348633 length of segment : 918 time for calcul the mask position with numpy : 0.0007839202880859375 nb_pixel_total : 18239 time to create 1 rle with old method : 0.020448684692382812 length of segment : 144 time for calcul the mask position with numpy : 0.0007383823394775391 nb_pixel_total : 11882 time to create 1 rle with old method : 0.013596534729003906 length of segment : 185 time for calcul the mask position with numpy : 0.0006020069122314453 nb_pixel_total : 14800 time to create 1 rle with old method : 0.016851186752319336 length of segment : 113 time for calcul the mask position with numpy : 0.0014219284057617188 nb_pixel_total : 39037 time to create 1 rle with old method : 0.0432431697845459 length of segment : 235 time for calcul the mask position with numpy : 0.001852273941040039 nb_pixel_total : 41009 time to create 1 rle with old method : 0.04514288902282715 length of segment : 211 time for calcul the mask position with numpy : 0.0011746883392333984 nb_pixel_total : 20886 time to create 1 rle with old method : 0.022752046585083008 length of segment : 194 time for calcul the mask position with numpy : 0.0009388923645019531 nb_pixel_total : 16415 time to create 1 rle with old method : 0.018866777420043945 length of segment : 157 time for calcul the mask position with numpy : 0.0007476806640625 nb_pixel_total : 14896 time to create 1 rle with old method : 0.017169713973999023 length of segment : 115 time for calcul the mask position with numpy : 0.0005576610565185547 nb_pixel_total : 12866 time to create 1 rle with old method : 0.014626502990722656 length of segment : 122 time for calcul the mask position with numpy : 0.0015327930450439453 nb_pixel_total : 45868 time to create 1 rle with old method : 0.05079197883605957 length of segment : 280 time for calcul the mask position with numpy : 0.0025892257690429688 nb_pixel_total : 76559 time to create 1 rle with old method : 0.08507132530212402 length of segment : 423 time for calcul the mask position with numpy : 0.0007605552673339844 nb_pixel_total : 24782 time to create 1 rle with old method : 0.02734661102294922 length of segment : 195 time for calcul the mask position with numpy : 0.00046372413635253906 nb_pixel_total : 13665 time to create 1 rle with old method : 0.015692949295043945 length of segment : 157 time for calcul the mask position with numpy : 0.001041412353515625 nb_pixel_total : 20392 time to create 1 rle with old method : 0.02429342269897461 length of segment : 313 time for calcul the mask position with numpy : 0.002106904983520508 nb_pixel_total : 51210 time to create 1 rle with old method : 0.056258201599121094 length of segment : 540 time for calcul the mask position with numpy : 0.0004627704620361328 nb_pixel_total : 13207 time to create 1 rle with old method : 0.01524209976196289 length of segment : 120 time for calcul the mask position with numpy : 0.0005235671997070312 nb_pixel_total : 11998 time to create 1 rle with old method : 0.013751983642578125 length of segment : 165 time for calcul the mask position with numpy : 0.0002636909484863281 nb_pixel_total : 6015 time to create 1 rle with old method : 0.00702214241027832 length of segment : 100 time for calcul the mask position with numpy : 0.003067493438720703 nb_pixel_total : 111696 time to create 1 rle with old method : 0.13337159156799316 length of segment : 338 time for calcul the mask position with numpy : 0.0019884109497070312 nb_pixel_total : 39047 time to create 1 rle with old method : 0.043381452560424805 length of segment : 487 time for calcul the mask position with numpy : 0.001631021499633789 nb_pixel_total : 56353 time to create 1 rle with old method : 0.06321406364440918 length of segment : 276 time for calcul the mask position with numpy : 0.002107858657836914 nb_pixel_total : 82089 time to create 1 rle with old method : 0.10344934463500977 length of segment : 413 time for calcul the mask position with numpy : 0.0010540485382080078 nb_pixel_total : 24091 time to create 1 rle with old method : 0.02717137336730957 length of segment : 263 time for calcul the mask position with numpy : 0.0039501190185546875 nb_pixel_total : 168643 time to create 1 rle with new method : 0.007669925689697266 length of segment : 645 time for calcul the mask position with numpy : 0.0015151500701904297 nb_pixel_total : 44134 time to create 1 rle with old method : 0.05046367645263672 length of segment : 322 time for calcul the mask position with numpy : 0.0014019012451171875 nb_pixel_total : 23096 time to create 1 rle with old method : 0.027064800262451172 length of segment : 276 time for calcul the mask position with numpy : 0.002866983413696289 nb_pixel_total : 95226 time to create 1 rle with old method : 0.10935425758361816 length of segment : 597 time for calcul the mask position with numpy : 0.004641056060791016 nb_pixel_total : 150280 time to create 1 rle with new method : 0.008618593215942383 length of segment : 480 time for calcul the mask position with numpy : 0.0019834041595458984 nb_pixel_total : 40719 time to create 1 rle with old method : 0.048238277435302734 length of segment : 199 time for calcul the mask position with numpy : 0.007892370223999023 nb_pixel_total : 351702 time to create 1 rle with new method : 0.021198749542236328 length of segment : 748 time for calcul the mask position with numpy : 0.0019538402557373047 nb_pixel_total : 77682 time to create 1 rle with old method : 0.08775019645690918 length of segment : 277 time for calcul the mask position with numpy : 0.007918357849121094 nb_pixel_total : 343466 time to create 1 rle with new method : 0.018645048141479492 length of segment : 850 time for calcul the mask position with numpy : 0.00089263916015625 nb_pixel_total : 30186 time to create 1 rle with old method : 0.03447723388671875 length of segment : 229 time for calcul the mask position with numpy : 0.0011882781982421875 nb_pixel_total : 25093 time to create 1 rle with old method : 0.027994632720947266 length of segment : 232 time for calcul the mask position with numpy : 0.005604743957519531 nb_pixel_total : 164975 time to create 1 rle with new method : 0.00971841812133789 length of segment : 382 time for calcul the mask position with numpy : 0.005780220031738281 nb_pixel_total : 126926 time to create 1 rle with old method : 0.1668558120727539 length of segment : 428 time for calcul the mask position with numpy : 0.0013744831085205078 nb_pixel_total : 29284 time to create 1 rle with old method : 0.03469085693359375 length of segment : 263 time for calcul the mask position with numpy : 0.008104085922241211 nb_pixel_total : 191868 time to create 1 rle with new method : 0.01291036605834961 length of segment : 539 time for calcul the mask position with numpy : 0.0009963512420654297 nb_pixel_total : 17754 time to create 1 rle with old method : 0.021661996841430664 length of segment : 96 time for calcul the mask position with numpy : 0.002775907516479492 nb_pixel_total : 81470 time to create 1 rle with old method : 0.09717130661010742 length of segment : 310 time for calcul the mask position with numpy : 0.001279592514038086 nb_pixel_total : 24400 time to create 1 rle with old method : 0.033994436264038086 length of segment : 221 time for calcul the mask position with numpy : 0.0008738040924072266 nb_pixel_total : 16317 time to create 1 rle with old method : 0.025809764862060547 length of segment : 170 time for calcul the mask position with numpy : 0.001168966293334961 nb_pixel_total : 36347 time to create 1 rle with old method : 0.041083574295043945 length of segment : 353 time for calcul the mask position with numpy : 0.0037131309509277344 nb_pixel_total : 87372 time to create 1 rle with old method : 0.09889674186706543 length of segment : 428 time for calcul the mask position with numpy : 0.0008335113525390625 nb_pixel_total : 19149 time to create 1 rle with old method : 0.022759199142456055 length of segment : 133 time for calcul the mask position with numpy : 0.0012450218200683594 nb_pixel_total : 25241 time to create 1 rle with old method : 0.028774023056030273 length of segment : 266 time for calcul the mask position with numpy : 0.005937099456787109 nb_pixel_total : 169964 time to create 1 rle with new method : 0.01163029670715332 length of segment : 540 time for calcul the mask position with numpy : 0.0014834403991699219 nb_pixel_total : 42282 time to create 1 rle with old method : 0.048203229904174805 length of segment : 198 time for calcul the mask position with numpy : 0.005084037780761719 nb_pixel_total : 152890 time to create 1 rle with new method : 0.006675004959106445 length of segment : 366 time for calcul the mask position with numpy : 0.006246089935302734 nb_pixel_total : 136852 time to create 1 rle with old method : 0.14933204650878906 length of segment : 1021 time for calcul the mask position with numpy : 0.0007977485656738281 nb_pixel_total : 33367 time to create 1 rle with old method : 0.03765153884887695 length of segment : 191 time for calcul the mask position with numpy : 0.0007164478302001953 nb_pixel_total : 11806 time to create 1 rle with old method : 0.013461589813232422 length of segment : 216 time for calcul the mask position with numpy : 0.0009293556213378906 nb_pixel_total : 22741 time to create 1 rle with old method : 0.02647852897644043 length of segment : 124 time for calcul the mask position with numpy : 0.0012998580932617188 nb_pixel_total : 38688 time to create 1 rle with old method : 0.04336237907409668 length of segment : 404 time for calcul the mask position with numpy : 0.0019893646240234375 nb_pixel_total : 58784 time to create 1 rle with old method : 0.06725358963012695 length of segment : 272 time for calcul the mask position with numpy : 0.012873411178588867 nb_pixel_total : 296393 time to create 1 rle with new method : 0.13439393043518066 length of segment : 839 time for calcul the mask position with numpy : 0.0005962848663330078 nb_pixel_total : 21650 time to create 1 rle with old method : 0.025107860565185547 length of segment : 140 time for calcul the mask position with numpy : 0.0007817745208740234 nb_pixel_total : 26577 time to create 1 rle with old method : 0.030498504638671875 length of segment : 179 time for calcul the mask position with numpy : 0.000507354736328125 nb_pixel_total : 9236 time to create 1 rle with old method : 0.010568618774414062 length of segment : 103 time for calcul the mask position with numpy : 0.0014913082122802734 nb_pixel_total : 33282 time to create 1 rle with old method : 0.03731417655944824 length of segment : 239 time for calcul the mask position with numpy : 0.0012805461883544922 nb_pixel_total : 39584 time to create 1 rle with old method : 0.044075965881347656 length of segment : 205 time for calcul the mask position with numpy : 0.0021164417266845703 nb_pixel_total : 64979 time to create 1 rle with old method : 0.07146692276000977 length of segment : 266 time for calcul the mask position with numpy : 0.0014646053314208984 nb_pixel_total : 31651 time to create 1 rle with old method : 0.035706520080566406 length of segment : 177 time for calcul the mask position with numpy : 0.0024662017822265625 nb_pixel_total : 64636 time to create 1 rle with old method : 0.07052731513977051 length of segment : 285 time for calcul the mask position with numpy : 0.0004315376281738281 nb_pixel_total : 8995 time to create 1 rle with old method : 0.010084390640258789 length of segment : 83 time for calcul the mask position with numpy : 0.0004382133483886719 nb_pixel_total : 9271 time to create 1 rle with old method : 0.010762453079223633 length of segment : 85 time for calcul the mask position with numpy : 0.000990152359008789 nb_pixel_total : 31598 time to create 1 rle with old method : 0.03472638130187988 length of segment : 237 time for calcul the mask position with numpy : 0.010979890823364258 nb_pixel_total : 404957 time to create 1 rle with new method : 0.16762852668762207 length of segment : 931 time for calcul the mask position with numpy : 0.0008480548858642578 nb_pixel_total : 18281 time to create 1 rle with old method : 0.020439624786376953 length of segment : 233 time for calcul the mask position with numpy : 0.002243518829345703 nb_pixel_total : 72631 time to create 1 rle with old method : 0.08450865745544434 length of segment : 302 time for calcul the mask position with numpy : 0.0068798065185546875 nb_pixel_total : 57689 time to create 1 rle with old method : 0.06989550590515137 length of segment : 400 time for calcul the mask position with numpy : 0.004961967468261719 nb_pixel_total : 142255 time to create 1 rle with old method : 0.18501067161560059 length of segment : 485 time for calcul the mask position with numpy : 0.0007948875427246094 nb_pixel_total : 14186 time to create 1 rle with old method : 0.015912294387817383 length of segment : 220 time for calcul the mask position with numpy : 0.0006444454193115234 nb_pixel_total : 17342 time to create 1 rle with old method : 0.019705533981323242 length of segment : 157 time for calcul the mask position with numpy : 0.0006701946258544922 nb_pixel_total : 17695 time to create 1 rle with old method : 0.022748231887817383 length of segment : 141 time for calcul the mask position with numpy : 0.005676746368408203 nb_pixel_total : 136311 time to create 1 rle with old method : 0.17065668106079102 length of segment : 371 time for calcul the mask position with numpy : 0.01524972915649414 nb_pixel_total : 434512 time to create 1 rle with new method : 0.023266315460205078 length of segment : 656 time for calcul the mask position with numpy : 0.00040793418884277344 nb_pixel_total : 7360 time to create 1 rle with old method : 0.008749008178710938 length of segment : 176 time for calcul the mask position with numpy : 0.0029566287994384766 nb_pixel_total : 130512 time to create 1 rle with old method : 0.14533734321594238 length of segment : 434 time for calcul the mask position with numpy : 0.0020186901092529297 nb_pixel_total : 73910 time to create 1 rle with old method : 0.08314919471740723 length of segment : 434 time for calcul the mask position with numpy : 0.00351715087890625 nb_pixel_total : 140699 time to create 1 rle with old method : 0.15570807456970215 length of segment : 412 time for calcul the mask position with numpy : 0.0034503936767578125 nb_pixel_total : 117371 time to create 1 rle with old method : 0.12778639793395996 length of segment : 520 time for calcul the mask position with numpy : 0.00292205810546875 nb_pixel_total : 91443 time to create 1 rle with old method : 0.1016988754272461 length of segment : 511 time for calcul the mask position with numpy : 0.10423946380615234 nb_pixel_total : 831896 time to create 1 rle with new method : 0.18979215621948242 length of segment : 1068 time for calcul the mask position with numpy : 0.0013527870178222656 nb_pixel_total : 29398 time to create 1 rle with old method : 0.033167123794555664 length of segment : 294 time for calcul the mask position with numpy : 0.0037682056427001953 nb_pixel_total : 145708 time to create 1 rle with old method : 0.1610112190246582 length of segment : 472 time for calcul the mask position with numpy : 0.002001047134399414 nb_pixel_total : 57562 time to create 1 rle with old method : 0.06455564498901367 length of segment : 249 time for calcul the mask position with numpy : 0.0015211105346679688 nb_pixel_total : 54178 time to create 1 rle with old method : 0.061797380447387695 length of segment : 248 time for calcul the mask position with numpy : 0.00115203857421875 nb_pixel_total : 26572 time to create 1 rle with old method : 0.030443906784057617 length of segment : 229 time for calcul the mask position with numpy : 0.002811431884765625 nb_pixel_total : 102135 time to create 1 rle with old method : 0.11505317687988281 length of segment : 283 time for calcul the mask position with numpy : 0.0009505748748779297 nb_pixel_total : 23329 time to create 1 rle with old method : 0.026324033737182617 length of segment : 220 time for calcul the mask position with numpy : 0.003232240676879883 nb_pixel_total : 129868 time to create 1 rle with old method : 0.14480113983154297 length of segment : 268 time for calcul the mask position with numpy : 0.0017628669738769531 nb_pixel_total : 65799 time to create 1 rle with old method : 0.10006570816040039 length of segment : 265 time for calcul the mask position with numpy : 0.0013473033905029297 nb_pixel_total : 42238 time to create 1 rle with old method : 0.04815936088562012 length of segment : 210 time for calcul the mask position with numpy : 0.004376411437988281 nb_pixel_total : 137387 time to create 1 rle with old method : 0.15136313438415527 length of segment : 413 time for calcul the mask position with numpy : 0.0003123283386230469 nb_pixel_total : 5586 time to create 1 rle with old method : 0.006388187408447266 length of segment : 106 time for calcul the mask position with numpy : 0.00043845176696777344 nb_pixel_total : 10518 time to create 1 rle with old method : 0.012274503707885742 length of segment : 101 time for calcul the mask position with numpy : 0.00058746337890625 nb_pixel_total : 20298 time to create 1 rle with old method : 0.03209972381591797 length of segment : 260 time for calcul the mask position with numpy : 0.0014274120330810547 nb_pixel_total : 23192 time to create 1 rle with old method : 0.034256935119628906 length of segment : 199 time for calcul the mask position with numpy : 0.0006349086761474609 nb_pixel_total : 16928 time to create 1 rle with old method : 0.019377946853637695 length of segment : 155 time for calcul the mask position with numpy : 0.0006172657012939453 nb_pixel_total : 20109 time to create 1 rle with old method : 0.02235698699951172 length of segment : 153 time for calcul the mask position with numpy : 0.002551555633544922 nb_pixel_total : 91292 time to create 1 rle with old method : 0.09938502311706543 length of segment : 609 time for calcul the mask position with numpy : 0.001102447509765625 nb_pixel_total : 32533 time to create 1 rle with old method : 0.036139488220214844 length of segment : 355 time for calcul the mask position with numpy : 0.0036880970001220703 nb_pixel_total : 143031 time to create 1 rle with old method : 0.16963434219360352 length of segment : 427 time for calcul the mask position with numpy : 0.0022737979888916016 nb_pixel_total : 86460 time to create 1 rle with old method : 0.09856820106506348 length of segment : 375 time for calcul the mask position with numpy : 0.0004153251647949219 nb_pixel_total : 8610 time to create 1 rle with old method : 0.01128530502319336 length of segment : 107 time for calcul the mask position with numpy : 0.0015451908111572266 nb_pixel_total : 44264 time to create 1 rle with old method : 0.05010819435119629 length of segment : 378 time for calcul the mask position with numpy : 0.0003960132598876953 nb_pixel_total : 7483 time to create 1 rle with old method : 0.008835792541503906 length of segment : 115 time for calcul the mask position with numpy : 0.0013589859008789062 nb_pixel_total : 37348 time to create 1 rle with old method : 0.04294848442077637 length of segment : 257 time for calcul the mask position with numpy : 0.0002446174621582031 nb_pixel_total : 5275 time to create 1 rle with old method : 0.006135702133178711 length of segment : 86 time for calcul the mask position with numpy : 0.00019168853759765625 nb_pixel_total : 6942 time to create 1 rle with old method : 0.008000373840332031 length of segment : 112 time for calcul the mask position with numpy : 0.0006453990936279297 nb_pixel_total : 20720 time to create 1 rle with old method : 0.024486303329467773 length of segment : 150 time for calcul the mask position with numpy : 0.002094268798828125 nb_pixel_total : 110201 time to create 1 rle with old method : 0.14403128623962402 length of segment : 385 time for calcul the mask position with numpy : 0.0004379749298095703 nb_pixel_total : 24397 time to create 1 rle with old method : 0.02684473991394043 length of segment : 213 time spent for convertir_results : 16.40059781074524 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 153 chid ids of type : 3594 Number RLEs to save : 46412 save missing photos in datou_result : time spend for datou_step_exec : 86.49397540092468 time spend to save output : 2.7421438694000244 total time spend for step 1 : 89.2361192703247 step2:crop_condition Thu May 8 19:21:59 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 11 ! batch 1 Loaded 153 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 102 About to insert : list_path_to_insert length 102 new photo from crops ! About to upload 102 photos upload in portfolio : 3736932 init cache_photo without model_param we have 102 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746724952_1798438 we have uploaded 102 photos in the portfolio 3736932 time of upload the photos Elapsed time : 40.39204239845276 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 16 About to insert : list_path_to_insert length 16 new photo from crops ! About to upload 16 photos upload in portfolio : 3736932 init cache_photo without model_param we have 16 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746724998_1798438 we have uploaded 16 photos in the portfolio 3736932 time of upload the photos Elapsed time : 4.189260721206665 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746725004_1798438 we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.7850167751312256 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 26 About to insert : list_path_to_insert length 26 new photo from crops ! About to upload 26 photos upload in portfolio : 3736932 init cache_photo without model_param we have 26 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746725019_1798438 we have uploaded 26 photos in the portfolio 3736932 time of upload the photos Elapsed time : 8.473407983779907 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3736932 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746725029_1798438 we have uploaded 4 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.809906244277954 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746725033_1798438 we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.1218533515930176 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746725035_1798438 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.5048604011535645 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1357031864, 1357031834, 1357031807, 1357031775, 1357031728, 1357031713, 1357031710, 1357031707, 1357031706, 1357031705, 1357031704] Looping around the photos to save general results len do output : 153 /1357037841Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037842Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037843Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037844Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037845Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037846Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037847Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037848Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037849Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037850Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037851Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037852Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037853Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037854Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037855Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037856Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037857Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037858Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037859Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037860Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037861Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037862Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037863Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037864Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037865Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037866Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037867Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037868Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037869Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037870Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037871Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037872Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037873Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037874Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037875Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037876Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037877Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037878Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037879Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037880Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037881Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037882Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037883Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037884Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037885Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037886Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037887Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037888Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037889Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037890Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037891Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037892Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037893Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037894Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037895Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037896Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037897Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037898Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037899Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037900Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037901Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037902Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037903Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037904Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037905Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037906Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037907Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037908Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037909Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037910Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037911Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037912Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037913Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037914Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037915Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037917Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037918Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037919Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037920Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037921Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037922Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037923Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037924Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037925Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037926Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037927Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037928Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037929Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037930Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037931Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037932Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037933Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037934Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037935Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037936Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037937Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037938Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037939Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037940Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037941Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037942Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037943Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037944Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037945Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037946Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037947Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037948Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037949Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037950Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037951Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037952Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037953Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037954Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037955Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037956Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037957Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037958Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037959Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037960Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037961Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037973Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037974Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037975Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037976Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037977Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037979Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037980Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037982Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037983Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037984Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037985Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037986Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037987Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037988Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037990Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037991Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037992Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037993Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037994Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037995Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037996Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037997Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037998Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357037999Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357038000Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357038001Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357038005Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357038006Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357038007Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357038008Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357038011Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357038012Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357038015Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2808713') ('3318', '22802746', '1357031864', None, None, None, None, None, '2808713') ('3318', None, None, None, None, None, None, None, '2808713') ('3318', '22802746', '1357031834', None, None, None, None, None, '2808713') ('3318', None, None, None, None, None, None, None, '2808713') ('3318', '22802746', '1357031807', None, None, None, None, None, '2808713') ('3318', None, None, None, None, None, None, None, '2808713') ('3318', '22802746', '1357031775', None, None, None, None, None, '2808713') ('3318', None, None, None, None, None, None, None, '2808713') ('3318', '22802746', '1357031728', None, None, None, None, None, '2808713') ('3318', None, None, None, None, None, None, None, '2808713') ('3318', '22802746', '1357031713', None, None, None, None, None, '2808713') ('3318', None, None, None, None, None, None, None, '2808713') ('3318', '22802746', '1357031710', None, None, None, None, None, '2808713') ('3318', None, None, None, None, None, None, None, '2808713') ('3318', '22802746', '1357031707', None, None, None, None, None, '2808713') ('3318', None, None, None, None, None, None, None, '2808713') ('3318', '22802746', '1357031706', None, None, None, None, None, '2808713') ('3318', None, None, None, None, None, None, None, '2808713') ('3318', '22802746', '1357031705', None, None, None, None, None, '2808713') ('3318', None, None, None, None, None, None, None, '2808713') ('3318', '22802746', '1357031704', None, None, None, None, None, '2808713') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 470 time used for this insertion : 0.032591819763183594 save_final save missing photos in datou_result : time spend for datou_step_exec : 116.97059869766235 time spend to save output : 0.03729248046875 total time spend for step 2 : 117.0078911781311 step3:rle_unique_nms_with_priority Thu May 8 19:23:56 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 153 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ No data in photo_id : 1357031864 nb_obj : 14 nb_hashtags : 4 time to prepare the origin masks : 5.980047941207886 time for calcul the mask position with numpy : 0.606980562210083 nb_pixel_total : 5888285 time to create 1 rle with new method : 0.6307888031005859 time for calcul the mask position with numpy : 0.0350649356842041 nb_pixel_total : 110307 time to create 1 rle with old method : 0.1314253807067871 time for calcul the mask position with numpy : 0.03419232368469238 nb_pixel_total : 84292 time to create 1 rle with old method : 0.09683108329772949 time for calcul the mask position with numpy : 0.03533530235290527 nb_pixel_total : 35501 time to create 1 rle with old method : 0.04010200500488281 time for calcul the mask position with numpy : 0.03534412384033203 nb_pixel_total : 78074 time to create 1 rle with old method : 0.08724546432495117 time for calcul the mask position with numpy : 0.03421378135681152 nb_pixel_total : 11816 time to create 1 rle with old method : 0.012867450714111328 time for calcul the mask position with numpy : 0.0336911678314209 nb_pixel_total : 36227 time to create 1 rle with old method : 0.04055309295654297 time for calcul the mask position with numpy : 0.034819841384887695 nb_pixel_total : 147889 time to create 1 rle with old method : 0.16187834739685059 time for calcul the mask position with numpy : 0.03722357749938965 nb_pixel_total : 40654 time to create 1 rle with old method : 0.045458078384399414 time for calcul the mask position with numpy : 0.029977083206176758 nb_pixel_total : 19789 time to create 1 rle with old method : 0.022259235382080078 time for calcul the mask position with numpy : 0.036023855209350586 nb_pixel_total : 343523 time to create 1 rle with new method : 0.8106343746185303 time for calcul the mask position with numpy : 0.03715085983276367 nb_pixel_total : 16404 time to create 1 rle with old method : 0.018320560455322266 time for calcul the mask position with numpy : 0.03654623031616211 nb_pixel_total : 161845 time to create 1 rle with new method : 0.40833306312561035 time for calcul the mask position with numpy : 0.03937673568725586 nb_pixel_total : 47012 time to create 1 rle with old method : 0.05318164825439453 time for calcul the mask position with numpy : 0.03236722946166992 nb_pixel_total : 28622 time to create 1 rle with old method : 0.031723737716674805 create new chi : 3.768998146057129 time to delete rle : 0.01676011085510254 batch 1 Loaded 29 chid ids of type : 3594 ++++++++++++++++Number RLEs to save : 10929 TO DO : save crop sub photo not yet done ! save time : 0.6376619338989258 nb_obj : 23 nb_hashtags : 4 time to prepare the origin masks : 7.917366027832031 time for calcul the mask position with numpy : 0.501861572265625 nb_pixel_total : 6027451 time to create 1 rle with new method : 0.7342209815979004 time for calcul the mask position with numpy : 0.024953603744506836 nb_pixel_total : 16946 time to create 1 rle with old method : 0.017824888229370117 time for calcul the mask position with numpy : 0.019997596740722656 nb_pixel_total : 13138 time to create 1 rle with old method : 0.013921022415161133 time for calcul the mask position with numpy : 0.022820711135864258 nb_pixel_total : 6557 time to create 1 rle with old method : 0.006928205490112305 time for calcul the mask position with numpy : 0.020709753036499023 nb_pixel_total : 25484 time to create 1 rle with old method : 0.02782464027404785 time for calcul the mask position with numpy : 0.02187943458557129 nb_pixel_total : 35937 time to create 1 rle with old method : 0.042200326919555664 time for calcul the mask position with numpy : 0.021452903747558594 nb_pixel_total : 27496 time to create 1 rle with old method : 0.02986621856689453 time for calcul the mask position with numpy : 0.026102781295776367 nb_pixel_total : 60368 time to create 1 rle with old method : 0.06869864463806152 time for calcul the mask position with numpy : 0.031846046447753906 nb_pixel_total : 9421 time to create 1 rle with old method : 0.009839773178100586 time for calcul the mask position with numpy : 0.0327455997467041 nb_pixel_total : 28454 time to create 1 rle with old method : 0.029714107513427734 time for calcul the mask position with numpy : 0.03533315658569336 nb_pixel_total : 19028 time to create 1 rle with old method : 0.019353866577148438 time for calcul the mask position with numpy : 0.0315241813659668 nb_pixel_total : 10658 time to create 1 rle with old method : 0.01119375228881836 time for calcul the mask position with numpy : 0.03130173683166504 nb_pixel_total : 19495 time to create 1 rle with old method : 0.021403789520263672 time for calcul the mask position with numpy : 0.03175830841064453 nb_pixel_total : 16983 time to create 1 rle with old method : 0.017389535903930664 time for calcul the mask position with numpy : 0.032408714294433594 nb_pixel_total : 14165 time to create 1 rle with old method : 0.014535903930664062 time for calcul the mask position with numpy : 0.03247332572937012 nb_pixel_total : 158014 time to create 1 rle with new method : 0.8142788410186768 time for calcul the mask position with numpy : 0.03149008750915527 nb_pixel_total : 26991 time to create 1 rle with old method : 0.028637170791625977 time for calcul the mask position with numpy : 0.03186202049255371 nb_pixel_total : 41196 time to create 1 rle with old method : 0.04353022575378418 time for calcul the mask position with numpy : 0.03169822692871094 nb_pixel_total : 29535 time to create 1 rle with old method : 0.0334169864654541 time for calcul the mask position with numpy : 0.03372931480407715 nb_pixel_total : 21213 time to create 1 rle with old method : 0.021908998489379883 time for calcul the mask position with numpy : 0.03138422966003418 nb_pixel_total : 84073 time to create 1 rle with old method : 0.08916950225830078 time for calcul the mask position with numpy : 0.032427310943603516 nb_pixel_total : 11272 time to create 1 rle with old method : 0.01248478889465332 time for calcul the mask position with numpy : 0.036345720291137695 nb_pixel_total : 31697 time to create 1 rle with old method : 0.03527116775512695 time for calcul the mask position with numpy : 0.036798715591430664 nb_pixel_total : 314668 time to create 1 rle with new method : 0.5945451259613037 create new chi : 4.002535581588745 time to delete rle : 0.003374814987182617 batch 1 Loaded 47 chid ids of type : 3594 +++++++++++++++++++++++++++++++Number RLEs to save : 12488 TO DO : save crop sub photo not yet done ! save time : 0.7487332820892334 nb_obj : 13 nb_hashtags : 2 time to prepare the origin masks : 3.9908175468444824 time for calcul the mask position with numpy : 0.6760823726654053 nb_pixel_total : 6157334 time to create 1 rle with new method : 1.603304386138916 time for calcul the mask position with numpy : 0.034592628479003906 nb_pixel_total : 76559 time to create 1 rle with old method : 0.08641433715820312 time for calcul the mask position with numpy : 0.03946685791015625 nb_pixel_total : 45868 time to create 1 rle with old method : 0.058477163314819336 time for calcul the mask position with numpy : 0.03617501258850098 nb_pixel_total : 12866 time to create 1 rle with old method : 0.014304637908935547 time for calcul the mask position with numpy : 0.03427290916442871 nb_pixel_total : 14896 time to create 1 rle with old method : 0.016910314559936523 time for calcul the mask position with numpy : 0.03363370895385742 nb_pixel_total : 16415 time to create 1 rle with old method : 0.018143177032470703 time for calcul the mask position with numpy : 0.034150123596191406 nb_pixel_total : 20886 time to create 1 rle with old method : 0.02317976951599121 time for calcul the mask position with numpy : 0.03539609909057617 nb_pixel_total : 41009 time to create 1 rle with old method : 0.04478645324707031 time for calcul the mask position with numpy : 0.0334470272064209 nb_pixel_total : 39037 time to create 1 rle with old method : 0.04249310493469238 time for calcul the mask position with numpy : 0.03505396842956543 nb_pixel_total : 14800 time to create 1 rle with old method : 0.01608562469482422 time for calcul the mask position with numpy : 0.03621935844421387 nb_pixel_total : 11882 time to create 1 rle with old method : 0.013126134872436523 time for calcul the mask position with numpy : 0.034455060958862305 nb_pixel_total : 18239 time to create 1 rle with old method : 0.02154088020324707 time for calcul the mask position with numpy : 0.03731346130371094 nb_pixel_total : 450719 time to create 1 rle with new method : 0.6181635856628418 time for calcul the mask position with numpy : 0.03636789321899414 nb_pixel_total : 129730 time to create 1 rle with old method : 0.14215373992919922 create new chi : 3.9167752265930176 time to delete rle : 0.0024013519287109375 batch 1 Loaded 27 chid ids of type : 3594 +++++++++++++++Number RLEs to save : 9110 TO DO : save crop sub photo not yet done ! save time : 0.6123547554016113 nb_obj : 12 nb_hashtags : 3 time to prepare the origin masks : 4.4518938064575195 time for calcul the mask position with numpy : 0.7434027194976807 nb_pixel_total : 6609273 time to create 1 rle with new method : 0.7768919467926025 time for calcul the mask position with numpy : 0.021691083908081055 nb_pixel_total : 10513 time to create 1 rle with old method : 0.011759042739868164 time for calcul the mask position with numpy : 0.021227359771728516 nb_pixel_total : 82089 time to create 1 rle with old method : 0.09253764152526855 time for calcul the mask position with numpy : 0.020815372467041016 nb_pixel_total : 56353 time to create 1 rle with old method : 0.059433698654174805 time for calcul the mask position with numpy : 0.0213167667388916 nb_pixel_total : 39047 time to create 1 rle with old method : 0.04281806945800781 time for calcul the mask position with numpy : 0.020996809005737305 nb_pixel_total : 111696 time to create 1 rle with old method : 0.11942291259765625 time for calcul the mask position with numpy : 0.022444963455200195 nb_pixel_total : 6015 time to create 1 rle with old method : 0.006588935852050781 time for calcul the mask position with numpy : 0.02112889289855957 nb_pixel_total : 11998 time to create 1 rle with old method : 0.013079166412353516 time for calcul the mask position with numpy : 0.02164292335510254 nb_pixel_total : 13207 time to create 1 rle with old method : 0.022011518478393555 time for calcul the mask position with numpy : 0.024525880813598633 nb_pixel_total : 51210 time to create 1 rle with old method : 0.06650090217590332 time for calcul the mask position with numpy : 0.022177934646606445 nb_pixel_total : 20392 time to create 1 rle with old method : 0.022116422653198242 time for calcul the mask position with numpy : 0.022283554077148438 nb_pixel_total : 13665 time to create 1 rle with old method : 0.015256166458129883 time for calcul the mask position with numpy : 0.022980213165283203 nb_pixel_total : 24782 time to create 1 rle with old method : 0.02727675437927246 create new chi : 2.321349859237671 time to delete rle : 0.0012557506561279297 batch 1 Loaded 25 chid ids of type : 3594 +++++++++++++++++++++Number RLEs to save : 8593 TO DO : save crop sub photo not yet done ! save time : 0.548314094543457 nb_obj : 10 nb_hashtags : 2 time to prepare the origin masks : 3.0914931297302246 time for calcul the mask position with numpy : 0.4770381450653076 nb_pixel_total : 5725106 time to create 1 rle with new method : 0.8697319030761719 time for calcul the mask position with numpy : 0.03505682945251465 nb_pixel_total : 30186 time to create 1 rle with old method : 0.032744646072387695 time for calcul the mask position with numpy : 0.03765988349914551 nb_pixel_total : 343466 time to create 1 rle with new method : 0.5790557861328125 time for calcul the mask position with numpy : 0.03727984428405762 nb_pixel_total : 77682 time to create 1 rle with old method : 0.08579659461975098 time for calcul the mask position with numpy : 0.03850054740905762 nb_pixel_total : 351702 time to create 1 rle with new method : 0.6227118968963623 time for calcul the mask position with numpy : 0.02118396759033203 nb_pixel_total : 40719 time to create 1 rle with old method : 0.06297874450683594 time for calcul the mask position with numpy : 0.025635242462158203 nb_pixel_total : 150280 time to create 1 rle with new method : 0.36794590950012207 time for calcul the mask position with numpy : 0.021453380584716797 nb_pixel_total : 95226 time to create 1 rle with old method : 0.10315704345703125 time for calcul the mask position with numpy : 0.020980358123779297 nb_pixel_total : 23096 time to create 1 rle with old method : 0.02456068992614746 time for calcul the mask position with numpy : 0.02094244956970215 nb_pixel_total : 44134 time to create 1 rle with old method : 0.04755401611328125 time for calcul the mask position with numpy : 0.021667957305908203 nb_pixel_total : 168643 time to create 1 rle with new method : 0.5717983245849609 create new chi : 4.254527568817139 time to delete rle : 0.0029249191284179688 batch 1 Loaded 21 chid ids of type : 3594 +++++++++++++++Number RLEs to save : 11406 TO DO : save crop sub photo not yet done ! save time : 0.7052345275878906 nb_obj : 25 nb_hashtags : 3 time to prepare the origin masks : 8.155301094055176 time for calcul the mask position with numpy : 0.5212538242340088 nb_pixel_total : 5198853 time to create 1 rle with new method : 0.6918809413909912 time for calcul the mask position with numpy : 0.03431582450866699 nb_pixel_total : 26577 time to create 1 rle with old method : 0.02817559242248535 time for calcul the mask position with numpy : 0.03364992141723633 nb_pixel_total : 21650 time to create 1 rle with old method : 0.022913217544555664 time for calcul the mask position with numpy : 0.03551173210144043 nb_pixel_total : 296393 time to create 1 rle with new method : 0.821601390838623 time for calcul the mask position with numpy : 0.03479814529418945 nb_pixel_total : 58784 time to create 1 rle with old method : 0.06329631805419922 time for calcul the mask position with numpy : 0.03569436073303223 nb_pixel_total : 38688 time to create 1 rle with old method : 0.0426325798034668 time for calcul the mask position with numpy : 0.03376603126525879 nb_pixel_total : 22741 time to create 1 rle with old method : 0.02791905403137207 time for calcul the mask position with numpy : 0.023072481155395508 nb_pixel_total : 11806 time to create 1 rle with old method : 0.012590646743774414 time for calcul the mask position with numpy : 0.020987987518310547 nb_pixel_total : 33367 time to create 1 rle with old method : 0.035634517669677734 time for calcul the mask position with numpy : 0.022345542907714844 nb_pixel_total : 130049 time to create 1 rle with old method : 0.14066791534423828 time for calcul the mask position with numpy : 0.02214789390563965 nb_pixel_total : 152890 time to create 1 rle with new method : 0.5318148136138916 time for calcul the mask position with numpy : 0.021782636642456055 nb_pixel_total : 42282 time to create 1 rle with old method : 0.045142173767089844 time for calcul the mask position with numpy : 0.022008180618286133 nb_pixel_total : 169964 time to create 1 rle with new method : 0.818453311920166 time for calcul the mask position with numpy : 0.02182936668395996 nb_pixel_total : 25241 time to create 1 rle with old method : 0.0273282527923584 time for calcul the mask position with numpy : 0.021047353744506836 nb_pixel_total : 19149 time to create 1 rle with old method : 0.021471261978149414 time for calcul the mask position with numpy : 0.021136999130249023 nb_pixel_total : 87372 time to create 1 rle with old method : 0.09497833251953125 time for calcul the mask position with numpy : 0.021003246307373047 nb_pixel_total : 36347 time to create 1 rle with old method : 0.03961896896362305 time for calcul the mask position with numpy : 0.021821260452270508 nb_pixel_total : 16317 time to create 1 rle with old method : 0.017437458038330078 time for calcul the mask position with numpy : 0.020733118057250977 nb_pixel_total : 24400 time to create 1 rle with old method : 0.025068998336791992 time for calcul the mask position with numpy : 0.02054619789123535 nb_pixel_total : 81470 time to create 1 rle with old method : 0.08787894248962402 time for calcul the mask position with numpy : 0.020975112915039062 nb_pixel_total : 17754 time to create 1 rle with old method : 0.018776655197143555 time for calcul the mask position with numpy : 0.023005008697509766 nb_pixel_total : 191868 time to create 1 rle with new method : 0.6399929523468018 time for calcul the mask position with numpy : 0.021359920501708984 nb_pixel_total : 29284 time to create 1 rle with old method : 0.031167984008789062 time for calcul the mask position with numpy : 0.021875619888305664 nb_pixel_total : 126926 time to create 1 rle with old method : 0.133103609085083 time for calcul the mask position with numpy : 0.021089553833007812 nb_pixel_total : 164975 time to create 1 rle with new method : 0.42122578620910645 time for calcul the mask position with numpy : 0.021251678466796875 nb_pixel_total : 25093 time to create 1 rle with old method : 0.026582002639770508 create new chi : 6.158606767654419 time to delete rle : 0.002515554428100586 batch 1 Loaded 51 chid ids of type : 3594 +++++++++++++++++++++++++++++++Number RLEs to save : 18571 TO DO : save crop sub photo not yet done ! save time : 1.1259632110595703 nb_obj : 16 nb_hashtags : 4 time to prepare the origin masks : 6.519779205322266 time for calcul the mask position with numpy : 0.4931788444519043 nb_pixel_total : 6030558 time to create 1 rle with new method : 0.9839506149291992 time for calcul the mask position with numpy : 0.021345853805541992 nb_pixel_total : 17342 time to create 1 rle with old method : 0.019065141677856445 time for calcul the mask position with numpy : 0.020526647567749023 nb_pixel_total : 14186 time to create 1 rle with old method : 0.015624046325683594 time for calcul the mask position with numpy : 0.02118849754333496 nb_pixel_total : 142255 time to create 1 rle with old method : 0.15720105171203613 time for calcul the mask position with numpy : 0.021459102630615234 nb_pixel_total : 56798 time to create 1 rle with old method : 0.06298971176147461 time for calcul the mask position with numpy : 0.02287912368774414 nb_pixel_total : 72631 time to create 1 rle with old method : 0.08008217811584473 time for calcul the mask position with numpy : 0.02228260040283203 nb_pixel_total : 18281 time to create 1 rle with old method : 0.0203092098236084 time for calcul the mask position with numpy : 0.024520158767700195 nb_pixel_total : 404957 time to create 1 rle with new method : 0.59598708152771 time for calcul the mask position with numpy : 0.02056264877319336 nb_pixel_total : 31598 time to create 1 rle with old method : 0.03269243240356445 time for calcul the mask position with numpy : 0.02430272102355957 nb_pixel_total : 9271 time to create 1 rle with old method : 0.014974594116210938 time for calcul the mask position with numpy : 0.023551464080810547 nb_pixel_total : 8995 time to create 1 rle with old method : 0.014377832412719727 time for calcul the mask position with numpy : 0.022871017456054688 nb_pixel_total : 64636 time to create 1 rle with old method : 0.06905055046081543 time for calcul the mask position with numpy : 0.02137589454650879 nb_pixel_total : 31651 time to create 1 rle with old method : 0.03375983238220215 time for calcul the mask position with numpy : 0.020595312118530273 nb_pixel_total : 64979 time to create 1 rle with old method : 0.06847763061523438 time for calcul the mask position with numpy : 0.019877910614013672 nb_pixel_total : 39584 time to create 1 rle with old method : 0.041821956634521484 time for calcul the mask position with numpy : 0.02150726318359375 nb_pixel_total : 33282 time to create 1 rle with old method : 0.03516030311584473 time for calcul the mask position with numpy : 0.020779848098754883 nb_pixel_total : 9236 time to create 1 rle with old method : 0.009733200073242188 create new chi : 3.1534488201141357 time to delete rle : 0.0016269683837890625 batch 1 Loaded 33 chid ids of type : 3594 +++++++++++++++++++++Number RLEs to save : 10946 TO DO : save crop sub photo not yet done ! save time : 0.6829946041107178 nb_obj : 10 nb_hashtags : 2 time to prepare the origin masks : 3.472219705581665 time for calcul the mask position with numpy : 0.5107681751251221 nb_pixel_total : 5068531 time to create 1 rle with new method : 0.5546257495880127 time for calcul the mask position with numpy : 0.029616117477416992 nb_pixel_total : 831896 time to create 1 rle with new method : 0.722048282623291 time for calcul the mask position with numpy : 0.020153284072875977 nb_pixel_total : 91443 time to create 1 rle with old method : 0.0933675765991211 time for calcul the mask position with numpy : 0.020596742630004883 nb_pixel_total : 117371 time to create 1 rle with old method : 0.12797069549560547 time for calcul the mask position with numpy : 0.025263547897338867 nb_pixel_total : 140699 time to create 1 rle with old method : 0.14676141738891602 time for calcul the mask position with numpy : 0.020311355590820312 nb_pixel_total : 73910 time to create 1 rle with old method : 0.07529282569885254 time for calcul the mask position with numpy : 0.021343708038330078 nb_pixel_total : 130512 time to create 1 rle with old method : 0.1360318660736084 time for calcul the mask position with numpy : 0.02001047134399414 nb_pixel_total : 7360 time to create 1 rle with old method : 0.008289575576782227 time for calcul the mask position with numpy : 0.02336287498474121 nb_pixel_total : 434512 time to create 1 rle with new method : 0.638582706451416 time for calcul the mask position with numpy : 0.022151947021484375 nb_pixel_total : 136311 time to create 1 rle with old method : 0.14566755294799805 time for calcul the mask position with numpy : 0.021558523178100586 nb_pixel_total : 17695 time to create 1 rle with old method : 0.01878809928894043 create new chi : 3.4808125495910645 time to delete rle : 0.0016021728515625 batch 1 Loaded 21 chid ids of type : 3594 +++++++++++++Number RLEs to save : 11606 TO DO : save crop sub photo not yet done ! save time : 0.744922399520874 nb_obj : 15 nb_hashtags : 4 time to prepare the origin masks : 4.791750192642212 time for calcul the mask position with numpy : 0.7510864734649658 nb_pixel_total : 6176472 time to create 1 rle with new method : 0.6804549694061279 time for calcul the mask position with numpy : 0.03138875961303711 nb_pixel_total : 23192 time to create 1 rle with old method : 0.03733372688293457 time for calcul the mask position with numpy : 0.02041316032409668 nb_pixel_total : 20298 time to create 1 rle with old method : 0.021507740020751953 time for calcul the mask position with numpy : 0.019987106323242188 nb_pixel_total : 10518 time to create 1 rle with old method : 0.011030435562133789 time for calcul the mask position with numpy : 0.020671367645263672 nb_pixel_total : 5586 time to create 1 rle with old method : 0.0060007572174072266 time for calcul the mask position with numpy : 0.02123236656188965 nb_pixel_total : 137387 time to create 1 rle with old method : 0.14898324012756348 time for calcul the mask position with numpy : 0.02150750160217285 nb_pixel_total : 42238 time to create 1 rle with old method : 0.04552340507507324 time for calcul the mask position with numpy : 0.022185325622558594 nb_pixel_total : 65799 time to create 1 rle with old method : 0.0715939998626709 time for calcul the mask position with numpy : 0.02104330062866211 nb_pixel_total : 129868 time to create 1 rle with old method : 0.13841724395751953 time for calcul the mask position with numpy : 0.020569801330566406 nb_pixel_total : 23329 time to create 1 rle with old method : 0.02500748634338379 time for calcul the mask position with numpy : 0.024514436721801758 nb_pixel_total : 102135 time to create 1 rle with old method : 0.12935233116149902 time for calcul the mask position with numpy : 0.02507472038269043 nb_pixel_total : 26572 time to create 1 rle with old method : 0.02881002426147461 time for calcul the mask position with numpy : 0.022190093994140625 nb_pixel_total : 54178 time to create 1 rle with old method : 0.06220126152038574 time for calcul the mask position with numpy : 0.02277827262878418 nb_pixel_total : 57562 time to create 1 rle with old method : 0.06485390663146973 time for calcul the mask position with numpy : 0.023657560348510742 nb_pixel_total : 145708 time to create 1 rle with old method : 0.15851950645446777 time for calcul the mask position with numpy : 0.02230048179626465 nb_pixel_total : 29398 time to create 1 rle with old method : 0.03297734260559082 create new chi : 2.7928173542022705 time to delete rle : 0.0015368461608886719 batch 1 Loaded 31 chid ids of type : 3594 +++++++++++++++++Number RLEs to save : 9794 TO DO : save crop sub photo not yet done ! save time : 0.6187167167663574 nb_obj : 15 nb_hashtags : 3 time to prepare the origin masks : 4.948964595794678 time for calcul the mask position with numpy : 0.47551679611206055 nb_pixel_total : 6394647 time to create 1 rle with new method : 0.8586931228637695 time for calcul the mask position with numpy : 0.020953655242919922 nb_pixel_total : 24397 time to create 1 rle with old method : 0.025171518325805664 time for calcul the mask position with numpy : 0.020618438720703125 nb_pixel_total : 110201 time to create 1 rle with old method : 0.11530041694641113 time for calcul the mask position with numpy : 0.019989013671875 nb_pixel_total : 20720 time to create 1 rle with old method : 0.022197961807250977 time for calcul the mask position with numpy : 0.02082514762878418 nb_pixel_total : 6942 time to create 1 rle with old method : 0.007592678070068359 time for calcul the mask position with numpy : 0.021496057510375977 nb_pixel_total : 5275 time to create 1 rle with old method : 0.005661487579345703 time for calcul the mask position with numpy : 0.021940946578979492 nb_pixel_total : 37348 time to create 1 rle with old method : 0.05987548828125 time for calcul the mask position with numpy : 0.021340608596801758 nb_pixel_total : 7483 time to create 1 rle with old method : 0.007827043533325195 time for calcul the mask position with numpy : 0.020767688751220703 nb_pixel_total : 44264 time to create 1 rle with old method : 0.07116436958312988 time for calcul the mask position with numpy : 0.022153139114379883 nb_pixel_total : 8610 time to create 1 rle with old method : 0.009599924087524414 time for calcul the mask position with numpy : 0.021999597549438477 nb_pixel_total : 86460 time to create 1 rle with old method : 0.09293675422668457 time for calcul the mask position with numpy : 0.02183675765991211 nb_pixel_total : 143031 time to create 1 rle with old method : 0.1600947380065918 time for calcul the mask position with numpy : 0.0214841365814209 nb_pixel_total : 32533 time to create 1 rle with old method : 0.03602957725524902 time for calcul the mask position with numpy : 0.022072792053222656 nb_pixel_total : 91292 time to create 1 rle with old method : 0.10222196578979492 time for calcul the mask position with numpy : 0.022090435028076172 nb_pixel_total : 20109 time to create 1 rle with old method : 0.022820472717285156 time for calcul the mask position with numpy : 0.02324652671813965 nb_pixel_total : 16928 time to create 1 rle with old method : 0.022165775299072266 create new chi : 2.455792188644409 time to delete rle : 0.0015201568603515625 batch 1 Loaded 31 chid ids of type : 3594 +++++++++++++++++++++++Number RLEs to save : 9914 TO DO : save crop sub photo not yet done ! save time : 0.6167325973510742 map_output_result : {1357031864: (0.0, 'Should be the crop_list due to order', 0.0), 1357031834: (0.0, 'Should be the crop_list due to order', 0), 1357031807: (0.0, 'Should be the crop_list due to order', 0), 1357031775: (0.0, 'Should be the crop_list due to order', 0), 1357031728: (0.0, 'Should be the crop_list due to order', 0), 1357031713: (0.0, 'Should be the crop_list due to order', 0), 1357031710: (0.0, 'Should be the crop_list due to order', 0), 1357031707: (0.0, 'Should be the crop_list due to order', 0), 1357031706: (0.0, 'Should be the crop_list due to order', 0), 1357031705: (0.0, 'Should be the crop_list due to order', 0), 1357031704: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1357031864, 1357031834, 1357031807, 1357031775, 1357031728, 1357031713, 1357031710, 1357031707, 1357031706, 1357031705, 1357031704] Looping around the photos to save general results len do output : 11 /1357031864.Didn't retrieve data . /1357031834.Didn't retrieve data . /1357031807.Didn't retrieve data . /1357031775.Didn't retrieve data . /1357031728.Didn't retrieve data . /1357031713.Didn't retrieve data . /1357031710.Didn't retrieve data . /1357031707.Didn't retrieve data . /1357031706.Didn't retrieve data . /1357031705.Didn't retrieve data . /1357031704.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2808713') ('3318', '22802746', '1357031864', None, None, None, None, None, '2808713') ('3318', None, None, None, None, None, None, None, '2808713') ('3318', '22802746', '1357031834', None, None, None, None, None, '2808713') ('3318', None, None, None, None, None, None, None, '2808713') ('3318', '22802746', '1357031807', None, None, None, None, None, '2808713') ('3318', None, None, None, None, None, None, None, '2808713') ('3318', '22802746', '1357031775', None, None, None, None, None, '2808713') ('3318', None, None, None, None, None, None, None, '2808713') ('3318', '22802746', '1357031728', None, None, None, None, None, '2808713') ('3318', None, None, None, None, None, None, None, '2808713') ('3318', '22802746', '1357031713', None, None, None, None, None, '2808713') ('3318', None, None, None, None, None, None, None, '2808713') ('3318', '22802746', '1357031710', None, None, None, None, None, '2808713') ('3318', None, None, None, None, None, None, None, '2808713') ('3318', '22802746', '1357031707', None, None, None, None, None, '2808713') ('3318', None, None, None, None, None, None, None, '2808713') ('3318', '22802746', '1357031706', None, None, None, None, None, '2808713') ('3318', None, None, None, None, None, None, None, '2808713') ('3318', '22802746', '1357031705', None, None, None, None, None, '2808713') ('3318', None, None, None, None, None, None, None, '2808713') ('3318', '22802746', '1357031704', None, None, None, None, None, '2808713') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 33 time used for this insertion : 0.014591217041015625 save_final save missing photos in datou_result : time spend for datou_step_exec : 98.0388867855072 time spend to save output : 0.015241146087646484 total time spend for step 3 : 98.05412793159485 step4:ventilate_hashtags_in_portfolio Thu May 8 19:25:34 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 22802746 get user id for portfolio 22802746 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22802746 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre','environnement','pehd','pet_fonce','background','pet_clair','metal','papier','mal_croppe','flou','carton')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22802746 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre','environnement','pehd','pet_fonce','background','pet_clair','metal','papier','mal_croppe','flou','carton')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22802746 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre','environnement','pehd','pet_fonce','background','pet_clair','metal','papier','mal_croppe','flou','carton')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/22802759,22802760,22802761,22802762,22802763,22802764,22802765,22802766,22802767,22802768,22802769?tags=autre,environnement,pehd,pet_fonce,background,pet_clair,metal,papier,mal_croppe,flou,carton Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1357031864, 1357031834, 1357031807, 1357031775, 1357031728, 1357031713, 1357031710, 1357031707, 1357031706, 1357031705, 1357031704] Looping around the photos to save general results len do output : 1 /22802746. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2808713') ('3318', '22802746', '1357031864', None, None, None, None, None, '2808713') ('3318', None, None, None, None, None, None, None, '2808713') ('3318', '22802746', '1357031834', None, None, None, None, None, '2808713') ('3318', None, None, None, None, None, None, None, '2808713') ('3318', '22802746', '1357031807', None, None, None, None, None, '2808713') ('3318', None, None, None, None, None, None, None, '2808713') ('3318', '22802746', '1357031775', None, None, None, None, None, '2808713') ('3318', None, None, None, None, None, None, None, '2808713') ('3318', '22802746', '1357031728', None, None, None, None, None, '2808713') ('3318', None, None, None, None, None, None, None, '2808713') ('3318', '22802746', '1357031713', None, None, None, None, None, '2808713') ('3318', None, None, None, None, None, None, None, '2808713') ('3318', '22802746', '1357031710', None, None, None, None, None, '2808713') ('3318', None, None, None, None, None, None, None, '2808713') ('3318', '22802746', '1357031707', None, None, None, None, None, '2808713') ('3318', None, None, None, None, None, None, None, '2808713') ('3318', '22802746', '1357031706', None, None, None, None, None, '2808713') ('3318', None, None, None, None, None, None, None, '2808713') ('3318', '22802746', '1357031705', None, None, None, None, None, '2808713') ('3318', None, None, None, None, None, None, None, '2808713') ('3318', '22802746', '1357031704', None, None, None, None, None, '2808713') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.015002727508544922 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.5456397533416748 time spend to save output : 0.015265464782714844 total time spend for step 4 : 1.5609052181243896 step5:final Thu May 8 19:25:35 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1357031864: ('0.14475187433980327',), 1357031834: ('0.14475187433980327',), 1357031807: ('0.14475187433980327',), 1357031775: ('0.14475187433980327',), 1357031728: ('0.14475187433980327',), 1357031713: ('0.14475187433980327',), 1357031710: ('0.14475187433980327',), 1357031707: ('0.14475187433980327',), 1357031706: ('0.14475187433980327',), 1357031705: ('0.14475187433980327',), 1357031704: ('0.14475187433980327',)} new output for save of step final : {1357031864: ('0.14475187433980327',), 1357031834: ('0.14475187433980327',), 1357031807: ('0.14475187433980327',), 1357031775: ('0.14475187433980327',), 1357031728: ('0.14475187433980327',), 1357031713: ('0.14475187433980327',), 1357031710: ('0.14475187433980327',), 1357031707: ('0.14475187433980327',), 1357031706: ('0.14475187433980327',), 1357031705: ('0.14475187433980327',), 1357031704: ('0.14475187433980327',)} [1357031864, 1357031834, 1357031807, 1357031775, 1357031728, 1357031713, 1357031710, 1357031707, 1357031706, 1357031705, 1357031704] Looping around the photos to save general results len do output : 11 /1357031864.Didn't retrieve data . /1357031834.Didn't retrieve data . /1357031807.Didn't retrieve data . /1357031775.Didn't retrieve data . /1357031728.Didn't retrieve data . /1357031713.Didn't retrieve data . /1357031710.Didn't retrieve data . /1357031707.Didn't retrieve data . /1357031706.Didn't retrieve data . /1357031705.Didn't retrieve data . /1357031704.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2808713') ('3318', '22802746', '1357031864', None, None, None, None, None, '2808713') ('3318', None, None, None, None, None, None, None, '2808713') ('3318', '22802746', '1357031834', None, None, None, None, None, '2808713') ('3318', None, None, None, None, None, None, None, '2808713') ('3318', '22802746', '1357031807', None, None, None, None, None, '2808713') ('3318', None, None, None, None, None, None, None, '2808713') ('3318', '22802746', '1357031775', None, None, None, None, None, '2808713') ('3318', None, None, None, None, None, None, None, '2808713') ('3318', '22802746', '1357031728', None, None, None, None, None, '2808713') ('3318', None, None, None, None, None, None, None, '2808713') ('3318', '22802746', '1357031713', None, None, None, None, None, '2808713') ('3318', None, None, None, None, None, None, None, '2808713') ('3318', '22802746', '1357031710', None, None, None, None, None, '2808713') ('3318', None, None, None, None, None, None, None, '2808713') ('3318', '22802746', '1357031707', None, None, None, None, None, '2808713') ('3318', None, None, None, None, None, None, None, '2808713') ('3318', '22802746', '1357031706', None, None, None, None, None, '2808713') ('3318', None, None, None, None, None, None, None, '2808713') ('3318', '22802746', '1357031705', None, None, None, None, None, '2808713') ('3318', None, None, None, None, None, None, None, '2808713') ('3318', '22802746', '1357031704', None, None, None, None, None, '2808713') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 33 time used for this insertion : 0.013608694076538086 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11258292198181152 time spend to save output : 0.0141448974609375 total time spend for step 5 : 0.12672781944274902 step6:blur_detection Thu May 8 19:25:35 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1746724828_1798438_1357031864_5d34f5c2d2613086dca59b1d6de934ea.jpg resize: (2160, 3264) 1357031864 -4.170026302940699 treat image : temp/1746724828_1798438_1357031834_df41f11707c0f092ace0f8528a769c58.jpg resize: (2160, 3264) 1357031834 -1.1573016361175181 treat image : temp/1746724828_1798438_1357031807_bb7fc7c5a318a00b735ff879861a5a55.jpg resize: (2160, 3264) 1357031807 -2.7583250683172578 treat image : temp/1746724828_1798438_1357031775_6afd76682d342e6a1f13c5df0fcba205.jpg resize: (2160, 3264) 1357031775 -3.045612267402573 treat image : temp/1746724828_1798438_1357031728_1362a7195b86374eb2383caaedcc66b8.jpg resize: (2160, 3264) 1357031728 -0.8145267141383985 treat image : temp/1746724828_1798438_1357031713_6dcbb02eec9c9fd453a8ae953c1827f0.jpg resize: (2160, 3264) 1357031713 0.4466698005674375 treat image : temp/1746724828_1798438_1357031710_728108bd2b5073b8959fc17b6605032e.jpg resize: (2160, 3264) 1357031710 -0.612549996236764 treat image : temp/1746724828_1798438_1357031707_6dfe46ff7ad9fe105348390992a5511e.jpg resize: (2160, 3264) 1357031707 -0.8457358720213175 treat image : temp/1746724828_1798438_1357031706_e616b8ae135ad810fc6d57a5e0ecaba1.jpg resize: (2160, 3264) 1357031706 1.5474117590941605 treat image : temp/1746724828_1798438_1357031705_6eda973d3f3cffddcd5e225e882bd711.jpg resize: (2160, 3264) 1357031705 -3.3414901420433663 treat image : temp/1746724828_1798438_1357031704_d004a0ef777835e7b2052b29b50c7ee2.jpg resize: (2160, 3264) 1357031704 -1.2057187504793374 treat image : temp/1746724828_1798438_1357031834_df41f11707c0f092ace0f8528a769c58_rle_crop_3790449033_0.png resize: (184, 272) 1357037841 -1.4338038095598256 treat image : temp/1746724828_1798438_1357031834_df41f11707c0f092ace0f8528a769c58_rle_crop_3790449035_0.png resize: (296, 748) 1357037842 -1.0293613007988807 treat image : temp/1746724828_1798438_1357031834_df41f11707c0f092ace0f8528a769c58_rle_crop_3790449036_0.png resize: (102, 200) 1357037843 0.03945590444583835 treat image : temp/1746724828_1798438_1357031834_df41f11707c0f092ace0f8528a769c58_rle_crop_3790449038_0.png resize: (172, 173) 1357037844 -1.1399914578782948 treat image : temp/1746724828_1798438_1357031834_df41f11707c0f092ace0f8528a769c58_rle_crop_3790449039_0.png resize: (424, 223) 1357037845 -1.6230529830642713 treat image : temp/1746724828_1798438_1357031834_df41f11707c0f092ace0f8528a769c58_rle_crop_3790449042_0.png resize: (99, 165) 1357037846 -0.5990477667117886 treat image : temp/1746724828_1798438_1357031834_df41f11707c0f092ace0f8528a769c58_rle_crop_3790449043_0.png resize: (357, 357) 1357037847 -1.1913848105601539 treat image : temp/1746724828_1798438_1357031834_df41f11707c0f092ace0f8528a769c58_rle_crop_3790449046_0.png resize: (217, 726) 1357037848 -1.1214269857385784 treat image : temp/1746724828_1798438_1357031807_bb7fc7c5a318a00b735ff879861a5a55_rle_crop_3790449047_0.png resize: (500, 796) 1357037849 -0.7210179992167344 treat image : temp/1746724828_1798438_1357031807_bb7fc7c5a318a00b735ff879861a5a55_rle_crop_3790449049_0.png resize: (127, 115) 1357037850 -0.9010434117356239 treat image : temp/1746724828_1798438_1357031807_bb7fc7c5a318a00b735ff879861a5a55_rle_crop_3790449050_0.png resize: (351, 386) 1357037851 -0.6514067632241844 treat image : temp/1746724828_1798438_1357031807_bb7fc7c5a318a00b735ff879861a5a55_rle_crop_3790449051_0.png resize: (190, 142) 1357037852 -1.0067300384344187 treat image : temp/1746724828_1798438_1357031807_bb7fc7c5a318a00b735ff879861a5a55_rle_crop_3790449053_0.png resize: (249, 227) 1357037853 -2.037360741326762 treat image : temp/1746724828_1798438_1357031807_bb7fc7c5a318a00b735ff879861a5a55_rle_crop_3790449054_0.png resize: (155, 228) 1357037854 1.2121351873155446 treat image : temp/1746724828_1798438_1357031807_bb7fc7c5a318a00b735ff879861a5a55_rle_crop_3790449055_0.png resize: (677, 454) 1357037855 -1.9812696643943424 treat image : temp/1746724828_1798438_1357031807_bb7fc7c5a318a00b735ff879861a5a55_rle_crop_3790449056_0.png resize: (179, 145) 1357037856 -1.7153348838596496 treat image : temp/1746724828_1798438_1357031807_bb7fc7c5a318a00b735ff879861a5a55_rle_crop_3790449058_0.png resize: (181, 187) 1357037857 -1.154945257330835 treat image : temp/1746724828_1798438_1357031807_bb7fc7c5a318a00b735ff879861a5a55_rle_crop_3790449059_0.png resize: (168, 225) 1357037858 -2.1795559121703216 treat image : temp/1746724828_1798438_1357031807_bb7fc7c5a318a00b735ff879861a5a55_rle_crop_3790449060_0.png resize: (164, 165) 1357037859 0.022012489920795884 treat image : temp/1746724828_1798438_1357031807_bb7fc7c5a318a00b735ff879861a5a55_rle_crop_3790449061_0.png resize: (155, 276) 1357037860 -2.3256544907588395 treat image : temp/1746724828_1798438_1357031807_bb7fc7c5a318a00b735ff879861a5a55_rle_crop_3790449062_0.png resize: (135, 106) 1357037861 -0.34422021581301293 treat image : temp/1746724828_1798438_1357031807_bb7fc7c5a318a00b735ff879861a5a55_rle_crop_3790449063_0.png resize: (246, 338) 1357037862 -1.1439361970171567 treat image : temp/1746724828_1798438_1357031807_bb7fc7c5a318a00b735ff879861a5a55_rle_crop_3790449064_0.png resize: (183, 210) 1357037863 -1.404281793438755 treat image : temp/1746724828_1798438_1357031807_bb7fc7c5a318a00b735ff879861a5a55_rle_crop_3790449065_0.png resize: (142, 317) 1357037864 -2.5409886974086096 treat image : temp/1746724828_1798438_1357031807_bb7fc7c5a318a00b735ff879861a5a55_rle_crop_3790449067_0.png resize: (113, 79) 1357037865 -0.8065794684416903 treat image : temp/1746724828_1798438_1357031807_bb7fc7c5a318a00b735ff879861a5a55_rle_crop_3790449068_0.png resize: (155, 195) 1357037866 -1.6324890122510658 treat image : temp/1746724828_1798438_1357031775_6afd76682d342e6a1f13c5df0fcba205_rle_crop_3790449070_0.png resize: (341, 741) 1357037867 -1.5250363882153262 treat image : temp/1746724828_1798438_1357031775_6afd76682d342e6a1f13c5df0fcba205_rle_crop_3790449071_0.png resize: (888, 610) 1357037868 -0.39999512656586367 treat image : temp/1746724828_1798438_1357031775_6afd76682d342e6a1f13c5df0fcba205_rle_crop_3790449072_0.png resize: (141, 207) 1357037869 -1.8855063816616895 treat image : temp/1746724828_1798438_1357031775_6afd76682d342e6a1f13c5df0fcba205_rle_crop_3790449073_0.png resize: (185, 113) 1357037870 -1.618312647629338 treat image : temp/1746724828_1798438_1357031775_6afd76682d342e6a1f13c5df0fcba205_rle_crop_3790449074_0.png resize: (113, 170) 1357037871 -0.8488985859371638 treat image : temp/1746724828_1798438_1357031775_6afd76682d342e6a1f13c5df0fcba205_rle_crop_3790449075_0.png resize: (234, 259) 1357037872 -2.334750947469272 treat image : temp/1746724828_1798438_1357031775_6afd76682d342e6a1f13c5df0fcba205_rle_crop_3790449077_0.png resize: (194, 244) 1357037873 -0.4850243092248481 treat image : temp/1746724828_1798438_1357031775_6afd76682d342e6a1f13c5df0fcba205_rle_crop_3790449078_0.png resize: (157, 194) 1357037874 -1.0541945874940217 treat image : temp/1746724828_1798438_1357031775_6afd76682d342e6a1f13c5df0fcba205_rle_crop_3790449079_0.png resize: (113, 209) 1357037875 -1.2507044209480702 treat image : temp/1746724828_1798438_1357031775_6afd76682d342e6a1f13c5df0fcba205_rle_crop_3790449080_0.png resize: (116, 168) 1357037876 -1.2343751623988117 treat image : temp/1746724828_1798438_1357031775_6afd76682d342e6a1f13c5df0fcba205_rle_crop_3790449081_0.png resize: (261, 238) 1357037877 -2.275838731348773 treat image : temp/1746724828_1798438_1357031775_6afd76682d342e6a1f13c5df0fcba205_rle_crop_3790449082_0.png resize: (419, 231) 1357037878 -1.5865494353806502 treat image : temp/1746724828_1798438_1357031728_1362a7195b86374eb2383caaedcc66b8_rle_crop_3790449083_0.png resize: (193, 171) 1357037879 0.17413670584502575 treat image : temp/1746724828_1798438_1357031728_1362a7195b86374eb2383caaedcc66b8_rle_crop_3790449084_0.png resize: (157, 116) 1357037880 -0.5831472122530676 treat image : temp/1746724828_1798438_1357031728_1362a7195b86374eb2383caaedcc66b8_rle_crop_3790449085_0.png resize: (313, 183) 1357037881 -0.42849798137195333 treat image : temp/1746724828_1798438_1357031728_1362a7195b86374eb2383caaedcc66b8_rle_crop_3790449086_0.png resize: (435, 254) 1357037882 -2.6353795291051383 treat image : temp/1746724828_1798438_1357031728_1362a7195b86374eb2383caaedcc66b8_rle_crop_3790449088_0.png resize: (165, 143) 1357037883 -1.343502457755396 treat image : temp/1746724828_1798438_1357031728_1362a7195b86374eb2383caaedcc66b8_rle_crop_3790449089_0.png resize: (100, 103) 1357037884 -1.9729540103335677 treat image : temp/1746724828_1798438_1357031728_1362a7195b86374eb2383caaedcc66b8_rle_crop_3790449090_0.png resize: (338, 517) 1357037885 0.9753511741731334 treat image : temp/1746724828_1798438_1357031728_1362a7195b86374eb2383caaedcc66b8_rle_crop_3790449091_0.png resize: (424, 200) 1357037886 -1.531052595306578 treat image : temp/1746724828_1798438_1357031728_1362a7195b86374eb2383caaedcc66b8_rle_crop_3790449094_0.png resize: (162, 231) 1357037887 -2.609420651475805 treat image : temp/1746724828_1798438_1357031713_6dcbb02eec9c9fd453a8ae953c1827f0_rle_crop_3790449095_0.png resize: (544, 399) 1357037888 -0.9525837336868139 treat image : temp/1746724828_1798438_1357031713_6dcbb02eec9c9fd453a8ae953c1827f0_rle_crop_3790449096_0.png resize: (373, 224) 1357037889 -0.625466783895741 treat image : temp/1746724828_1798438_1357031713_6dcbb02eec9c9fd453a8ae953c1827f0_rle_crop_3790449097_0.png resize: (272, 275) 1357037890 0.328300278006735 treat image : temp/1746724828_1798438_1357031713_6dcbb02eec9c9fd453a8ae953c1827f0_rle_crop_3790449098_0.png resize: (597, 269) 1357037891 0.1861782813285611 treat image : temp/1746724828_1798438_1357031713_6dcbb02eec9c9fd453a8ae953c1827f0_rle_crop_3790449100_0.png resize: (198, 487) 1357037892 0.2303176255939644 treat image : temp/1746724828_1798438_1357031713_6dcbb02eec9c9fd453a8ae953c1827f0_rle_crop_3790449101_0.png resize: (641, 720) 1357037893 0.06332555728293608 treat image : temp/1746724828_1798438_1357031713_6dcbb02eec9c9fd453a8ae953c1827f0_rle_crop_3790449103_0.png resize: (850, 491) 1357037894 -0.6430673829807482 treat image : temp/1746724828_1798438_1357031713_6dcbb02eec9c9fd453a8ae953c1827f0_rle_crop_3790449104_0.png resize: (229, 200) 1357037895 -0.4228009110910194 treat image : temp/1746724828_1798438_1357031710_728108bd2b5073b8959fc17b6605032e_rle_crop_3790449105_0.png resize: (232, 174) 1357037896 -3.3175005002549773 treat image : temp/1746724828_1798438_1357031710_728108bd2b5073b8959fc17b6605032e_rle_crop_3790449107_0.png resize: (428, 448) 1357037897 1.6400662273772593 treat image : temp/1746724828_1798438_1357031710_728108bd2b5073b8959fc17b6605032e_rle_crop_3790449110_0.png resize: (89, 296) 1357037898 -2.0907748022088364 treat image : temp/1746724828_1798438_1357031710_728108bd2b5073b8959fc17b6605032e_rle_crop_3790449112_0.png resize: (216, 204) 1357037899 -1.3522871554262266 treat image : temp/1746724828_1798438_1357031710_728108bd2b5073b8959fc17b6605032e_rle_crop_3790449113_0.png resize: (170, 133) 1357037900 -2.001375985532234 treat image : temp/1746724828_1798438_1357031710_728108bd2b5073b8959fc17b6605032e_rle_crop_3790449117_0.png resize: (263, 198) 1357037901 -2.066413035075045 treat image : temp/1746724828_1798438_1357031710_728108bd2b5073b8959fc17b6605032e_rle_crop_3790449118_0.png resize: (540, 460) 1357037902 -1.0109864705389717 treat image : temp/1746724828_1798438_1357031710_728108bd2b5073b8959fc17b6605032e_rle_crop_3790449120_0.png resize: (351, 580) 1357037903 -0.5332754351183626 treat image : temp/1746724828_1798438_1357031710_728108bd2b5073b8959fc17b6605032e_rle_crop_3790449121_0.png resize: (669, 819) 1357037904 -1.1634973879437474 treat image : temp/1746724828_1798438_1357031710_728108bd2b5073b8959fc17b6605032e_rle_crop_3790449123_0.png resize: (216, 83) 1357037905 -1.2605466032430077 treat image : temp/1746724828_1798438_1357031710_728108bd2b5073b8959fc17b6605032e_rle_crop_3790449125_0.png resize: (402, 171) 1357037906 -1.8316250437734585 treat image : temp/1746724828_1798438_1357031710_728108bd2b5073b8959fc17b6605032e_rle_crop_3790449129_0.png resize: (179, 191) 1357037907 -0.5953726591916642 treat image : temp/1746724828_1798438_1357031707_6dfe46ff7ad9fe105348390992a5511e_rle_crop_3790449130_0.png resize: (103, 127) 1357037908 -1.9869093165110154 treat image : temp/1746724828_1798438_1357031707_6dfe46ff7ad9fe105348390992a5511e_rle_crop_3790449131_0.png resize: (223, 240) 1357037909 -1.948833235470193 treat image : temp/1746724828_1798438_1357031707_6dfe46ff7ad9fe105348390992a5511e_rle_crop_3790449133_0.png resize: (259, 322) 1357037910 0.2111444906513247 treat image : temp/1746724828_1798438_1357031707_6dfe46ff7ad9fe105348390992a5511e_rle_crop_3790449135_0.png resize: (273, 325) 1357037911 -0.5399642735283303 treat image : temp/1746724828_1798438_1357031707_6dfe46ff7ad9fe105348390992a5511e_rle_crop_3790449136_0.png resize: (83, 150) 1357037912 -1.5100008050104294 treat image : temp/1746724828_1798438_1357031707_6dfe46ff7ad9fe105348390992a5511e_rle_crop_3790449137_0.png resize: (81, 162) 1357037913 -1.2192849483924841 treat image : temp/1746724828_1798438_1357031707_6dfe46ff7ad9fe105348390992a5511e_rle_crop_3790449138_0.png resize: (228, 200) 1357037914 -2.192862870279983 treat image : temp/1746724828_1798438_1357031707_6dfe46ff7ad9fe105348390992a5511e_rle_crop_3790449139_0.png resize: (782, 611) 1357037915 0.7505083846192377 treat image : temp/1746724828_1798438_1357031707_6dfe46ff7ad9fe105348390992a5511e_rle_crop_3790449140_0.png resize: (233, 108) 1357037917 -0.753961621433768 treat image : temp/1746724828_1798438_1357031707_6dfe46ff7ad9fe105348390992a5511e_rle_crop_3790449144_0.png resize: (220, 145) 1357037918 -2.4712503436169526 treat image : temp/1746724828_1798438_1357031706_e616b8ae135ad810fc6d57a5e0ecaba1_rle_crop_3790449146_0.png resize: (131, 212) 1357037919 -1.0503687028915003 treat image : temp/1746724828_1798438_1357031706_e616b8ae135ad810fc6d57a5e0ecaba1_rle_crop_3790449147_0.png resize: (360, 821) 1357037920 -0.984435290649187 treat image : temp/1746724828_1798438_1357031706_e616b8ae135ad810fc6d57a5e0ecaba1_rle_crop_3790449149_0.png resize: (175, 179) 1357037921 -1.962881982417795 treat image : temp/1746724828_1798438_1357031706_e616b8ae135ad810fc6d57a5e0ecaba1_rle_crop_3790449151_0.png resize: (434, 246) 1357037922 -1.2096006134182362 treat image : temp/1746724828_1798438_1357031706_e616b8ae135ad810fc6d57a5e0ecaba1_rle_crop_3790449153_0.png resize: (507, 384) 1357037923 -1.4799588972331956 treat image : temp/1746724828_1798438_1357031706_e616b8ae135ad810fc6d57a5e0ecaba1_rle_crop_3790449154_0.png resize: (489, 394) 1357037924 0.0021066151959536206 treat image : temp/1746724828_1798438_1357031706_e616b8ae135ad810fc6d57a5e0ecaba1_rle_crop_3790449155_0.png resize: (823, 1140) 1357037925 -0.18079535533942512 treat image : temp/1746724828_1798438_1357031705_6eda973d3f3cffddcd5e225e882bd711_rle_crop_3790449156_0.png resize: (249, 236) 1357037926 -2.322768957594734 treat image : temp/1746724828_1798438_1357031705_6eda973d3f3cffddcd5e225e882bd711_rle_crop_3790449158_0.png resize: (199, 453) 1357037927 -2.4700217285764205 treat image : temp/1746724828_1798438_1357031705_6eda973d3f3cffddcd5e225e882bd711_rle_crop_3790449159_0.png resize: (243, 288) 1357037928 -1.1633150140456106 treat image : temp/1746724828_1798438_1357031705_6eda973d3f3cffddcd5e225e882bd711_rle_crop_3790449163_0.png resize: (254, 693) 1357037929 -1.2037772708797774 treat image : temp/1746724828_1798438_1357031705_6eda973d3f3cffddcd5e225e882bd711_rle_crop_3790449165_0.png resize: (162, 419) 1357037930 -1.3841928355991546 treat image : temp/1746724828_1798438_1357031705_6eda973d3f3cffddcd5e225e882bd711_rle_crop_3790449168_0.png resize: (98, 138) 1357037931 -0.34421095902189014 treat image : temp/1746724828_1798438_1357031705_6eda973d3f3cffddcd5e225e882bd711_rle_crop_3790449169_0.png resize: (260, 148) 1357037932 -1.867295911455041 treat image : temp/1746724828_1798438_1357031704_d004a0ef777835e7b2052b29b50c7ee2_rle_crop_3790449171_0.png resize: (147, 178) 1357037933 -0.9257238938411146 treat image : temp/1746724828_1798438_1357031704_d004a0ef777835e7b2052b29b50c7ee2_rle_crop_3790449172_0.png resize: (148, 157) 1357037934 0.9535509007183607 treat image : temp/1746724828_1798438_1357031704_d004a0ef777835e7b2052b29b50c7ee2_rle_crop_3790449173_0.png resize: (421, 352) 1357037935 -2.3391602205449877 treat image : temp/1746724828_1798438_1357031704_d004a0ef777835e7b2052b29b50c7ee2_rle_crop_3790449174_0.png resize: (353, 160) 1357037936 -2.169699345915574 treat image : temp/1746724828_1798438_1357031704_d004a0ef777835e7b2052b29b50c7ee2_rle_crop_3790449175_0.png resize: (323, 663) 1357037937 -0.4475785683412369 treat image : temp/1746724828_1798438_1357031704_d004a0ef777835e7b2052b29b50c7ee2_rle_crop_3790449177_0.png resize: (106, 94) 1357037938 2.5196250398235307 treat image : temp/1746724828_1798438_1357031704_d004a0ef777835e7b2052b29b50c7ee2_rle_crop_3790449178_0.png resize: (306, 251) 1357037939 -0.9140285202923667 treat image : temp/1746724828_1798438_1357031704_d004a0ef777835e7b2052b29b50c7ee2_rle_crop_3790449179_0.png resize: (115, 108) 1357037940 -0.38774621381276797 treat image : temp/1746724828_1798438_1357031704_d004a0ef777835e7b2052b29b50c7ee2_rle_crop_3790449180_0.png resize: (204, 312) 1357037941 -1.3360241851085712 treat image : temp/1746724828_1798438_1357031704_d004a0ef777835e7b2052b29b50c7ee2_rle_crop_3790449182_0.png resize: (112, 78) 1357037942 0.7094993627117788 treat image : temp/1746724828_1798438_1357031704_d004a0ef777835e7b2052b29b50c7ee2_rle_crop_3790449183_0.png resize: (146, 192) 1357037943 -0.8386424894570037 treat image : temp/1746724828_1798438_1357031834_df41f11707c0f092ace0f8528a769c58_rle_crop_3790449034_0.png resize: (243, 286) 1357037944 -2.1710731920720625 treat image : temp/1746724828_1798438_1357031834_df41f11707c0f092ace0f8528a769c58_rle_crop_3790449037_0.png resize: (519, 1053) 1357037945 -1.3519576568847116 treat image : temp/1746724828_1798438_1357031834_df41f11707c0f092ace0f8528a769c58_rle_crop_3790449044_0.png resize: (457, 106) 1357037946 -1.174115489283885 treat image : temp/1746724828_1798438_1357031807_bb7fc7c5a318a00b735ff879861a5a55_rle_crop_3790449048_0.png resize: (205, 260) 1357037947 -0.7477612072091178 treat image : temp/1746724828_1798438_1357031807_bb7fc7c5a318a00b735ff879861a5a55_rle_crop_3790449052_0.png resize: (220, 168) 1357037948 -3.4056172731548005 treat image : temp/1746724828_1798438_1357031807_bb7fc7c5a318a00b735ff879861a5a55_rle_crop_3790449066_0.png resize: (128, 248) 1357037949 -1.4476800363186453 treat image : temp/1746724828_1798438_1357031710_728108bd2b5073b8959fc17b6605032e_rle_crop_3790449108_0.png resize: (254, 155) 1357037950 -1.7481746527533761 treat image : temp/1746724828_1798438_1357031710_728108bd2b5073b8959fc17b6605032e_rle_crop_3790449116_0.png resize: (155, 198) 1357037951 -1.3660311602265223 treat image : temp/1746724828_1798438_1357031710_728108bd2b5073b8959fc17b6605032e_rle_crop_3790449124_0.png resize: (124, 249) 1357037952 -1.044173471673963 treat image : temp/1746724828_1798438_1357031710_728108bd2b5073b8959fc17b6605032e_rle_crop_3790449128_0.png resize: (102, 283) 1357037953 -1.5101784092512651 treat image : temp/1746724828_1798438_1357031707_6dfe46ff7ad9fe105348390992a5511e_rle_crop_3790449134_0.png resize: (174, 264) 1357037954 -1.0394951022592482 treat image : temp/1746724828_1798438_1357031707_6dfe46ff7ad9fe105348390992a5511e_rle_crop_3790449142_0.png resize: (271, 770) 1357037955 -0.7663535655076551 treat image : temp/1746724828_1798438_1357031705_6eda973d3f3cffddcd5e225e882bd711_rle_crop_3790449157_0.png resize: (467, 455) 1357037956 -1.2824793804545251 treat image : temp/1746724828_1798438_1357031705_6eda973d3f3cffddcd5e225e882bd711_rle_crop_3790449160_0.png resize: (226, 212) 1357037957 -2.242452125238097 treat image : temp/1746724828_1798438_1357031705_6eda973d3f3cffddcd5e225e882bd711_rle_crop_3790449162_0.png resize: (220, 226) 1357037958 -1.8768808832513266 treat image : temp/1746724828_1798438_1357031705_6eda973d3f3cffddcd5e225e882bd711_rle_crop_3790449170_0.png resize: (177, 330) 1357037959 -1.7545212217239252 treat image : temp/1746724828_1798438_1357031707_6dfe46ff7ad9fe105348390992a5511e_rle_crop_3790449132_0.png resize: (205, 240) 1357037960 -1.7237189083737257 treat image : temp/1746724828_1798438_1357031707_6dfe46ff7ad9fe105348390992a5511e_rle_crop_3790449145_0.png resize: (136, 150) 1357037961 -0.9334312872495597 treat image : temp/1746724828_1798438_1357031834_df41f11707c0f092ace0f8528a769c58_rle_crop_3790449040_0.png resize: (430, 449) 1357037973 -1.7068598283401766 treat image : temp/1746724828_1798438_1357031834_df41f11707c0f092ace0f8528a769c58_rle_crop_3790449041_0.png resize: (191, 266) 1357037974 -3.457929377258277 treat image : temp/1746724828_1798438_1357031775_6afd76682d342e6a1f13c5df0fcba205_rle_crop_3790449076_0.png resize: (198, 326) 1357037975 -2.0427266668205224 treat image : temp/1746724828_1798438_1357031728_1362a7195b86374eb2383caaedcc66b8_rle_crop_3790449092_0.png resize: (262, 299) 1357037976 -1.2348201495969033 treat image : temp/1746724828_1798438_1357031728_1362a7195b86374eb2383caaedcc66b8_rle_crop_3790449093_0.png resize: (412, 285) 1357037977 -3.80517627300343 treat image : temp/1746724828_1798438_1357031713_6dcbb02eec9c9fd453a8ae953c1827f0_rle_crop_3790449099_0.png resize: (472, 472) 1357037979 -0.40298174613056575 treat image : temp/1746724828_1798438_1357031713_6dcbb02eec9c9fd453a8ae953c1827f0_rle_crop_3790449102_0.png resize: (277, 402) 1357037980 -2.209185751205094 treat image : temp/1746724828_1798438_1357031710_728108bd2b5073b8959fc17b6605032e_rle_crop_3790449106_0.png resize: (372, 637) 1357037982 -0.8827184900363845 treat image : temp/1746724828_1798438_1357031710_728108bd2b5073b8959fc17b6605032e_rle_crop_3790449109_0.png resize: (524, 627) 1357037983 -1.4989864571969767 treat image : temp/1746724828_1798438_1357031710_728108bd2b5073b8959fc17b6605032e_rle_crop_3790449111_0.png resize: (264, 478) 1357037984 -1.1391801003163904 treat image : temp/1746724828_1798438_1357031710_728108bd2b5073b8959fc17b6605032e_rle_crop_3790449114_0.png resize: (352, 130) 1357037985 -1.783055863634199 treat image : temp/1746724828_1798438_1357031710_728108bd2b5073b8959fc17b6605032e_rle_crop_3790449115_0.png resize: (370, 448) 1357037986 -1.6187452804182023 treat image : temp/1746724828_1798438_1357031710_728108bd2b5073b8959fc17b6605032e_rle_crop_3790449119_0.png resize: (195, 291) 1357037987 -1.6122712735737685 treat image : temp/1746724828_1798438_1357031710_728108bd2b5073b8959fc17b6605032e_rle_crop_3790449122_0.png resize: (188, 241) 1357037988 -1.9095176960561149 treat image : temp/1746724828_1798438_1357031710_728108bd2b5073b8959fc17b6605032e_rle_crop_3790449126_0.png resize: (262, 343) 1357037990 -1.8329512785370106 treat image : temp/1746724828_1798438_1357031710_728108bd2b5073b8959fc17b6605032e_rle_crop_3790449127_0.png resize: (837, 658) 1357037991 -1.2980632510428922 treat image : temp/1746724828_1798438_1357031707_6dfe46ff7ad9fe105348390992a5511e_rle_crop_3790449141_0.png resize: (287, 316) 1357037992 -0.9476282704362302 treat image : temp/1746724828_1798438_1357031707_6dfe46ff7ad9fe105348390992a5511e_rle_crop_3790449143_0.png resize: (413, 533) 1357037993 -1.6747038250228259 treat image : temp/1746724828_1798438_1357031706_e616b8ae135ad810fc6d57a5e0ecaba1_rle_crop_3790449148_0.png resize: (643, 764) 1357037994 -0.3390294029947943 treat image : temp/1746724828_1798438_1357031706_e616b8ae135ad810fc6d57a5e0ecaba1_rle_crop_3790449150_0.png resize: (387, 574) 1357037995 -0.7627958055213785 treat image : temp/1746724828_1798438_1357031706_e616b8ae135ad810fc6d57a5e0ecaba1_rle_crop_3790449152_0.png resize: (410, 507) 1357037996 -0.4677261434452266 treat image : temp/1746724828_1798438_1357031705_6eda973d3f3cffddcd5e225e882bd711_rle_crop_3790449164_0.png resize: (245, 328) 1357037997 -1.4642199404420637 treat image : temp/1746724828_1798438_1357031705_6eda973d3f3cffddcd5e225e882bd711_rle_crop_3790449166_0.png resize: (367, 605) 1357037998 -2.5746559189915357 treat image : temp/1746724828_1798438_1357031704_d004a0ef777835e7b2052b29b50c7ee2_rle_crop_3790449176_0.png resize: (369, 312) 1357037999 -2.2594455763462054 treat image : temp/1746724828_1798438_1357031704_d004a0ef777835e7b2052b29b50c7ee2_rle_crop_3790449184_0.png resize: (384, 311) 1357038000 1.971638036357525 treat image : temp/1746724828_1798438_1357031704_d004a0ef777835e7b2052b29b50c7ee2_rle_crop_3790449185_0.png resize: (208, 156) 1357038001 -0.2549527180824291 treat image : temp/1746724828_1798438_1357031807_bb7fc7c5a318a00b735ff879861a5a55_rle_crop_3790449057_0.png resize: (153, 137) 1357038005 -0.8799466697570792 treat image : temp/1746724828_1798438_1357031705_6eda973d3f3cffddcd5e225e882bd711_rle_crop_3790449161_0.png resize: (238, 604) 1357038006 -1.4634502543987638 treat image : temp/1746724828_1798438_1357031705_6eda973d3f3cffddcd5e225e882bd711_rle_crop_3790449167_0.png resize: (106, 62) 1357038007 3.1946662653939466 treat image : temp/1746724828_1798438_1357031704_d004a0ef777835e7b2052b29b50c7ee2_rle_crop_3790449181_0.png resize: (86, 77) 1357038008 2.444333227101495 treat image : temp/1746724828_1798438_1357031834_df41f11707c0f092ace0f8528a769c58_rle_crop_3790449045_0.png resize: (342, 393) 1357038011 -0.5635706381570784 treat image : temp/1746724828_1798438_1357031728_1362a7195b86374eb2383caaedcc66b8_rle_crop_3790449087_0.png resize: (120, 158) 1357038012 -1.0924639563137764 treat image : temp/1746724828_1798438_1357031807_bb7fc7c5a318a00b735ff879861a5a55_rle_crop_3790449069_0.png resize: (138, 172) 1357038015 -1.9628547770586147 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 164 time used for this insertion : 0.01830768585205078 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 164 time used for this insertion : 0.0347599983215332 save missing photos in datou_result : time spend for datou_step_exec : 42.46207332611084 time spend to save output : 0.0582735538482666 total time spend for step 6 : 42.520346879959106 step7:brightness Thu May 8 19:26:18 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1746724828_1798438_1357031864_5d34f5c2d2613086dca59b1d6de934ea.jpg treat image : temp/1746724828_1798438_1357031834_df41f11707c0f092ace0f8528a769c58.jpg treat image : temp/1746724828_1798438_1357031807_bb7fc7c5a318a00b735ff879861a5a55.jpg treat image : temp/1746724828_1798438_1357031775_6afd76682d342e6a1f13c5df0fcba205.jpg treat image : temp/1746724828_1798438_1357031728_1362a7195b86374eb2383caaedcc66b8.jpg treat image : temp/1746724828_1798438_1357031713_6dcbb02eec9c9fd453a8ae953c1827f0.jpg treat image : temp/1746724828_1798438_1357031710_728108bd2b5073b8959fc17b6605032e.jpg treat image : temp/1746724828_1798438_1357031707_6dfe46ff7ad9fe105348390992a5511e.jpg treat image : temp/1746724828_1798438_1357031706_e616b8ae135ad810fc6d57a5e0ecaba1.jpg treat image : temp/1746724828_1798438_1357031705_6eda973d3f3cffddcd5e225e882bd711.jpg treat image : temp/1746724828_1798438_1357031704_d004a0ef777835e7b2052b29b50c7ee2.jpg treat image : temp/1746724828_1798438_1357031834_df41f11707c0f092ace0f8528a769c58_rle_crop_3790449033_0.png treat image : temp/1746724828_1798438_1357031834_df41f11707c0f092ace0f8528a769c58_rle_crop_3790449035_0.png treat image : temp/1746724828_1798438_1357031834_df41f11707c0f092ace0f8528a769c58_rle_crop_3790449036_0.png treat image : temp/1746724828_1798438_1357031834_df41f11707c0f092ace0f8528a769c58_rle_crop_3790449038_0.png treat image : temp/1746724828_1798438_1357031834_df41f11707c0f092ace0f8528a769c58_rle_crop_3790449039_0.png treat image : temp/1746724828_1798438_1357031834_df41f11707c0f092ace0f8528a769c58_rle_crop_3790449042_0.png treat image : temp/1746724828_1798438_1357031834_df41f11707c0f092ace0f8528a769c58_rle_crop_3790449043_0.png treat image : temp/1746724828_1798438_1357031834_df41f11707c0f092ace0f8528a769c58_rle_crop_3790449046_0.png treat image : temp/1746724828_1798438_1357031807_bb7fc7c5a318a00b735ff879861a5a55_rle_crop_3790449047_0.png treat image : temp/1746724828_1798438_1357031807_bb7fc7c5a318a00b735ff879861a5a55_rle_crop_3790449049_0.png treat image : temp/1746724828_1798438_1357031807_bb7fc7c5a318a00b735ff879861a5a55_rle_crop_3790449050_0.png treat image : temp/1746724828_1798438_1357031807_bb7fc7c5a318a00b735ff879861a5a55_rle_crop_3790449051_0.png treat image : temp/1746724828_1798438_1357031807_bb7fc7c5a318a00b735ff879861a5a55_rle_crop_3790449053_0.png treat image : temp/1746724828_1798438_1357031807_bb7fc7c5a318a00b735ff879861a5a55_rle_crop_3790449054_0.png treat image : temp/1746724828_1798438_1357031807_bb7fc7c5a318a00b735ff879861a5a55_rle_crop_3790449055_0.png treat image : temp/1746724828_1798438_1357031807_bb7fc7c5a318a00b735ff879861a5a55_rle_crop_3790449056_0.png treat image : temp/1746724828_1798438_1357031807_bb7fc7c5a318a00b735ff879861a5a55_rle_crop_3790449058_0.png treat image : temp/1746724828_1798438_1357031807_bb7fc7c5a318a00b735ff879861a5a55_rle_crop_3790449059_0.png treat image : temp/1746724828_1798438_1357031807_bb7fc7c5a318a00b735ff879861a5a55_rle_crop_3790449060_0.png treat image : temp/1746724828_1798438_1357031807_bb7fc7c5a318a00b735ff879861a5a55_rle_crop_3790449061_0.png treat image : temp/1746724828_1798438_1357031807_bb7fc7c5a318a00b735ff879861a5a55_rle_crop_3790449062_0.png treat image : temp/1746724828_1798438_1357031807_bb7fc7c5a318a00b735ff879861a5a55_rle_crop_3790449063_0.png treat image : temp/1746724828_1798438_1357031807_bb7fc7c5a318a00b735ff879861a5a55_rle_crop_3790449064_0.png treat image : temp/1746724828_1798438_1357031807_bb7fc7c5a318a00b735ff879861a5a55_rle_crop_3790449065_0.png treat image : temp/1746724828_1798438_1357031807_bb7fc7c5a318a00b735ff879861a5a55_rle_crop_3790449067_0.png treat image : temp/1746724828_1798438_1357031807_bb7fc7c5a318a00b735ff879861a5a55_rle_crop_3790449068_0.png treat image : temp/1746724828_1798438_1357031775_6afd76682d342e6a1f13c5df0fcba205_rle_crop_3790449070_0.png treat image : temp/1746724828_1798438_1357031775_6afd76682d342e6a1f13c5df0fcba205_rle_crop_3790449071_0.png treat image : temp/1746724828_1798438_1357031775_6afd76682d342e6a1f13c5df0fcba205_rle_crop_3790449072_0.png treat image : temp/1746724828_1798438_1357031775_6afd76682d342e6a1f13c5df0fcba205_rle_crop_3790449073_0.png treat image : temp/1746724828_1798438_1357031775_6afd76682d342e6a1f13c5df0fcba205_rle_crop_3790449074_0.png treat image : temp/1746724828_1798438_1357031775_6afd76682d342e6a1f13c5df0fcba205_rle_crop_3790449075_0.png treat image : temp/1746724828_1798438_1357031775_6afd76682d342e6a1f13c5df0fcba205_rle_crop_3790449077_0.png treat image : temp/1746724828_1798438_1357031775_6afd76682d342e6a1f13c5df0fcba205_rle_crop_3790449078_0.png treat image : temp/1746724828_1798438_1357031775_6afd76682d342e6a1f13c5df0fcba205_rle_crop_3790449079_0.png treat image : temp/1746724828_1798438_1357031775_6afd76682d342e6a1f13c5df0fcba205_rle_crop_3790449080_0.png treat image : temp/1746724828_1798438_1357031775_6afd76682d342e6a1f13c5df0fcba205_rle_crop_3790449081_0.png treat image : temp/1746724828_1798438_1357031775_6afd76682d342e6a1f13c5df0fcba205_rle_crop_3790449082_0.png treat image : temp/1746724828_1798438_1357031728_1362a7195b86374eb2383caaedcc66b8_rle_crop_3790449083_0.png treat image : temp/1746724828_1798438_1357031728_1362a7195b86374eb2383caaedcc66b8_rle_crop_3790449084_0.png treat image : temp/1746724828_1798438_1357031728_1362a7195b86374eb2383caaedcc66b8_rle_crop_3790449085_0.png treat image : temp/1746724828_1798438_1357031728_1362a7195b86374eb2383caaedcc66b8_rle_crop_3790449086_0.png treat image : temp/1746724828_1798438_1357031728_1362a7195b86374eb2383caaedcc66b8_rle_crop_3790449088_0.png treat image : temp/1746724828_1798438_1357031728_1362a7195b86374eb2383caaedcc66b8_rle_crop_3790449089_0.png treat image : temp/1746724828_1798438_1357031728_1362a7195b86374eb2383caaedcc66b8_rle_crop_3790449090_0.png treat image : temp/1746724828_1798438_1357031728_1362a7195b86374eb2383caaedcc66b8_rle_crop_3790449091_0.png treat image : temp/1746724828_1798438_1357031728_1362a7195b86374eb2383caaedcc66b8_rle_crop_3790449094_0.png treat image : temp/1746724828_1798438_1357031713_6dcbb02eec9c9fd453a8ae953c1827f0_rle_crop_3790449095_0.png treat image : temp/1746724828_1798438_1357031713_6dcbb02eec9c9fd453a8ae953c1827f0_rle_crop_3790449096_0.png treat image : temp/1746724828_1798438_1357031713_6dcbb02eec9c9fd453a8ae953c1827f0_rle_crop_3790449097_0.png treat image : temp/1746724828_1798438_1357031713_6dcbb02eec9c9fd453a8ae953c1827f0_rle_crop_3790449098_0.png treat image : temp/1746724828_1798438_1357031713_6dcbb02eec9c9fd453a8ae953c1827f0_rle_crop_3790449100_0.png treat image : temp/1746724828_1798438_1357031713_6dcbb02eec9c9fd453a8ae953c1827f0_rle_crop_3790449101_0.png treat image : temp/1746724828_1798438_1357031713_6dcbb02eec9c9fd453a8ae953c1827f0_rle_crop_3790449103_0.png treat image : temp/1746724828_1798438_1357031713_6dcbb02eec9c9fd453a8ae953c1827f0_rle_crop_3790449104_0.png treat image : temp/1746724828_1798438_1357031710_728108bd2b5073b8959fc17b6605032e_rle_crop_3790449105_0.png treat image : temp/1746724828_1798438_1357031710_728108bd2b5073b8959fc17b6605032e_rle_crop_3790449107_0.png treat image : temp/1746724828_1798438_1357031710_728108bd2b5073b8959fc17b6605032e_rle_crop_3790449110_0.png treat image : temp/1746724828_1798438_1357031710_728108bd2b5073b8959fc17b6605032e_rle_crop_3790449112_0.png treat image : temp/1746724828_1798438_1357031710_728108bd2b5073b8959fc17b6605032e_rle_crop_3790449113_0.png treat image : temp/1746724828_1798438_1357031710_728108bd2b5073b8959fc17b6605032e_rle_crop_3790449117_0.png treat image : temp/1746724828_1798438_1357031710_728108bd2b5073b8959fc17b6605032e_rle_crop_3790449118_0.png treat image : temp/1746724828_1798438_1357031710_728108bd2b5073b8959fc17b6605032e_rle_crop_3790449120_0.png treat image : temp/1746724828_1798438_1357031710_728108bd2b5073b8959fc17b6605032e_rle_crop_3790449121_0.png treat image : temp/1746724828_1798438_1357031710_728108bd2b5073b8959fc17b6605032e_rle_crop_3790449123_0.png treat image : temp/1746724828_1798438_1357031710_728108bd2b5073b8959fc17b6605032e_rle_crop_3790449125_0.png treat image : temp/1746724828_1798438_1357031710_728108bd2b5073b8959fc17b6605032e_rle_crop_3790449129_0.png treat image : temp/1746724828_1798438_1357031707_6dfe46ff7ad9fe105348390992a5511e_rle_crop_3790449130_0.png treat image : temp/1746724828_1798438_1357031707_6dfe46ff7ad9fe105348390992a5511e_rle_crop_3790449131_0.png treat image : temp/1746724828_1798438_1357031707_6dfe46ff7ad9fe105348390992a5511e_rle_crop_3790449133_0.png treat image : temp/1746724828_1798438_1357031707_6dfe46ff7ad9fe105348390992a5511e_rle_crop_3790449135_0.png treat image : temp/1746724828_1798438_1357031707_6dfe46ff7ad9fe105348390992a5511e_rle_crop_3790449136_0.png treat image : temp/1746724828_1798438_1357031707_6dfe46ff7ad9fe105348390992a5511e_rle_crop_3790449137_0.png treat image : temp/1746724828_1798438_1357031707_6dfe46ff7ad9fe105348390992a5511e_rle_crop_3790449138_0.png treat image : temp/1746724828_1798438_1357031707_6dfe46ff7ad9fe105348390992a5511e_rle_crop_3790449139_0.png treat image : temp/1746724828_1798438_1357031707_6dfe46ff7ad9fe105348390992a5511e_rle_crop_3790449140_0.png treat image : temp/1746724828_1798438_1357031707_6dfe46ff7ad9fe105348390992a5511e_rle_crop_3790449144_0.png treat image : temp/1746724828_1798438_1357031706_e616b8ae135ad810fc6d57a5e0ecaba1_rle_crop_3790449146_0.png treat image : temp/1746724828_1798438_1357031706_e616b8ae135ad810fc6d57a5e0ecaba1_rle_crop_3790449147_0.png treat image : temp/1746724828_1798438_1357031706_e616b8ae135ad810fc6d57a5e0ecaba1_rle_crop_3790449149_0.png treat image : temp/1746724828_1798438_1357031706_e616b8ae135ad810fc6d57a5e0ecaba1_rle_crop_3790449151_0.png treat image : temp/1746724828_1798438_1357031706_e616b8ae135ad810fc6d57a5e0ecaba1_rle_crop_3790449153_0.png treat image : temp/1746724828_1798438_1357031706_e616b8ae135ad810fc6d57a5e0ecaba1_rle_crop_3790449154_0.png treat image : temp/1746724828_1798438_1357031706_e616b8ae135ad810fc6d57a5e0ecaba1_rle_crop_3790449155_0.png treat image : temp/1746724828_1798438_1357031705_6eda973d3f3cffddcd5e225e882bd711_rle_crop_3790449156_0.png treat image : temp/1746724828_1798438_1357031705_6eda973d3f3cffddcd5e225e882bd711_rle_crop_3790449158_0.png treat image : temp/1746724828_1798438_1357031705_6eda973d3f3cffddcd5e225e882bd711_rle_crop_3790449159_0.png treat image : temp/1746724828_1798438_1357031705_6eda973d3f3cffddcd5e225e882bd711_rle_crop_3790449163_0.png treat image : temp/1746724828_1798438_1357031705_6eda973d3f3cffddcd5e225e882bd711_rle_crop_3790449165_0.png treat image : temp/1746724828_1798438_1357031705_6eda973d3f3cffddcd5e225e882bd711_rle_crop_3790449168_0.png treat image : temp/1746724828_1798438_1357031705_6eda973d3f3cffddcd5e225e882bd711_rle_crop_3790449169_0.png treat image : temp/1746724828_1798438_1357031704_d004a0ef777835e7b2052b29b50c7ee2_rle_crop_3790449171_0.png treat image : temp/1746724828_1798438_1357031704_d004a0ef777835e7b2052b29b50c7ee2_rle_crop_3790449172_0.png treat image : temp/1746724828_1798438_1357031704_d004a0ef777835e7b2052b29b50c7ee2_rle_crop_3790449173_0.png treat image : temp/1746724828_1798438_1357031704_d004a0ef777835e7b2052b29b50c7ee2_rle_crop_3790449174_0.png treat image : temp/1746724828_1798438_1357031704_d004a0ef777835e7b2052b29b50c7ee2_rle_crop_3790449175_0.png treat image : temp/1746724828_1798438_1357031704_d004a0ef777835e7b2052b29b50c7ee2_rle_crop_3790449177_0.png treat image : temp/1746724828_1798438_1357031704_d004a0ef777835e7b2052b29b50c7ee2_rle_crop_3790449178_0.png treat image : temp/1746724828_1798438_1357031704_d004a0ef777835e7b2052b29b50c7ee2_rle_crop_3790449179_0.png treat image : temp/1746724828_1798438_1357031704_d004a0ef777835e7b2052b29b50c7ee2_rle_crop_3790449180_0.png treat image : temp/1746724828_1798438_1357031704_d004a0ef777835e7b2052b29b50c7ee2_rle_crop_3790449182_0.png treat image : temp/1746724828_1798438_1357031704_d004a0ef777835e7b2052b29b50c7ee2_rle_crop_3790449183_0.png treat image : temp/1746724828_1798438_1357031834_df41f11707c0f092ace0f8528a769c58_rle_crop_3790449034_0.png treat image : temp/1746724828_1798438_1357031834_df41f11707c0f092ace0f8528a769c58_rle_crop_3790449037_0.png treat image : temp/1746724828_1798438_1357031834_df41f11707c0f092ace0f8528a769c58_rle_crop_3790449044_0.png treat image : temp/1746724828_1798438_1357031807_bb7fc7c5a318a00b735ff879861a5a55_rle_crop_3790449048_0.png treat image : temp/1746724828_1798438_1357031807_bb7fc7c5a318a00b735ff879861a5a55_rle_crop_3790449052_0.png treat image : temp/1746724828_1798438_1357031807_bb7fc7c5a318a00b735ff879861a5a55_rle_crop_3790449066_0.png treat image : temp/1746724828_1798438_1357031710_728108bd2b5073b8959fc17b6605032e_rle_crop_3790449108_0.png treat image : temp/1746724828_1798438_1357031710_728108bd2b5073b8959fc17b6605032e_rle_crop_3790449116_0.png treat image : temp/1746724828_1798438_1357031710_728108bd2b5073b8959fc17b6605032e_rle_crop_3790449124_0.png treat image : temp/1746724828_1798438_1357031710_728108bd2b5073b8959fc17b6605032e_rle_crop_3790449128_0.png treat image : temp/1746724828_1798438_1357031707_6dfe46ff7ad9fe105348390992a5511e_rle_crop_3790449134_0.png treat image : temp/1746724828_1798438_1357031707_6dfe46ff7ad9fe105348390992a5511e_rle_crop_3790449142_0.png treat image : temp/1746724828_1798438_1357031705_6eda973d3f3cffddcd5e225e882bd711_rle_crop_3790449157_0.png treat image : temp/1746724828_1798438_1357031705_6eda973d3f3cffddcd5e225e882bd711_rle_crop_3790449160_0.png treat image : temp/1746724828_1798438_1357031705_6eda973d3f3cffddcd5e225e882bd711_rle_crop_3790449162_0.png treat image : temp/1746724828_1798438_1357031705_6eda973d3f3cffddcd5e225e882bd711_rle_crop_3790449170_0.png treat image : temp/1746724828_1798438_1357031707_6dfe46ff7ad9fe105348390992a5511e_rle_crop_3790449132_0.png treat image : temp/1746724828_1798438_1357031707_6dfe46ff7ad9fe105348390992a5511e_rle_crop_3790449145_0.png treat image : temp/1746724828_1798438_1357031834_df41f11707c0f092ace0f8528a769c58_rle_crop_3790449040_0.png treat image : temp/1746724828_1798438_1357031834_df41f11707c0f092ace0f8528a769c58_rle_crop_3790449041_0.png treat image : temp/1746724828_1798438_1357031775_6afd76682d342e6a1f13c5df0fcba205_rle_crop_3790449076_0.png treat image : temp/1746724828_1798438_1357031728_1362a7195b86374eb2383caaedcc66b8_rle_crop_3790449092_0.png treat image : temp/1746724828_1798438_1357031728_1362a7195b86374eb2383caaedcc66b8_rle_crop_3790449093_0.png treat image : temp/1746724828_1798438_1357031713_6dcbb02eec9c9fd453a8ae953c1827f0_rle_crop_3790449099_0.png treat image : temp/1746724828_1798438_1357031713_6dcbb02eec9c9fd453a8ae953c1827f0_rle_crop_3790449102_0.png treat image : temp/1746724828_1798438_1357031710_728108bd2b5073b8959fc17b6605032e_rle_crop_3790449106_0.png treat image : temp/1746724828_1798438_1357031710_728108bd2b5073b8959fc17b6605032e_rle_crop_3790449109_0.png treat image : temp/1746724828_1798438_1357031710_728108bd2b5073b8959fc17b6605032e_rle_crop_3790449111_0.png treat image : temp/1746724828_1798438_1357031710_728108bd2b5073b8959fc17b6605032e_rle_crop_3790449114_0.png treat image : temp/1746724828_1798438_1357031710_728108bd2b5073b8959fc17b6605032e_rle_crop_3790449115_0.png treat image : temp/1746724828_1798438_1357031710_728108bd2b5073b8959fc17b6605032e_rle_crop_3790449119_0.png treat image : temp/1746724828_1798438_1357031710_728108bd2b5073b8959fc17b6605032e_rle_crop_3790449122_0.png treat image : temp/1746724828_1798438_1357031710_728108bd2b5073b8959fc17b6605032e_rle_crop_3790449126_0.png treat image : temp/1746724828_1798438_1357031710_728108bd2b5073b8959fc17b6605032e_rle_crop_3790449127_0.png treat image : temp/1746724828_1798438_1357031707_6dfe46ff7ad9fe105348390992a5511e_rle_crop_3790449141_0.png treat image : temp/1746724828_1798438_1357031707_6dfe46ff7ad9fe105348390992a5511e_rle_crop_3790449143_0.png treat image : temp/1746724828_1798438_1357031706_e616b8ae135ad810fc6d57a5e0ecaba1_rle_crop_3790449148_0.png treat image : temp/1746724828_1798438_1357031706_e616b8ae135ad810fc6d57a5e0ecaba1_rle_crop_3790449150_0.png treat image : temp/1746724828_1798438_1357031706_e616b8ae135ad810fc6d57a5e0ecaba1_rle_crop_3790449152_0.png treat image : temp/1746724828_1798438_1357031705_6eda973d3f3cffddcd5e225e882bd711_rle_crop_3790449164_0.png treat image : temp/1746724828_1798438_1357031705_6eda973d3f3cffddcd5e225e882bd711_rle_crop_3790449166_0.png treat image : temp/1746724828_1798438_1357031704_d004a0ef777835e7b2052b29b50c7ee2_rle_crop_3790449176_0.png treat image : temp/1746724828_1798438_1357031704_d004a0ef777835e7b2052b29b50c7ee2_rle_crop_3790449184_0.png treat image : temp/1746724828_1798438_1357031704_d004a0ef777835e7b2052b29b50c7ee2_rle_crop_3790449185_0.png treat image : temp/1746724828_1798438_1357031807_bb7fc7c5a318a00b735ff879861a5a55_rle_crop_3790449057_0.png treat image : temp/1746724828_1798438_1357031705_6eda973d3f3cffddcd5e225e882bd711_rle_crop_3790449161_0.png treat image : temp/1746724828_1798438_1357031705_6eda973d3f3cffddcd5e225e882bd711_rle_crop_3790449167_0.png treat image : temp/1746724828_1798438_1357031704_d004a0ef777835e7b2052b29b50c7ee2_rle_crop_3790449181_0.png treat image : temp/1746724828_1798438_1357031834_df41f11707c0f092ace0f8528a769c58_rle_crop_3790449045_0.png treat image : temp/1746724828_1798438_1357031728_1362a7195b86374eb2383caaedcc66b8_rle_crop_3790449087_0.png treat image : temp/1746724828_1798438_1357031807_bb7fc7c5a318a00b735ff879861a5a55_rle_crop_3790449069_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 164 time used for this insertion : 0.017907142639160156 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 164 time used for this insertion : 0.031889915466308594 save missing photos in datou_result : time spend for datou_step_exec : 11.597195625305176 time spend to save output : 0.05764627456665039 total time spend for step 7 : 11.654841899871826 step8:velours_tree Thu May 8 19:26:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.41644930839538574 time spend to save output : 3.409385681152344e-05 total time spend for step 8 : 0.41648340225219727 step9:send_mail_cod Thu May 8 19:26:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P22802746_08-05-2025_19_26_30.pdf 22802759 change filename to text .change filename to text .change filename to text .change filename to text .imagette228027591746725190 22802761 change filename to text .change filename to text .imagette228027611746725190 22802762 change filename to text .imagette228027621746725190 22802763 imagette228027631746725191 22802764 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette228027641746725191 22802765 change filename to text .change filename to text .imagette228027651746725192 22802766 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette228027661746725192 22802767 imagette228027671746725194 22802768 imagette228027681746725194 22802769 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette228027691746725194 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=22802746 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/22802759,22802760,22802761,22802762,22802763,22802764,22802765,22802766,22802767,22802768,22802769?tags=autre,environnement,pehd,pet_fonce,background,pet_clair,metal,papier,mal_croppe,flou,carton args[1357031864] : ((1357031864, -4.170026302940699, 492609224), (1357031864, -0.027447304654934345, 2107752395), '0.14475187433980327') We are sending mail with results at report@fotonower.com args[1357031834] : ((1357031834, -1.1573016361175181, 492688767), (1357031834, 0.03083393717018351, 2107752395), '0.14475187433980327') We are sending mail with results at report@fotonower.com args[1357031807] : ((1357031807, -2.7583250683172578, 492609224), (1357031807, 0.05202526337943896, 2107752395), '0.14475187433980327') We are sending mail with results at report@fotonower.com args[1357031775] : ((1357031775, -3.045612267402573, 492609224), (1357031775, 0.07718065436726382, 2107752395), '0.14475187433980327') We are sending mail with results at report@fotonower.com args[1357031728] : ((1357031728, -0.8145267141383985, 492688767), (1357031728, -0.32104563100081973, 496442774), '0.14475187433980327') We are sending mail with results at report@fotonower.com args[1357031713] : ((1357031713, 0.4466698005674375, 492688767), (1357031713, 0.023853944207883115, 2107752395), '0.14475187433980327') We are sending mail with results at report@fotonower.com args[1357031710] : ((1357031710, -0.612549996236764, 492688767), (1357031710, -0.19429533895108902, 496442774), '0.14475187433980327') We are sending mail with results at report@fotonower.com args[1357031707] : ((1357031707, -0.8457358720213175, 492688767), (1357031707, 0.08086319646544005, 2107752395), '0.14475187433980327') We are sending mail with results at report@fotonower.com args[1357031706] : ((1357031706, 1.5474117590941605, 492688767), (1357031706, -0.1870006115305932, 496442774), '0.14475187433980327') We are sending mail with results at report@fotonower.com args[1357031705] : ((1357031705, -3.3414901420433663, 492609224), (1357031705, 0.03446208630872502, 2107752395), '0.14475187433980327') We are sending mail with results at report@fotonower.com args[1357031704] : ((1357031704, -1.2057187504793374, 492688767), (1357031704, 0.18548486377184487, 2107752395), '0.14475187433980327') We are sending mail with results at report@fotonower.com refus_total : 0.14475187433980327 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=22802746 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22802746_08-05-2025_19_26_30.pdf results_Auto_P22802746_08-05-2025_19_26_30.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22802746_08-05-2025_19_26_30.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','22802746','results_Auto_P22802746_08-05-2025_19_26_30.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22802746_08-05-2025_19_26_30.pdf','pdf','','0.85','0.14475187433980327') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/22802746

https://www.fotonower.com/image?json=false&list_photos_id=1357031864
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1357031834
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1357031807
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1357031775
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1357031728
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1357031713
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1357031710
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1357031707
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1357031706
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.5474117590941605)
https://www.fotonower.com/image?json=false&list_photos_id=1357031705
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1357031704
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 14.48%
Veuillez trouver les photos des contaminants.

exemples de contaminants: autre: https://www.fotonower.com/view/22802759?limit=200
exemples de contaminants: pehd: https://www.fotonower.com/view/22802761?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/22802762?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/22802764?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/22802765?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/22802766?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/22802769?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22802746_08-05-2025_19_26_30.pdf.

Lien vers velours :https://www.fotonower.com/velours/22802759,22802760,22802761,22802762,22802763,22802764,22802765,22802766,22802767,22802768,22802769?tags=autre,environnement,pehd,pet_fonce,background,pet_clair,metal,papier,mal_croppe,flou,carton.


L'équipe Fotonower 202 b'' Server: nginx Date: Thu, 08 May 2025 17:26:38 GMT Content-Length: 0 Connection: close X-Message-Id: 0aerAuAZSdm1TkR5taLOmg Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1357031864, 1357031834, 1357031807, 1357031775, 1357031728, 1357031713, 1357031710, 1357031707, 1357031706, 1357031705, 1357031704] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2808713') ('3318', '22802746', '1357031864', None, None, None, None, None, '2808713') ('3318', None, None, None, None, None, None, None, '2808713') ('3318', '22802746', '1357031834', None, None, None, None, None, '2808713') ('3318', None, None, None, None, None, None, None, '2808713') ('3318', '22802746', '1357031807', None, None, None, None, None, '2808713') ('3318', None, None, None, None, None, None, None, '2808713') ('3318', '22802746', '1357031775', None, None, None, None, None, '2808713') ('3318', None, None, None, None, None, None, None, '2808713') ('3318', '22802746', '1357031728', None, None, None, None, None, '2808713') ('3318', None, None, None, None, None, None, None, '2808713') ('3318', '22802746', '1357031713', None, None, None, None, None, '2808713') ('3318', None, None, None, None, None, None, None, '2808713') ('3318', '22802746', '1357031710', None, None, None, None, None, '2808713') ('3318', None, None, None, None, None, None, None, '2808713') ('3318', '22802746', '1357031707', None, None, None, None, None, '2808713') ('3318', None, None, None, None, None, None, None, '2808713') ('3318', '22802746', '1357031706', None, None, None, None, None, '2808713') ('3318', None, None, None, None, None, None, None, '2808713') ('3318', '22802746', '1357031705', None, None, None, None, None, '2808713') ('3318', None, None, None, None, None, None, None, '2808713') ('3318', '22802746', '1357031704', None, None, None, None, None, '2808713') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.014378547668457031 save_final save missing photos in datou_result : time spend for datou_step_exec : 7.631798028945923 time spend to save output : 0.014614582061767578 total time spend for step 9 : 7.64641261100769 step10:split_time_score Thu May 8 19:26:38 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('18', 11),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 08052025 22802746 Nombre de photos uploadées : 11 / 23040 (0%) 08052025 22802746 Nombre de photos taguées (types de déchets): 0 / 11 (0%) 08052025 22802746 Nombre de photos taguées (volume) : 0 / 11 (0%) elapsed_time : load_data_split_time_score 1.430511474609375e-06 elapsed_time : order_list_meta_photo_and_scores 5.0067901611328125e-06 ??????????? elapsed_time : fill_and_build_computed_from_old_data 0.0005991458892822266 elapsed_time : insert_dashboard_record_day_entry 0.028509140014648438 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.09101863626923734 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22797335_08-05-2025_10_41_47.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22797335 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22797335 AND mptpi.`type`=3726 To do Qualite : 0.1491809971480875 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22796754_08-05-2025_09_01_40.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22796754 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22796754 AND mptpi.`type`=3594 To do Qualite : 0.036240760927195435 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22797341_08-05-2025_10_21_30.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22797341 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22797341 AND mptpi.`type`=3726 To do Qualite : 0.0951294665534718 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22797981_08-05-2025_11_11_55.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22797981 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22797981 AND mptpi.`type`=3726 To do Qualite : 0.042063713081336246 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22798499_08-05-2025_12_10_50.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22798499 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22798499 AND mptpi.`type`=3726 To do Qualite : 0.037676790389423696 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22798724_08-05-2025_12_38_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22798724 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22798724 AND mptpi.`type`=3726 To do Qualite : 0.1469477191556599 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22800773_08-05-2025_15_50_20.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22800773 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22800773 AND mptpi.`type`=3594 To do Qualite : 0.12962935884581103 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22799861_08-05-2025_14_17_00.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22799861 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22799861 AND mptpi.`type`=3594 To do Qualite : 0.13872483152505186 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22800776_08-05-2025_15_43_15.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22800776 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22800776 AND mptpi.`type`=3726 To do Qualite : 0.127602651881095 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22800290_08-05-2025_14_42_02.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22800290 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22800290 AND mptpi.`type`=3726 To do Qualite : 0.11184673670579505 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22800777_08-05-2025_15_43_20.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22800777 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22800777 AND mptpi.`type`=3726 To do Qualite : 0.13374742483155816 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22801541_08-05-2025_17_34_12.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22801541 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22801541 AND mptpi.`type`=3594 To do Qualite : 0.15091523125453885 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22802363_08-05-2025_19_24_23.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22802363 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22802363 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22802367 order by id desc limit 1 Qualite : 0.14475187433980327 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22802746_08-05-2025_19_26_30.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22802746 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22802746 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'08052025': {'nb_upload': 11, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1357031864, 1357031834, 1357031807, 1357031775, 1357031728, 1357031713, 1357031710, 1357031707, 1357031706, 1357031705, 1357031704] Looping around the photos to save general results len do output : 1 /22802746Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2808713') ('3318', '22802746', '1357031864', None, None, None, None, None, '2808713') ('3318', None, None, None, None, None, None, None, '2808713') ('3318', '22802746', '1357031834', None, None, None, None, None, '2808713') ('3318', None, None, None, None, None, None, None, '2808713') ('3318', '22802746', '1357031807', None, None, None, None, None, '2808713') ('3318', None, None, None, None, None, None, None, '2808713') ('3318', '22802746', '1357031775', None, None, None, None, None, '2808713') ('3318', None, None, None, None, None, None, None, '2808713') ('3318', '22802746', '1357031728', None, None, None, None, None, '2808713') ('3318', None, None, None, None, None, None, None, '2808713') ('3318', '22802746', '1357031713', None, None, None, None, None, '2808713') ('3318', None, None, None, None, None, None, None, '2808713') ('3318', '22802746', '1357031710', None, None, None, None, None, '2808713') ('3318', None, None, None, None, None, None, None, '2808713') ('3318', '22802746', '1357031707', None, None, None, None, None, '2808713') ('3318', None, None, None, None, None, None, None, '2808713') ('3318', '22802746', '1357031706', None, None, None, None, None, '2808713') ('3318', None, None, None, None, None, None, None, '2808713') ('3318', '22802746', '1357031705', None, None, None, None, None, '2808713') ('3318', None, None, None, None, None, None, None, '2808713') ('3318', '22802746', '1357031704', None, None, None, None, None, '2808713') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.01285243034362793 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.8345587253570557 time spend to save output : 0.013042449951171875 total time spend for step 10 : 1.8476011753082275 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 11 set_done_treatment 163.52user 142.25system 6:14.16elapsed 81%CPU (0avgtext+0avgdata 5192476maxresident)k 845712inputs+102280outputs (9886major+14327994minor)pagefaults 0swaps