python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1979084 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3465384'] with mtr_portfolio_ids : ['25743472'] and first list_photo_ids : [] new path : /proc/1979084/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 23 ; length of list_pids : 23 ; length of list_args : 23 time to download the photos : 3.381192922592163 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Wed Aug 6 21:10:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10957 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-08-06 21:10:33.648725: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-08-06 21:10:33.675305: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493035000 Hz 2025-08-06 21:10:33.677398: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f31b0000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-08-06 21:10:33.677449: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-08-06 21:10:33.681289: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-08-06 21:10:33.801278: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x27c0e9e0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-08-06 21:10:33.801337: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-08-06 21:10:33.802850: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-06 21:10:33.803269: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-06 21:10:33.806141: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-06 21:10:33.808777: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-06 21:10:33.809366: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-06 21:10:33.812521: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-06 21:10:33.813614: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-06 21:10:33.817506: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-06 21:10:33.818992: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-06 21:10:33.819058: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-06 21:10:33.819837: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-06 21:10:33.819853: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-06 21:10:33.819862: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-06 21:10:33.821216: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10011 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-08-06 21:10:34.080062: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-06 21:10:34.080176: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-06 21:10:34.080205: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-06 21:10:34.080232: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-06 21:10:34.080257: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-06 21:10:34.080282: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-06 21:10:34.080307: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-06 21:10:34.080332: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-06 21:10:34.082317: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-06 21:10:34.083908: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-06 21:10:34.083956: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-06 21:10:34.083983: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-06 21:10:34.084007: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-06 21:10:34.084031: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-06 21:10:34.084055: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-06 21:10:34.084079: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-06 21:10:34.084106: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-06 21:10:34.086057: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-06 21:10:34.086092: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-06 21:10:34.086105: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-06 21:10:34.086117: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-06 21:10:34.088154: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10011 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-08-06 21:10:43.720351: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-06 21:10:43.919943: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 23 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 37.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 22.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 33.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 31.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 32.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 36.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 19.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 35.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 12 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 34.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 37.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 31.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 31.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 Detection mask done ! Trying to reset tf kernel 1979847 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 695 tf kernel not reseted sub process len(results) : 23 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 23 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5984 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.00028896331787109375 nb_pixel_total : 10674 time to create 1 rle with old method : 0.013436555862426758 length of segment : 126 time for calcul the mask position with numpy : 0.00014543533325195312 nb_pixel_total : 6405 time to create 1 rle with old method : 0.007816314697265625 length of segment : 123 time for calcul the mask position with numpy : 0.09747648239135742 nb_pixel_total : 1548035 time to create 1 rle with new method : 0.24867510795593262 length of segment : 990 time for calcul the mask position with numpy : 0.00017333030700683594 nb_pixel_total : 8287 time to create 1 rle with old method : 0.009617328643798828 length of segment : 91 time for calcul the mask position with numpy : 8.749961853027344e-05 nb_pixel_total : 2727 time to create 1 rle with old method : 0.0034284591674804688 length of segment : 51 time for calcul the mask position with numpy : 0.0005879402160644531 nb_pixel_total : 37884 time to create 1 rle with old method : 0.0434117317199707 length of segment : 215 time for calcul the mask position with numpy : 0.000118255615234375 nb_pixel_total : 4459 time to create 1 rle with old method : 0.005524873733520508 length of segment : 66 time for calcul the mask position with numpy : 0.00013399124145507812 nb_pixel_total : 7066 time to create 1 rle with old method : 0.008253812789916992 length of segment : 128 time for calcul the mask position with numpy : 0.00023055076599121094 nb_pixel_total : 7963 time to create 1 rle with old method : 0.009618282318115234 length of segment : 89 time for calcul the mask position with numpy : 0.0019087791442871094 nb_pixel_total : 110608 time to create 1 rle with old method : 0.12395858764648438 length of segment : 578 time for calcul the mask position with numpy : 0.00011420249938964844 nb_pixel_total : 2317 time to create 1 rle with old method : 0.0028731822967529297 length of segment : 56 time for calcul the mask position with numpy : 0.00023746490478515625 nb_pixel_total : 10878 time to create 1 rle with old method : 0.012653827667236328 length of segment : 129 time for calcul the mask position with numpy : 0.00054168701171875 nb_pixel_total : 29954 time to create 1 rle with old method : 0.03481006622314453 length of segment : 180 time for calcul the mask position with numpy : 0.0016989707946777344 nb_pixel_total : 90919 time to create 1 rle with old method : 0.10229277610778809 length of segment : 459 time for calcul the mask position with numpy : 0.0001468658447265625 nb_pixel_total : 6080 time to create 1 rle with old method : 0.007149934768676758 length of segment : 125 time for calcul the mask position with numpy : 0.00015115737915039062 nb_pixel_total : 7072 time to create 1 rle with old method : 0.008480310440063477 length of segment : 114 time for calcul the mask position with numpy : 0.00031280517578125 nb_pixel_total : 17722 time to create 1 rle with old method : 0.020616769790649414 length of segment : 202 time for calcul the mask position with numpy : 0.00012826919555664062 nb_pixel_total : 4804 time to create 1 rle with old method : 0.005866289138793945 length of segment : 71 time for calcul the mask position with numpy : 0.0015952587127685547 nb_pixel_total : 106295 time to create 1 rle with old method : 0.11958789825439453 length of segment : 492 time for calcul the mask position with numpy : 0.00015091896057128906 nb_pixel_total : 8380 time to create 1 rle with old method : 0.009974479675292969 length of segment : 88 time for calcul the mask position with numpy : 0.01055765151977539 nb_pixel_total : 761525 time to create 1 rle with new method : 0.2251284122467041 length of segment : 997 time for calcul the mask position with numpy : 0.0006315708160400391 nb_pixel_total : 18666 time to create 1 rle with old method : 0.021430015563964844 length of segment : 204 time for calcul the mask position with numpy : 0.00022530555725097656 nb_pixel_total : 5056 time to create 1 rle with old method : 0.006085634231567383 length of segment : 83 time for calcul the mask position with numpy : 0.00015401840209960938 nb_pixel_total : 2280 time to create 1 rle with old method : 0.0027251243591308594 length of segment : 67 time for calcul the mask position with numpy : 0.0003535747528076172 nb_pixel_total : 12077 time to create 1 rle with old method : 0.014441251754760742 length of segment : 107 time for calcul the mask position with numpy : 0.0002524852752685547 nb_pixel_total : 7609 time to create 1 rle with old method : 0.009491682052612305 length of segment : 135 time for calcul the mask position with numpy : 0.0003447532653808594 nb_pixel_total : 12705 time to create 1 rle with old method : 0.01496124267578125 length of segment : 147 time for calcul the mask position with numpy : 0.00013947486877441406 nb_pixel_total : 2011 time to create 1 rle with old method : 0.0025594234466552734 length of segment : 42 time for calcul the mask position with numpy : 0.019126176834106445 nb_pixel_total : 1080695 time to create 1 rle with new method : 0.06440567970275879 length of segment : 1953 time for calcul the mask position with numpy : 0.0013816356658935547 nb_pixel_total : 85512 time to create 1 rle with old method : 0.0904533863067627 length of segment : 465 time for calcul the mask position with numpy : 0.00011992454528808594 nb_pixel_total : 3186 time to create 1 rle with old method : 0.0037512779235839844 length of segment : 60 time for calcul the mask position with numpy : 0.0021407604217529297 nb_pixel_total : 102260 time to create 1 rle with old method : 0.10933184623718262 length of segment : 518 time for calcul the mask position with numpy : 0.014678239822387695 nb_pixel_total : 771188 time to create 1 rle with new method : 0.02399420738220215 length of segment : 990 time for calcul the mask position with numpy : 8.702278137207031e-05 nb_pixel_total : 2533 time to create 1 rle with old method : 0.0054931640625 length of segment : 52 time for calcul the mask position with numpy : 0.0002620220184326172 nb_pixel_total : 16124 time to create 1 rle with old method : 0.017872333526611328 length of segment : 117 time for calcul the mask position with numpy : 0.0026209354400634766 nb_pixel_total : 111676 time to create 1 rle with old method : 0.11688232421875 length of segment : 551 time for calcul the mask position with numpy : 0.00046324729919433594 nb_pixel_total : 11655 time to create 1 rle with old method : 0.012712240219116211 length of segment : 175 time for calcul the mask position with numpy : 0.000461578369140625 nb_pixel_total : 12954 time to create 1 rle with old method : 0.0145416259765625 length of segment : 142 time for calcul the mask position with numpy : 0.002293825149536133 nb_pixel_total : 79742 time to create 1 rle with old method : 0.0872957706451416 length of segment : 567 time for calcul the mask position with numpy : 0.00029540061950683594 nb_pixel_total : 7966 time to create 1 rle with old method : 0.008636474609375 length of segment : 137 time for calcul the mask position with numpy : 0.000244140625 nb_pixel_total : 7021 time to create 1 rle with old method : 0.008034467697143555 length of segment : 81 time for calcul the mask position with numpy : 0.00044846534729003906 nb_pixel_total : 11164 time to create 1 rle with old method : 0.0120697021484375 length of segment : 138 time for calcul the mask position with numpy : 0.00015354156494140625 nb_pixel_total : 4479 time to create 1 rle with old method : 0.005012989044189453 length of segment : 87 time for calcul the mask position with numpy : 0.0023682117462158203 nb_pixel_total : 91325 time to create 1 rle with old method : 0.09772849082946777 length of segment : 511 time for calcul the mask position with numpy : 0.0002238750457763672 nb_pixel_total : 5689 time to create 1 rle with old method : 0.006410121917724609 length of segment : 67 time for calcul the mask position with numpy : 0.0009560585021972656 nb_pixel_total : 21360 time to create 1 rle with old method : 0.022899389266967773 length of segment : 239 time for calcul the mask position with numpy : 0.0002532005310058594 nb_pixel_total : 5196 time to create 1 rle with old method : 0.005826711654663086 length of segment : 113 time for calcul the mask position with numpy : 0.00017189979553222656 nb_pixel_total : 4741 time to create 1 rle with old method : 0.0054628849029541016 length of segment : 51 time for calcul the mask position with numpy : 0.0020041465759277344 nb_pixel_total : 90249 time to create 1 rle with old method : 0.09670114517211914 length of segment : 459 time for calcul the mask position with numpy : 0.021646738052368164 nb_pixel_total : 976919 time to create 1 rle with new method : 0.031207561492919922 length of segment : 1796 time for calcul the mask position with numpy : 0.00023436546325683594 nb_pixel_total : 4041 time to create 1 rle with old method : 0.004816293716430664 length of segment : 57 time for calcul the mask position with numpy : 0.003135204315185547 nb_pixel_total : 92024 time to create 1 rle with old method : 0.09626340866088867 length of segment : 474 time for calcul the mask position with numpy : 0.00026917457580566406 nb_pixel_total : 9647 time to create 1 rle with old method : 0.010544538497924805 length of segment : 102 time for calcul the mask position with numpy : 0.00241851806640625 nb_pixel_total : 91947 time to create 1 rle with old method : 0.09739279747009277 length of segment : 449 time for calcul the mask position with numpy : 0.00024127960205078125 nb_pixel_total : 4864 time to create 1 rle with old method : 0.00537109375 length of segment : 88 time for calcul the mask position with numpy : 0.0001926422119140625 nb_pixel_total : 4404 time to create 1 rle with old method : 0.004865407943725586 length of segment : 83 time for calcul the mask position with numpy : 0.0009629726409912109 nb_pixel_total : 32630 time to create 1 rle with old method : 0.0344233512878418 length of segment : 334 time for calcul the mask position with numpy : 0.00022029876708984375 nb_pixel_total : 4670 time to create 1 rle with old method : 0.00517725944519043 length of segment : 73 time for calcul the mask position with numpy : 0.00023889541625976562 nb_pixel_total : 4247 time to create 1 rle with old method : 0.004625797271728516 length of segment : 94 time for calcul the mask position with numpy : 0.0003859996795654297 nb_pixel_total : 13074 time to create 1 rle with old method : 0.014417409896850586 length of segment : 94 time for calcul the mask position with numpy : 0.00038695335388183594 nb_pixel_total : 6956 time to create 1 rle with old method : 0.007529020309448242 length of segment : 150 time for calcul the mask position with numpy : 0.0003426074981689453 nb_pixel_total : 8980 time to create 1 rle with old method : 0.012682437896728516 length of segment : 101 time for calcul the mask position with numpy : 0.000453948974609375 nb_pixel_total : 10435 time to create 1 rle with old method : 0.011472225189208984 length of segment : 119 time for calcul the mask position with numpy : 0.0003814697265625 nb_pixel_total : 9628 time to create 1 rle with old method : 0.010429859161376953 length of segment : 135 time for calcul the mask position with numpy : 0.0004851818084716797 nb_pixel_total : 17862 time to create 1 rle with old method : 0.019487857818603516 length of segment : 106 time for calcul the mask position with numpy : 0.0003743171691894531 nb_pixel_total : 8691 time to create 1 rle with old method : 0.009707927703857422 length of segment : 132 time for calcul the mask position with numpy : 0.0026216506958007812 nb_pixel_total : 85868 time to create 1 rle with old method : 0.09051799774169922 length of segment : 480 time for calcul the mask position with numpy : 0.027204036712646484 nb_pixel_total : 767508 time to create 1 rle with new method : 0.044942617416381836 length of segment : 1008 time for calcul the mask position with numpy : 0.00018215179443359375 nb_pixel_total : 3049 time to create 1 rle with old method : 0.00360870361328125 length of segment : 39 time for calcul the mask position with numpy : 0.0004200935363769531 nb_pixel_total : 10318 time to create 1 rle with old method : 0.011406660079956055 length of segment : 129 time for calcul the mask position with numpy : 0.00022554397583007812 nb_pixel_total : 3878 time to create 1 rle with old method : 0.004517316818237305 length of segment : 73 time spent for convertir_results : 5.444374322891235 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 71 chid ids of type : 3594 Number RLEs to save : 19744 save missing photos in datou_result : time spend for datou_step_exec : 34.227928161621094 time spend to save output : 1.1241931915283203 total time spend for step 1 : 35.352121353149414 step2:crop_condition Wed Aug 6 21:11:06 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 23 ! batch 1 Loaded 71 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 19 About to insert : list_path_to_insert length 19 new photo from crops ! About to upload 19 photos upload in portfolio : 3736932 init cache_photo without model_param we have 19 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1754507468_1979084 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 19 photos in the portfolio 3736932 time of upload the photos Elapsed time : 5.3268678188323975 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3736932 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1754507474_1979084 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 4 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.4005274772644043 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1754507475_1979084 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.5260009765625 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 35 About to insert : list_path_to_insert length 35 new photo from crops ! About to upload 35 photos upload in portfolio : 3736932 init cache_photo without model_param we have 35 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1754507504_1979084 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 35 photos in the portfolio 3736932 time of upload the photos Elapsed time : 8.405541181564331 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 12 About to insert : list_path_to_insert length 12 new photo from crops ! About to upload 12 photos upload in portfolio : 3736932 init cache_photo without model_param we have 12 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1754507514_1979084 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 12 photos in the portfolio 3736932 time of upload the photos Elapsed time : 3.366755485534668 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1375497799, 1375497798, 1375497796, 1375497795, 1375497792, 1375497774, 1375497772, 1375497768, 1375497763, 1375497760, 1375497757, 1375497746, 1375497745, 1375497743, 1375497741, 1375497740, 1375497733, 1375497708, 1375497707, 1375497705, 1375497704, 1375497701, 1375497698] Looping around the photos to save general results len do output : 71 /1375520310Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375520311Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375520312Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375520313Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375520314Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375520315Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375520316Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375520317Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375520318Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375520319Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375520320Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375520321Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375520322Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375520323Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375520324Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375520325Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375520326Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375520327Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375520328Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375520329Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375520330Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375520331Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375520332Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375520333Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375520354Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375520355Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375520356Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375520357Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375520358Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375520359Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375520360Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375520361Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375520362Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375520363Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375520364Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375520365Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375520366Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375520367Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375520368Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375520369Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375520370Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375520371Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375520372Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375520373Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375520374Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375520375Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375520376Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375520377Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375520378Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375520379Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375520380Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375520381Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375520382Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375520383Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375520384Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375520385Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375520386Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375520387Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375520388Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375520392Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375520394Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375520395Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375520396Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375520397Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375520398Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375520399Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375520400Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375520401Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375520402Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375520403Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1375520404Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497799', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497798', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497796', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497795', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497792', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497774', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497772', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497768', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497763', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497760', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497757', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497746', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497745', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497743', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497741', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497740', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497733', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497708', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497707', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497705', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497704', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497701', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497698', None, None, None, None, None, '3465384') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 236 time used for this insertion : 0.026352405548095703 save_final save missing photos in datou_result : time spend for datou_step_exec : 50.7389817237854 time spend to save output : 0.02918839454650879 total time spend for step 2 : 50.76817011833191 step3:rle_unique_nms_with_priority Wed Aug 6 21:11:57 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 71 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.4215071201324463 time for calcul the mask position with numpy : 0.022191524505615234 nb_pixel_total : 524696 time to create 1 rle with new method : 0.20409679412841797 time for calcul the mask position with numpy : 0.07988333702087402 nb_pixel_total : 1531825 time to create 1 rle with new method : 0.21480536460876465 time for calcul the mask position with numpy : 0.0061304569244384766 nb_pixel_total : 6405 time to create 1 rle with old method : 0.006995201110839844 time for calcul the mask position with numpy : 0.006036281585693359 nb_pixel_total : 10674 time to create 1 rle with old method : 0.011635303497314453 create new chi : 0.5680017471313477 time to delete rle : 0.024884700775146484 batch 1 Loaded 9 chid ids of type : 3594 +++++Number RLEs to save : 3557 TO DO : save crop sub photo not yet done ! save time : 0.23486542701721191 nb_obj : 4 nb_hashtags : 4 time to prepare the origin masks : 0.22518348693847656 time for calcul the mask position with numpy : 0.07422876358032227 nb_pixel_total : 2016228 time to create 1 rle with new method : 0.22083711624145508 time for calcul the mask position with numpy : 0.006041288375854492 nb_pixel_total : 7963 time to create 1 rle with old method : 0.008705615997314453 time for calcul the mask position with numpy : 0.005791187286376953 nb_pixel_total : 7066 time to create 1 rle with old method : 0.007788181304931641 time for calcul the mask position with numpy : 0.005831003189086914 nb_pixel_total : 4459 time to create 1 rle with old method : 0.0048296451568603516 time for calcul the mask position with numpy : 0.0061838626861572266 nb_pixel_total : 37884 time to create 1 rle with old method : 0.041558265686035156 create new chi : 0.39114832878112793 time to delete rle : 0.000301361083984375 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 2076 TO DO : save crop sub photo not yet done ! save time : 0.1602489948272705 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.06258702278137207 time for calcul the mask position with numpy : 0.022987842559814453 nb_pixel_total : 1949797 time to create 1 rle with new method : 0.1108548641204834 time for calcul the mask position with numpy : 0.0064334869384765625 nb_pixel_total : 10878 time to create 1 rle with old method : 0.011700868606567383 time for calcul the mask position with numpy : 0.006641864776611328 nb_pixel_total : 2317 time to create 1 rle with old method : 0.0026967525482177734 time for calcul the mask position with numpy : 0.006923675537109375 nb_pixel_total : 110608 time to create 1 rle with old method : 0.12604761123657227 create new chi : 0.3036465644836426 time to delete rle : 0.000400543212890625 batch 1 Loaded 7 chid ids of type : 3594 ++++Number RLEs to save : 2606 TO DO : save crop sub photo not yet done ! save time : 0.18372344970703125 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.26436591148376465 time for calcul the mask position with numpy : 0.15419244766235352 nb_pixel_total : 1946647 time to create 1 rle with new method : 0.09818220138549805 time for calcul the mask position with numpy : 0.005942583084106445 nb_pixel_total : 6080 time to create 1 rle with old method : 0.00658726692199707 time for calcul the mask position with numpy : 0.0061185359954833984 nb_pixel_total : 90919 time to create 1 rle with old method : 0.09935808181762695 time for calcul the mask position with numpy : 0.0062448978424072266 nb_pixel_total : 29954 time to create 1 rle with old method : 0.03374052047729492 create new chi : 0.42042064666748047 time to delete rle : 0.0005047321319580078 batch 1 Loaded 7 chid ids of type : 3594 ++++++Number RLEs to save : 2608 TO DO : save crop sub photo not yet done ! save time : 0.1840076446533203 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03175163269042969 time for calcul the mask position with numpy : 0.018316268920898438 nb_pixel_total : 2066528 time to create 1 rle with new method : 0.0866861343383789 time for calcul the mask position with numpy : 0.005978107452392578 nb_pixel_total : 7072 time to create 1 rle with old method : 0.007603645324707031 create new chi : 0.1255042552947998 time to delete rle : 0.00021147727966308594 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1308 TO DO : save crop sub photo not yet done ! save time : 0.10951685905456543 nb_obj : 6 nb_hashtags : 3 time to prepare the origin masks : 0.6085495948791504 time for calcul the mask position with numpy : 0.0675051212310791 nb_pixel_total : 1156208 time to create 1 rle with new method : 0.43097496032714844 time for calcul the mask position with numpy : 0.0063440799713134766 nb_pixel_total : 18666 time to create 1 rle with old method : 0.020652055740356445 time for calcul the mask position with numpy : 0.011331796646118164 nb_pixel_total : 761525 time to create 1 rle with new method : 0.5208704471588135 time for calcul the mask position with numpy : 0.006052255630493164 nb_pixel_total : 8380 time to create 1 rle with old method : 0.008965492248535156 time for calcul the mask position with numpy : 0.006796360015869141 nb_pixel_total : 106295 time to create 1 rle with old method : 0.11542916297912598 time for calcul the mask position with numpy : 0.0059528350830078125 nb_pixel_total : 4804 time to create 1 rle with old method : 0.00509190559387207 time for calcul the mask position with numpy : 0.0061914920806884766 nb_pixel_total : 17722 time to create 1 rle with old method : 0.019021034240722656 create new chi : 1.2420494556427002 time to delete rle : 0.0008437633514404297 batch 1 Loaded 13 chid ids of type : 3594 ++++++Number RLEs to save : 5188 TO DO : save crop sub photo not yet done ! save time : 0.3155369758605957 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.06824493408203125 time for calcul the mask position with numpy : 0.01884174346923828 nb_pixel_total : 2046578 time to create 1 rle with new method : 0.03001260757446289 time for calcul the mask position with numpy : 0.006129741668701172 nb_pixel_total : 7609 time to create 1 rle with old method : 0.008617639541625977 time for calcul the mask position with numpy : 0.0063631534576416016 nb_pixel_total : 12077 time to create 1 rle with old method : 0.01356959342956543 time for calcul the mask position with numpy : 0.006246328353881836 nb_pixel_total : 2280 time to create 1 rle with old method : 0.0026154518127441406 time for calcul the mask position with numpy : 0.0059032440185546875 nb_pixel_total : 5056 time to create 1 rle with old method : 0.005683422088623047 create new chi : 0.11136460304260254 time to delete rle : 0.0002987384796142578 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 1864 TO DO : save crop sub photo not yet done ! save time : 0.13853716850280762 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.07828068733215332 time for calcul the mask position with numpy : 0.012990474700927734 nb_pixel_total : 901220 time to create 1 rle with new method : 0.10369873046875 time for calcul the mask position with numpy : 0.006936788558959961 nb_pixel_total : 85512 time to create 1 rle with old method : 0.0944511890411377 time for calcul the mask position with numpy : 0.15418148040771484 nb_pixel_total : 1072152 time to create 1 rle with new method : 0.0872805118560791 time for calcul the mask position with numpy : 0.0060269832611083984 nb_pixel_total : 2011 time to create 1 rle with old method : 0.0021865367889404297 time for calcul the mask position with numpy : 0.0058629512786865234 nb_pixel_total : 12705 time to create 1 rle with old method : 0.013983488082885742 create new chi : 0.5031967163085938 time to delete rle : 0.0008442401885986328 batch 1 Loaded 10 chid ids of type : 3594 +++++++++Number RLEs to save : 6257 TO DO : save crop sub photo not yet done ! save time : 0.3716895580291748 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.061009883880615234 time for calcul the mask position with numpy : 0.04906868934631348 nb_pixel_total : 1181495 time to create 1 rle with new method : 0.5863535404205322 time for calcul the mask position with numpy : 0.00630950927734375 nb_pixel_total : 16124 time to create 1 rle with old method : 0.01793956756591797 time for calcul the mask position with numpy : 0.010033130645751953 nb_pixel_total : 2533 time to create 1 rle with old method : 0.0027632713317871094 time for calcul the mask position with numpy : 0.01622915267944336 nb_pixel_total : 771188 time to create 1 rle with new method : 0.4217817783355713 time for calcul the mask position with numpy : 0.010973453521728516 nb_pixel_total : 102260 time to create 1 rle with old method : 0.11183643341064453 create new chi : 1.250692367553711 time to delete rle : 0.0011661052703857422 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 4434 TO DO : save crop sub photo not yet done ! save time : 0.2871994972229004 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.09093880653381348 time for calcul the mask position with numpy : 0.03013014793395996 nb_pixel_total : 1950269 time to create 1 rle with new method : 0.09957504272460938 time for calcul the mask position with numpy : 0.00619959831237793 nb_pixel_total : 11655 time to create 1 rle with old method : 0.012685775756835938 time for calcul the mask position with numpy : 0.006882190704345703 nb_pixel_total : 111676 time to create 1 rle with old method : 0.11753535270690918 create new chi : 0.2734389305114746 time to delete rle : 0.0003781318664550781 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2532 TO DO : save crop sub photo not yet done ! save time : 0.17400431632995605 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.055542707443237305 time for calcul the mask position with numpy : 0.17073869705200195 nb_pixel_total : 1972938 time to create 1 rle with new method : 0.3482229709625244 time for calcul the mask position with numpy : 0.0099945068359375 nb_pixel_total : 7966 time to create 1 rle with old method : 0.009846925735473633 time for calcul the mask position with numpy : 0.010650396347045898 nb_pixel_total : 79742 time to create 1 rle with old method : 0.0865023136138916 time for calcul the mask position with numpy : 0.009843111038208008 nb_pixel_total : 12954 time to create 1 rle with old method : 0.01393747329711914 create new chi : 0.6692888736724854 time to delete rle : 0.0003516674041748047 batch 1 Loaded 7 chid ids of type : 3594 +++++++Number RLEs to save : 2772 TO DO : save crop sub photo not yet done ! save time : 0.18848943710327148 nb_obj : 5 nb_hashtags : 2 time to prepare the origin masks : 0.1573953628540039 time for calcul the mask position with numpy : 0.2642638683319092 nb_pixel_total : 1953922 time to create 1 rle with new method : 0.11235594749450684 time for calcul the mask position with numpy : 0.006014823913574219 nb_pixel_total : 5689 time to create 1 rle with old method : 0.006272554397583008 time for calcul the mask position with numpy : 0.01071476936340332 nb_pixel_total : 91325 time to create 1 rle with old method : 0.1030886173248291 time for calcul the mask position with numpy : 0.01001429557800293 nb_pixel_total : 4479 time to create 1 rle with old method : 0.0047762393951416016 time for calcul the mask position with numpy : 0.009915590286254883 nb_pixel_total : 11164 time to create 1 rle with old method : 0.012327909469604492 time for calcul the mask position with numpy : 0.00985574722290039 nb_pixel_total : 7021 time to create 1 rle with old method : 0.007581949234008789 create new chi : 0.5677471160888672 time to delete rle : 0.0005543231964111328 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 2848 TO DO : save crop sub photo not yet done ! save time : 0.1913607120513916 nb_obj : 3 nb_hashtags : 3 time to prepare the origin masks : 0.05101323127746582 time for calcul the mask position with numpy : 0.22066330909729004 nb_pixel_total : 2042303 time to create 1 rle with new method : 0.2770514488220215 time for calcul the mask position with numpy : 0.006264686584472656 nb_pixel_total : 4741 time to create 1 rle with old method : 0.005453348159790039 time for calcul the mask position with numpy : 0.005774974822998047 nb_pixel_total : 5196 time to create 1 rle with old method : 0.0059397220611572266 time for calcul the mask position with numpy : 0.006218910217285156 nb_pixel_total : 21360 time to create 1 rle with old method : 0.023786306381225586 create new chi : 0.560896635055542 time to delete rle : 0.00029850006103515625 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1886 TO DO : save crop sub photo not yet done ! save time : 0.1455087661743164 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.06919288635253906 time for calcul the mask position with numpy : 0.013998746871948242 nb_pixel_total : 1006432 time to create 1 rle with new method : 0.09873294830322266 time for calcul the mask position with numpy : 0.012433290481567383 nb_pixel_total : 976919 time to create 1 rle with new method : 0.02845001220703125 time for calcul the mask position with numpy : 0.0062787532806396484 nb_pixel_total : 90249 time to create 1 rle with old method : 0.09732913970947266 create new chi : 0.2581601142883301 time to delete rle : 0.0008499622344970703 batch 1 Loaded 5 chid ids of type : 3594 ++++Number RLEs to save : 5590 TO DO : save crop sub photo not yet done ! save time : 0.33593130111694336 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.30031585693359375 time for calcul the mask position with numpy : 0.07434606552124023 nb_pixel_total : 1967888 time to create 1 rle with new method : 0.22110605239868164 time for calcul the mask position with numpy : 0.0058078765869140625 nb_pixel_total : 9647 time to create 1 rle with old method : 0.01037454605102539 time for calcul the mask position with numpy : 0.0062944889068603516 nb_pixel_total : 92024 time to create 1 rle with old method : 0.09676599502563477 time for calcul the mask position with numpy : 0.005860805511474609 nb_pixel_total : 4041 time to create 1 rle with old method : 0.004378080368041992 create new chi : 0.4346325397491455 time to delete rle : 0.00038909912109375 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2346 TO DO : save crop sub photo not yet done ! save time : 0.16462087631225586 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 0.27168750762939453 time for calcul the mask position with numpy : 0.20364952087402344 nb_pixel_total : 1935085 time to create 1 rle with new method : 0.10242867469787598 time for calcul the mask position with numpy : 0.0058171749114990234 nb_pixel_total : 4670 time to create 1 rle with old method : 0.0050885677337646484 time for calcul the mask position with numpy : 0.005806922912597656 nb_pixel_total : 32630 time to create 1 rle with old method : 0.03455352783203125 time for calcul the mask position with numpy : 0.005985260009765625 nb_pixel_total : 4404 time to create 1 rle with old method : 0.004839658737182617 time for calcul the mask position with numpy : 0.009672880172729492 nb_pixel_total : 4864 time to create 1 rle with old method : 0.005170345306396484 time for calcul the mask position with numpy : 0.009946823120117188 nb_pixel_total : 91947 time to create 1 rle with old method : 0.09743165969848633 create new chi : 0.5010523796081543 time to delete rle : 0.0004830360412597656 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 3134 TO DO : save crop sub photo not yet done ! save time : 0.21144700050354004 No data in photo_id : 1375497733 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.05764484405517578 time for calcul the mask position with numpy : 0.021898746490478516 nb_pixel_total : 2056279 time to create 1 rle with new method : 0.13059163093566895 time for calcul the mask position with numpy : 0.006302356719970703 nb_pixel_total : 13074 time to create 1 rle with old method : 0.014192342758178711 time for calcul the mask position with numpy : 0.0059893131256103516 nb_pixel_total : 4247 time to create 1 rle with old method : 0.0046367645263671875 create new chi : 0.18388962745666504 time to delete rle : 0.0002799034118652344 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1456 TO DO : save crop sub photo not yet done ! save time : 0.1152191162109375 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.05026412010192871 time for calcul the mask position with numpy : 0.019305706024169922 nb_pixel_total : 2057664 time to create 1 rle with new method : 0.09947085380554199 time for calcul the mask position with numpy : 0.006149768829345703 nb_pixel_total : 8980 time to create 1 rle with old method : 0.009994745254516602 time for calcul the mask position with numpy : 0.006340503692626953 nb_pixel_total : 6956 time to create 1 rle with old method : 0.00766301155090332 create new chi : 0.1557168960571289 time to delete rle : 0.0002655982971191406 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1582 TO DO : save crop sub photo not yet done ! save time : 0.1325533390045166 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.5308830738067627 time for calcul the mask position with numpy : 0.328916072845459 nb_pixel_total : 2035675 time to create 1 rle with new method : 0.10302066802978516 time for calcul the mask position with numpy : 0.006214618682861328 nb_pixel_total : 17862 time to create 1 rle with old method : 0.018906831741333008 time for calcul the mask position with numpy : 0.005944728851318359 nb_pixel_total : 9628 time to create 1 rle with old method : 0.010103225708007812 time for calcul the mask position with numpy : 0.006259441375732422 nb_pixel_total : 10435 time to create 1 rle with old method : 0.011358022689819336 create new chi : 0.5010719299316406 time to delete rle : 0.0003142356872558594 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1800 TO DO : save crop sub photo not yet done ! save time : 0.1404876708984375 nb_obj : 3 nb_hashtags : 1 time to prepare the origin masks : 0.06130814552307129 time for calcul the mask position with numpy : 0.015145540237426758 nb_pixel_total : 1219200 time to create 1 rle with new method : 0.18548893928527832 time for calcul the mask position with numpy : 0.01647043228149414 nb_pixel_total : 759841 time to create 1 rle with new method : 0.3187847137451172 time for calcul the mask position with numpy : 0.011194229125976562 nb_pixel_total : 85868 time to create 1 rle with old method : 0.09099054336547852 time for calcul the mask position with numpy : 0.010122537612915039 nb_pixel_total : 8691 time to create 1 rle with old method : 0.009209871292114258 create new chi : 0.6739721298217773 time to delete rle : 0.0007812976837158203 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 4308 TO DO : save crop sub photo not yet done ! save time : 0.2717249393463135 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.07561230659484863 time for calcul the mask position with numpy : 0.02865290641784668 nb_pixel_total : 2070551 time to create 1 rle with new method : 0.09958624839782715 time for calcul the mask position with numpy : 0.005867958068847656 nb_pixel_total : 3049 time to create 1 rle with old method : 0.003190755844116211 create new chi : 0.1480119228363037 time to delete rle : 0.0002689361572265625 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1158 TO DO : save crop sub photo not yet done ! save time : 0.10308051109313965 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.29769086837768555 time for calcul the mask position with numpy : 0.1741626262664795 nb_pixel_total : 2059404 time to create 1 rle with new method : 0.29731202125549316 time for calcul the mask position with numpy : 0.007360696792602539 nb_pixel_total : 3878 time to create 1 rle with old method : 0.004240751266479492 time for calcul the mask position with numpy : 0.006435871124267578 nb_pixel_total : 10318 time to create 1 rle with old method : 0.011222600936889648 create new chi : 0.5104873180389404 time to delete rle : 0.0002818107604980469 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1484 TO DO : save crop sub photo not yet done ! save time : 0.11798715591430664 map_output_result : {1375497799: (0.0, 'Should be the crop_list due to order', 0), 1375497798: (0.0, 'Should be the crop_list due to order', 0), 1375497796: (0.0, 'Should be the crop_list due to order', 0), 1375497795: (0.0, 'Should be the crop_list due to order', 0), 1375497792: (0.0, 'Should be the crop_list due to order', 0), 1375497774: (0.0, 'Should be the crop_list due to order', 0), 1375497772: (0.0, 'Should be the crop_list due to order', 0), 1375497768: (0.0, 'Should be the crop_list due to order', 0), 1375497763: (0.0, 'Should be the crop_list due to order', 0), 1375497760: (0.0, 'Should be the crop_list due to order', 0), 1375497757: (0.0, 'Should be the crop_list due to order', 0), 1375497746: (0.0, 'Should be the crop_list due to order', 0), 1375497745: (0.0, 'Should be the crop_list due to order', 0), 1375497743: (0.0, 'Should be the crop_list due to order', 0), 1375497741: (0.0, 'Should be the crop_list due to order', 0), 1375497740: (0.0, 'Should be the crop_list due to order', 0), 1375497733: (0.0, 'Should be the crop_list due to order', 0.0), 1375497708: (0.0, 'Should be the crop_list due to order', 0), 1375497707: (0.0, 'Should be the crop_list due to order', 0), 1375497705: (0.0, 'Should be the crop_list due to order', 0), 1375497704: (0.0, 'Should be the crop_list due to order', 0), 1375497701: (0.0, 'Should be the crop_list due to order', 0), 1375497698: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1375497799, 1375497798, 1375497796, 1375497795, 1375497792, 1375497774, 1375497772, 1375497768, 1375497763, 1375497760, 1375497757, 1375497746, 1375497745, 1375497743, 1375497741, 1375497740, 1375497733, 1375497708, 1375497707, 1375497705, 1375497704, 1375497701, 1375497698] Looping around the photos to save general results len do output : 23 /1375497799.Didn't retrieve data . /1375497798.Didn't retrieve data . /1375497796.Didn't retrieve data . /1375497795.Didn't retrieve data . /1375497792.Didn't retrieve data . /1375497774.Didn't retrieve data . /1375497772.Didn't retrieve data . /1375497768.Didn't retrieve data . /1375497763.Didn't retrieve data . /1375497760.Didn't retrieve data . /1375497757.Didn't retrieve data . /1375497746.Didn't retrieve data . /1375497745.Didn't retrieve data . /1375497743.Didn't retrieve data . /1375497741.Didn't retrieve data . /1375497740.Didn't retrieve data . /1375497733.Didn't retrieve data . /1375497708.Didn't retrieve data . /1375497707.Didn't retrieve data . /1375497705.Didn't retrieve data . /1375497704.Didn't retrieve data . /1375497701.Didn't retrieve data . /1375497698.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497799', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497798', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497796', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497795', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497792', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497774', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497772', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497768', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497763', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497760', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497757', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497746', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497745', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497743', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497741', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497740', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497733', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497708', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497707', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497705', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497704', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497701', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497698', None, None, None, None, None, '3465384') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 69 time used for this insertion : 0.015840768814086914 save_final save missing photos in datou_result : time spend for datou_step_exec : 19.27965235710144 time spend to save output : 0.01660752296447754 total time spend for step 3 : 19.296259880065918 step4:ventilate_hashtags_in_portfolio Wed Aug 6 21:12:16 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 25743472 get user id for portfolio 25743472 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25743472 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','background','carton','flou','autre','papier','pehd','pet_clair','metal','mal_croppe','environnement')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25743472 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','background','carton','flou','autre','papier','pehd','pet_clair','metal','mal_croppe','environnement')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25743472 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','background','carton','flou','autre','papier','pehd','pet_clair','metal','mal_croppe','environnement')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/25744731,25744732,25744733,25744734,25744735,25744736,25744737,25744738,25744739,25744740,25744741?tags=pet_fonce,background,carton,flou,autre,papier,pehd,pet_clair,metal,mal_croppe,environnement Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1375497799, 1375497798, 1375497796, 1375497795, 1375497792, 1375497774, 1375497772, 1375497768, 1375497763, 1375497760, 1375497757, 1375497746, 1375497745, 1375497743, 1375497741, 1375497740, 1375497733, 1375497708, 1375497707, 1375497705, 1375497704, 1375497701, 1375497698] Looping around the photos to save general results len do output : 1 /25743472. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497799', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497798', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497796', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497795', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497792', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497774', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497772', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497768', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497763', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497760', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497757', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497746', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497745', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497743', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497741', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497740', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497733', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497708', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497707', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497705', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497704', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497701', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497698', None, None, None, None, None, '3465384') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.016123056411743164 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.7457914352416992 time spend to save output : 0.016551494598388672 total time spend for step 4 : 1.762342929840088 step5:final Wed Aug 6 21:12:18 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1375497799: ('0.15730242300724648',), 1375497798: ('0.15730242300724648',), 1375497796: ('0.15730242300724648',), 1375497795: ('0.15730242300724648',), 1375497792: ('0.15730242300724648',), 1375497774: ('0.15730242300724648',), 1375497772: ('0.15730242300724648',), 1375497768: ('0.15730242300724648',), 1375497763: ('0.15730242300724648',), 1375497760: ('0.15730242300724648',), 1375497757: ('0.15730242300724648',), 1375497746: ('0.15730242300724648',), 1375497745: ('0.15730242300724648',), 1375497743: ('0.15730242300724648',), 1375497741: ('0.15730242300724648',), 1375497740: ('0.15730242300724648',), 1375497733: ('0.15730242300724648',), 1375497708: ('0.15730242300724648',), 1375497707: ('0.15730242300724648',), 1375497705: ('0.15730242300724648',), 1375497704: ('0.15730242300724648',), 1375497701: ('0.15730242300724648',), 1375497698: ('0.15730242300724648',)} new output for save of step final : {1375497799: ('0.15730242300724648',), 1375497798: ('0.15730242300724648',), 1375497796: ('0.15730242300724648',), 1375497795: ('0.15730242300724648',), 1375497792: ('0.15730242300724648',), 1375497774: ('0.15730242300724648',), 1375497772: ('0.15730242300724648',), 1375497768: ('0.15730242300724648',), 1375497763: ('0.15730242300724648',), 1375497760: ('0.15730242300724648',), 1375497757: ('0.15730242300724648',), 1375497746: ('0.15730242300724648',), 1375497745: ('0.15730242300724648',), 1375497743: ('0.15730242300724648',), 1375497741: ('0.15730242300724648',), 1375497740: ('0.15730242300724648',), 1375497733: ('0.15730242300724648',), 1375497708: ('0.15730242300724648',), 1375497707: ('0.15730242300724648',), 1375497705: ('0.15730242300724648',), 1375497704: ('0.15730242300724648',), 1375497701: ('0.15730242300724648',), 1375497698: ('0.15730242300724648',)} [1375497799, 1375497798, 1375497796, 1375497795, 1375497792, 1375497774, 1375497772, 1375497768, 1375497763, 1375497760, 1375497757, 1375497746, 1375497745, 1375497743, 1375497741, 1375497740, 1375497733, 1375497708, 1375497707, 1375497705, 1375497704, 1375497701, 1375497698] Looping around the photos to save general results len do output : 23 /1375497799.Didn't retrieve data . /1375497798.Didn't retrieve data . /1375497796.Didn't retrieve data . /1375497795.Didn't retrieve data . /1375497792.Didn't retrieve data . /1375497774.Didn't retrieve data . /1375497772.Didn't retrieve data . /1375497768.Didn't retrieve data . /1375497763.Didn't retrieve data . /1375497760.Didn't retrieve data . /1375497757.Didn't retrieve data . /1375497746.Didn't retrieve data . /1375497745.Didn't retrieve data . /1375497743.Didn't retrieve data . /1375497741.Didn't retrieve data . /1375497740.Didn't retrieve data . /1375497733.Didn't retrieve data . /1375497708.Didn't retrieve data . /1375497707.Didn't retrieve data . /1375497705.Didn't retrieve data . /1375497704.Didn't retrieve data . /1375497701.Didn't retrieve data . /1375497698.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497799', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497798', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497796', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497795', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497792', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497774', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497772', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497768', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497763', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497760', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497757', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497746', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497745', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497743', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497741', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497740', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497733', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497708', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497707', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497705', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497704', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497701', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497698', None, None, None, None, None, '3465384') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 69 time used for this insertion : 0.014893054962158203 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11624264717102051 time spend to save output : 0.016013383865356445 total time spend for step 5 : 0.13225603103637695 step6:blur_detection Wed Aug 6 21:12:18 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1754507427_1979084_1375497799_a69bb316f1156f8159315a4b79d9fc4c.jpg resize: (1080, 1920) 1375497799 -1.5242269779692497 treat image : temp/1754507427_1979084_1375497798_064a70cb72afddcd00c37e32fe904bee.jpg resize: (1080, 1920) 1375497798 -0.43634609837094684 treat image : temp/1754507427_1979084_1375497796_c7c75a3aa7b887ca687bbccb3171234b.jpg resize: (1080, 1920) 1375497796 -4.4076091761206335 treat image : temp/1754507427_1979084_1375497795_0f23d7742cda852ee0df2906e0e95fe4.jpg resize: (1080, 1920) 1375497795 -2.518283742964456 treat image : temp/1754507427_1979084_1375497792_e2fc08199116ad5f1274fc3cf5925383.jpg resize: (1080, 1920) 1375497792 -1.216407910561166 treat image : temp/1754507427_1979084_1375497774_96bf086c3407c801a6d2fa1ef6904c37.jpg resize: (1080, 1920) 1375497774 -1.7889155092933786 treat image : temp/1754507427_1979084_1375497772_e0c28dabf9a02cdd8478e6063b9cfbf3.jpg resize: (1080, 1920) 1375497772 -2.2115252639949983 treat image : temp/1754507427_1979084_1375497768_3ed9323cbd95bbca8d86954b17b2e24e.jpg resize: (1080, 1920) 1375497768 -1.677183197298804 treat image : temp/1754507427_1979084_1375497763_1efcf2bd32b9ed1aec14b36d06715a05.jpg resize: (1080, 1920) 1375497763 0.912416478235774 treat image : temp/1754507427_1979084_1375497760_2064b00adee282975e3d89f6b592b4b8.jpg resize: (1080, 1920) 1375497760 -2.075926191642724 treat image : temp/1754507427_1979084_1375497757_42283be108acec4bbab50fb602878b21.jpg resize: (1080, 1920) 1375497757 0.6993974482575419 treat image : temp/1754507427_1979084_1375497746_c3a9c38b2402dd69bcd30a4e6972f80b.jpg resize: (1080, 1920) 1375497746 -1.556102135096409 treat image : temp/1754507427_1979084_1375497745_43068b5c5f278d05a43c67296b2e4a7b.jpg resize: (1080, 1920) 1375497745 -2.1123163067533994 treat image : temp/1754507427_1979084_1375497743_3fd62c58f40d05d0d79f14350c7b445b.jpg resize: (1080, 1920) 1375497743 -1.816944683722796 treat image : temp/1754507427_1979084_1375497741_e12ce6156b7c1760c500869afaa35bdc.jpg resize: (1080, 1920) 1375497741 -0.41425847191704995 treat image : temp/1754507427_1979084_1375497740_e323ebf8c43fee1a487d4369394bc498.jpg resize: (1080, 1920) 1375497740 -1.891138680787437 treat image : temp/1754507427_1979084_1375497733_23a11610220366a403805f42d01c04d0.jpg resize: (1080, 1920) 1375497733 -1.087780248191521 treat image : temp/1754507427_1979084_1375497708_960c56cf4f814240b2af2de01f11557f.jpg resize: (1080, 1920) 1375497708 -2.557175362465788 treat image : temp/1754507427_1979084_1375497707_b37996749ea9b691aad06217d1f6245c.jpg resize: (1080, 1920) 1375497707 -1.68709405448119 treat image : temp/1754507427_1979084_1375497705_d2e631260a34a0603c4240c9128f03cc.jpg resize: (1080, 1920) 1375497705 -1.033110105547988 treat image : temp/1754507427_1979084_1375497704_3453d8e27f9f819d5edf7afa80b3072d.jpg resize: (1080, 1920) 1375497704 -2.1471962630638766 treat image : temp/1754507427_1979084_1375497701_016e686734e375bf6ae9624b214f7d8f.jpg resize: (1080, 1920) 1375497701 -2.4885322790088322 treat image : temp/1754507427_1979084_1375497698_27df74f3c8ab877dc0823ba9a270b5ec.jpg resize: (1080, 1920) 1375497698 -1.5863097041685668 treat image : temp/1754507427_1979084_1375497799_a69bb316f1156f8159315a4b79d9fc4c_rle_crop_3905039220_0.png resize: (42, 80) 1375520310 2.9051909041746606 treat image : temp/1754507427_1979084_1375497798_064a70cb72afddcd00c37e32fe904bee_rle_crop_3905039222_0.png resize: (63, 128) 1375520311 -0.3134274490988461 treat image : temp/1754507427_1979084_1375497795_0f23d7742cda852ee0df2906e0e95fe4_rle_crop_3905039230_0.png resize: (125, 64) 1375520312 0.13660730761358386 treat image : temp/1754507427_1979084_1375497772_e0c28dabf9a02cdd8478e6063b9cfbf3_rle_crop_3905039238_0.png resize: (83, 101) 1375520313 -2.2661612916265086 treat image : temp/1754507427_1979084_1375497772_e0c28dabf9a02cdd8478e6063b9cfbf3_rle_crop_3905039239_0.png resize: (65, 50) 1375520314 -2.213613675144941 treat image : temp/1754507427_1979084_1375497772_e0c28dabf9a02cdd8478e6063b9cfbf3_rle_crop_3905039241_0.png resize: (135, 68) 1375520315 0.7182419502351568 treat image : temp/1754507427_1979084_1375497768_3ed9323cbd95bbca8d86954b17b2e24e_rle_crop_3905039246_0.png resize: (51, 98) 1375520316 -1.528315954757814 treat image : temp/1754507427_1979084_1375497763_1efcf2bd32b9ed1aec14b36d06715a05_rle_crop_3905039249_0.png resize: (52, 68) 1375520317 0.8422527791798108 treat image : temp/1754507427_1979084_1375497763_1efcf2bd32b9ed1aec14b36d06715a05_rle_crop_3905039250_0.png resize: (116, 171) 1375520318 -1.1872092914258534 treat image : temp/1754507427_1979084_1375497757_42283be108acec4bbab50fb602878b21_rle_crop_3905039253_0.png resize: (142, 162) 1375520319 -1.651094389290798 treat image : temp/1754507427_1979084_1375497746_c3a9c38b2402dd69bcd30a4e6972f80b_rle_crop_3905039256_0.png resize: (81, 127) 1375520320 1.5829733027804123 treat image : temp/1754507427_1979084_1375497745_43068b5c5f278d05a43c67296b2e4a7b_rle_crop_3905039263_0.png resize: (51, 116) 1375520321 0.9540511630216645 treat image : temp/1754507427_1979084_1375497741_e12ce6156b7c1760c500869afaa35bdc_rle_crop_3905039266_0.png resize: (56, 116) 1375520322 -0.6297044818626766 treat image : temp/1754507427_1979084_1375497741_e12ce6156b7c1760c500869afaa35bdc_rle_crop_3905039268_0.png resize: (101, 132) 1375520323 -0.543369116533037 treat image : temp/1754507427_1979084_1375497740_e323ebf8c43fee1a487d4369394bc498_rle_crop_3905039270_0.png resize: (88, 98) 1375520324 -1.9971549556651462 treat image : temp/1754507427_1979084_1375497708_960c56cf4f814240b2af2de01f11557f_rle_crop_3905039274_0.png resize: (94, 56) 1375520325 -0.15449430764390115 treat image : temp/1754507427_1979084_1375497705_d2e631260a34a0603c4240c9128f03cc_rle_crop_3905039278_0.png resize: (119, 156) 1375520326 -1.3271445823242833 treat image : temp/1754507427_1979084_1375497705_d2e631260a34a0603c4240c9128f03cc_rle_crop_3905039280_0.png resize: (106, 205) 1375520327 1.9604061178093615 treat image : temp/1754507427_1979084_1375497698_27df74f3c8ab877dc0823ba9a270b5ec_rle_crop_3905039286_0.png resize: (71, 96) 1375520328 -0.5253461228156878 treat image : temp/1754507427_1979084_1375497798_064a70cb72afddcd00c37e32fe904bee_rle_crop_3905039224_0.png resize: (81, 137) 1375520329 -1.241646170811111 treat image : temp/1754507427_1979084_1375497774_96bf086c3407c801a6d2fa1ef6904c37_rle_crop_3905039233_0.png resize: (71, 106) 1375520330 -1.782137089366005 treat image : temp/1754507427_1979084_1375497708_960c56cf4f814240b2af2de01f11557f_rle_crop_3905039275_0.png resize: (91, 211) 1375520331 -1.6359331503605394 treat image : temp/1754507427_1979084_1375497701_016e686734e375bf6ae9624b214f7d8f_rle_crop_3905039284_0.png resize: (39, 106) 1375520332 -0.24778410886244662 treat image : temp/1754507427_1979084_1375497799_a69bb316f1156f8159315a4b79d9fc4c_rle_crop_3905039219_0.png resize: (89, 125) 1375520333 -3.4041881046110385 treat image : temp/1754507427_1979084_1375497799_a69bb316f1156f8159315a4b79d9fc4c_rle_crop_3905039217_0.png resize: (123, 66) 1375520354 -3.394377955086775 treat image : temp/1754507427_1979084_1375497799_a69bb316f1156f8159315a4b79d9fc4c_rle_crop_3905039218_0.png resize: (957, 1706) 1375520355 -1.5606820426694796 treat image : temp/1754507427_1979084_1375497798_064a70cb72afddcd00c37e32fe904bee_rle_crop_3905039221_0.png resize: (210, 240) 1375520356 -0.9669726384097319 treat image : temp/1754507427_1979084_1375497796_c7c75a3aa7b887ca687bbccb3171234b_rle_crop_3905039225_0.png resize: (528, 349) 1375520357 -0.30963992901661286 treat image : temp/1754507427_1979084_1375497795_0f23d7742cda852ee0df2906e0e95fe4_rle_crop_3905039228_0.png resize: (142, 298) 1375520358 -3.3026340363409896 treat image : temp/1754507427_1979084_1375497795_0f23d7742cda852ee0df2906e0e95fe4_rle_crop_3905039229_0.png resize: (431, 356) 1375520359 -0.578323327535627 treat image : temp/1754507427_1979084_1375497774_96bf086c3407c801a6d2fa1ef6904c37_rle_crop_3905039232_0.png resize: (201, 120) 1375520360 -2.4144805968831746 treat image : temp/1754507427_1979084_1375497774_96bf086c3407c801a6d2fa1ef6904c37_rle_crop_3905039234_0.png resize: (488, 380) 1375520361 0.5189434708351296 treat image : temp/1754507427_1979084_1375497774_96bf086c3407c801a6d2fa1ef6904c37_rle_crop_3905039236_0.png resize: (992, 1076) 1375520362 0.3510477835490995 treat image : temp/1754507427_1979084_1375497774_96bf086c3407c801a6d2fa1ef6904c37_rle_crop_3905039237_0.png resize: (180, 180) 1375520363 -0.6816849108316311 treat image : temp/1754507427_1979084_1375497772_e0c28dabf9a02cdd8478e6063b9cfbf3_rle_crop_3905039240_0.png resize: (106, 185) 1375520364 -2.942928163381301 treat image : temp/1754507427_1979084_1375497768_3ed9323cbd95bbca8d86954b17b2e24e_rle_crop_3905039242_0.png resize: (147, 101) 1375520365 -2.376925307046497 treat image : temp/1754507427_1979084_1375497768_3ed9323cbd95bbca8d86954b17b2e24e_rle_crop_3905039244_0.png resize: (1007, 1285) 1375520366 -2.125074869968726 treat image : temp/1754507427_1979084_1375497768_3ed9323cbd95bbca8d86954b17b2e24e_rle_crop_3905039245_0.png resize: (449, 318) 1375520367 -0.3838432696611882 treat image : temp/1754507427_1979084_1375497763_1efcf2bd32b9ed1aec14b36d06715a05_rle_crop_3905039247_0.png resize: (501, 356) 1375520368 -0.3493667519382999 treat image : temp/1754507427_1979084_1375497763_1efcf2bd32b9ed1aec14b36d06715a05_rle_crop_3905039248_0.png resize: (986, 1072) 1375520369 1.2019693975545591 treat image : temp/1754507427_1979084_1375497760_2064b00adee282975e3d89f6b592b4b8_rle_crop_3905039251_0.png resize: (528, 349) 1375520370 -0.5214229086715318 treat image : temp/1754507427_1979084_1375497760_2064b00adee282975e3d89f6b592b4b8_rle_crop_3905039252_0.png resize: (175, 90) 1375520371 -1.7711959707899538 treat image : temp/1754507427_1979084_1375497757_42283be108acec4bbab50fb602878b21_rle_crop_3905039254_0.png resize: (484, 344) 1375520372 -0.9748652474692935 treat image : temp/1754507427_1979084_1375497757_42283be108acec4bbab50fb602878b21_rle_crop_3905039255_0.png resize: (114, 81) 1375520373 -1.8262134385488258 treat image : temp/1754507427_1979084_1375497746_c3a9c38b2402dd69bcd30a4e6972f80b_rle_crop_3905039257_0.png resize: (138, 115) 1375520374 -1.0355567658207385 treat image : temp/1754507427_1979084_1375497746_c3a9c38b2402dd69bcd30a4e6972f80b_rle_crop_3905039258_0.png resize: (87, 65) 1375520375 -1.374868663755952 treat image : temp/1754507427_1979084_1375497746_c3a9c38b2402dd69bcd30a4e6972f80b_rle_crop_3905039259_0.png resize: (500, 334) 1375520376 -0.43450727883754675 treat image : temp/1754507427_1979084_1375497746_c3a9c38b2402dd69bcd30a4e6972f80b_rle_crop_3905039260_0.png resize: (61, 131) 1375520377 -2.854942919596248 treat image : temp/1754507427_1979084_1375497745_43068b5c5f278d05a43c67296b2e4a7b_rle_crop_3905039261_0.png resize: (239, 130) 1375520378 -0.19252142685135273 treat image : temp/1754507427_1979084_1375497743_3fd62c58f40d05d0d79f14350c7b445b_rle_crop_3905039264_0.png resize: (456, 337) 1375520379 -0.19305452315174376 treat image : temp/1754507427_1979084_1375497743_3fd62c58f40d05d0d79f14350c7b445b_rle_crop_3905039265_0.png resize: (1004, 1272) 1375520380 -1.767043145505057 treat image : temp/1754507427_1979084_1375497741_e12ce6156b7c1760c500869afaa35bdc_rle_crop_3905039267_0.png resize: (472, 323) 1375520381 -0.10795800993401862 treat image : temp/1754507427_1979084_1375497740_e323ebf8c43fee1a487d4369394bc498_rle_crop_3905039269_0.png resize: (442, 344) 1375520382 -0.34784820984683 treat image : temp/1754507427_1979084_1375497740_e323ebf8c43fee1a487d4369394bc498_rle_crop_3905039272_0.png resize: (305, 144) 1375520383 -1.2491556074279995 treat image : temp/1754507427_1979084_1375497707_b37996749ea9b691aad06217d1f6245c_rle_crop_3905039276_0.png resize: (150, 62) 1375520384 -3.3068702396584153 treat image : temp/1754507427_1979084_1375497707_b37996749ea9b691aad06217d1f6245c_rle_crop_3905039277_0.png resize: (101, 133) 1375520385 -1.2473022811426369 treat image : temp/1754507427_1979084_1375497704_3453d8e27f9f819d5edf7afa80b3072d_rle_crop_3905039281_0.png resize: (131, 91) 1375520386 -2.535177633136541 treat image : temp/1754507427_1979084_1375497704_3453d8e27f9f819d5edf7afa80b3072d_rle_crop_3905039282_0.png resize: (457, 311) 1375520387 -0.6052846087085421 treat image : temp/1754507427_1979084_1375497704_3453d8e27f9f819d5edf7afa80b3072d_rle_crop_3905039283_0.png resize: (1002, 1100) 1375520388 -0.3463560504252328 treat image : temp/1754507427_1979084_1375497799_a69bb316f1156f8159315a4b79d9fc4c_rle_crop_3905039216_0.png resize: (126, 123) 1375520392 -2.338110075569803 treat image : temp/1754507427_1979084_1375497798_064a70cb72afddcd00c37e32fe904bee_rle_crop_3905039223_0.png resize: (121, 73) 1375520394 -0.08122449812893809 treat image : temp/1754507427_1979084_1375497796_c7c75a3aa7b887ca687bbccb3171234b_rle_crop_3905039226_0.png resize: (55, 67) 1375520395 -4.954054260869666 treat image : temp/1754507427_1979084_1375497796_c7c75a3aa7b887ca687bbccb3171234b_rle_crop_3905039227_0.png resize: (129, 117) 1375520396 -3.4463685662181596 treat image : temp/1754507427_1979084_1375497792_e2fc08199116ad5f1274fc3cf5925383_rle_crop_3905039231_0.png resize: (97, 115) 1375520397 -2.983532856456816 treat image : temp/1754507427_1979084_1375497774_96bf086c3407c801a6d2fa1ef6904c37_rle_crop_3905039235_0.png resize: (87, 118) 1375520398 -1.2675219037140344 treat image : temp/1754507427_1979084_1375497768_3ed9323cbd95bbca8d86954b17b2e24e_rle_crop_3905039243_0.png resize: (42, 60) 1375520399 0.6670687708693639 treat image : temp/1754507427_1979084_1375497745_43068b5c5f278d05a43c67296b2e4a7b_rle_crop_3905039262_0.png resize: (113, 71) 1375520400 -1.323166698127098 treat image : temp/1754507427_1979084_1375497740_e323ebf8c43fee1a487d4369394bc498_rle_crop_3905039271_0.png resize: (83, 67) 1375520401 -2.3340325170443212 treat image : temp/1754507427_1979084_1375497740_e323ebf8c43fee1a487d4369394bc498_rle_crop_3905039273_0.png resize: (73, 90) 1375520402 -0.7938337950158283 treat image : temp/1754507427_1979084_1375497705_d2e631260a34a0603c4240c9128f03cc_rle_crop_3905039279_0.png resize: (135, 84) 1375520403 -0.9010598329709993 treat image : temp/1754507427_1979084_1375497698_27df74f3c8ab877dc0823ba9a270b5ec_rle_crop_3905039285_0.png resize: (126, 113) 1375520404 -2.1537967387449575 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 94 time used for this insertion : 0.016203880310058594 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 94 time used for this insertion : 0.016306638717651367 save missing photos in datou_result : time spend for datou_step_exec : 21.859455108642578 time spend to save output : 0.03780651092529297 total time spend for step 6 : 21.89726161956787 step7:brightness Wed Aug 6 21:12:40 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1754507427_1979084_1375497799_a69bb316f1156f8159315a4b79d9fc4c.jpg treat image : temp/1754507427_1979084_1375497798_064a70cb72afddcd00c37e32fe904bee.jpg treat image : temp/1754507427_1979084_1375497796_c7c75a3aa7b887ca687bbccb3171234b.jpg treat image : temp/1754507427_1979084_1375497795_0f23d7742cda852ee0df2906e0e95fe4.jpg treat image : temp/1754507427_1979084_1375497792_e2fc08199116ad5f1274fc3cf5925383.jpg treat image : temp/1754507427_1979084_1375497774_96bf086c3407c801a6d2fa1ef6904c37.jpg treat image : temp/1754507427_1979084_1375497772_e0c28dabf9a02cdd8478e6063b9cfbf3.jpg treat image : temp/1754507427_1979084_1375497768_3ed9323cbd95bbca8d86954b17b2e24e.jpg treat image : temp/1754507427_1979084_1375497763_1efcf2bd32b9ed1aec14b36d06715a05.jpg treat image : temp/1754507427_1979084_1375497760_2064b00adee282975e3d89f6b592b4b8.jpg treat image : temp/1754507427_1979084_1375497757_42283be108acec4bbab50fb602878b21.jpg treat image : temp/1754507427_1979084_1375497746_c3a9c38b2402dd69bcd30a4e6972f80b.jpg treat image : temp/1754507427_1979084_1375497745_43068b5c5f278d05a43c67296b2e4a7b.jpg treat image : temp/1754507427_1979084_1375497743_3fd62c58f40d05d0d79f14350c7b445b.jpg treat image : temp/1754507427_1979084_1375497741_e12ce6156b7c1760c500869afaa35bdc.jpg treat image : temp/1754507427_1979084_1375497740_e323ebf8c43fee1a487d4369394bc498.jpg treat image : temp/1754507427_1979084_1375497733_23a11610220366a403805f42d01c04d0.jpg treat image : temp/1754507427_1979084_1375497708_960c56cf4f814240b2af2de01f11557f.jpg treat image : temp/1754507427_1979084_1375497707_b37996749ea9b691aad06217d1f6245c.jpg treat image : temp/1754507427_1979084_1375497705_d2e631260a34a0603c4240c9128f03cc.jpg treat image : temp/1754507427_1979084_1375497704_3453d8e27f9f819d5edf7afa80b3072d.jpg treat image : temp/1754507427_1979084_1375497701_016e686734e375bf6ae9624b214f7d8f.jpg treat image : temp/1754507427_1979084_1375497698_27df74f3c8ab877dc0823ba9a270b5ec.jpg treat image : temp/1754507427_1979084_1375497799_a69bb316f1156f8159315a4b79d9fc4c_rle_crop_3905039220_0.png treat image : temp/1754507427_1979084_1375497798_064a70cb72afddcd00c37e32fe904bee_rle_crop_3905039222_0.png treat image : temp/1754507427_1979084_1375497795_0f23d7742cda852ee0df2906e0e95fe4_rle_crop_3905039230_0.png treat image : temp/1754507427_1979084_1375497772_e0c28dabf9a02cdd8478e6063b9cfbf3_rle_crop_3905039238_0.png treat image : temp/1754507427_1979084_1375497772_e0c28dabf9a02cdd8478e6063b9cfbf3_rle_crop_3905039239_0.png treat image : temp/1754507427_1979084_1375497772_e0c28dabf9a02cdd8478e6063b9cfbf3_rle_crop_3905039241_0.png treat image : temp/1754507427_1979084_1375497768_3ed9323cbd95bbca8d86954b17b2e24e_rle_crop_3905039246_0.png treat image : temp/1754507427_1979084_1375497763_1efcf2bd32b9ed1aec14b36d06715a05_rle_crop_3905039249_0.png treat image : temp/1754507427_1979084_1375497763_1efcf2bd32b9ed1aec14b36d06715a05_rle_crop_3905039250_0.png treat image : temp/1754507427_1979084_1375497757_42283be108acec4bbab50fb602878b21_rle_crop_3905039253_0.png treat image : temp/1754507427_1979084_1375497746_c3a9c38b2402dd69bcd30a4e6972f80b_rle_crop_3905039256_0.png treat image : temp/1754507427_1979084_1375497745_43068b5c5f278d05a43c67296b2e4a7b_rle_crop_3905039263_0.png treat image : temp/1754507427_1979084_1375497741_e12ce6156b7c1760c500869afaa35bdc_rle_crop_3905039266_0.png treat image : temp/1754507427_1979084_1375497741_e12ce6156b7c1760c500869afaa35bdc_rle_crop_3905039268_0.png treat image : temp/1754507427_1979084_1375497740_e323ebf8c43fee1a487d4369394bc498_rle_crop_3905039270_0.png treat image : temp/1754507427_1979084_1375497708_960c56cf4f814240b2af2de01f11557f_rle_crop_3905039274_0.png treat image : temp/1754507427_1979084_1375497705_d2e631260a34a0603c4240c9128f03cc_rle_crop_3905039278_0.png treat image : temp/1754507427_1979084_1375497705_d2e631260a34a0603c4240c9128f03cc_rle_crop_3905039280_0.png treat image : temp/1754507427_1979084_1375497698_27df74f3c8ab877dc0823ba9a270b5ec_rle_crop_3905039286_0.png treat image : temp/1754507427_1979084_1375497798_064a70cb72afddcd00c37e32fe904bee_rle_crop_3905039224_0.png treat image : temp/1754507427_1979084_1375497774_96bf086c3407c801a6d2fa1ef6904c37_rle_crop_3905039233_0.png treat image : temp/1754507427_1979084_1375497708_960c56cf4f814240b2af2de01f11557f_rle_crop_3905039275_0.png treat image : temp/1754507427_1979084_1375497701_016e686734e375bf6ae9624b214f7d8f_rle_crop_3905039284_0.png treat image : temp/1754507427_1979084_1375497799_a69bb316f1156f8159315a4b79d9fc4c_rle_crop_3905039219_0.png treat image : temp/1754507427_1979084_1375497799_a69bb316f1156f8159315a4b79d9fc4c_rle_crop_3905039217_0.png treat image : temp/1754507427_1979084_1375497799_a69bb316f1156f8159315a4b79d9fc4c_rle_crop_3905039218_0.png treat image : temp/1754507427_1979084_1375497798_064a70cb72afddcd00c37e32fe904bee_rle_crop_3905039221_0.png treat image : temp/1754507427_1979084_1375497796_c7c75a3aa7b887ca687bbccb3171234b_rle_crop_3905039225_0.png treat image : temp/1754507427_1979084_1375497795_0f23d7742cda852ee0df2906e0e95fe4_rle_crop_3905039228_0.png treat image : temp/1754507427_1979084_1375497795_0f23d7742cda852ee0df2906e0e95fe4_rle_crop_3905039229_0.png treat image : temp/1754507427_1979084_1375497774_96bf086c3407c801a6d2fa1ef6904c37_rle_crop_3905039232_0.png treat image : temp/1754507427_1979084_1375497774_96bf086c3407c801a6d2fa1ef6904c37_rle_crop_3905039234_0.png treat image : temp/1754507427_1979084_1375497774_96bf086c3407c801a6d2fa1ef6904c37_rle_crop_3905039236_0.png treat image : temp/1754507427_1979084_1375497774_96bf086c3407c801a6d2fa1ef6904c37_rle_crop_3905039237_0.png treat image : temp/1754507427_1979084_1375497772_e0c28dabf9a02cdd8478e6063b9cfbf3_rle_crop_3905039240_0.png treat image : temp/1754507427_1979084_1375497768_3ed9323cbd95bbca8d86954b17b2e24e_rle_crop_3905039242_0.png treat image : temp/1754507427_1979084_1375497768_3ed9323cbd95bbca8d86954b17b2e24e_rle_crop_3905039244_0.png treat image : temp/1754507427_1979084_1375497768_3ed9323cbd95bbca8d86954b17b2e24e_rle_crop_3905039245_0.png treat image : temp/1754507427_1979084_1375497763_1efcf2bd32b9ed1aec14b36d06715a05_rle_crop_3905039247_0.png treat image : temp/1754507427_1979084_1375497763_1efcf2bd32b9ed1aec14b36d06715a05_rle_crop_3905039248_0.png treat image : temp/1754507427_1979084_1375497760_2064b00adee282975e3d89f6b592b4b8_rle_crop_3905039251_0.png treat image : temp/1754507427_1979084_1375497760_2064b00adee282975e3d89f6b592b4b8_rle_crop_3905039252_0.png treat image : temp/1754507427_1979084_1375497757_42283be108acec4bbab50fb602878b21_rle_crop_3905039254_0.png treat image : temp/1754507427_1979084_1375497757_42283be108acec4bbab50fb602878b21_rle_crop_3905039255_0.png treat image : temp/1754507427_1979084_1375497746_c3a9c38b2402dd69bcd30a4e6972f80b_rle_crop_3905039257_0.png treat image : temp/1754507427_1979084_1375497746_c3a9c38b2402dd69bcd30a4e6972f80b_rle_crop_3905039258_0.png treat image : temp/1754507427_1979084_1375497746_c3a9c38b2402dd69bcd30a4e6972f80b_rle_crop_3905039259_0.png treat image : temp/1754507427_1979084_1375497746_c3a9c38b2402dd69bcd30a4e6972f80b_rle_crop_3905039260_0.png treat image : temp/1754507427_1979084_1375497745_43068b5c5f278d05a43c67296b2e4a7b_rle_crop_3905039261_0.png treat image : temp/1754507427_1979084_1375497743_3fd62c58f40d05d0d79f14350c7b445b_rle_crop_3905039264_0.png treat image : temp/1754507427_1979084_1375497743_3fd62c58f40d05d0d79f14350c7b445b_rle_crop_3905039265_0.png treat image : temp/1754507427_1979084_1375497741_e12ce6156b7c1760c500869afaa35bdc_rle_crop_3905039267_0.png treat image : temp/1754507427_1979084_1375497740_e323ebf8c43fee1a487d4369394bc498_rle_crop_3905039269_0.png treat image : temp/1754507427_1979084_1375497740_e323ebf8c43fee1a487d4369394bc498_rle_crop_3905039272_0.png treat image : temp/1754507427_1979084_1375497707_b37996749ea9b691aad06217d1f6245c_rle_crop_3905039276_0.png treat image : temp/1754507427_1979084_1375497707_b37996749ea9b691aad06217d1f6245c_rle_crop_3905039277_0.png treat image : temp/1754507427_1979084_1375497704_3453d8e27f9f819d5edf7afa80b3072d_rle_crop_3905039281_0.png treat image : temp/1754507427_1979084_1375497704_3453d8e27f9f819d5edf7afa80b3072d_rle_crop_3905039282_0.png treat image : temp/1754507427_1979084_1375497704_3453d8e27f9f819d5edf7afa80b3072d_rle_crop_3905039283_0.png treat image : temp/1754507427_1979084_1375497799_a69bb316f1156f8159315a4b79d9fc4c_rle_crop_3905039216_0.png treat image : temp/1754507427_1979084_1375497798_064a70cb72afddcd00c37e32fe904bee_rle_crop_3905039223_0.png treat image : temp/1754507427_1979084_1375497796_c7c75a3aa7b887ca687bbccb3171234b_rle_crop_3905039226_0.png treat image : temp/1754507427_1979084_1375497796_c7c75a3aa7b887ca687bbccb3171234b_rle_crop_3905039227_0.png treat image : temp/1754507427_1979084_1375497792_e2fc08199116ad5f1274fc3cf5925383_rle_crop_3905039231_0.png treat image : temp/1754507427_1979084_1375497774_96bf086c3407c801a6d2fa1ef6904c37_rle_crop_3905039235_0.png treat image : temp/1754507427_1979084_1375497768_3ed9323cbd95bbca8d86954b17b2e24e_rle_crop_3905039243_0.png treat image : temp/1754507427_1979084_1375497745_43068b5c5f278d05a43c67296b2e4a7b_rle_crop_3905039262_0.png treat image : temp/1754507427_1979084_1375497740_e323ebf8c43fee1a487d4369394bc498_rle_crop_3905039271_0.png treat image : temp/1754507427_1979084_1375497740_e323ebf8c43fee1a487d4369394bc498_rle_crop_3905039273_0.png treat image : temp/1754507427_1979084_1375497705_d2e631260a34a0603c4240c9128f03cc_rle_crop_3905039279_0.png treat image : temp/1754507427_1979084_1375497698_27df74f3c8ab877dc0823ba9a270b5ec_rle_crop_3905039285_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 94 time used for this insertion : 0.014877796173095703 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 94 time used for this insertion : 0.01540994644165039 save missing photos in datou_result : time spend for datou_step_exec : 6.107769012451172 time spend to save output : 0.03551030158996582 total time spend for step 7 : 6.143279314041138 step8:velours_tree Wed Aug 6 21:12:46 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.09596800804138184 time spend to save output : 4.696846008300781e-05 total time spend for step 8 : 0.09601497650146484 step9:send_mail_cod Wed Aug 6 21:12:46 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P25743472_06-08-2025_21_12_46.pdf 25744731 imagette257447311754507566 25744732 imagette257447321754507566 25744733 change filename to text .change filename to text .change filename to text .change filename to text .imagette257447331754507566 25744734 imagette257447341754507566 25744735 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette257447351754507566 25744736 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette257447361754507568 25744737 imagette257447371754507569 25744738 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette257447381754507569 25744739 change filename to text .imagette257447391754507571 25744740 imagette257447401754507571 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=25743472 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/25744731,25744732,25744733,25744734,25744735,25744736,25744737,25744738,25744739,25744740,25744741?tags=pet_fonce,background,carton,flou,autre,papier,pehd,pet_clair,metal,mal_croppe,environnement args[1375497799] : ((1375497799, -1.5242269779692497, 492688767), (1375497799, 0.34430788207016383, 2107752395), '0.15730242300724648') We are sending mail with results at report@fotonower.com args[1375497798] : ((1375497798, -0.43634609837094684, 492688767), (1375497798, 0.46500870512629383, 2107752395), '0.15730242300724648') We are sending mail with results at report@fotonower.com args[1375497796] : ((1375497796, -4.4076091761206335, 492609224), (1375497796, 0.4386131741168103, 2107752395), '0.15730242300724648') We are sending mail with results at report@fotonower.com args[1375497795] : ((1375497795, -2.518283742964456, 492609224), (1375497795, 0.3559786203828193, 2107752395), '0.15730242300724648') We are sending mail with results at report@fotonower.com args[1375497792] : ((1375497792, -1.216407910561166, 492688767), (1375497792, 0.38726075617158845, 2107752395), '0.15730242300724648') We are sending mail with results at report@fotonower.com args[1375497774] : ((1375497774, -1.7889155092933786, 492688767), (1375497774, 0.5933219675067243, 2107752395), '0.15730242300724648') We are sending mail with results at report@fotonower.com args[1375497772] : ((1375497772, -2.2115252639949983, 492609224), (1375497772, 0.367655042475722, 2107752395), '0.15730242300724648') We are sending mail with results at report@fotonower.com args[1375497768] : ((1375497768, -1.677183197298804, 492688767), (1375497768, 0.5234447183114748, 2107752395), '0.15730242300724648') We are sending mail with results at report@fotonower.com args[1375497763] : ((1375497763, 0.912416478235774, 492688767), (1375497763, 0.5989122054642041, 2107752395), '0.15730242300724648') We are sending mail with results at report@fotonower.com args[1375497760] : ((1375497760, -2.075926191642724, 492609224), (1375497760, 0.48115735351124594, 2107752395), '0.15730242300724648') We are sending mail with results at report@fotonower.com args[1375497757] : ((1375497757, 0.6993974482575419, 492688767), (1375497757, 0.4506671597082468, 2107752395), '0.15730242300724648') We are sending mail with results at report@fotonower.com args[1375497746] : ((1375497746, -1.556102135096409, 492688767), (1375497746, 0.5223768764883631, 2107752395), '0.15730242300724648') We are sending mail with results at report@fotonower.com args[1375497745] : ((1375497745, -2.1123163067533994, 492609224), (1375497745, 0.40672609550996097, 2107752395), '0.15730242300724648') We are sending mail with results at report@fotonower.com args[1375497743] : ((1375497743, -1.816944683722796, 492688767), (1375497743, 0.3850082012521411, 2107752395), '0.15730242300724648') We are sending mail with results at report@fotonower.com args[1375497741] : ((1375497741, -0.41425847191704995, 492688767), (1375497741, 0.35929145089249487, 2107752395), '0.15730242300724648') We are sending mail with results at report@fotonower.com args[1375497740] : ((1375497740, -1.891138680787437, 492688767), (1375497740, 0.4774823405073424, 2107752395), '0.15730242300724648') We are sending mail with results at report@fotonower.com args[1375497733] : ((1375497733, -1.087780248191521, 492688767), (1375497733, 0.5217525980871534, 2107752395), '0.15730242300724648') We are sending mail with results at report@fotonower.com args[1375497708] : ((1375497708, -2.557175362465788, 492609224), (1375497708, 0.5925144317776574, 2107752395), '0.15730242300724648') We are sending mail with results at report@fotonower.com args[1375497707] : ((1375497707, -1.68709405448119, 492688767), (1375497707, 0.25808785489696145, 2107752395), '0.15730242300724648') We are sending mail with results at report@fotonower.com args[1375497705] : ((1375497705, -1.033110105547988, 492688767), (1375497705, 0.528455654542749, 2107752395), '0.15730242300724648') We are sending mail with results at report@fotonower.com args[1375497704] : ((1375497704, -2.1471962630638766, 492609224), (1375497704, 0.6145508130278636, 2107752395), '0.15730242300724648') We are sending mail with results at report@fotonower.com args[1375497701] : ((1375497701, -2.4885322790088322, 492609224), (1375497701, 0.5579016992214306, 2107752395), '0.15730242300724648') We are sending mail with results at report@fotonower.com args[1375497698] : ((1375497698, -1.5863097041685668, 492688767), (1375497698, 0.44933615590179016, 2107752395), '0.15730242300724648') We are sending mail with results at report@fotonower.com refus_total : 0.15730242300724648 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=25743472 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25743472_06-08-2025_21_12_46.pdf results_Auto_P25743472_06-08-2025_21_12_46.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25743472_06-08-2025_21_12_46.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','25743472','results_Auto_P25743472_06-08-2025_21_12_46.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25743472_06-08-2025_21_12_46.pdf','pdf','','0.6','0.15730242300724648') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/25743472

https://www.fotonower.com/image?json=false&list_photos_id=1375497799
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375497798
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375497796
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375497795
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375497792
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375497774
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375497772
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375497768
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375497763
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375497760
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375497757
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375497746
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375497745
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375497743
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375497741
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375497740
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375497733
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375497708
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375497707
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375497705
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375497704
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375497701
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1375497698
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 15.73%
Veuillez trouver les photos des contaminants.

exemples de contaminants: carton: https://www.fotonower.com/view/25744733?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/25744735?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/25744736?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/25744738?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/25744739?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25743472_06-08-2025_21_12_46.pdf.

Lien vers velours :https://www.fotonower.com/velours/25744731,25744732,25744733,25744734,25744735,25744736,25744737,25744738,25744739,25744740,25744741?tags=pet_fonce,background,carton,flou,autre,papier,pehd,pet_clair,metal,mal_croppe,environnement.


L'équipe Fotonower 202 b'' Server: nginx Date: Wed, 06 Aug 2025 19:12:53 GMT Content-Length: 0 Connection: close X-Message-Id: OjZ-L368TYu8FRck6rjHgQ Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1375497799, 1375497798, 1375497796, 1375497795, 1375497792, 1375497774, 1375497772, 1375497768, 1375497763, 1375497760, 1375497757, 1375497746, 1375497745, 1375497743, 1375497741, 1375497740, 1375497733, 1375497708, 1375497707, 1375497705, 1375497704, 1375497701, 1375497698] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497799', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497798', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497796', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497795', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497792', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497774', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497772', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497768', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497763', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497760', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497757', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497746', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497745', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497743', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497741', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497740', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497733', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497708', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497707', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497705', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497704', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497701', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497698', None, None, None, None, None, '3465384') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 23 time used for this insertion : 0.016029834747314453 save_final save missing photos in datou_result : time spend for datou_step_exec : 7.1079912185668945 time spend to save output : 0.016405820846557617 total time spend for step 9 : 7.124397039413452 step10:split_time_score Wed Aug 6 21:12:53 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('16', 23),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 06082025 25743472 Nombre de photos uploadées : 23 / 23040 (0%) 06082025 25743472 Nombre de photos taguées (types de déchets): 0 / 23 (0%) 06082025 25743472 Nombre de photos taguées (volume) : 0 / 23 (0%) elapsed_time : load_data_split_time_score 1.430511474609375e-06 elapsed_time : order_list_meta_photo_and_scores 5.0067901611328125e-06 ??????????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0010421276092529297 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.197251558303833 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.11844979745370371 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25716934_06-08-2025_08_42_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25716934 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25716934 AND mptpi.`type`=3594 To do Qualite : 0.05851508601125635 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25717830_06-08-2025_09_22_04.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25717830 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25717830 AND mptpi.`type`=3594 To do Qualite : 0.1097653653252612 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25727185_06-08-2025_13_48_17.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25727185 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25727185 AND mptpi.`type`=3594 To do Qualite : 0.037152867083904896 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25727189_06-08-2025_14_07_55.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25727189 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25727189 AND mptpi.`type`=3594 To do Qualite : 0.2675555332977209 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25727191_06-08-2025_14_12_41.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25727191 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25727191 AND mptpi.`type`=3594 To do Qualite : 0.14284234457671954 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25727194_06-08-2025_14_13_18.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25727194 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25727194 AND mptpi.`type`=3594 To do Qualite : 0.12946329615600452 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25727196_06-08-2025_14_01_44.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25727196 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25727196 AND mptpi.`type`=3594 To do Qualite : 0.24456746720679012 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25727198_06-08-2025_13_51_48.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25727198 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25727198 AND mptpi.`type`=3594 To do Qualite : 0.12766646499719417 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25727203_06-08-2025_13_41_45.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25727203 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25727203 AND mptpi.`type`=3594 To do Qualite : 0.11182745341792408 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25727206_06-08-2025_13_33_15.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25727206 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25727206 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25743461 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25743471 order by id desc limit 1 Qualite : 0.15730242300724648 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25743472_06-08-2025_21_12_46.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25743472 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25743472 AND mptpi.`type`=3594 To do Qualite : 0.1279718364197531 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25743476_06-08-2025_21_01_19.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25743476 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25743476 AND mptpi.`type`=3594 To do Qualite : 0.09388955198688272 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P25743483_06-08-2025_20_41_30.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 25743483 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25743483 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'06082025': {'nb_upload': 23, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1375497799, 1375497798, 1375497796, 1375497795, 1375497792, 1375497774, 1375497772, 1375497768, 1375497763, 1375497760, 1375497757, 1375497746, 1375497745, 1375497743, 1375497741, 1375497740, 1375497733, 1375497708, 1375497707, 1375497705, 1375497704, 1375497701, 1375497698] Looping around the photos to save general results len do output : 1 /25743472Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497799', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497798', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497796', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497795', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497792', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497774', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497772', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497768', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497763', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497760', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497757', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497746', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497745', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497743', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497741', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497740', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497733', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497708', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497707', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497705', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497704', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497701', None, None, None, None, None, '3465384') ('3318', None, None, None, None, None, None, None, '3465384') ('3318', '25743472', '1375497698', None, None, None, None, None, '3465384') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.01712942123413086 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.9952259063720703 time spend to save output : 0.017441987991333008 total time spend for step 10 : 3.0126678943634033 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 23 set_done_treatment 88.72user 33.76system 2:31.86elapsed 80%CPU (0avgtext+0avgdata 3086760maxresident)k 35728inputs+53376outputs (186major+2881493minor)pagefaults 0swaps