python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1815683 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2778691'] with mtr_portfolio_ids : ['22582553'] and first list_photo_ids : [] new path : /proc/1815683/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 8 ; length of list_pids : 8 ; length of list_args : 8 time to download the photos : 1.4282782077789307 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Thu May 1 11:00:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 9617 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-01 11:00:34.695576: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-01 11:00:34.727147: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-01 11:00:34.728915: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f13e0000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-01 11:00:34.728966: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-01 11:00:34.733089: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-01 11:00:34.997982: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x23fe4ce0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-01 11:00:34.998041: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-01 11:00:34.999494: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-01 11:00:35.001633: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-01 11:00:35.031672: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-01 11:00:35.049181: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-01 11:00:35.052995: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-01 11:00:35.082147: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-01 11:00:35.086317: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-01 11:00:35.136763: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-01 11:00:35.138218: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-01 11:00:35.138611: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-01 11:00:35.140179: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-01 11:00:35.140198: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-01 11:00:35.140207: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-01 11:00:35.141825: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 8897 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-01 11:00:35.502083: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-01 11:00:35.502205: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-01 11:00:35.502229: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-01 11:00:35.502250: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-01 11:00:35.502271: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-01 11:00:35.502291: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-01 11:00:35.502310: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-01 11:00:35.502331: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-01 11:00:35.504025: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-01 11:00:35.505215: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-01 11:00:35.505250: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-01 11:00:35.505272: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-01 11:00:35.505289: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-01 11:00:35.505305: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-01 11:00:35.505321: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-01 11:00:35.505336: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-01 11:00:35.505352: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-01 11:00:35.506489: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-01 11:00:35.506522: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-01 11:00:35.506531: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-01 11:00:35.506538: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-01 11:00:35.507724: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 8897 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-05-01 11:00:47.710058: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-01 11:00:48.058778: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 8 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 21 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 1.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 22 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 44 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 30 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 44 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 15.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 38 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 21 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 32 Detection mask done ! Trying to reset tf kernel 1816614 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 3135 tf kernel not reseted sub process len(results) : 8 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 8 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 8424 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0005004405975341797 nb_pixel_total : 12659 time to create 1 rle with old method : 0.014622926712036133 length of segment : 210 time for calcul the mask position with numpy : 0.000396728515625 nb_pixel_total : 10795 time to create 1 rle with old method : 0.014235734939575195 length of segment : 127 time for calcul the mask position with numpy : 0.0012106895446777344 nb_pixel_total : 36789 time to create 1 rle with old method : 0.059302568435668945 length of segment : 511 time for calcul the mask position with numpy : 0.0004355907440185547 nb_pixel_total : 26466 time to create 1 rle with old method : 0.03461503982543945 length of segment : 104 time for calcul the mask position with numpy : 0.00017881393432617188 nb_pixel_total : 7310 time to create 1 rle with old method : 0.009062767028808594 length of segment : 129 time for calcul the mask position with numpy : 0.0001811981201171875 nb_pixel_total : 9397 time to create 1 rle with old method : 0.011409282684326172 length of segment : 85 time for calcul the mask position with numpy : 0.00016117095947265625 nb_pixel_total : 5891 time to create 1 rle with old method : 0.007215023040771484 length of segment : 83 time for calcul the mask position with numpy : 0.0054357051849365234 nb_pixel_total : 235809 time to create 1 rle with new method : 0.011298418045043945 length of segment : 559 time for calcul the mask position with numpy : 0.000675201416015625 nb_pixel_total : 17137 time to create 1 rle with old method : 0.021251678466796875 length of segment : 218 time for calcul the mask position with numpy : 0.0006866455078125 nb_pixel_total : 27701 time to create 1 rle with old method : 0.03337287902832031 length of segment : 321 time for calcul the mask position with numpy : 0.0015184879302978516 nb_pixel_total : 95394 time to create 1 rle with old method : 0.1412341594696045 length of segment : 332 time for calcul the mask position with numpy : 0.00043320655822753906 nb_pixel_total : 19067 time to create 1 rle with old method : 0.023352384567260742 length of segment : 170 time for calcul the mask position with numpy : 0.00025844573974609375 nb_pixel_total : 9468 time to create 1 rle with old method : 0.011347055435180664 length of segment : 116 time for calcul the mask position with numpy : 0.0002505779266357422 nb_pixel_total : 12712 time to create 1 rle with old method : 0.014657735824584961 length of segment : 156 time for calcul the mask position with numpy : 0.00031304359436035156 nb_pixel_total : 15549 time to create 1 rle with old method : 0.018435001373291016 length of segment : 121 time for calcul the mask position with numpy : 0.0003695487976074219 nb_pixel_total : 10315 time to create 1 rle with old method : 0.01281285285949707 length of segment : 186 time for calcul the mask position with numpy : 0.00030303001403808594 nb_pixel_total : 13615 time to create 1 rle with old method : 0.015488386154174805 length of segment : 212 time for calcul the mask position with numpy : 0.0003123283386230469 nb_pixel_total : 14451 time to create 1 rle with old method : 0.016788959503173828 length of segment : 191 time for calcul the mask position with numpy : 0.0003268718719482422 nb_pixel_total : 13473 time to create 1 rle with old method : 0.01567816734313965 length of segment : 139 time for calcul the mask position with numpy : 0.0002357959747314453 nb_pixel_total : 11170 time to create 1 rle with old method : 0.01661515235900879 length of segment : 130 time for calcul the mask position with numpy : 0.0017731189727783203 nb_pixel_total : 99000 time to create 1 rle with old method : 0.11415362358093262 length of segment : 381 time for calcul the mask position with numpy : 0.0007729530334472656 nb_pixel_total : 41459 time to create 1 rle with old method : 0.057929039001464844 length of segment : 458 time for calcul the mask position with numpy : 0.0007901191711425781 nb_pixel_total : 29979 time to create 1 rle with old method : 0.04222846031188965 length of segment : 280 time for calcul the mask position with numpy : 0.00024962425231933594 nb_pixel_total : 5734 time to create 1 rle with old method : 0.007150411605834961 length of segment : 127 time for calcul the mask position with numpy : 0.00039267539978027344 nb_pixel_total : 18101 time to create 1 rle with old method : 0.02285003662109375 length of segment : 158 time for calcul the mask position with numpy : 0.0006992816925048828 nb_pixel_total : 27879 time to create 1 rle with old method : 0.05590462684631348 length of segment : 106 time for calcul the mask position with numpy : 0.0006492137908935547 nb_pixel_total : 20032 time to create 1 rle with old method : 0.031230449676513672 length of segment : 246 time for calcul the mask position with numpy : 0.0008492469787597656 nb_pixel_total : 21316 time to create 1 rle with old method : 0.03325772285461426 length of segment : 190 time for calcul the mask position with numpy : 0.0004172325134277344 nb_pixel_total : 9096 time to create 1 rle with old method : 0.01656508445739746 length of segment : 138 time for calcul the mask position with numpy : 0.0055119991302490234 nb_pixel_total : 209824 time to create 1 rle with new method : 0.01707005500793457 length of segment : 516 time for calcul the mask position with numpy : 0.0040166378021240234 nb_pixel_total : 197796 time to create 1 rle with new method : 0.01385188102722168 length of segment : 492 time for calcul the mask position with numpy : 0.003454446792602539 nb_pixel_total : 150350 time to create 1 rle with new method : 0.012551069259643555 length of segment : 435 time for calcul the mask position with numpy : 0.0009500980377197266 nb_pixel_total : 28790 time to create 1 rle with old method : 0.03326916694641113 length of segment : 195 time for calcul the mask position with numpy : 0.0004379749298095703 nb_pixel_total : 22989 time to create 1 rle with old method : 0.02696824073791504 length of segment : 115 time for calcul the mask position with numpy : 0.002260923385620117 nb_pixel_total : 92818 time to create 1 rle with old method : 0.10712862014770508 length of segment : 323 time for calcul the mask position with numpy : 0.0016701221466064453 nb_pixel_total : 64846 time to create 1 rle with old method : 0.0745391845703125 length of segment : 220 time for calcul the mask position with numpy : 0.0009124279022216797 nb_pixel_total : 24478 time to create 1 rle with old method : 0.029185056686401367 length of segment : 164 time for calcul the mask position with numpy : 0.001444101333618164 nb_pixel_total : 52077 time to create 1 rle with old method : 0.060250043869018555 length of segment : 323 time for calcul the mask position with numpy : 0.00043392181396484375 nb_pixel_total : 22922 time to create 1 rle with old method : 0.027279138565063477 length of segment : 135 time for calcul the mask position with numpy : 0.0007526874542236328 nb_pixel_total : 37239 time to create 1 rle with old method : 0.04357504844665527 length of segment : 140 time for calcul the mask position with numpy : 0.0020143985748291016 nb_pixel_total : 103870 time to create 1 rle with old method : 0.11739015579223633 length of segment : 453 time for calcul the mask position with numpy : 0.0006330013275146484 nb_pixel_total : 18221 time to create 1 rle with old method : 0.021300315856933594 length of segment : 215 time for calcul the mask position with numpy : 0.0018773078918457031 nb_pixel_total : 41501 time to create 1 rle with old method : 0.06102705001831055 length of segment : 244 time for calcul the mask position with numpy : 0.0077931880950927734 nb_pixel_total : 162849 time to create 1 rle with new method : 0.015626907348632812 length of segment : 364 time for calcul the mask position with numpy : 0.007698535919189453 nb_pixel_total : 144712 time to create 1 rle with old method : 0.24415254592895508 length of segment : 428 time for calcul the mask position with numpy : 0.0061833858489990234 nb_pixel_total : 102754 time to create 1 rle with old method : 0.17162871360778809 length of segment : 334 time for calcul the mask position with numpy : 0.0010635852813720703 nb_pixel_total : 13787 time to create 1 rle with old method : 0.022161006927490234 length of segment : 255 time for calcul the mask position with numpy : 0.006482839584350586 nb_pixel_total : 93756 time to create 1 rle with old method : 0.12570977210998535 length of segment : 325 time for calcul the mask position with numpy : 0.0007357597351074219 nb_pixel_total : 10582 time to create 1 rle with old method : 0.012523651123046875 length of segment : 125 time for calcul the mask position with numpy : 0.0007023811340332031 nb_pixel_total : 23183 time to create 1 rle with old method : 0.026989459991455078 length of segment : 223 time for calcul the mask position with numpy : 0.004965066909790039 nb_pixel_total : 149476 time to create 1 rle with old method : 0.19291973114013672 length of segment : 698 time for calcul the mask position with numpy : 0.0004448890686035156 nb_pixel_total : 15787 time to create 1 rle with old method : 0.02270197868347168 length of segment : 118 time for calcul the mask position with numpy : 0.005107879638671875 nb_pixel_total : 202473 time to create 1 rle with new method : 0.014061450958251953 length of segment : 516 time for calcul the mask position with numpy : 0.0009021759033203125 nb_pixel_total : 41888 time to create 1 rle with old method : 0.046091318130493164 length of segment : 263 time for calcul the mask position with numpy : 0.0014569759368896484 nb_pixel_total : 67661 time to create 1 rle with old method : 0.07946491241455078 length of segment : 318 time for calcul the mask position with numpy : 0.001712799072265625 nb_pixel_total : 49163 time to create 1 rle with old method : 0.05546855926513672 length of segment : 302 time for calcul the mask position with numpy : 0.004547119140625 nb_pixel_total : 129426 time to create 1 rle with old method : 0.17237067222595215 length of segment : 281 time for calcul the mask position with numpy : 0.001512289047241211 nb_pixel_total : 34720 time to create 1 rle with old method : 0.03902316093444824 length of segment : 343 time for calcul the mask position with numpy : 0.0011239051818847656 nb_pixel_total : 23521 time to create 1 rle with old method : 0.027243375778198242 length of segment : 199 time for calcul the mask position with numpy : 0.00047588348388671875 nb_pixel_total : 10625 time to create 1 rle with old method : 0.012685298919677734 length of segment : 92 time for calcul the mask position with numpy : 0.0017180442810058594 nb_pixel_total : 26747 time to create 1 rle with old method : 0.03138136863708496 length of segment : 306 time for calcul the mask position with numpy : 0.0007927417755126953 nb_pixel_total : 17727 time to create 1 rle with old method : 0.021372556686401367 length of segment : 222 time for calcul the mask position with numpy : 0.0017571449279785156 nb_pixel_total : 40027 time to create 1 rle with old method : 0.045720815658569336 length of segment : 313 time for calcul the mask position with numpy : 0.0012161731719970703 nb_pixel_total : 21544 time to create 1 rle with old method : 0.024346351623535156 length of segment : 219 time for calcul the mask position with numpy : 0.0036699771881103516 nb_pixel_total : 60551 time to create 1 rle with old method : 0.09237074851989746 length of segment : 494 time for calcul the mask position with numpy : 0.004975318908691406 nb_pixel_total : 124212 time to create 1 rle with old method : 0.14903712272644043 length of segment : 412 time for calcul the mask position with numpy : 0.0014107227325439453 nb_pixel_total : 27150 time to create 1 rle with old method : 0.031360626220703125 length of segment : 232 time for calcul the mask position with numpy : 0.0016140937805175781 nb_pixel_total : 18730 time to create 1 rle with old method : 0.030885696411132812 length of segment : 397 time for calcul the mask position with numpy : 0.0039055347442626953 nb_pixel_total : 43886 time to create 1 rle with old method : 0.05029797554016113 length of segment : 214 time for calcul the mask position with numpy : 0.0025014877319335938 nb_pixel_total : 53242 time to create 1 rle with old method : 0.061428070068359375 length of segment : 255 time for calcul the mask position with numpy : 0.0029973983764648438 nb_pixel_total : 55036 time to create 1 rle with old method : 0.0679171085357666 length of segment : 296 time for calcul the mask position with numpy : 0.0021066665649414062 nb_pixel_total : 56772 time to create 1 rle with old method : 0.06650066375732422 length of segment : 213 time for calcul the mask position with numpy : 0.0003142356872558594 nb_pixel_total : 6500 time to create 1 rle with old method : 0.008162498474121094 length of segment : 45 time for calcul the mask position with numpy : 0.0010609626770019531 nb_pixel_total : 22615 time to create 1 rle with old method : 0.0354313850402832 length of segment : 154 time for calcul the mask position with numpy : 0.010083198547363281 nb_pixel_total : 174226 time to create 1 rle with new method : 0.020068645477294922 length of segment : 475 time for calcul the mask position with numpy : 0.0025146007537841797 nb_pixel_total : 37869 time to create 1 rle with old method : 0.060392141342163086 length of segment : 372 time for calcul the mask position with numpy : 0.004879474639892578 nb_pixel_total : 64548 time to create 1 rle with old method : 0.10007214546203613 length of segment : 340 time for calcul the mask position with numpy : 0.0019469261169433594 nb_pixel_total : 31548 time to create 1 rle with old method : 0.036116838455200195 length of segment : 424 time for calcul the mask position with numpy : 0.0005524158477783203 nb_pixel_total : 6456 time to create 1 rle with old method : 0.008465051651000977 length of segment : 115 time for calcul the mask position with numpy : 0.005258798599243164 nb_pixel_total : 90088 time to create 1 rle with old method : 0.19783258438110352 length of segment : 281 time for calcul the mask position with numpy : 0.001443624496459961 nb_pixel_total : 38566 time to create 1 rle with old method : 0.04454517364501953 length of segment : 263 time for calcul the mask position with numpy : 0.0015690326690673828 nb_pixel_total : 32415 time to create 1 rle with old method : 0.03782343864440918 length of segment : 217 time for calcul the mask position with numpy : 0.0009853839874267578 nb_pixel_total : 19318 time to create 1 rle with old method : 0.02325606346130371 length of segment : 188 time for calcul the mask position with numpy : 0.0012140274047851562 nb_pixel_total : 27640 time to create 1 rle with old method : 0.033448219299316406 length of segment : 171 time for calcul the mask position with numpy : 0.003151416778564453 nb_pixel_total : 68951 time to create 1 rle with old method : 0.07815217971801758 length of segment : 313 time for calcul the mask position with numpy : 0.001245737075805664 nb_pixel_total : 26000 time to create 1 rle with old method : 0.030138492584228516 length of segment : 244 time for calcul the mask position with numpy : 0.002630949020385742 nb_pixel_total : 60115 time to create 1 rle with old method : 0.09029388427734375 length of segment : 266 time for calcul the mask position with numpy : 0.0013320446014404297 nb_pixel_total : 26384 time to create 1 rle with old method : 0.0305178165435791 length of segment : 317 time for calcul the mask position with numpy : 0.003137826919555664 nb_pixel_total : 95902 time to create 1 rle with old method : 0.11268281936645508 length of segment : 375 time for calcul the mask position with numpy : 0.0008447170257568359 nb_pixel_total : 18063 time to create 1 rle with old method : 0.021308422088623047 length of segment : 172 time for calcul the mask position with numpy : 0.0017251968383789062 nb_pixel_total : 24249 time to create 1 rle with old method : 0.039101362228393555 length of segment : 304 time for calcul the mask position with numpy : 0.012599706649780273 nb_pixel_total : 249893 time to create 1 rle with new method : 0.018616437911987305 length of segment : 654 time for calcul the mask position with numpy : 0.0018467903137207031 nb_pixel_total : 33864 time to create 1 rle with old method : 0.04426836967468262 length of segment : 251 time for calcul the mask position with numpy : 0.0006778240203857422 nb_pixel_total : 14601 time to create 1 rle with old method : 0.017499446868896484 length of segment : 173 time for calcul the mask position with numpy : 0.002498149871826172 nb_pixel_total : 46993 time to create 1 rle with old method : 0.07516312599182129 length of segment : 316 time for calcul the mask position with numpy : 0.0045664310455322266 nb_pixel_total : 101688 time to create 1 rle with old method : 0.11386561393737793 length of segment : 487 time for calcul the mask position with numpy : 0.00274658203125 nb_pixel_total : 58222 time to create 1 rle with old method : 0.0663909912109375 length of segment : 262 time for calcul the mask position with numpy : 0.002340078353881836 nb_pixel_total : 64787 time to create 1 rle with old method : 0.08037114143371582 length of segment : 307 time for calcul the mask position with numpy : 0.0006613731384277344 nb_pixel_total : 15428 time to create 1 rle with old method : 0.01847696304321289 length of segment : 128 time for calcul the mask position with numpy : 0.0006659030914306641 nb_pixel_total : 15655 time to create 1 rle with old method : 0.018781423568725586 length of segment : 116 time for calcul the mask position with numpy : 0.0026073455810546875 nb_pixel_total : 54458 time to create 1 rle with old method : 0.0775151252746582 length of segment : 272 time for calcul the mask position with numpy : 0.0019915103912353516 nb_pixel_total : 40516 time to create 1 rle with old method : 0.051532745361328125 length of segment : 334 time for calcul the mask position with numpy : 0.0020613670349121094 nb_pixel_total : 52540 time to create 1 rle with old method : 0.07197999954223633 length of segment : 281 time for calcul the mask position with numpy : 0.009565114974975586 nb_pixel_total : 228571 time to create 1 rle with new method : 0.018573284149169922 length of segment : 571 time for calcul the mask position with numpy : 0.0007479190826416016 nb_pixel_total : 10517 time to create 1 rle with old method : 0.017973899841308594 length of segment : 113 time for calcul the mask position with numpy : 0.0011970996856689453 nb_pixel_total : 31346 time to create 1 rle with old method : 0.03711509704589844 length of segment : 134 time for calcul the mask position with numpy : 0.0027930736541748047 nb_pixel_total : 53012 time to create 1 rle with old method : 0.05919528007507324 length of segment : 445 time for calcul the mask position with numpy : 0.000766754150390625 nb_pixel_total : 14044 time to create 1 rle with old method : 0.01636815071105957 length of segment : 172 time for calcul the mask position with numpy : 0.0034132003784179688 nb_pixel_total : 89855 time to create 1 rle with old method : 0.10268902778625488 length of segment : 503 time for calcul the mask position with numpy : 0.0049932003021240234 nb_pixel_total : 119234 time to create 1 rle with old method : 0.13510489463806152 length of segment : 479 time for calcul the mask position with numpy : 0.0014879703521728516 nb_pixel_total : 31985 time to create 1 rle with old method : 0.03644418716430664 length of segment : 302 time for calcul the mask position with numpy : 0.0008029937744140625 nb_pixel_total : 21389 time to create 1 rle with old method : 0.025377273559570312 length of segment : 118 time for calcul the mask position with numpy : 0.0004899501800537109 nb_pixel_total : 11929 time to create 1 rle with old method : 0.014130830764770508 length of segment : 99 time for calcul the mask position with numpy : 0.002011537551879883 nb_pixel_total : 61675 time to create 1 rle with old method : 0.08213257789611816 length of segment : 511 time for calcul the mask position with numpy : 0.00384521484375 nb_pixel_total : 136421 time to create 1 rle with old method : 0.17597317695617676 length of segment : 538 time for calcul the mask position with numpy : 0.0007288455963134766 nb_pixel_total : 18491 time to create 1 rle with old method : 0.023790597915649414 length of segment : 200 time for calcul the mask position with numpy : 0.0008089542388916016 nb_pixel_total : 30593 time to create 1 rle with old method : 0.03499317169189453 length of segment : 214 time for calcul the mask position with numpy : 0.0003082752227783203 nb_pixel_total : 9139 time to create 1 rle with old method : 0.01111602783203125 length of segment : 73 time for calcul the mask position with numpy : 0.001641988754272461 nb_pixel_total : 41775 time to create 1 rle with old method : 0.048322439193725586 length of segment : 310 time for calcul the mask position with numpy : 0.0017805099487304688 nb_pixel_total : 52216 time to create 1 rle with old method : 0.06015181541442871 length of segment : 208 time for calcul the mask position with numpy : 0.0040094852447509766 nb_pixel_total : 113117 time to create 1 rle with old method : 0.1269063949584961 length of segment : 602 time for calcul the mask position with numpy : 0.0023148059844970703 nb_pixel_total : 50453 time to create 1 rle with old method : 0.07555866241455078 length of segment : 280 time for calcul the mask position with numpy : 0.0036573410034179688 nb_pixel_total : 94142 time to create 1 rle with old method : 0.10689806938171387 length of segment : 418 time for calcul the mask position with numpy : 0.0003275871276855469 nb_pixel_total : 5157 time to create 1 rle with old method : 0.006181955337524414 length of segment : 94 time for calcul the mask position with numpy : 0.003926515579223633 nb_pixel_total : 84229 time to create 1 rle with old method : 0.09954833984375 length of segment : 288 time for calcul the mask position with numpy : 0.0007746219635009766 nb_pixel_total : 15410 time to create 1 rle with old method : 0.02144479751586914 length of segment : 160 time for calcul the mask position with numpy : 0.0048258304595947266 nb_pixel_total : 116312 time to create 1 rle with old method : 0.13492941856384277 length of segment : 338 time for calcul the mask position with numpy : 0.0037870407104492188 nb_pixel_total : 79263 time to create 1 rle with old method : 0.08995246887207031 length of segment : 220 time for calcul the mask position with numpy : 0.000644683837890625 nb_pixel_total : 15721 time to create 1 rle with old method : 0.026622295379638672 length of segment : 69 time for calcul the mask position with numpy : 0.0012276172637939453 nb_pixel_total : 20799 time to create 1 rle with old method : 0.024669885635375977 length of segment : 178 time for calcul the mask position with numpy : 0.003717660903930664 nb_pixel_total : 132025 time to create 1 rle with old method : 0.1520400047302246 length of segment : 578 time for calcul the mask position with numpy : 0.0065457820892333984 nb_pixel_total : 207091 time to create 1 rle with new method : 0.03258705139160156 length of segment : 720 time for calcul the mask position with numpy : 0.0011217594146728516 nb_pixel_total : 49579 time to create 1 rle with old method : 0.05701589584350586 length of segment : 297 time for calcul the mask position with numpy : 0.0007641315460205078 nb_pixel_total : 25675 time to create 1 rle with old method : 0.030211687088012695 length of segment : 102 time spent for convertir_results : 13.277090549468994 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 134 chid ids of type : 3594 Number RLEs to save : 36862 save missing photos in datou_result : time spend for datou_step_exec : 74.81849789619446 time spend to save output : 2.3118083477020264 total time spend for step 1 : 77.13030624389648 step2:crop_condition Thu May 1 11:01:47 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 8 ! batch 1 Loaded 134 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 77 About to insert : list_path_to_insert length 77 new photo from crops ! About to upload 77 photos upload in portfolio : 3736932 init cache_photo without model_param we have 77 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746090126_1815683 we have uploaded 77 photos in the portfolio 3736932 time of upload the photos Elapsed time : 22.226385354995728 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 10 About to insert : list_path_to_insert length 10 new photo from crops ! About to upload 10 photos upload in portfolio : 3736932 init cache_photo without model_param we have 10 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746090151_1815683 we have uploaded 10 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.634039878845215 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746090155_1815683 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.8615298271179199 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 46 About to insert : list_path_to_insert length 46 new photo from crops ! About to upload 46 photos upload in portfolio : 3736932 init cache_photo without model_param we have 46 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1746090170_1815683 we have uploaded 46 photos in the portfolio 3736932 time of upload the photos Elapsed time : 22.541883945465088 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1354781200, 1354774455, 1354774041, 1354773960, 1354773879, 1354773796, 1354773716, 1354772484] Looping around the photos to save general results len do output : 134 /1355075781Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075782Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075783Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075785Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075786Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075787Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075789Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075790Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075791Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075793Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075794Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075795Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075796Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075798Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075799Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075800Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075802Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075803Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075804Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075806Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075807Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075808Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075810Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075811Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075812Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075813Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075815Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075816Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075817Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075819Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075820Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075821Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075822Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075824Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075825Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075826Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075828Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075829Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075830Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075832Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075833Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075834Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075835Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075837Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075839Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075840Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075842Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075843Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075845Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075847Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075849Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075850Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075852Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075854Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075855Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075856Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075858Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075860Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075861Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075863Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075865Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075866Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075867Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075870Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075871Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075872Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075874Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075876Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075877Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075879Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075881Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075882Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075883Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075886Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075887Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075888Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075890Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075936Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075937Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075938Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075939Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075941Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075942Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075943Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075945Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075946Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075947Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355075960Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355076154Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355076155Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355076157Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355076158Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355076159Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355076161Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355076162Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355076163Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355076165Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355076166Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355076167Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355076168Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355076170Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355076171Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355076172Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355076174Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355076175Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355076176Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355076177Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355076179Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355076180Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355076181Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355076183Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355076184Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355076185Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355076187Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355076188Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355076189Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355076190Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355076192Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355076193Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355076194Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355076196Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355076197Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355076198Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355076199Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355076201Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355076203Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355076204Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355076206Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355076208Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355076209Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355076210Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355076212Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355076213Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1355076214Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2778691') ('3318', '22582553', '1354781200', None, None, None, None, None, '2778691') ('3318', None, None, None, None, None, None, None, '2778691') ('3318', '22582553', '1354774455', None, None, None, None, None, '2778691') ('3318', None, None, None, None, None, None, None, '2778691') ('3318', '22582553', '1354774041', None, None, None, None, None, '2778691') ('3318', None, None, None, None, None, None, None, '2778691') ('3318', '22582553', '1354773960', None, None, None, None, None, '2778691') ('3318', None, None, None, None, None, None, None, '2778691') ('3318', '22582553', '1354773879', None, None, None, None, None, '2778691') ('3318', None, None, None, None, None, None, None, '2778691') ('3318', '22582553', '1354773796', None, None, None, None, None, '2778691') ('3318', None, None, None, None, None, None, None, '2778691') ('3318', '22582553', '1354773716', None, None, None, None, None, '2778691') ('3318', None, None, None, None, None, None, None, '2778691') ('3318', '22582553', '1354772484', None, None, None, None, None, '2778691') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 410 time used for this insertion : 0.028074264526367188 save_final save missing photos in datou_result : time spend for datou_step_exec : 85.19035363197327 time spend to save output : 0.03205227851867676 total time spend for step 2 : 85.22240591049194 step3:rle_unique_nms_with_priority Thu May 1 11:03:12 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 134 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 16 nb_hashtags : 3 time to prepare the origin masks : 7.90448784828186 time for calcul the mask position with numpy : 0.6254780292510986 nb_pixel_total : 6499305 time to create 1 rle with new method : 1.4109716415405273 time for calcul the mask position with numpy : 0.035170793533325195 nb_pixel_total : 10315 time to create 1 rle with old method : 0.01145315170288086 time for calcul the mask position with numpy : 0.03260540962219238 nb_pixel_total : 15549 time to create 1 rle with old method : 0.017406940460205078 time for calcul the mask position with numpy : 0.030697107315063477 nb_pixel_total : 12712 time to create 1 rle with old method : 0.01410055160522461 time for calcul the mask position with numpy : 0.025461196899414062 nb_pixel_total : 9468 time to create 1 rle with old method : 0.01060032844543457 time for calcul the mask position with numpy : 0.022555112838745117 nb_pixel_total : 19067 time to create 1 rle with old method : 0.021075963973999023 time for calcul the mask position with numpy : 0.024189233779907227 nb_pixel_total : 95394 time to create 1 rle with old method : 0.10529041290283203 time for calcul the mask position with numpy : 0.0240628719329834 nb_pixel_total : 27701 time to create 1 rle with old method : 0.03090524673461914 time for calcul the mask position with numpy : 0.02278280258178711 nb_pixel_total : 17137 time to create 1 rle with old method : 0.021392107009887695 time for calcul the mask position with numpy : 0.02455282211303711 nb_pixel_total : 235809 time to create 1 rle with new method : 1.4181044101715088 time for calcul the mask position with numpy : 0.026851415634155273 nb_pixel_total : 5891 time to create 1 rle with old method : 0.006623744964599609 time for calcul the mask position with numpy : 0.022584915161132812 nb_pixel_total : 9397 time to create 1 rle with old method : 0.010581254959106445 time for calcul the mask position with numpy : 0.023366451263427734 nb_pixel_total : 5786 time to create 1 rle with old method : 0.00655817985534668 time for calcul the mask position with numpy : 0.025393009185791016 nb_pixel_total : 26466 time to create 1 rle with old method : 0.03102254867553711 time for calcul the mask position with numpy : 0.024705171585083008 nb_pixel_total : 36789 time to create 1 rle with old method : 0.04141068458557129 time for calcul the mask position with numpy : 0.025252819061279297 nb_pixel_total : 10795 time to create 1 rle with old method : 0.012058496475219727 time for calcul the mask position with numpy : 0.025532960891723633 nb_pixel_total : 12659 time to create 1 rle with old method : 0.014202117919921875 create new chi : 4.28565788269043 time to delete rle : 0.06073474884033203 batch 1 Loaded 33 chid ids of type : 3594 ++++++++++++++++++++Number RLEs to save : 8961 TO DO : save crop sub photo not yet done ! save time : 0.5569295883178711 nb_obj : 13 nb_hashtags : 3 time to prepare the origin masks : 7.1719300746917725 time for calcul the mask position with numpy : 0.5955379009246826 nb_pixel_total : 6729290 time to create 1 rle with new method : 1.5701775550842285 time for calcul the mask position with numpy : 0.038661956787109375 nb_pixel_total : 9096 time to create 1 rle with old method : 0.010103702545166016 time for calcul the mask position with numpy : 0.037935495376586914 nb_pixel_total : 21316 time to create 1 rle with old method : 0.02305293083190918 time for calcul the mask position with numpy : 0.03447699546813965 nb_pixel_total : 20032 time to create 1 rle with old method : 0.022441387176513672 time for calcul the mask position with numpy : 0.035492897033691406 nb_pixel_total : 27879 time to create 1 rle with old method : 0.030912399291992188 time for calcul the mask position with numpy : 0.023453235626220703 nb_pixel_total : 18101 time to create 1 rle with old method : 0.020262479782104492 time for calcul the mask position with numpy : 0.023813247680664062 nb_pixel_total : 1379 time to create 1 rle with old method : 0.0016620159149169922 time for calcul the mask position with numpy : 0.022585153579711914 nb_pixel_total : 29979 time to create 1 rle with old method : 0.03242850303649902 time for calcul the mask position with numpy : 0.02079296112060547 nb_pixel_total : 41459 time to create 1 rle with old method : 0.045723915100097656 time for calcul the mask position with numpy : 0.033945560455322266 nb_pixel_total : 99000 time to create 1 rle with old method : 0.1103658676147461 time for calcul the mask position with numpy : 0.03585004806518555 nb_pixel_total : 11170 time to create 1 rle with old method : 0.014886856079101562 time for calcul the mask position with numpy : 0.03549909591674805 nb_pixel_total : 13473 time to create 1 rle with old method : 0.014797210693359375 time for calcul the mask position with numpy : 0.039789438247680664 nb_pixel_total : 14451 time to create 1 rle with old method : 0.01692056655883789 time for calcul the mask position with numpy : 0.03683161735534668 nb_pixel_total : 13615 time to create 1 rle with old method : 0.015280008316040039 create new chi : 2.9868154525756836 time to delete rle : 0.0013453960418701172 batch 1 Loaded 27 chid ids of type : 3594 ++++++++++++++++++Number RLEs to save : 7549 TO DO : save crop sub photo not yet done ! save time : 0.46644163131713867 nb_obj : 20 nb_hashtags : 3 time to prepare the origin masks : 10.370049715042114 time for calcul the mask position with numpy : 1.0686781406402588 nb_pixel_total : 5486947 time to create 1 rle with new method : 0.7318544387817383 time for calcul the mask position with numpy : 0.03755307197570801 nb_pixel_total : 10582 time to create 1 rle with old method : 0.011846065521240234 time for calcul the mask position with numpy : 0.036418914794921875 nb_pixel_total : 93756 time to create 1 rle with old method : 0.10381078720092773 time for calcul the mask position with numpy : 0.03756427764892578 nb_pixel_total : 10686 time to create 1 rle with old method : 0.012804508209228516 time for calcul the mask position with numpy : 0.036858320236206055 nb_pixel_total : 99990 time to create 1 rle with old method : 0.11578178405761719 time for calcul the mask position with numpy : 0.038416385650634766 nb_pixel_total : 144712 time to create 1 rle with old method : 0.16057634353637695 time for calcul the mask position with numpy : 0.037096261978149414 nb_pixel_total : 162849 time to create 1 rle with new method : 1.1706016063690186 time for calcul the mask position with numpy : 0.040040016174316406 nb_pixel_total : 41501 time to create 1 rle with old method : 0.06847047805786133 time for calcul the mask position with numpy : 0.040216684341430664 nb_pixel_total : 18221 time to create 1 rle with old method : 0.020463228225708008 time for calcul the mask position with numpy : 0.03810691833496094 nb_pixel_total : 103870 time to create 1 rle with old method : 0.11627388000488281 time for calcul the mask position with numpy : 0.04050469398498535 nb_pixel_total : 10236 time to create 1 rle with old method : 0.011766195297241211 time for calcul the mask position with numpy : 0.03930926322937012 nb_pixel_total : 22922 time to create 1 rle with old method : 0.027262449264526367 time for calcul the mask position with numpy : 0.037392377853393555 nb_pixel_total : 52077 time to create 1 rle with old method : 0.05747485160827637 time for calcul the mask position with numpy : 0.03477931022644043 nb_pixel_total : 24478 time to create 1 rle with old method : 0.028338909149169922 time for calcul the mask position with numpy : 0.03668856620788574 nb_pixel_total : 64846 time to create 1 rle with old method : 0.0707087516784668 time for calcul the mask position with numpy : 0.03505516052246094 nb_pixel_total : 92818 time to create 1 rle with old method : 0.11944699287414551 time for calcul the mask position with numpy : 0.037773847579956055 nb_pixel_total : 22989 time to create 1 rle with old method : 0.02620863914489746 time for calcul the mask position with numpy : 0.03462696075439453 nb_pixel_total : 28790 time to create 1 rle with old method : 0.03213214874267578 time for calcul the mask position with numpy : 0.034105539321899414 nb_pixel_total : 150350 time to create 1 rle with new method : 1.2846722602844238 time for calcul the mask position with numpy : 0.03318953514099121 nb_pixel_total : 197796 time to create 1 rle with new method : 1.0737133026123047 time for calcul the mask position with numpy : 0.03657102584838867 nb_pixel_total : 209824 time to create 1 rle with new method : 1.1088018417358398 create new chi : 8.303271770477295 time to delete rle : 0.003612041473388672 batch 1 Loaded 41 chid ids of type : 3594 +++++++++++++++++++++Number RLEs to save : 13253 TO DO : save crop sub photo not yet done ! save time : 0.8152682781219482 nb_obj : 18 nb_hashtags : 3 time to prepare the origin masks : 7.844627141952515 time for calcul the mask position with numpy : 1.0528366565704346 nb_pixel_total : 5984359 time to create 1 rle with new method : 1.0412814617156982 time for calcul the mask position with numpy : 0.045409202575683594 nb_pixel_total : 27150 time to create 1 rle with old method : 0.032196760177612305 time for calcul the mask position with numpy : 0.02695751190185547 nb_pixel_total : 124212 time to create 1 rle with old method : 0.13573455810546875 time for calcul the mask position with numpy : 0.021505355834960938 nb_pixel_total : 60551 time to create 1 rle with old method : 0.07380414009094238 time for calcul the mask position with numpy : 0.02611541748046875 nb_pixel_total : 21544 time to create 1 rle with old method : 0.023195505142211914 time for calcul the mask position with numpy : 0.020684003829956055 nb_pixel_total : 40027 time to create 1 rle with old method : 0.04303145408630371 time for calcul the mask position with numpy : 0.021411657333374023 nb_pixel_total : 17727 time to create 1 rle with old method : 0.019672870635986328 time for calcul the mask position with numpy : 0.022907733917236328 nb_pixel_total : 26747 time to create 1 rle with old method : 0.030349016189575195 time for calcul the mask position with numpy : 0.024232149124145508 nb_pixel_total : 10625 time to create 1 rle with old method : 0.011984825134277344 time for calcul the mask position with numpy : 0.021892309188842773 nb_pixel_total : 23521 time to create 1 rle with old method : 0.02612018585205078 time for calcul the mask position with numpy : 0.024518251419067383 nb_pixel_total : 34720 time to create 1 rle with old method : 0.037908077239990234 time for calcul the mask position with numpy : 0.02154850959777832 nb_pixel_total : 129426 time to create 1 rle with old method : 0.13997864723205566 time for calcul the mask position with numpy : 0.022378921508789062 nb_pixel_total : 49163 time to create 1 rle with old method : 0.05348324775695801 time for calcul the mask position with numpy : 0.022228717803955078 nb_pixel_total : 67661 time to create 1 rle with old method : 0.0731501579284668 time for calcul the mask position with numpy : 0.02138495445251465 nb_pixel_total : 41888 time to create 1 rle with old method : 0.04652762413024902 time for calcul the mask position with numpy : 0.02720022201538086 nb_pixel_total : 202473 time to create 1 rle with new method : 0.9440293312072754 time for calcul the mask position with numpy : 0.02199578285217285 nb_pixel_total : 15787 time to create 1 rle with old method : 0.016832351684570312 time for calcul the mask position with numpy : 0.025988101959228516 nb_pixel_total : 149476 time to create 1 rle with old method : 0.17667627334594727 time for calcul the mask position with numpy : 0.02176833152770996 nb_pixel_total : 23183 time to create 1 rle with old method : 0.024884939193725586 create new chi : 4.510997533798218 time to delete rle : 0.0018939971923828125 batch 1 Loaded 37 chid ids of type : 3594 ++++++++++++++++++++++++++Number RLEs to save : 13262 TO DO : save crop sub photo not yet done ! save time : 0.8871252536773682 nb_obj : 20 nb_hashtags : 3 time to prepare the origin masks : 9.704220533370972 time for calcul the mask position with numpy : 0.7262411117553711 nb_pixel_total : 6115719 time to create 1 rle with new method : 1.0548834800720215 time for calcul the mask position with numpy : 0.022703886032104492 nb_pixel_total : 60115 time to create 1 rle with old method : 0.06330418586730957 time for calcul the mask position with numpy : 0.035488128662109375 nb_pixel_total : 26000 time to create 1 rle with old method : 0.029016494750976562 time for calcul the mask position with numpy : 0.03609442710876465 nb_pixel_total : 68951 time to create 1 rle with old method : 0.0744926929473877 time for calcul the mask position with numpy : 0.036168813705444336 nb_pixel_total : 27640 time to create 1 rle with old method : 0.029346227645874023 time for calcul the mask position with numpy : 0.028706073760986328 nb_pixel_total : 19318 time to create 1 rle with old method : 0.020514965057373047 time for calcul the mask position with numpy : 0.02285933494567871 nb_pixel_total : 32415 time to create 1 rle with old method : 0.05254983901977539 time for calcul the mask position with numpy : 0.025175809860229492 nb_pixel_total : 38566 time to create 1 rle with old method : 0.04362225532531738 time for calcul the mask position with numpy : 0.022090435028076172 nb_pixel_total : 90088 time to create 1 rle with old method : 0.09904313087463379 time for calcul the mask position with numpy : 0.021764278411865234 nb_pixel_total : 6456 time to create 1 rle with old method : 0.00722813606262207 time for calcul the mask position with numpy : 0.022220611572265625 nb_pixel_total : 31548 time to create 1 rle with old method : 0.03500056266784668 time for calcul the mask position with numpy : 0.021860599517822266 nb_pixel_total : 64548 time to create 1 rle with old method : 0.07203793525695801 time for calcul the mask position with numpy : 0.023227930068969727 nb_pixel_total : 37869 time to create 1 rle with old method : 0.04217338562011719 time for calcul the mask position with numpy : 0.024448871612548828 nb_pixel_total : 174226 time to create 1 rle with new method : 1.0963692665100098 time for calcul the mask position with numpy : 0.02141404151916504 nb_pixel_total : 22615 time to create 1 rle with old method : 0.026648521423339844 time for calcul the mask position with numpy : 0.023183345794677734 nb_pixel_total : 6500 time to create 1 rle with old method : 0.008928775787353516 time for calcul the mask position with numpy : 0.024235248565673828 nb_pixel_total : 56772 time to create 1 rle with old method : 0.07805132865905762 time for calcul the mask position with numpy : 0.022745609283447266 nb_pixel_total : 55036 time to create 1 rle with old method : 0.0612337589263916 time for calcul the mask position with numpy : 0.021988868713378906 nb_pixel_total : 53242 time to create 1 rle with old method : 0.061582326889038086 time for calcul the mask position with numpy : 0.02230978012084961 nb_pixel_total : 43886 time to create 1 rle with old method : 0.05051898956298828 time for calcul the mask position with numpy : 0.022498607635498047 nb_pixel_total : 18730 time to create 1 rle with old method : 0.0208585262298584 create new chi : 4.316955804824829 time to delete rle : 0.001894235610961914 batch 1 Loaded 41 chid ids of type : 3594 +++++++++++++++++++++++++Number RLEs to save : 12646 TO DO : save crop sub photo not yet done ! save time : 0.808962345123291 nb_obj : 24 nb_hashtags : 3 time to prepare the origin masks : 12.00326132774353 time for calcul the mask position with numpy : 0.6343479156494141 nb_pixel_total : 5558433 time to create 1 rle with new method : 1.1816844940185547 time for calcul the mask position with numpy : 0.039368629455566406 nb_pixel_total : 31985 time to create 1 rle with old method : 0.035695791244506836 time for calcul the mask position with numpy : 0.03641104698181152 nb_pixel_total : 119234 time to create 1 rle with old method : 0.15683722496032715 time for calcul the mask position with numpy : 0.03652524948120117 nb_pixel_total : 89855 time to create 1 rle with old method : 0.10492491722106934 time for calcul the mask position with numpy : 0.03667283058166504 nb_pixel_total : 14044 time to create 1 rle with old method : 0.015760183334350586 time for calcul the mask position with numpy : 0.03562140464782715 nb_pixel_total : 53012 time to create 1 rle with old method : 0.05897402763366699 time for calcul the mask position with numpy : 0.03589653968811035 nb_pixel_total : 31346 time to create 1 rle with old method : 0.035161495208740234 time for calcul the mask position with numpy : 0.03551030158996582 nb_pixel_total : 10517 time to create 1 rle with old method : 0.011836051940917969 time for calcul the mask position with numpy : 0.03704214096069336 nb_pixel_total : 228571 time to create 1 rle with new method : 0.8531179428100586 time for calcul the mask position with numpy : 0.03683829307556152 nb_pixel_total : 52540 time to create 1 rle with old method : 0.058212995529174805 time for calcul the mask position with numpy : 0.036475419998168945 nb_pixel_total : 40516 time to create 1 rle with old method : 0.04510927200317383 time for calcul the mask position with numpy : 0.03457188606262207 nb_pixel_total : 54458 time to create 1 rle with old method : 0.05931663513183594 time for calcul the mask position with numpy : 0.03351449966430664 nb_pixel_total : 15655 time to create 1 rle with old method : 0.01698780059814453 time for calcul the mask position with numpy : 0.03649568557739258 nb_pixel_total : 15428 time to create 1 rle with old method : 0.02470564842224121 time for calcul the mask position with numpy : 0.04005837440490723 nb_pixel_total : 64787 time to create 1 rle with old method : 0.0740056037902832 time for calcul the mask position with numpy : 0.03502774238586426 nb_pixel_total : 58222 time to create 1 rle with old method : 0.08872294425964355 time for calcul the mask position with numpy : 0.03511500358581543 nb_pixel_total : 101688 time to create 1 rle with old method : 0.11162424087524414 time for calcul the mask position with numpy : 0.03556394577026367 nb_pixel_total : 46993 time to create 1 rle with old method : 0.05569005012512207 time for calcul the mask position with numpy : 0.03531670570373535 nb_pixel_total : 14601 time to create 1 rle with old method : 0.016263246536254883 time for calcul the mask position with numpy : 0.0344853401184082 nb_pixel_total : 33864 time to create 1 rle with old method : 0.03759884834289551 time for calcul the mask position with numpy : 0.0358881950378418 nb_pixel_total : 249893 time to create 1 rle with new method : 1.296832799911499 time for calcul the mask position with numpy : 0.04117918014526367 nb_pixel_total : 24249 time to create 1 rle with old method : 0.027158498764038086 time for calcul the mask position with numpy : 0.028738021850585938 nb_pixel_total : 18063 time to create 1 rle with old method : 0.02023148536682129 time for calcul the mask position with numpy : 0.035558223724365234 nb_pixel_total : 95902 time to create 1 rle with old method : 0.11181330680847168 time for calcul the mask position with numpy : 0.035391807556152344 nb_pixel_total : 26384 time to create 1 rle with old method : 0.029145479202270508 create new chi : 6.1196112632751465 time to delete rle : 0.0036423206329345703 batch 1 Loaded 49 chid ids of type : 3594 ++++++++++++++++++++++++++++++Number RLEs to save : 17096 TO DO : save crop sub photo not yet done ! save time : 1.0391695499420166 nb_obj : 8 nb_hashtags : 3 time to prepare the origin masks : 4.625590085983276 time for calcul the mask position with numpy : 0.9502806663513184 nb_pixel_total : 6718828 time to create 1 rle with new method : 0.7093949317932129 time for calcul the mask position with numpy : 0.036188602447509766 nb_pixel_total : 41775 time to create 1 rle with old method : 0.04999089241027832 time for calcul the mask position with numpy : 0.03693222999572754 nb_pixel_total : 9139 time to create 1 rle with old method : 0.010507345199584961 time for calcul the mask position with numpy : 0.0391995906829834 nb_pixel_total : 30593 time to create 1 rle with old method : 0.03448891639709473 time for calcul the mask position with numpy : 0.03546953201293945 nb_pixel_total : 18491 time to create 1 rle with old method : 0.020295143127441406 time for calcul the mask position with numpy : 0.038304805755615234 nb_pixel_total : 136421 time to create 1 rle with old method : 0.14828753471374512 time for calcul the mask position with numpy : 0.035738468170166016 nb_pixel_total : 61675 time to create 1 rle with old method : 0.06790828704833984 time for calcul the mask position with numpy : 0.022801637649536133 nb_pixel_total : 11929 time to create 1 rle with old method : 0.01323556900024414 time for calcul the mask position with numpy : 0.02056264877319336 nb_pixel_total : 21389 time to create 1 rle with old method : 0.023965120315551758 create new chi : 2.3374979496002197 time to delete rle : 0.001130819320678711 batch 1 Loaded 17 chid ids of type : 3594 ++++++++Number RLEs to save : 6286 TO DO : save crop sub photo not yet done ! save time : 0.5313427448272705 nb_obj : 14 nb_hashtags : 2 time to prepare the origin masks : 6.460123062133789 time for calcul the mask position with numpy : 0.8619136810302734 nb_pixel_total : 6038869 time to create 1 rle with new method : 1.2646703720092773 time for calcul the mask position with numpy : 0.026645660400390625 nb_pixel_total : 25675 time to create 1 rle with old method : 0.02839064598083496 time for calcul the mask position with numpy : 0.0228574275970459 nb_pixel_total : 206852 time to create 1 rle with new method : 0.8102056980133057 time for calcul the mask position with numpy : 0.021988391876220703 nb_pixel_total : 132025 time to create 1 rle with old method : 0.1460559368133545 time for calcul the mask position with numpy : 0.022486209869384766 nb_pixel_total : 20799 time to create 1 rle with old method : 0.02332901954650879 time for calcul the mask position with numpy : 0.021259546279907227 nb_pixel_total : 15721 time to create 1 rle with old method : 0.01775503158569336 time for calcul the mask position with numpy : 0.023061275482177734 nb_pixel_total : 79263 time to create 1 rle with old method : 0.08763289451599121 time for calcul the mask position with numpy : 0.022905826568603516 nb_pixel_total : 116312 time to create 1 rle with old method : 0.12723875045776367 time for calcul the mask position with numpy : 0.021001338958740234 nb_pixel_total : 15410 time to create 1 rle with old method : 0.019284963607788086 time for calcul the mask position with numpy : 0.021822452545166016 nb_pixel_total : 84229 time to create 1 rle with old method : 0.0920097827911377 time for calcul the mask position with numpy : 0.021105051040649414 nb_pixel_total : 5157 time to create 1 rle with old method : 0.005952596664428711 time for calcul the mask position with numpy : 0.021845340728759766 nb_pixel_total : 94142 time to create 1 rle with old method : 0.10612273216247559 time for calcul the mask position with numpy : 0.0208284854888916 nb_pixel_total : 50453 time to create 1 rle with old method : 0.05900931358337402 time for calcul the mask position with numpy : 0.03491950035095215 nb_pixel_total : 113117 time to create 1 rle with old method : 0.12400555610656738 time for calcul the mask position with numpy : 0.033985137939453125 nb_pixel_total : 52216 time to create 1 rle with old method : 0.05688881874084473 create new chi : 4.237560749053955 time to delete rle : 0.0019080638885498047 batch 1 Loaded 30 chid ids of type : 3594 ++++++++++++++++++Number RLEs to save : 10576 TO DO : save crop sub photo not yet done ! save time : 0.6497585773468018 map_output_result : {1354781200: (0.0, 'Should be the crop_list due to order', 0), 1354774455: (0.0, 'Should be the crop_list due to order', 0), 1354774041: (0.0, 'Should be the crop_list due to order', 0), 1354773960: (0.0, 'Should be the crop_list due to order', 0), 1354773879: (0.0, 'Should be the crop_list due to order', 0), 1354773796: (0.0, 'Should be the crop_list due to order', 0), 1354773716: (0.0, 'Should be the crop_list due to order', 0), 1354772484: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1354781200, 1354774455, 1354774041, 1354773960, 1354773879, 1354773796, 1354773716, 1354772484] Looping around the photos to save general results len do output : 8 /1354781200.Didn't retrieve data . /1354774455.Didn't retrieve data . /1354774041.Didn't retrieve data . /1354773960.Didn't retrieve data . /1354773879.Didn't retrieve data . /1354773796.Didn't retrieve data . /1354773716.Didn't retrieve data . /1354772484.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2778691') ('3318', '22582553', '1354781200', None, None, None, None, None, '2778691') ('3318', None, None, None, None, None, None, None, '2778691') ('3318', '22582553', '1354774455', None, None, None, None, None, '2778691') ('3318', None, None, None, None, None, None, None, '2778691') ('3318', '22582553', '1354774041', None, None, None, None, None, '2778691') ('3318', None, None, None, None, None, None, None, '2778691') ('3318', '22582553', '1354773960', None, None, None, None, None, '2778691') ('3318', None, None, None, None, None, None, None, '2778691') ('3318', '22582553', '1354773879', None, None, None, None, None, '2778691') ('3318', None, None, None, None, None, None, None, '2778691') ('3318', '22582553', '1354773796', None, None, None, None, None, '2778691') ('3318', None, None, None, None, None, None, None, '2778691') ('3318', '22582553', '1354773716', None, None, None, None, None, '2778691') ('3318', None, None, None, None, None, None, None, '2778691') ('3318', '22582553', '1354772484', None, None, None, None, None, '2778691') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.015350103378295898 save_final save missing photos in datou_result : time spend for datou_step_exec : 110.52434635162354 time spend to save output : 0.015756607055664062 total time spend for step 3 : 110.5401029586792 step4:ventilate_hashtags_in_portfolio Thu May 1 11:05:03 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 22582553 get user id for portfolio 22582553 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22582553 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','flou','background','metal','mal_croppe','papier','autre','pet_fonce','carton','pet_clair','pehd')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22582553 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','flou','background','metal','mal_croppe','papier','autre','pet_fonce','carton','pet_clair','pehd')) AND mptpi.`min_score`=0.5 To do To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22582553 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','flou','background','metal','mal_croppe','papier','autre','pet_fonce','carton','pet_clair','pehd')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/22583578,22583579,22583580,22583581,22583582,22583583,22583584,22583585,22583586,22583587,22583588?tags=environnement,flou,background,metal,mal_croppe,papier,autre,pet_fonce,carton,pet_clair,pehd Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1354781200, 1354774455, 1354774041, 1354773960, 1354773879, 1354773796, 1354773716, 1354772484] Looping around the photos to save general results len do output : 1 /22582553. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2778691') ('3318', '22582553', '1354781200', None, None, None, None, None, '2778691') ('3318', None, None, None, None, None, None, None, '2778691') ('3318', '22582553', '1354774455', None, None, None, None, None, '2778691') ('3318', None, None, None, None, None, None, None, '2778691') ('3318', '22582553', '1354774041', None, None, None, None, None, '2778691') ('3318', None, None, None, None, None, None, None, '2778691') ('3318', '22582553', '1354773960', None, None, None, None, None, '2778691') ('3318', None, None, None, None, None, None, None, '2778691') ('3318', '22582553', '1354773879', None, None, None, None, None, '2778691') ('3318', None, None, None, None, None, None, None, '2778691') ('3318', '22582553', '1354773796', None, None, None, None, None, '2778691') ('3318', None, None, None, None, None, None, None, '2778691') ('3318', '22582553', '1354773716', None, None, None, None, None, '2778691') ('3318', None, None, None, None, None, None, None, '2778691') ('3318', '22582553', '1354772484', None, None, None, None, None, '2778691') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.015620946884155273 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.7583980560302734 time spend to save output : 0.015866756439208984 total time spend for step 4 : 0.7742648124694824 step5:final Thu May 1 11:05:04 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1354781200: ('0.12889933534177564',), 1354774455: ('0.12889933534177564',), 1354774041: ('0.12889933534177564',), 1354773960: ('0.12889933534177564',), 1354773879: ('0.12889933534177564',), 1354773796: ('0.12889933534177564',), 1354773716: ('0.12889933534177564',), 1354772484: ('0.12889933534177564',)} new output for save of step final : {1354781200: ('0.12889933534177564',), 1354774455: ('0.12889933534177564',), 1354774041: ('0.12889933534177564',), 1354773960: ('0.12889933534177564',), 1354773879: ('0.12889933534177564',), 1354773796: ('0.12889933534177564',), 1354773716: ('0.12889933534177564',), 1354772484: ('0.12889933534177564',)} [1354781200, 1354774455, 1354774041, 1354773960, 1354773879, 1354773796, 1354773716, 1354772484] Looping around the photos to save general results len do output : 8 /1354781200.Didn't retrieve data . /1354774455.Didn't retrieve data . /1354774041.Didn't retrieve data . /1354773960.Didn't retrieve data . /1354773879.Didn't retrieve data . /1354773796.Didn't retrieve data . /1354773716.Didn't retrieve data . /1354772484.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2778691') ('3318', '22582553', '1354781200', None, None, None, None, None, '2778691') ('3318', None, None, None, None, None, None, None, '2778691') ('3318', '22582553', '1354774455', None, None, None, None, None, '2778691') ('3318', None, None, None, None, None, None, None, '2778691') ('3318', '22582553', '1354774041', None, None, None, None, None, '2778691') ('3318', None, None, None, None, None, None, None, '2778691') ('3318', '22582553', '1354773960', None, None, None, None, None, '2778691') ('3318', None, None, None, None, None, None, None, '2778691') ('3318', '22582553', '1354773879', None, None, None, None, None, '2778691') ('3318', None, None, None, None, None, None, None, '2778691') ('3318', '22582553', '1354773796', None, None, None, None, None, '2778691') ('3318', None, None, None, None, None, None, None, '2778691') ('3318', '22582553', '1354773716', None, None, None, None, None, '2778691') ('3318', None, None, None, None, None, None, None, '2778691') ('3318', '22582553', '1354772484', None, None, None, None, None, '2778691') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.012333393096923828 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.12414050102233887 time spend to save output : 0.012877464294433594 total time spend for step 5 : 0.13701796531677246 step6:blur_detection Thu May 1 11:05:04 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1746090029_1815683_1354781200_156adea2166f72f2d28e57023af23e44.jpg resize: (2160, 3264) 1354781200 -0.5050774383738155 treat image : temp/1746090029_1815683_1354774455_cbb50f435dd72bab1ad4e5fde9682f8a.jpg resize: (2160, 3264) 1354774455 -2.588293592872852 treat image : temp/1746090029_1815683_1354774041_1fef8b6fe6be6f0aa5ef9a0d7f54808f.jpg resize: (2160, 3264) 1354774041 -2.2282187967276723 treat image : temp/1746090029_1815683_1354773960_9041dafa2e7e3e7f5cf3d2b9b8473ebd.jpg resize: (2160, 3264) 1354773960 -2.324735206250888 treat image : temp/1746090029_1815683_1354773879_a6401e0cb1b04daadeaa19852d6dbe0d.jpg resize: (2160, 3264) 1354773879 -3.704217198457676 treat image : temp/1746090029_1815683_1354773796_173bb05bf24cbe80d2e98c48bb4e9bdf.jpg resize: (2160, 3264) 1354773796 -0.11666399183253691 treat image : temp/1746090029_1815683_1354773716_e4557276acd76e0f44acd91867b30a33.jpg resize: (2160, 3264) 1354773716 -1.2695142219087743 treat image : temp/1746090029_1815683_1354772484_ea62b6de805cce7f17cffa3a6b20b42d.jpg resize: (2160, 3264) 1354772484 -5.620999469797681 treat image : temp/1746090029_1815683_1354781200_156adea2166f72f2d28e57023af23e44_rle_crop_3778255540_0.png resize: (210, 71) 1355075781 3.091298143607238 treat image : temp/1746090029_1815683_1354781200_156adea2166f72f2d28e57023af23e44_rle_crop_3778255548_0.png resize: (206, 126) 1355075782 -1.7340900311153253 treat image : temp/1746090029_1815683_1354781200_156adea2166f72f2d28e57023af23e44_rle_crop_3778255555_0.png resize: (186, 85) 1355075783 -1.3945651831749237 treat image : temp/1746090029_1815683_1354781200_156adea2166f72f2d28e57023af23e44_rle_crop_3778255549_0.png resize: (206, 236) 1355075785 -1.1520949616720106 treat image : temp/1746090029_1815683_1354781200_156adea2166f72f2d28e57023af23e44_rle_crop_3778255550_0.png resize: (318, 363) 1355075786 -0.4512781969884106 treat image : temp/1746090029_1815683_1354781200_156adea2166f72f2d28e57023af23e44_rle_crop_3778255545_0.png resize: (84, 165) 1355075787 -1.1661402786815145 treat image : temp/1746090029_1815683_1354781200_156adea2166f72f2d28e57023af23e44_rle_crop_3778255546_0.png resize: (77, 100) 1355075789 1.1452092956266362 treat image : temp/1746090029_1815683_1354781200_156adea2166f72f2d28e57023af23e44_rle_crop_3778255542_0.png resize: (321, 199) 1355075790 -0.7389385747895783 treat image : temp/1746090029_1815683_1354781200_156adea2166f72f2d28e57023af23e44_rle_crop_3778255544_0.png resize: (129, 76) 1355075791 3.435356276798962 treat image : temp/1746090029_1815683_1354781200_156adea2166f72f2d28e57023af23e44_rle_crop_3778255541_0.png resize: (127, 115) 1355075793 -0.8496953914767829 treat image : temp/1746090029_1815683_1354781200_156adea2166f72f2d28e57023af23e44_rle_crop_3778255553_0.png resize: (156, 103) 1355075794 2.36283898891613 treat image : temp/1746090029_1815683_1354781200_156adea2166f72f2d28e57023af23e44_rle_crop_3778255552_0.png resize: (111, 105) 1355075795 -0.557882506365423 treat image : temp/1746090029_1815683_1354781200_156adea2166f72f2d28e57023af23e44_rle_crop_3778255551_0.png resize: (170, 168) 1355075796 1.1656514650243954 treat image : temp/1746090029_1815683_1354774455_cbb50f435dd72bab1ad4e5fde9682f8a_rle_crop_3778255556_0.png resize: (212, 77) 1355075798 1.477104365580285 treat image : temp/1746090029_1815683_1354774455_cbb50f435dd72bab1ad4e5fde9682f8a_rle_crop_3778255561_0.png resize: (328, 188) 1355075799 -3.3106348195377375 treat image : temp/1746090029_1815683_1354774455_cbb50f435dd72bab1ad4e5fde9682f8a_rle_crop_3778255560_0.png resize: (305, 382) 1355075800 -2.7424463040103157 treat image : temp/1746090029_1815683_1354774455_cbb50f435dd72bab1ad4e5fde9682f8a_rle_crop_3778255558_0.png resize: (139, 143) 1355075802 -1.504498747146073 treat image : temp/1746090029_1815683_1354774455_cbb50f435dd72bab1ad4e5fde9682f8a_rle_crop_3778255564_0.png resize: (158, 152) 1355075803 -3.5557169162723867 treat image : temp/1746090029_1815683_1354774455_cbb50f435dd72bab1ad4e5fde9682f8a_rle_crop_3778255562_0.png resize: (268, 176) 1355075804 -2.3429416970374413 treat image : temp/1746090029_1815683_1354774455_cbb50f435dd72bab1ad4e5fde9682f8a_rle_crop_3778255563_0.png resize: (122, 69) 1355075806 1.1884071899917363 treat image : temp/1746090029_1815683_1354774455_cbb50f435dd72bab1ad4e5fde9682f8a_rle_crop_3778255559_0.png resize: (130, 113) 1355075807 -2.624336704303713 treat image : temp/1746090029_1815683_1354774455_cbb50f435dd72bab1ad4e5fde9682f8a_rle_crop_3778255568_0.png resize: (141, 105) 1355075808 -3.3101993034284805 treat image : temp/1746090029_1815683_1354774455_cbb50f435dd72bab1ad4e5fde9682f8a_rle_crop_3778255557_0.png resize: (191, 127) 1355075810 -3.7021865957152285 treat image : temp/1746090029_1815683_1354774041_1fef8b6fe6be6f0aa5ef9a0d7f54808f_rle_crop_3778255586_0.png resize: (190, 115) 1355075811 -2.031173515740108 treat image : temp/1746090029_1815683_1354774041_1fef8b6fe6be6f0aa5ef9a0d7f54808f_rle_crop_3778255582_0.png resize: (244, 268) 1355075812 -0.8425619738279295 treat image : temp/1746090029_1815683_1354774041_1fef8b6fe6be6f0aa5ef9a0d7f54808f_rle_crop_3778255576_0.png resize: (148, 262) 1355075813 -1.7702948651032677 treat image : temp/1746090029_1815683_1354774041_1fef8b6fe6be6f0aa5ef9a0d7f54808f_rle_crop_3778255572_0.png resize: (191, 269) 1355075815 -0.5728096464646586 treat image : temp/1746090029_1815683_1354774041_1fef8b6fe6be6f0aa5ef9a0d7f54808f_rle_crop_3778255587_0.png resize: (325, 611) 1355075816 -2.581710934135592 treat image : temp/1746090029_1815683_1354774041_1fef8b6fe6be6f0aa5ef9a0d7f54808f_rle_crop_3778255569_0.png resize: (515, 600) 1355075817 -1.2299565937626955 treat image : temp/1746090029_1815683_1354774041_1fef8b6fe6be6f0aa5ef9a0d7f54808f_rle_crop_3778255571_0.png resize: (433, 570) 1355075819 -0.7432919717603369 treat image : temp/1746090029_1815683_1354774041_1fef8b6fe6be6f0aa5ef9a0d7f54808f_rle_crop_3778255577_0.png resize: (323, 244) 1355075820 -0.7359829891966948 treat image : temp/1746090029_1815683_1354773960_9041dafa2e7e3e7f5cf3d2b9b8473ebd_rle_crop_3778255597_0.png resize: (342, 147) 1355075821 -1.5596703196925334 treat image : temp/1746090029_1815683_1354773960_9041dafa2e7e3e7f5cf3d2b9b8473ebd_rle_crop_3778255593_0.png resize: (262, 207) 1355075822 -1.146308783139793 treat image : temp/1746090029_1815683_1354773960_9041dafa2e7e3e7f5cf3d2b9b8473ebd_rle_crop_3778255601_0.png resize: (186, 130) 1355075824 -1.0385858590912664 treat image : temp/1746090029_1815683_1354773960_9041dafa2e7e3e7f5cf3d2b9b8473ebd_rle_crop_3778255592_0.png resize: (516, 627) 1355075825 -0.7962830790646003 treat image : temp/1746090029_1815683_1354773960_9041dafa2e7e3e7f5cf3d2b9b8473ebd_rle_crop_3778255603_0.png resize: (229, 165) 1355075826 -2.4711279721839436 treat image : temp/1746090029_1815683_1354773960_9041dafa2e7e3e7f5cf3d2b9b8473ebd_rle_crop_3778255599_0.png resize: (85, 156) 1355075828 -0.9088819775471766 treat image : temp/1746090029_1815683_1354773960_9041dafa2e7e3e7f5cf3d2b9b8473ebd_rle_crop_3778255596_0.png resize: (279, 707) 1355075829 -1.9250343221189834 treat image : temp/1746090029_1815683_1354773960_9041dafa2e7e3e7f5cf3d2b9b8473ebd_rle_crop_3778255605_0.png resize: (406, 390) 1355075830 -1.9513453574715418 treat image : temp/1746090029_1815683_1354773960_9041dafa2e7e3e7f5cf3d2b9b8473ebd_rle_crop_3778255600_0.png resize: (171, 358) 1355075832 -2.3695811361009054 treat image : temp/1746090029_1815683_1354773879_a6401e0cb1b04daadeaa19852d6dbe0d_rle_crop_3778255617_0.png resize: (288, 225) 1355075833 -2.0776600318373886 treat image : temp/1746090029_1815683_1354773879_a6401e0cb1b04daadeaa19852d6dbe0d_rle_crop_3778255614_0.png resize: (459, 623) 1355075834 -1.355317504166156 treat image : temp/1746090029_1815683_1354773879_a6401e0cb1b04daadeaa19852d6dbe0d_rle_crop_3778255613_0.png resize: (131, 247) 1355075835 -1.690683738532444 treat image : temp/1746090029_1815683_1354773879_a6401e0cb1b04daadeaa19852d6dbe0d_rle_crop_3778255623_0.png resize: (163, 209) 1355075837 -3.521582563998691 treat image : temp/1746090029_1815683_1354773879_a6401e0cb1b04daadeaa19852d6dbe0d_rle_crop_3778255624_0.png resize: (301, 323) 1355075839 -1.6960235054062187 treat image : temp/1746090029_1815683_1354773879_a6401e0cb1b04daadeaa19852d6dbe0d_rle_crop_3778255612_0.png resize: (45, 181) 1355075840 -1.0120378631283475 treat image : temp/1746090029_1815683_1354773879_a6401e0cb1b04daadeaa19852d6dbe0d_rle_crop_3778255615_0.png resize: (307, 229) 1355075842 -2.4645804855723994 treat image : temp/1746090029_1815683_1354773879_a6401e0cb1b04daadeaa19852d6dbe0d_rle_crop_3778255616_0.png resize: (339, 398) 1355075843 -0.9662038481670389 treat image : temp/1746090029_1815683_1354773879_a6401e0cb1b04daadeaa19852d6dbe0d_rle_crop_3778255618_0.png resize: (115, 85) 1355075845 -1.5113271406646307 treat image : temp/1746090029_1815683_1354773879_a6401e0cb1b04daadeaa19852d6dbe0d_rle_crop_3778255607_0.png resize: (376, 81) 1355075847 -2.134097432151885 treat image : temp/1746090029_1815683_1354773879_a6401e0cb1b04daadeaa19852d6dbe0d_rle_crop_3778255622_0.png resize: (187, 166) 1355075849 -2.625239070707033 treat image : temp/1746090029_1815683_1354773796_173bb05bf24cbe80d2e98c48bb4e9bdf_rle_crop_3778255646_0.png resize: (431, 216) 1355075850 -1.7212317841848566 treat image : temp/1746090029_1815683_1354773796_173bb05bf24cbe80d2e98c48bb4e9bdf_rle_crop_3778255631_0.png resize: (564, 667) 1355075852 -0.9109681387401086 treat image : temp/1746090029_1815683_1354773796_173bb05bf24cbe80d2e98c48bb4e9bdf_rle_crop_3778255643_0.png resize: (531, 685) 1355075854 -0.6403219479039061 treat image : temp/1746090029_1815683_1354773796_173bb05bf24cbe80d2e98c48bb4e9bdf_rle_crop_3778255629_0.png resize: (149, 186) 1355075855 -0.4129413224096654 treat image : temp/1746090029_1815683_1354773796_173bb05bf24cbe80d2e98c48bb4e9bdf_rle_crop_3778255630_0.png resize: (203, 215) 1355075856 -2.2033927619732934 treat image : temp/1746090029_1815683_1354773796_173bb05bf24cbe80d2e98c48bb4e9bdf_rle_crop_3778255639_0.png resize: (116, 177) 1355075858 -0.4440169512227687 treat image : temp/1746090029_1815683_1354773796_173bb05bf24cbe80d2e98c48bb4e9bdf_rle_crop_3778255647_0.png resize: (161, 135) 1355075860 -0.7821835528216957 treat image : temp/1746090029_1815683_1354773796_173bb05bf24cbe80d2e98c48bb4e9bdf_rle_crop_3778255637_0.png resize: (296, 296) 1355075861 -1.167751496169721 treat image : temp/1746090029_1815683_1354773796_173bb05bf24cbe80d2e98c48bb4e9bdf_rle_crop_3778255628_0.png resize: (374, 340) 1355075863 0.20995990785822294 treat image : temp/1746090029_1815683_1354773796_173bb05bf24cbe80d2e98c48bb4e9bdf_rle_crop_3778255633_0.png resize: (172, 101) 1355075865 -1.1380599996126044 treat image : temp/1746090029_1815683_1354773796_173bb05bf24cbe80d2e98c48bb4e9bdf_rle_crop_3778255649_0.png resize: (464, 311) 1355075866 0.04442100103856677 treat image : temp/1746090029_1815683_1354773796_173bb05bf24cbe80d2e98c48bb4e9bdf_rle_crop_3778255627_0.png resize: (262, 169) 1355075867 -0.6366707531896519 treat image : temp/1746090029_1815683_1354773716_e4557276acd76e0f44acd91867b30a33_rle_crop_3778255657_0.png resize: (73, 180) 1355075870 -0.5117515278700966 treat image : temp/1746090029_1815683_1354773716_e4557276acd76e0f44acd91867b30a33_rle_crop_3778255653_0.png resize: (507, 162) 1355075871 -0.2217468893639002 treat image : temp/1746090029_1815683_1354773716_e4557276acd76e0f44acd91867b30a33_rle_crop_3778255656_0.png resize: (210, 186) 1355075872 -0.1627510047583011 treat image : temp/1746090029_1815683_1354773716_e4557276acd76e0f44acd91867b30a33_rle_crop_3778255652_0.png resize: (99, 179) 1355075874 -1.5912541009008518 treat image : temp/1746090029_1815683_1354772484_ea62b6de805cce7f17cffa3a6b20b42d_rle_crop_3778255672_0.png resize: (282, 364) 1355075876 -2.370460561842625 treat image : temp/1746090029_1815683_1354772484_ea62b6de805cce7f17cffa3a6b20b42d_rle_crop_3778255669_0.png resize: (176, 206) 1355075877 -2.108301882488988 treat image : temp/1746090029_1815683_1354772484_ea62b6de805cce7f17cffa3a6b20b42d_rle_crop_3778255664_0.png resize: (285, 544) 1355075879 -4.991672392677926 treat image : temp/1746090029_1815683_1354772484_ea62b6de805cce7f17cffa3a6b20b42d_rle_crop_3778255670_0.png resize: (435, 422) 1355075881 -2.7246046574830216 treat image : temp/1746090029_1815683_1354772484_ea62b6de805cce7f17cffa3a6b20b42d_rle_crop_3778255665_0.png resize: (160, 129) 1355075882 -4.045863027287009 treat image : temp/1746090029_1815683_1354772484_ea62b6de805cce7f17cffa3a6b20b42d_rle_crop_3778255668_0.png resize: (58, 319) 1355075883 -1.9082284339949318 treat image : temp/1746090029_1815683_1354772484_ea62b6de805cce7f17cffa3a6b20b42d_rle_crop_3778255667_0.png resize: (202, 560) 1355075886 -3.414232684785645 treat image : temp/1746090029_1815683_1354772484_ea62b6de805cce7f17cffa3a6b20b42d_rle_crop_3778255662_0.png resize: (405, 419) 1355075887 -4.620260813895807 treat image : temp/1746090029_1815683_1354772484_ea62b6de805cce7f17cffa3a6b20b42d_rle_crop_3778255663_0.png resize: (94, 77) 1355075888 -2.2485146305848467 treat image : temp/1746090029_1815683_1354772484_ea62b6de805cce7f17cffa3a6b20b42d_rle_crop_3778255659_0.png resize: (204, 335) 1355075890 -2.8035203412199783 treat image : temp/1746090029_1815683_1354781200_156adea2166f72f2d28e57023af23e44_rle_crop_3778255554_0.png resize: (121, 200) 1355075936 -0.8103262834366696 treat image : temp/1746090029_1815683_1354774455_cbb50f435dd72bab1ad4e5fde9682f8a_rle_crop_3778255566_0.png resize: (198, 179) 1355075937 -1.2683486978020297 treat image : temp/1746090029_1815683_1354774455_cbb50f435dd72bab1ad4e5fde9682f8a_rle_crop_3778255567_0.png resize: (190, 165) 1355075938 -1.3491752332154643 treat image : temp/1746090029_1815683_1354773960_9041dafa2e7e3e7f5cf3d2b9b8473ebd_rle_crop_3778255606_0.png resize: (231, 188) 1355075939 -0.8541577224749365 treat image : temp/1746090029_1815683_1354773960_9041dafa2e7e3e7f5cf3d2b9b8473ebd_rle_crop_3778255602_0.png resize: (313, 222) 1355075941 -1.6202737598124857 treat image : temp/1746090029_1815683_1354773960_9041dafa2e7e3e7f5cf3d2b9b8473ebd_rle_crop_3778255604_0.png resize: (357, 466) 1355075942 -1.653650707995428 treat image : temp/1746090029_1815683_1354773879_a6401e0cb1b04daadeaa19852d6dbe0d_rle_crop_3778255621_0.png resize: (217, 222) 1355075943 -1.9483331768190195 treat image : temp/1746090029_1815683_1354773796_173bb05bf24cbe80d2e98c48bb4e9bdf_rle_crop_3778255632_0.png resize: (251, 244) 1355075945 -0.715958836129494 treat image : temp/1746090029_1815683_1354773796_173bb05bf24cbe80d2e98c48bb4e9bdf_rle_crop_3778255642_0.png resize: (261, 325) 1355075946 -0.1254814538991685 treat image : temp/1746090029_1815683_1354773716_e4557276acd76e0f44acd91867b30a33_rle_crop_3778255651_0.png resize: (114, 297) 1355075947 -1.3043140979354344 treat image : temp/1746090029_1815683_1354774041_1fef8b6fe6be6f0aa5ef9a0d7f54808f_rle_crop_3778255588_0.png resize: (114, 140) 1355075960 -2.4037838193755134 treat image : temp/1746090029_1815683_1354781200_156adea2166f72f2d28e57023af23e44_rle_crop_3778255543_0.png resize: (99, 344) 1355076154 -3.27449420112292 treat image : temp/1746090029_1815683_1354781200_156adea2166f72f2d28e57023af23e44_rle_crop_3778255547_0.png resize: (559, 474) 1355076155 0.019892449079833542 treat image : temp/1746090029_1815683_1354774455_cbb50f435dd72bab1ad4e5fde9682f8a_rle_crop_3778255565_0.png resize: (104, 341) 1355076157 -3.4892491214474557 treat image : temp/1746090029_1815683_1354774041_1fef8b6fe6be6f0aa5ef9a0d7f54808f_rle_crop_3778255583_0.png resize: (333, 688) 1355076158 -0.8936473837626422 treat image : temp/1746090029_1815683_1354774041_1fef8b6fe6be6f0aa5ef9a0d7f54808f_rle_crop_3778255580_0.png resize: (416, 329) 1355076159 -1.082424448257606 treat image : temp/1746090029_1815683_1354774041_1fef8b6fe6be6f0aa5ef9a0d7f54808f_rle_crop_3778255584_0.png resize: (426, 493) 1355076161 -1.425291121778878 treat image : temp/1746090029_1815683_1354774041_1fef8b6fe6be6f0aa5ef9a0d7f54808f_rle_crop_3778255574_0.png resize: (278, 496) 1355076162 -1.708145303043017 treat image : temp/1746090029_1815683_1354774041_1fef8b6fe6be6f0aa5ef9a0d7f54808f_rle_crop_3778255573_0.png resize: (115, 238) 1355076163 -2.728814122327121 treat image : temp/1746090029_1815683_1354774041_1fef8b6fe6be6f0aa5ef9a0d7f54808f_rle_crop_3778255579_0.png resize: (140, 351) 1355076165 -0.8050575399620994 treat image : temp/1746090029_1815683_1354774041_1fef8b6fe6be6f0aa5ef9a0d7f54808f_rle_crop_3778255575_0.png resize: (212, 359) 1355076166 0.06536636148369637 treat image : temp/1746090029_1815683_1354774041_1fef8b6fe6be6f0aa5ef9a0d7f54808f_rle_crop_3778255585_0.png resize: (326, 439) 1355076167 -0.39905372530681815 treat image : temp/1746090029_1815683_1354774041_1fef8b6fe6be6f0aa5ef9a0d7f54808f_rle_crop_3778255578_0.png resize: (126, 224) 1355076168 -0.3499836795008086 treat image : temp/1746090029_1815683_1354774041_1fef8b6fe6be6f0aa5ef9a0d7f54808f_rle_crop_3778255570_0.png resize: (488, 495) 1355076170 -1.2090367632985026 treat image : temp/1746090029_1815683_1354774041_1fef8b6fe6be6f0aa5ef9a0d7f54808f_rle_crop_3778255581_0.png resize: (213, 152) 1355076171 -3.6863845600663696 treat image : temp/1746090029_1815683_1354773960_9041dafa2e7e3e7f5cf3d2b9b8473ebd_rle_crop_3778255590_0.png resize: (447, 787) 1355076172 -2.3009769454303353 treat image : temp/1746090029_1815683_1354773960_9041dafa2e7e3e7f5cf3d2b9b8473ebd_rle_crop_3778255598_0.png resize: (196, 217) 1355076174 -0.9714918887672285 treat image : temp/1746090029_1815683_1354773960_9041dafa2e7e3e7f5cf3d2b9b8473ebd_rle_crop_3778255595_0.png resize: (299, 219) 1355076175 -2.872821007986598 treat image : temp/1746090029_1815683_1354773960_9041dafa2e7e3e7f5cf3d2b9b8473ebd_rle_crop_3778255589_0.png resize: (216, 175) 1355076176 -1.9104640723876616 treat image : temp/1746090029_1815683_1354773960_9041dafa2e7e3e7f5cf3d2b9b8473ebd_rle_crop_3778255591_0.png resize: (118, 237) 1355076177 -2.837666777231718 treat image : temp/1746090029_1815683_1354773960_9041dafa2e7e3e7f5cf3d2b9b8473ebd_rle_crop_3778255594_0.png resize: (316, 304) 1355076179 -2.013709377673137 treat image : temp/1746090029_1815683_1354773879_a6401e0cb1b04daadeaa19852d6dbe0d_rle_crop_3778255626_0.png resize: (255, 292) 1355076180 -0.7793505955884528 treat image : temp/1746090029_1815683_1354773879_a6401e0cb1b04daadeaa19852d6dbe0d_rle_crop_3778255620_0.png resize: (263, 174) 1355076181 -2.0232653094129818 treat image : temp/1746090029_1815683_1354773879_a6401e0cb1b04daadeaa19852d6dbe0d_rle_crop_3778255610_0.png resize: (282, 372) 1355076183 -1.7531775971438295 treat image : temp/1746090029_1815683_1354773879_a6401e0cb1b04daadeaa19852d6dbe0d_rle_crop_3778255611_0.png resize: (206, 334) 1355076184 -1.719725715828786 treat image : temp/1746090029_1815683_1354773879_a6401e0cb1b04daadeaa19852d6dbe0d_rle_crop_3778255625_0.png resize: (234, 153) 1355076185 -1.5775932419699839 treat image : temp/1746090029_1815683_1354773879_a6401e0cb1b04daadeaa19852d6dbe0d_rle_crop_3778255609_0.png resize: (247, 310) 1355076187 -2.284216013302237 treat image : temp/1746090029_1815683_1354773879_a6401e0cb1b04daadeaa19852d6dbe0d_rle_crop_3778255619_0.png resize: (273, 489) 1355076188 -0.6714375667018545 treat image : temp/1746090029_1815683_1354773879_a6401e0cb1b04daadeaa19852d6dbe0d_rle_crop_3778255608_0.png resize: (214, 385) 1355076189 -2.097893414072632 treat image : temp/1746090029_1815683_1354773796_173bb05bf24cbe80d2e98c48bb4e9bdf_rle_crop_3778255635_0.png resize: (487, 289) 1355076190 -1.3217850727751104 treat image : temp/1746090029_1815683_1354773796_173bb05bf24cbe80d2e98c48bb4e9bdf_rle_crop_3778255650_0.png resize: (302, 147) 1355076192 -1.3913720377552383 treat image : temp/1746090029_1815683_1354773796_173bb05bf24cbe80d2e98c48bb4e9bdf_rle_crop_3778255640_0.png resize: (268, 280) 1355076193 -1.7451271189968027 treat image : temp/1746090029_1815683_1354773796_173bb05bf24cbe80d2e98c48bb4e9bdf_rle_crop_3778255638_0.png resize: (125, 141) 1355076194 -1.7483149254247385 treat image : temp/1746090029_1815683_1354773796_173bb05bf24cbe80d2e98c48bb4e9bdf_rle_crop_3778255641_0.png resize: (302, 152) 1355076196 0.26134972005056784 treat image : temp/1746090029_1815683_1354773796_173bb05bf24cbe80d2e98c48bb4e9bdf_rle_crop_3778255636_0.png resize: (250, 307) 1355076197 -0.8048007235677304 treat image : temp/1746090029_1815683_1354773796_173bb05bf24cbe80d2e98c48bb4e9bdf_rle_crop_3778255634_0.png resize: (310, 241) 1355076198 -1.0990281354554687 treat image : temp/1746090029_1815683_1354773796_173bb05bf24cbe80d2e98c48bb4e9bdf_rle_crop_3778255645_0.png resize: (134, 306) 1355076199 -1.3874046688164483 treat image : temp/1746090029_1815683_1354773796_173bb05bf24cbe80d2e98c48bb4e9bdf_rle_crop_3778255644_0.png resize: (113, 162) 1355076201 -1.2534122941255212 treat image : temp/1746090029_1815683_1354773796_173bb05bf24cbe80d2e98c48bb4e9bdf_rle_crop_3778255648_0.png resize: (487, 283) 1355076203 -0.8014329446976427 treat image : temp/1746090029_1815683_1354773716_e4557276acd76e0f44acd91867b30a33_rle_crop_3778255654_0.png resize: (533, 382) 1355076204 -0.9855421264873887 treat image : temp/1746090029_1815683_1354773716_e4557276acd76e0f44acd91867b30a33_rle_crop_3778255658_0.png resize: (290, 280) 1355076206 -1.7658052960791977 treat image : temp/1746090029_1815683_1354773716_e4557276acd76e0f44acd91867b30a33_rle_crop_3778255655_0.png resize: (200, 108) 1355076208 0.9891468154934199 treat image : temp/1746090029_1815683_1354772484_ea62b6de805cce7f17cffa3a6b20b42d_rle_crop_3778255660_0.png resize: (463, 424) 1355076209 -2.7567976566053214 treat image : temp/1746090029_1815683_1354772484_ea62b6de805cce7f17cffa3a6b20b42d_rle_crop_3778255671_0.png resize: (703, 496) 1355076210 -4.348727590012925 treat image : temp/1746090029_1815683_1354772484_ea62b6de805cce7f17cffa3a6b20b42d_rle_crop_3778255673_0.png resize: (102, 327) 1355076212 -2.51235485269843 treat image : temp/1746090029_1815683_1354772484_ea62b6de805cce7f17cffa3a6b20b42d_rle_crop_3778255666_0.png resize: (337, 477) 1355076213 -4.458493424847074 treat image : temp/1746090029_1815683_1354772484_ea62b6de805cce7f17cffa3a6b20b42d_rle_crop_3778255661_0.png resize: (278, 243) 1355076214 -2.353289424726847 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 142 time used for this insertion : 0.019019365310668945 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 142 time used for this insertion : 0.028149843215942383 save missing photos in datou_result : time spend for datou_step_exec : 29.096909999847412 time spend to save output : 0.052979469299316406 total time spend for step 6 : 29.14988946914673 step7:brightness Thu May 1 11:05:33 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1746090029_1815683_1354781200_156adea2166f72f2d28e57023af23e44.jpg treat image : temp/1746090029_1815683_1354774455_cbb50f435dd72bab1ad4e5fde9682f8a.jpg treat image : temp/1746090029_1815683_1354774041_1fef8b6fe6be6f0aa5ef9a0d7f54808f.jpg treat image : temp/1746090029_1815683_1354773960_9041dafa2e7e3e7f5cf3d2b9b8473ebd.jpg treat image : temp/1746090029_1815683_1354773879_a6401e0cb1b04daadeaa19852d6dbe0d.jpg treat image : temp/1746090029_1815683_1354773796_173bb05bf24cbe80d2e98c48bb4e9bdf.jpg treat image : temp/1746090029_1815683_1354773716_e4557276acd76e0f44acd91867b30a33.jpg treat image : temp/1746090029_1815683_1354772484_ea62b6de805cce7f17cffa3a6b20b42d.jpg treat image : temp/1746090029_1815683_1354781200_156adea2166f72f2d28e57023af23e44_rle_crop_3778255540_0.png treat image : temp/1746090029_1815683_1354781200_156adea2166f72f2d28e57023af23e44_rle_crop_3778255548_0.png treat image : temp/1746090029_1815683_1354781200_156adea2166f72f2d28e57023af23e44_rle_crop_3778255555_0.png treat image : temp/1746090029_1815683_1354781200_156adea2166f72f2d28e57023af23e44_rle_crop_3778255549_0.png treat image : temp/1746090029_1815683_1354781200_156adea2166f72f2d28e57023af23e44_rle_crop_3778255550_0.png treat image : temp/1746090029_1815683_1354781200_156adea2166f72f2d28e57023af23e44_rle_crop_3778255545_0.png treat image : temp/1746090029_1815683_1354781200_156adea2166f72f2d28e57023af23e44_rle_crop_3778255546_0.png treat image : temp/1746090029_1815683_1354781200_156adea2166f72f2d28e57023af23e44_rle_crop_3778255542_0.png treat image : temp/1746090029_1815683_1354781200_156adea2166f72f2d28e57023af23e44_rle_crop_3778255544_0.png treat image : temp/1746090029_1815683_1354781200_156adea2166f72f2d28e57023af23e44_rle_crop_3778255541_0.png treat image : temp/1746090029_1815683_1354781200_156adea2166f72f2d28e57023af23e44_rle_crop_3778255553_0.png treat image : temp/1746090029_1815683_1354781200_156adea2166f72f2d28e57023af23e44_rle_crop_3778255552_0.png treat image : temp/1746090029_1815683_1354781200_156adea2166f72f2d28e57023af23e44_rle_crop_3778255551_0.png treat image : temp/1746090029_1815683_1354774455_cbb50f435dd72bab1ad4e5fde9682f8a_rle_crop_3778255556_0.png treat image : temp/1746090029_1815683_1354774455_cbb50f435dd72bab1ad4e5fde9682f8a_rle_crop_3778255561_0.png treat image : temp/1746090029_1815683_1354774455_cbb50f435dd72bab1ad4e5fde9682f8a_rle_crop_3778255560_0.png treat image : temp/1746090029_1815683_1354774455_cbb50f435dd72bab1ad4e5fde9682f8a_rle_crop_3778255558_0.png treat image : temp/1746090029_1815683_1354774455_cbb50f435dd72bab1ad4e5fde9682f8a_rle_crop_3778255564_0.png treat image : temp/1746090029_1815683_1354774455_cbb50f435dd72bab1ad4e5fde9682f8a_rle_crop_3778255562_0.png treat image : temp/1746090029_1815683_1354774455_cbb50f435dd72bab1ad4e5fde9682f8a_rle_crop_3778255563_0.png treat image : temp/1746090029_1815683_1354774455_cbb50f435dd72bab1ad4e5fde9682f8a_rle_crop_3778255559_0.png treat image : temp/1746090029_1815683_1354774455_cbb50f435dd72bab1ad4e5fde9682f8a_rle_crop_3778255568_0.png treat image : temp/1746090029_1815683_1354774455_cbb50f435dd72bab1ad4e5fde9682f8a_rle_crop_3778255557_0.png treat image : temp/1746090029_1815683_1354774041_1fef8b6fe6be6f0aa5ef9a0d7f54808f_rle_crop_3778255586_0.png treat image : temp/1746090029_1815683_1354774041_1fef8b6fe6be6f0aa5ef9a0d7f54808f_rle_crop_3778255582_0.png treat image : temp/1746090029_1815683_1354774041_1fef8b6fe6be6f0aa5ef9a0d7f54808f_rle_crop_3778255576_0.png treat image : temp/1746090029_1815683_1354774041_1fef8b6fe6be6f0aa5ef9a0d7f54808f_rle_crop_3778255572_0.png treat image : temp/1746090029_1815683_1354774041_1fef8b6fe6be6f0aa5ef9a0d7f54808f_rle_crop_3778255587_0.png treat image : temp/1746090029_1815683_1354774041_1fef8b6fe6be6f0aa5ef9a0d7f54808f_rle_crop_3778255569_0.png treat image : temp/1746090029_1815683_1354774041_1fef8b6fe6be6f0aa5ef9a0d7f54808f_rle_crop_3778255571_0.png treat image : temp/1746090029_1815683_1354774041_1fef8b6fe6be6f0aa5ef9a0d7f54808f_rle_crop_3778255577_0.png treat image : temp/1746090029_1815683_1354773960_9041dafa2e7e3e7f5cf3d2b9b8473ebd_rle_crop_3778255597_0.png treat image : temp/1746090029_1815683_1354773960_9041dafa2e7e3e7f5cf3d2b9b8473ebd_rle_crop_3778255593_0.png treat image : temp/1746090029_1815683_1354773960_9041dafa2e7e3e7f5cf3d2b9b8473ebd_rle_crop_3778255601_0.png treat image : temp/1746090029_1815683_1354773960_9041dafa2e7e3e7f5cf3d2b9b8473ebd_rle_crop_3778255592_0.png treat image : temp/1746090029_1815683_1354773960_9041dafa2e7e3e7f5cf3d2b9b8473ebd_rle_crop_3778255603_0.png treat image : temp/1746090029_1815683_1354773960_9041dafa2e7e3e7f5cf3d2b9b8473ebd_rle_crop_3778255599_0.png treat image : temp/1746090029_1815683_1354773960_9041dafa2e7e3e7f5cf3d2b9b8473ebd_rle_crop_3778255596_0.png treat image : temp/1746090029_1815683_1354773960_9041dafa2e7e3e7f5cf3d2b9b8473ebd_rle_crop_3778255605_0.png treat image : temp/1746090029_1815683_1354773960_9041dafa2e7e3e7f5cf3d2b9b8473ebd_rle_crop_3778255600_0.png treat image : temp/1746090029_1815683_1354773879_a6401e0cb1b04daadeaa19852d6dbe0d_rle_crop_3778255617_0.png treat image : temp/1746090029_1815683_1354773879_a6401e0cb1b04daadeaa19852d6dbe0d_rle_crop_3778255614_0.png treat image : temp/1746090029_1815683_1354773879_a6401e0cb1b04daadeaa19852d6dbe0d_rle_crop_3778255613_0.png treat image : temp/1746090029_1815683_1354773879_a6401e0cb1b04daadeaa19852d6dbe0d_rle_crop_3778255623_0.png treat image : temp/1746090029_1815683_1354773879_a6401e0cb1b04daadeaa19852d6dbe0d_rle_crop_3778255624_0.png treat image : temp/1746090029_1815683_1354773879_a6401e0cb1b04daadeaa19852d6dbe0d_rle_crop_3778255612_0.png treat image : temp/1746090029_1815683_1354773879_a6401e0cb1b04daadeaa19852d6dbe0d_rle_crop_3778255615_0.png treat image : temp/1746090029_1815683_1354773879_a6401e0cb1b04daadeaa19852d6dbe0d_rle_crop_3778255616_0.png treat image : temp/1746090029_1815683_1354773879_a6401e0cb1b04daadeaa19852d6dbe0d_rle_crop_3778255618_0.png treat image : temp/1746090029_1815683_1354773879_a6401e0cb1b04daadeaa19852d6dbe0d_rle_crop_3778255607_0.png treat image : temp/1746090029_1815683_1354773879_a6401e0cb1b04daadeaa19852d6dbe0d_rle_crop_3778255622_0.png treat image : temp/1746090029_1815683_1354773796_173bb05bf24cbe80d2e98c48bb4e9bdf_rle_crop_3778255646_0.png treat image : temp/1746090029_1815683_1354773796_173bb05bf24cbe80d2e98c48bb4e9bdf_rle_crop_3778255631_0.png treat image : temp/1746090029_1815683_1354773796_173bb05bf24cbe80d2e98c48bb4e9bdf_rle_crop_3778255643_0.png treat image : temp/1746090029_1815683_1354773796_173bb05bf24cbe80d2e98c48bb4e9bdf_rle_crop_3778255629_0.png treat image : temp/1746090029_1815683_1354773796_173bb05bf24cbe80d2e98c48bb4e9bdf_rle_crop_3778255630_0.png treat image : temp/1746090029_1815683_1354773796_173bb05bf24cbe80d2e98c48bb4e9bdf_rle_crop_3778255639_0.png treat image : temp/1746090029_1815683_1354773796_173bb05bf24cbe80d2e98c48bb4e9bdf_rle_crop_3778255647_0.png treat image : temp/1746090029_1815683_1354773796_173bb05bf24cbe80d2e98c48bb4e9bdf_rle_crop_3778255637_0.png treat image : temp/1746090029_1815683_1354773796_173bb05bf24cbe80d2e98c48bb4e9bdf_rle_crop_3778255628_0.png treat image : temp/1746090029_1815683_1354773796_173bb05bf24cbe80d2e98c48bb4e9bdf_rle_crop_3778255633_0.png treat image : temp/1746090029_1815683_1354773796_173bb05bf24cbe80d2e98c48bb4e9bdf_rle_crop_3778255649_0.png treat image : temp/1746090029_1815683_1354773796_173bb05bf24cbe80d2e98c48bb4e9bdf_rle_crop_3778255627_0.png treat image : temp/1746090029_1815683_1354773716_e4557276acd76e0f44acd91867b30a33_rle_crop_3778255657_0.png treat image : temp/1746090029_1815683_1354773716_e4557276acd76e0f44acd91867b30a33_rle_crop_3778255653_0.png treat image : temp/1746090029_1815683_1354773716_e4557276acd76e0f44acd91867b30a33_rle_crop_3778255656_0.png treat image : temp/1746090029_1815683_1354773716_e4557276acd76e0f44acd91867b30a33_rle_crop_3778255652_0.png treat image : temp/1746090029_1815683_1354772484_ea62b6de805cce7f17cffa3a6b20b42d_rle_crop_3778255672_0.png treat image : temp/1746090029_1815683_1354772484_ea62b6de805cce7f17cffa3a6b20b42d_rle_crop_3778255669_0.png treat image : temp/1746090029_1815683_1354772484_ea62b6de805cce7f17cffa3a6b20b42d_rle_crop_3778255664_0.png treat image : temp/1746090029_1815683_1354772484_ea62b6de805cce7f17cffa3a6b20b42d_rle_crop_3778255670_0.png treat image : temp/1746090029_1815683_1354772484_ea62b6de805cce7f17cffa3a6b20b42d_rle_crop_3778255665_0.png treat image : temp/1746090029_1815683_1354772484_ea62b6de805cce7f17cffa3a6b20b42d_rle_crop_3778255668_0.png treat image : temp/1746090029_1815683_1354772484_ea62b6de805cce7f17cffa3a6b20b42d_rle_crop_3778255667_0.png treat image : temp/1746090029_1815683_1354772484_ea62b6de805cce7f17cffa3a6b20b42d_rle_crop_3778255662_0.png treat image : temp/1746090029_1815683_1354772484_ea62b6de805cce7f17cffa3a6b20b42d_rle_crop_3778255663_0.png treat image : temp/1746090029_1815683_1354772484_ea62b6de805cce7f17cffa3a6b20b42d_rle_crop_3778255659_0.png treat image : temp/1746090029_1815683_1354781200_156adea2166f72f2d28e57023af23e44_rle_crop_3778255554_0.png treat image : temp/1746090029_1815683_1354774455_cbb50f435dd72bab1ad4e5fde9682f8a_rle_crop_3778255566_0.png treat image : temp/1746090029_1815683_1354774455_cbb50f435dd72bab1ad4e5fde9682f8a_rle_crop_3778255567_0.png treat image : temp/1746090029_1815683_1354773960_9041dafa2e7e3e7f5cf3d2b9b8473ebd_rle_crop_3778255606_0.png treat image : temp/1746090029_1815683_1354773960_9041dafa2e7e3e7f5cf3d2b9b8473ebd_rle_crop_3778255602_0.png treat image : temp/1746090029_1815683_1354773960_9041dafa2e7e3e7f5cf3d2b9b8473ebd_rle_crop_3778255604_0.png treat image : temp/1746090029_1815683_1354773879_a6401e0cb1b04daadeaa19852d6dbe0d_rle_crop_3778255621_0.png treat image : temp/1746090029_1815683_1354773796_173bb05bf24cbe80d2e98c48bb4e9bdf_rle_crop_3778255632_0.png treat image : temp/1746090029_1815683_1354773796_173bb05bf24cbe80d2e98c48bb4e9bdf_rle_crop_3778255642_0.png treat image : temp/1746090029_1815683_1354773716_e4557276acd76e0f44acd91867b30a33_rle_crop_3778255651_0.png treat image : temp/1746090029_1815683_1354774041_1fef8b6fe6be6f0aa5ef9a0d7f54808f_rle_crop_3778255588_0.png treat image : temp/1746090029_1815683_1354781200_156adea2166f72f2d28e57023af23e44_rle_crop_3778255543_0.png treat image : temp/1746090029_1815683_1354781200_156adea2166f72f2d28e57023af23e44_rle_crop_3778255547_0.png treat image : temp/1746090029_1815683_1354774455_cbb50f435dd72bab1ad4e5fde9682f8a_rle_crop_3778255565_0.png treat image : temp/1746090029_1815683_1354774041_1fef8b6fe6be6f0aa5ef9a0d7f54808f_rle_crop_3778255583_0.png treat image : temp/1746090029_1815683_1354774041_1fef8b6fe6be6f0aa5ef9a0d7f54808f_rle_crop_3778255580_0.png treat image : temp/1746090029_1815683_1354774041_1fef8b6fe6be6f0aa5ef9a0d7f54808f_rle_crop_3778255584_0.png treat image : temp/1746090029_1815683_1354774041_1fef8b6fe6be6f0aa5ef9a0d7f54808f_rle_crop_3778255574_0.png treat image : temp/1746090029_1815683_1354774041_1fef8b6fe6be6f0aa5ef9a0d7f54808f_rle_crop_3778255573_0.png treat image : temp/1746090029_1815683_1354774041_1fef8b6fe6be6f0aa5ef9a0d7f54808f_rle_crop_3778255579_0.png treat image : temp/1746090029_1815683_1354774041_1fef8b6fe6be6f0aa5ef9a0d7f54808f_rle_crop_3778255575_0.png treat image : temp/1746090029_1815683_1354774041_1fef8b6fe6be6f0aa5ef9a0d7f54808f_rle_crop_3778255585_0.png treat image : temp/1746090029_1815683_1354774041_1fef8b6fe6be6f0aa5ef9a0d7f54808f_rle_crop_3778255578_0.png treat image : temp/1746090029_1815683_1354774041_1fef8b6fe6be6f0aa5ef9a0d7f54808f_rle_crop_3778255570_0.png treat image : temp/1746090029_1815683_1354774041_1fef8b6fe6be6f0aa5ef9a0d7f54808f_rle_crop_3778255581_0.png treat image : temp/1746090029_1815683_1354773960_9041dafa2e7e3e7f5cf3d2b9b8473ebd_rle_crop_3778255590_0.png treat image : temp/1746090029_1815683_1354773960_9041dafa2e7e3e7f5cf3d2b9b8473ebd_rle_crop_3778255598_0.png treat image : temp/1746090029_1815683_1354773960_9041dafa2e7e3e7f5cf3d2b9b8473ebd_rle_crop_3778255595_0.png treat image : temp/1746090029_1815683_1354773960_9041dafa2e7e3e7f5cf3d2b9b8473ebd_rle_crop_3778255589_0.png treat image : temp/1746090029_1815683_1354773960_9041dafa2e7e3e7f5cf3d2b9b8473ebd_rle_crop_3778255591_0.png treat image : temp/1746090029_1815683_1354773960_9041dafa2e7e3e7f5cf3d2b9b8473ebd_rle_crop_3778255594_0.png treat image : temp/1746090029_1815683_1354773879_a6401e0cb1b04daadeaa19852d6dbe0d_rle_crop_3778255626_0.png treat image : temp/1746090029_1815683_1354773879_a6401e0cb1b04daadeaa19852d6dbe0d_rle_crop_3778255620_0.png treat image : temp/1746090029_1815683_1354773879_a6401e0cb1b04daadeaa19852d6dbe0d_rle_crop_3778255610_0.png treat image : temp/1746090029_1815683_1354773879_a6401e0cb1b04daadeaa19852d6dbe0d_rle_crop_3778255611_0.png treat image : temp/1746090029_1815683_1354773879_a6401e0cb1b04daadeaa19852d6dbe0d_rle_crop_3778255625_0.png treat image : temp/1746090029_1815683_1354773879_a6401e0cb1b04daadeaa19852d6dbe0d_rle_crop_3778255609_0.png treat image : temp/1746090029_1815683_1354773879_a6401e0cb1b04daadeaa19852d6dbe0d_rle_crop_3778255619_0.png treat image : temp/1746090029_1815683_1354773879_a6401e0cb1b04daadeaa19852d6dbe0d_rle_crop_3778255608_0.png treat image : temp/1746090029_1815683_1354773796_173bb05bf24cbe80d2e98c48bb4e9bdf_rle_crop_3778255635_0.png treat image : temp/1746090029_1815683_1354773796_173bb05bf24cbe80d2e98c48bb4e9bdf_rle_crop_3778255650_0.png treat image : temp/1746090029_1815683_1354773796_173bb05bf24cbe80d2e98c48bb4e9bdf_rle_crop_3778255640_0.png treat image : temp/1746090029_1815683_1354773796_173bb05bf24cbe80d2e98c48bb4e9bdf_rle_crop_3778255638_0.png treat image : temp/1746090029_1815683_1354773796_173bb05bf24cbe80d2e98c48bb4e9bdf_rle_crop_3778255641_0.png treat image : temp/1746090029_1815683_1354773796_173bb05bf24cbe80d2e98c48bb4e9bdf_rle_crop_3778255636_0.png treat image : temp/1746090029_1815683_1354773796_173bb05bf24cbe80d2e98c48bb4e9bdf_rle_crop_3778255634_0.png treat image : temp/1746090029_1815683_1354773796_173bb05bf24cbe80d2e98c48bb4e9bdf_rle_crop_3778255645_0.png treat image : temp/1746090029_1815683_1354773796_173bb05bf24cbe80d2e98c48bb4e9bdf_rle_crop_3778255644_0.png treat image : temp/1746090029_1815683_1354773796_173bb05bf24cbe80d2e98c48bb4e9bdf_rle_crop_3778255648_0.png treat image : temp/1746090029_1815683_1354773716_e4557276acd76e0f44acd91867b30a33_rle_crop_3778255654_0.png treat image : temp/1746090029_1815683_1354773716_e4557276acd76e0f44acd91867b30a33_rle_crop_3778255658_0.png treat image : temp/1746090029_1815683_1354773716_e4557276acd76e0f44acd91867b30a33_rle_crop_3778255655_0.png treat image : temp/1746090029_1815683_1354772484_ea62b6de805cce7f17cffa3a6b20b42d_rle_crop_3778255660_0.png treat image : temp/1746090029_1815683_1354772484_ea62b6de805cce7f17cffa3a6b20b42d_rle_crop_3778255671_0.png treat image : temp/1746090029_1815683_1354772484_ea62b6de805cce7f17cffa3a6b20b42d_rle_crop_3778255673_0.png treat image : temp/1746090029_1815683_1354772484_ea62b6de805cce7f17cffa3a6b20b42d_rle_crop_3778255666_0.png treat image : temp/1746090029_1815683_1354772484_ea62b6de805cce7f17cffa3a6b20b42d_rle_crop_3778255661_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 142 time used for this insertion : 0.016821861267089844 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 142 time used for this insertion : 0.026880741119384766 save missing photos in datou_result : time spend for datou_step_exec : 8.041851997375488 time spend to save output : 0.04892683029174805 total time spend for step 7 : 8.090778827667236 step8:velours_tree Thu May 1 11:05:41 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.39490628242492676 time spend to save output : 7.224082946777344e-05 total time spend for step 8 : 0.39497852325439453 step9:send_mail_cod Thu May 1 11:05:42 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P22582553_01-05-2025_11_05_42.pdf 22583579 imagette225835791746090342 22583580 imagette225835801746090342 22583581 change filename to text .imagette225835811746090342 22583582 imagette225835821746090342 22583583 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette225835831746090342 22583584 imagette225835841746090347 22583585 imagette225835851746090347 22583586 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette225835861746090347 22583587 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette225835871746090348 22583588 imagette225835881746090349 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=22582553 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/22583578,22583579,22583580,22583581,22583582,22583583,22583584,22583585,22583586,22583587,22583588?tags=environnement,flou,background,metal,mal_croppe,papier,autre,pet_fonce,carton,pet_clair,pehd args[1354781200] : ((1354781200, -0.5050774383738155, 492688767), (1354781200, 0.5391995752699704, 2107752395), '0.12889933534177564') We are sending mail with results at report@fotonower.com args[1354774455] : ((1354774455, -2.588293592872852, 492609224), (1354774455, 0.5504021521259256, 2107752395), '0.12889933534177564') We are sending mail with results at report@fotonower.com args[1354774041] : ((1354774041, -2.2282187967276723, 492609224), (1354774041, 0.1709049350386012, 2107752395), '0.12889933534177564') We are sending mail with results at report@fotonower.com args[1354773960] : ((1354773960, -2.324735206250888, 492609224), (1354773960, -0.07430556705642422, 496442774), '0.12889933534177564') We are sending mail with results at report@fotonower.com args[1354773879] : ((1354773879, -3.704217198457676, 492609224), (1354773879, 0.13162856824649355, 2107752395), '0.12889933534177564') We are sending mail with results at report@fotonower.com args[1354773796] : ((1354773796, -0.11666399183253691, 492688767), (1354773796, 0.09182801348931104, 2107752395), '0.12889933534177564') We are sending mail with results at report@fotonower.com args[1354773716] : ((1354773716, -1.2695142219087743, 492688767), (1354773716, 0.14234137619913212, 2107752395), '0.12889933534177564') We are sending mail with results at report@fotonower.com args[1354772484] : ((1354772484, -5.620999469797681, 492609224), (1354772484, 0.11604141082829224, 2107752395), '0.12889933534177564') We are sending mail with results at report@fotonower.com refus_total : 0.12889933534177564 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=22582553 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22582553_01-05-2025_11_05_42.pdf results_Auto_P22582553_01-05-2025_11_05_42.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22582553_01-05-2025_11_05_42.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','22582553','results_Auto_P22582553_01-05-2025_11_05_42.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22582553_01-05-2025_11_05_42.pdf','pdf','','0.56','0.12889933534177564') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/22582553

https://www.fotonower.com/image?json=false&list_photos_id=1354781200
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1354774455
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1354774041
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1354773960
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1354773879
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1354773796
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1354773716
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1354772484
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 12.89%
Veuillez trouver les photos des contaminants.

exemples de contaminants: metal: https://www.fotonower.com/view/22583581?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/22583583?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/22583586?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/22583587?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22582553_01-05-2025_11_05_42.pdf.

Lien vers velours :https://www.fotonower.com/velours/22583578,22583579,22583580,22583581,22583582,22583583,22583584,22583585,22583586,22583587,22583588?tags=environnement,flou,background,metal,mal_croppe,papier,autre,pet_fonce,carton,pet_clair,pehd.


L'équipe Fotonower 202 b'' Server: nginx Date: Thu, 01 May 2025 09:05:53 GMT Content-Length: 0 Connection: close X-Message-Id: 82ZLIUEJSD2OjvbWrE7orA Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1354781200, 1354774455, 1354774041, 1354773960, 1354773879, 1354773796, 1354773716, 1354772484] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2778691') ('3318', '22582553', '1354781200', None, None, None, None, None, '2778691') ('3318', None, None, None, None, None, None, None, '2778691') ('3318', '22582553', '1354774455', None, None, None, None, None, '2778691') ('3318', None, None, None, None, None, None, None, '2778691') ('3318', '22582553', '1354774041', None, None, None, None, None, '2778691') ('3318', None, None, None, None, None, None, None, '2778691') ('3318', '22582553', '1354773960', None, None, None, None, None, '2778691') ('3318', None, None, None, None, None, None, None, '2778691') ('3318', '22582553', '1354773879', None, None, None, None, None, '2778691') ('3318', None, None, None, None, None, None, None, '2778691') ('3318', '22582553', '1354773796', None, None, None, None, None, '2778691') ('3318', None, None, None, None, None, None, None, '2778691') ('3318', '22582553', '1354773716', None, None, None, None, None, '2778691') ('3318', None, None, None, None, None, None, None, '2778691') ('3318', '22582553', '1354772484', None, None, None, None, None, '2778691') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.012982845306396484 save_final save missing photos in datou_result : time spend for datou_step_exec : 10.954758167266846 time spend to save output : 0.013234376907348633 total time spend for step 9 : 10.967992544174194 step10:split_time_score Thu May 1 11:05:53 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('16', 8),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 30042025 22582553 Nombre de photos uploadées : 8 / 23040 (0%) 30042025 22582553 Nombre de photos taguées (types de déchets): 0 / 8 (0%) 30042025 22582553 Nombre de photos taguées (volume) : 0 / 8 (0%) elapsed_time : load_data_split_time_score 2.384185791015625e-06 elapsed_time : order_list_meta_photo_and_scores 6.9141387939453125e-06 ???????? elapsed_time : fill_and_build_computed_from_old_data 0.00036787986755371094 elapsed_time : insert_dashboard_record_day_entry 0.0225069522857666 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22582513 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22582515 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22582516 order by id desc limit 1 Qualite : 0.038301612895888265 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22582519_01-05-2025_11_04_46.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22582519 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22582519 AND mptpi.`type`=3726 To do Qualite : 0.176817061369542 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22582521_01-05-2025_10_55_55.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22582521 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22582521 AND mptpi.`type`=3594 To do Qualite : 0.12953026486267905 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22582523_01-05-2025_10_53_39.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22582523 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22582523 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22582535 order by id desc limit 1 Qualite : 0.03250910773056836 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22582540_01-05-2025_10_53_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22582540 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22582540 AND mptpi.`type`=3726 To do Qualite : 0.13705221534710457 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22582544_01-05-2025_10_42_36.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22582544 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22582544 AND mptpi.`type`=3726 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22582550 order by id desc limit 1 Qualite : 0.12889933534177564 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22582553_01-05-2025_11_05_42.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22582553 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22582553 AND mptpi.`type`=3594 To do Qualite : 0.16734336348833515 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22582554_01-05-2025_10_46_17.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22582554 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22582554 AND mptpi.`type`=3594 To do Qualite : 0.15751766370128306 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22582555_01-05-2025_10_59_49.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22582555 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22582555 AND mptpi.`type`=3594 To do Qualite : 0.07161995459001567 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22582556_01-05-2025_10_31_16.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22582556 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22582556 AND mptpi.`type`=3726 To do Qualite : 0.15599883371222897 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22582560_01-05-2025_10_46_52.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22582560 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22582560 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22582571 order by id desc limit 1 NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'30042025': {'nb_upload': 8, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1354781200, 1354774455, 1354774041, 1354773960, 1354773879, 1354773796, 1354773716, 1354772484] Looping around the photos to save general results len do output : 1 /22582553Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2778691') ('3318', '22582553', '1354781200', None, None, None, None, None, '2778691') ('3318', None, None, None, None, None, None, None, '2778691') ('3318', '22582553', '1354774455', None, None, None, None, None, '2778691') ('3318', None, None, None, None, None, None, None, '2778691') ('3318', '22582553', '1354774041', None, None, None, None, None, '2778691') ('3318', None, None, None, None, None, None, None, '2778691') ('3318', '22582553', '1354773960', None, None, None, None, None, '2778691') ('3318', None, None, None, None, None, None, None, '2778691') ('3318', '22582553', '1354773879', None, None, None, None, None, '2778691') ('3318', None, None, None, None, None, None, None, '2778691') ('3318', '22582553', '1354773796', None, None, None, None, None, '2778691') ('3318', None, None, None, None, None, None, None, '2778691') ('3318', '22582553', '1354773716', None, None, None, None, None, '2778691') ('3318', None, None, None, None, None, None, None, '2778691') ('3318', '22582553', '1354772484', None, None, None, None, None, '2778691') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.013965368270874023 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.802164554595947 time spend to save output : 0.014272451400756836 total time spend for step 10 : 5.816437005996704 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 8 set_done_treatment 126.37user 136.62system 5:33.65elapsed 78%CPU (0avgtext+0avgdata 5137936maxresident)k 2454760inputs+80184outputs (17481major+11961250minor)pagefaults 0swaps