python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 569182 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2553456'] with mtr_portfolio_ids : ['20270434'] and first list_photo_ids : [] new path : /proc/569182/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 7 ; length of list_pids : 7 ; length of list_args : 7 time to download the photos : 1.609318733215332 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Wed Feb 5 19:10:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 3145 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-02-05 19:10:32.344790: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-02-05 19:10:32.351620: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-02-05 19:10:32.352875: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fd8ec000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-02-05 19:10:32.352911: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-02-05 19:10:32.355172: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-02-05 19:10:32.604136: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x3bc27d80 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-02-05 19:10:32.604186: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-02-05 19:10:32.605166: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-05 19:10:32.605548: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-05 19:10:32.608272: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-05 19:10:32.610986: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-05 19:10:32.611474: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-05 19:10:32.613951: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-05 19:10:32.615144: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-05 19:10:32.619711: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-05 19:10:32.620873: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-05 19:10:32.620989: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-05 19:10:32.621621: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-05 19:10:32.621639: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-05 19:10:32.621650: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-05 19:10:32.622756: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 2540 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-02-05 19:10:32.871174: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-05 19:10:32.871283: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-05 19:10:32.871312: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-05 19:10:32.871337: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-05 19:10:32.871363: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-05 19:10:32.871388: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-05 19:10:32.871412: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-05 19:10:32.871438: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-05 19:10:32.872420: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-05 19:10:32.873416: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-05 19:10:32.873472: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-05 19:10:32.873489: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-05 19:10:32.873503: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-05 19:10:32.873517: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-05 19:10:32.873532: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-05 19:10:32.873545: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-05 19:10:32.873561: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-05 19:10:32.874389: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-05 19:10:32.874419: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-05 19:10:32.874428: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-05 19:10:32.874436: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-05 19:10:32.875361: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 2540 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-02-05 19:10:45.741484: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-05 19:10:45.977295: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-05 19:10:47.424244: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-05 19:10:47.424308: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-05 19:10:47.430769: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-05 19:10:47.430794: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-05 19:10:47.480698: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-05 19:10:47.480768: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-05 19:10:47.522394: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.09GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-05 19:10:47.522420: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.09GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-05 19:10:47.573402: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.15GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-05 19:10:47.573434: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.15GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-05 19:10:47.893601: W tensorflow/core/common_runtime/bfc_allocator.cc:311] Garbage collection: deallocate free memory regions (i.e., allocations) so that we can re-allocate a larger region to avoid OOM due to memory fragmentation. If you see this message frequently, you are running near the threshold of the available device memory and re-allocation may incur great performance overhead. You may try smaller batch sizes to observe the performance impact. Set TF_ENABLE_GPU_GARBAGE_COLLECTION=false if you'd like to disable this feature. local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 7 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.35000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 36 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.85000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 39 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 2.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 145.35000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 50 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 5.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 147.35000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 34 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 145.35000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 51 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 147.35000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 45 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 144.85000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 59 Detection mask done ! Trying to reset tf kernel 569383 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 143 tf kernel not reseted sub process len(results) : 7 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 7 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 3366 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0006558895111083984 nb_pixel_total : 25435 time to create 1 rle with old method : 0.02915048599243164 length of segment : 154 time for calcul the mask position with numpy : 0.0007224082946777344 nb_pixel_total : 34671 time to create 1 rle with old method : 0.03648972511291504 length of segment : 226 time for calcul the mask position with numpy : 0.0003132820129394531 nb_pixel_total : 15623 time to create 1 rle with old method : 0.016535043716430664 length of segment : 168 time for calcul the mask position with numpy : 0.0002071857452392578 nb_pixel_total : 10102 time to create 1 rle with old method : 0.010950803756713867 length of segment : 132 time for calcul the mask position with numpy : 0.0004036426544189453 nb_pixel_total : 27885 time to create 1 rle with old method : 0.031263113021850586 length of segment : 176 time for calcul the mask position with numpy : 0.0002713203430175781 nb_pixel_total : 13298 time to create 1 rle with old method : 0.014745473861694336 length of segment : 141 time for calcul the mask position with numpy : 0.0003657341003417969 nb_pixel_total : 24643 time to create 1 rle with old method : 0.025602340698242188 length of segment : 171 time for calcul the mask position with numpy : 0.00038623809814453125 nb_pixel_total : 21431 time to create 1 rle with old method : 0.02297687530517578 length of segment : 166 time for calcul the mask position with numpy : 0.00025463104248046875 nb_pixel_total : 12992 time to create 1 rle with old method : 0.014359712600708008 length of segment : 115 time for calcul the mask position with numpy : 0.00019669532775878906 nb_pixel_total : 9060 time to create 1 rle with old method : 0.010686159133911133 length of segment : 75 time for calcul the mask position with numpy : 0.0003516674041748047 nb_pixel_total : 23634 time to create 1 rle with old method : 0.026001691818237305 length of segment : 153 time for calcul the mask position with numpy : 0.0001404285430908203 nb_pixel_total : 5910 time to create 1 rle with old method : 0.006418466567993164 length of segment : 93 time for calcul the mask position with numpy : 0.0002205371856689453 nb_pixel_total : 11215 time to create 1 rle with old method : 0.012778520584106445 length of segment : 127 time for calcul the mask position with numpy : 0.005266666412353516 nb_pixel_total : 142719 time to create 1 rle with old method : 0.14737606048583984 length of segment : 643 time for calcul the mask position with numpy : 0.0004887580871582031 nb_pixel_total : 14682 time to create 1 rle with old method : 0.01711130142211914 length of segment : 159 time for calcul the mask position with numpy : 0.006334066390991211 nb_pixel_total : 208447 time to create 1 rle with new method : 0.019342660903930664 length of segment : 828 time for calcul the mask position with numpy : 0.0003571510314941406 nb_pixel_total : 13160 time to create 1 rle with old method : 0.015042781829833984 length of segment : 173 time for calcul the mask position with numpy : 0.000377655029296875 nb_pixel_total : 24423 time to create 1 rle with old method : 0.02723836898803711 length of segment : 172 time for calcul the mask position with numpy : 0.0002486705780029297 nb_pixel_total : 5602 time to create 1 rle with old method : 0.0065953731536865234 length of segment : 221 time for calcul the mask position with numpy : 0.0004673004150390625 nb_pixel_total : 11302 time to create 1 rle with old method : 0.013093709945678711 length of segment : 227 time for calcul the mask position with numpy : 0.00034356117248535156 nb_pixel_total : 10371 time to create 1 rle with old method : 0.011890649795532227 length of segment : 205 time for calcul the mask position with numpy : 0.0009119510650634766 nb_pixel_total : 49890 time to create 1 rle with old method : 0.05366158485412598 length of segment : 313 time for calcul the mask position with numpy : 0.00049591064453125 nb_pixel_total : 25826 time to create 1 rle with old method : 0.028387784957885742 length of segment : 323 time for calcul the mask position with numpy : 0.00034332275390625 nb_pixel_total : 12512 time to create 1 rle with old method : 0.02033829689025879 length of segment : 142 time for calcul the mask position with numpy : 0.0008280277252197266 nb_pixel_total : 37266 time to create 1 rle with old method : 0.04758477210998535 length of segment : 254 time for calcul the mask position with numpy : 0.00044465065002441406 nb_pixel_total : 27201 time to create 1 rle with old method : 0.030711889266967773 length of segment : 201 time for calcul the mask position with numpy : 0.0017657279968261719 nb_pixel_total : 102648 time to create 1 rle with old method : 0.13435626029968262 length of segment : 534 time for calcul the mask position with numpy : 0.0007071495056152344 nb_pixel_total : 31244 time to create 1 rle with old method : 0.03481411933898926 length of segment : 194 time for calcul the mask position with numpy : 0.0004990100860595703 nb_pixel_total : 24757 time to create 1 rle with old method : 0.02746868133544922 length of segment : 298 time for calcul the mask position with numpy : 0.001245260238647461 nb_pixel_total : 64707 time to create 1 rle with old method : 0.09494447708129883 length of segment : 427 time for calcul the mask position with numpy : 0.0004067420959472656 nb_pixel_total : 19201 time to create 1 rle with old method : 0.02145528793334961 length of segment : 198 time for calcul the mask position with numpy : 0.0005028247833251953 nb_pixel_total : 25614 time to create 1 rle with old method : 0.030899763107299805 length of segment : 203 time for calcul the mask position with numpy : 0.0011572837829589844 nb_pixel_total : 59273 time to create 1 rle with old method : 0.06672215461730957 length of segment : 316 time for calcul the mask position with numpy : 0.0003426074981689453 nb_pixel_total : 17313 time to create 1 rle with old method : 0.020040512084960938 length of segment : 133 time for calcul the mask position with numpy : 0.0003695487976074219 nb_pixel_total : 14017 time to create 1 rle with old method : 0.015982866287231445 length of segment : 197 time for calcul the mask position with numpy : 0.0004944801330566406 nb_pixel_total : 27218 time to create 1 rle with old method : 0.030488014221191406 length of segment : 271 time for calcul the mask position with numpy : 0.0001933574676513672 nb_pixel_total : 8253 time to create 1 rle with old method : 0.009704351425170898 length of segment : 86 time for calcul the mask position with numpy : 0.00016736984252929688 nb_pixel_total : 8762 time to create 1 rle with old method : 0.010123968124389648 length of segment : 105 time for calcul the mask position with numpy : 0.0003142356872558594 nb_pixel_total : 19643 time to create 1 rle with old method : 0.022857666015625 length of segment : 103 time for calcul the mask position with numpy : 0.00014209747314453125 nb_pixel_total : 7920 time to create 1 rle with old method : 0.00933980941772461 length of segment : 78 time for calcul the mask position with numpy : 0.00015044212341308594 nb_pixel_total : 8116 time to create 1 rle with old method : 0.009331703186035156 length of segment : 75 time for calcul the mask position with numpy : 0.002431631088256836 nb_pixel_total : 145317 time to create 1 rle with old method : 0.15698814392089844 length of segment : 480 time for calcul the mask position with numpy : 0.000965118408203125 nb_pixel_total : 57378 time to create 1 rle with old method : 0.0592494010925293 length of segment : 227 time for calcul the mask position with numpy : 0.0021848678588867188 nb_pixel_total : 105096 time to create 1 rle with old method : 0.12038612365722656 length of segment : 531 time for calcul the mask position with numpy : 0.005842447280883789 nb_pixel_total : 138093 time to create 1 rle with old method : 0.14873814582824707 length of segment : 627 time for calcul the mask position with numpy : 0.0008575916290283203 nb_pixel_total : 34354 time to create 1 rle with old method : 0.03897738456726074 length of segment : 240 time for calcul the mask position with numpy : 0.0006358623504638672 nb_pixel_total : 25089 time to create 1 rle with old method : 0.029070377349853516 length of segment : 168 time for calcul the mask position with numpy : 0.0017480850219726562 nb_pixel_total : 49494 time to create 1 rle with old method : 0.05672049522399902 length of segment : 488 time for calcul the mask position with numpy : 0.0003304481506347656 nb_pixel_total : 10347 time to create 1 rle with old method : 0.011645317077636719 length of segment : 136 time for calcul the mask position with numpy : 0.0002803802490234375 nb_pixel_total : 11492 time to create 1 rle with old method : 0.013040542602539062 length of segment : 107 time for calcul the mask position with numpy : 0.0006670951843261719 nb_pixel_total : 15127 time to create 1 rle with old method : 0.017192840576171875 length of segment : 420 time for calcul the mask position with numpy : 0.0007243156433105469 nb_pixel_total : 32908 time to create 1 rle with old method : 0.037885189056396484 length of segment : 198 time for calcul the mask position with numpy : 0.0007765293121337891 nb_pixel_total : 25794 time to create 1 rle with old method : 0.028901100158691406 length of segment : 219 time for calcul the mask position with numpy : 0.00045371055603027344 nb_pixel_total : 17039 time to create 1 rle with old method : 0.017922163009643555 length of segment : 198 time for calcul the mask position with numpy : 0.00019550323486328125 nb_pixel_total : 7807 time to create 1 rle with old method : 0.013854265213012695 length of segment : 111 time for calcul the mask position with numpy : 0.0022296905517578125 nb_pixel_total : 89978 time to create 1 rle with old method : 0.09710240364074707 length of segment : 572 time for calcul the mask position with numpy : 0.0001990795135498047 nb_pixel_total : 6939 time to create 1 rle with old method : 0.007586240768432617 length of segment : 95 time for calcul the mask position with numpy : 0.0007126331329345703 nb_pixel_total : 27939 time to create 1 rle with old method : 0.03266453742980957 length of segment : 240 time for calcul the mask position with numpy : 0.0002193450927734375 nb_pixel_total : 8243 time to create 1 rle with old method : 0.009531497955322266 length of segment : 125 time for calcul the mask position with numpy : 0.002015352249145508 nb_pixel_total : 70255 time to create 1 rle with old method : 0.08048129081726074 length of segment : 421 time for calcul the mask position with numpy : 0.0002524852752685547 nb_pixel_total : 7478 time to create 1 rle with old method : 0.008335113525390625 length of segment : 151 time for calcul the mask position with numpy : 0.0011241436004638672 nb_pixel_total : 49862 time to create 1 rle with old method : 0.05405879020690918 length of segment : 258 time for calcul the mask position with numpy : 0.0004305839538574219 nb_pixel_total : 17413 time to create 1 rle with old method : 0.018758058547973633 length of segment : 189 time for calcul the mask position with numpy : 0.0006303787231445312 nb_pixel_total : 27615 time to create 1 rle with old method : 0.0287168025970459 length of segment : 189 time for calcul the mask position with numpy : 0.0007953643798828125 nb_pixel_total : 30692 time to create 1 rle with old method : 0.03266263008117676 length of segment : 210 time for calcul the mask position with numpy : 0.0006477832794189453 nb_pixel_total : 17568 time to create 1 rle with old method : 0.0198974609375 length of segment : 147 time for calcul the mask position with numpy : 0.0036449432373046875 nb_pixel_total : 69830 time to create 1 rle with old method : 0.07978272438049316 length of segment : 379 time for calcul the mask position with numpy : 0.003999948501586914 nb_pixel_total : 100400 time to create 1 rle with old method : 0.10709762573242188 length of segment : 454 time for calcul the mask position with numpy : 0.0006802082061767578 nb_pixel_total : 15878 time to create 1 rle with old method : 0.017563819885253906 length of segment : 190 time for calcul the mask position with numpy : 0.009385347366333008 nb_pixel_total : 195169 time to create 1 rle with new method : 0.02290821075439453 length of segment : 876 time for calcul the mask position with numpy : 0.001447439193725586 nb_pixel_total : 31031 time to create 1 rle with old method : 0.03407549858093262 length of segment : 307 time for calcul the mask position with numpy : 0.0005822181701660156 nb_pixel_total : 13578 time to create 1 rle with old method : 0.0204775333404541 length of segment : 102 time for calcul the mask position with numpy : 0.0015244483947753906 nb_pixel_total : 34706 time to create 1 rle with old method : 0.03875017166137695 length of segment : 206 time for calcul the mask position with numpy : 0.0007524490356445312 nb_pixel_total : 17237 time to create 1 rle with old method : 0.019356966018676758 length of segment : 152 time for calcul the mask position with numpy : 0.0012247562408447266 nb_pixel_total : 39916 time to create 1 rle with old method : 0.04496955871582031 length of segment : 193 time for calcul the mask position with numpy : 0.0014929771423339844 nb_pixel_total : 30948 time to create 1 rle with old method : 0.0354611873626709 length of segment : 298 time for calcul the mask position with numpy : 0.0011706352233886719 nb_pixel_total : 29679 time to create 1 rle with old method : 0.034201860427856445 length of segment : 194 time for calcul the mask position with numpy : 0.00022554397583007812 nb_pixel_total : 9750 time to create 1 rle with old method : 0.01130819320678711 length of segment : 106 time for calcul the mask position with numpy : 0.0010063648223876953 nb_pixel_total : 27696 time to create 1 rle with old method : 0.032062530517578125 length of segment : 177 time for calcul the mask position with numpy : 0.009484529495239258 nb_pixel_total : 236362 time to create 1 rle with new method : 0.016488313674926758 length of segment : 744 time for calcul the mask position with numpy : 0.0009989738464355469 nb_pixel_total : 25596 time to create 1 rle with old method : 0.028656721115112305 length of segment : 204 time for calcul the mask position with numpy : 0.0011379718780517578 nb_pixel_total : 25874 time to create 1 rle with old method : 0.02846503257751465 length of segment : 248 time for calcul the mask position with numpy : 0.0003762245178222656 nb_pixel_total : 4805 time to create 1 rle with old method : 0.005754947662353516 length of segment : 113 time for calcul the mask position with numpy : 0.0014181137084960938 nb_pixel_total : 36385 time to create 1 rle with old method : 0.0407102108001709 length of segment : 391 time for calcul the mask position with numpy : 0.0008175373077392578 nb_pixel_total : 19741 time to create 1 rle with old method : 0.021511554718017578 length of segment : 244 time for calcul the mask position with numpy : 0.0003719329833984375 nb_pixel_total : 9037 time to create 1 rle with old method : 0.010557174682617188 length of segment : 160 time for calcul the mask position with numpy : 0.0007801055908203125 nb_pixel_total : 15268 time to create 1 rle with old method : 0.018151044845581055 length of segment : 106 time for calcul the mask position with numpy : 0.0009579658508300781 nb_pixel_total : 20115 time to create 1 rle with old method : 0.022861480712890625 length of segment : 129 time for calcul the mask position with numpy : 0.0025107860565185547 nb_pixel_total : 51460 time to create 1 rle with old method : 0.057177066802978516 length of segment : 359 time for calcul the mask position with numpy : 0.0006625652313232422 nb_pixel_total : 12373 time to create 1 rle with old method : 0.019895553588867188 length of segment : 120 time for calcul the mask position with numpy : 0.0005898475646972656 nb_pixel_total : 7366 time to create 1 rle with old method : 0.012406587600708008 length of segment : 125 time for calcul the mask position with numpy : 0.0007007122039794922 nb_pixel_total : 15464 time to create 1 rle with old method : 0.017607927322387695 length of segment : 116 time for calcul the mask position with numpy : 0.0006394386291503906 nb_pixel_total : 15325 time to create 1 rle with old method : 0.017021656036376953 length of segment : 151 time for calcul the mask position with numpy : 0.0053615570068359375 nb_pixel_total : 126689 time to create 1 rle with old method : 0.1369922161102295 length of segment : 329 time for calcul the mask position with numpy : 0.0009996891021728516 nb_pixel_total : 21659 time to create 1 rle with old method : 0.024075984954833984 length of segment : 205 time for calcul the mask position with numpy : 0.0012271404266357422 nb_pixel_total : 42903 time to create 1 rle with old method : 0.04736685752868652 length of segment : 117 time for calcul the mask position with numpy : 0.004108905792236328 nb_pixel_total : 91187 time to create 1 rle with old method : 0.10000395774841309 length of segment : 373 time for calcul the mask position with numpy : 0.005892276763916016 nb_pixel_total : 109666 time to create 1 rle with old method : 0.11773085594177246 length of segment : 603 time for calcul the mask position with numpy : 0.002290964126586914 nb_pixel_total : 52879 time to create 1 rle with old method : 0.0594782829284668 length of segment : 255 time for calcul the mask position with numpy : 0.0013685226440429688 nb_pixel_total : 32482 time to create 1 rle with old method : 0.03600025177001953 length of segment : 244 time for calcul the mask position with numpy : 0.0013988018035888672 nb_pixel_total : 31280 time to create 1 rle with old method : 0.0349576473236084 length of segment : 319 time for calcul the mask position with numpy : 0.002624988555908203 nb_pixel_total : 57939 time to create 1 rle with old method : 0.06797003746032715 length of segment : 310 time for calcul the mask position with numpy : 0.0012819766998291016 nb_pixel_total : 26449 time to create 1 rle with old method : 0.029206514358520508 length of segment : 169 time for calcul the mask position with numpy : 0.0036258697509765625 nb_pixel_total : 71540 time to create 1 rle with old method : 0.07950711250305176 length of segment : 331 time for calcul the mask position with numpy : 0.0028908252716064453 nb_pixel_total : 93755 time to create 1 rle with old method : 0.1003720760345459 length of segment : 413 time for calcul the mask position with numpy : 0.004236936569213867 nb_pixel_total : 109021 time to create 1 rle with old method : 0.1181490421295166 length of segment : 308 time for calcul the mask position with numpy : 0.0005052089691162109 nb_pixel_total : 11574 time to create 1 rle with old method : 0.013090848922729492 length of segment : 136 time for calcul the mask position with numpy : 0.0025131702423095703 nb_pixel_total : 43632 time to create 1 rle with old method : 0.04629325866699219 length of segment : 455 time for calcul the mask position with numpy : 0.0011296272277832031 nb_pixel_total : 33775 time to create 1 rle with old method : 0.03614997863769531 length of segment : 258 time for calcul the mask position with numpy : 0.0010771751403808594 nb_pixel_total : 29826 time to create 1 rle with old method : 0.032540321350097656 length of segment : 224 time for calcul the mask position with numpy : 0.0027298927307128906 nb_pixel_total : 43077 time to create 1 rle with old method : 0.046743154525756836 length of segment : 316 time for calcul the mask position with numpy : 0.0009338855743408203 nb_pixel_total : 14978 time to create 1 rle with old method : 0.01709151268005371 length of segment : 186 time for calcul the mask position with numpy : 0.001954317092895508 nb_pixel_total : 55704 time to create 1 rle with old method : 0.06086015701293945 length of segment : 310 time for calcul the mask position with numpy : 0.0012507438659667969 nb_pixel_total : 21354 time to create 1 rle with old method : 0.023880958557128906 length of segment : 296 time for calcul the mask position with numpy : 0.0005221366882324219 nb_pixel_total : 15994 time to create 1 rle with old method : 0.017861366271972656 length of segment : 156 time for calcul the mask position with numpy : 0.001996755599975586 nb_pixel_total : 43246 time to create 1 rle with old method : 0.048096418380737305 length of segment : 319 time for calcul the mask position with numpy : 0.0008666515350341797 nb_pixel_total : 18758 time to create 1 rle with old method : 0.02034759521484375 length of segment : 161 time for calcul the mask position with numpy : 0.0014405250549316406 nb_pixel_total : 23639 time to create 1 rle with old method : 0.024869680404663086 length of segment : 329 time for calcul the mask position with numpy : 0.0013859272003173828 nb_pixel_total : 26110 time to create 1 rle with old method : 0.028696775436401367 length of segment : 263 time for calcul the mask position with numpy : 0.0004799365997314453 nb_pixel_total : 10285 time to create 1 rle with old method : 0.012123584747314453 length of segment : 73 time for calcul the mask position with numpy : 0.0007615089416503906 nb_pixel_total : 16764 time to create 1 rle with old method : 0.019459247589111328 length of segment : 139 time for calcul the mask position with numpy : 0.0016362667083740234 nb_pixel_total : 44775 time to create 1 rle with old method : 0.0585780143737793 length of segment : 300 time for calcul the mask position with numpy : 0.007658720016479492 nb_pixel_total : 156170 time to create 1 rle with new method : 0.01219940185546875 length of segment : 457 time for calcul the mask position with numpy : 0.0010235309600830078 nb_pixel_total : 33090 time to create 1 rle with old method : 0.03583931922912598 length of segment : 188 time for calcul the mask position with numpy : 0.002908945083618164 nb_pixel_total : 68744 time to create 1 rle with old method : 0.07155632972717285 length of segment : 376 time for calcul the mask position with numpy : 0.0021839141845703125 nb_pixel_total : 49640 time to create 1 rle with old method : 0.05440640449523926 length of segment : 338 time for calcul the mask position with numpy : 0.00034117698669433594 nb_pixel_total : 5328 time to create 1 rle with old method : 0.006333589553833008 length of segment : 106 time for calcul the mask position with numpy : 0.0022575855255126953 nb_pixel_total : 44036 time to create 1 rle with old method : 0.05106234550476074 length of segment : 280 time for calcul the mask position with numpy : 0.0008425712585449219 nb_pixel_total : 29740 time to create 1 rle with old method : 0.034538984298706055 length of segment : 276 time for calcul the mask position with numpy : 0.0017437934875488281 nb_pixel_total : 35962 time to create 1 rle with old method : 0.04075431823730469 length of segment : 254 time for calcul the mask position with numpy : 0.0012345314025878906 nb_pixel_total : 24133 time to create 1 rle with old method : 0.028460979461669922 length of segment : 180 time for calcul the mask position with numpy : 0.0007297992706298828 nb_pixel_total : 17873 time to create 1 rle with old method : 0.019526958465576172 length of segment : 208 time for calcul the mask position with numpy : 0.0020682811737060547 nb_pixel_total : 38227 time to create 1 rle with old method : 0.042528390884399414 length of segment : 264 time for calcul the mask position with numpy : 0.008045673370361328 nb_pixel_total : 132055 time to create 1 rle with old method : 0.13641715049743652 length of segment : 700 time for calcul the mask position with numpy : 0.0036351680755615234 nb_pixel_total : 93884 time to create 1 rle with old method : 0.10050106048583984 length of segment : 535 time for calcul the mask position with numpy : 0.0008356571197509766 nb_pixel_total : 18215 time to create 1 rle with old method : 0.020786046981811523 length of segment : 116 time for calcul the mask position with numpy : 0.0007717609405517578 nb_pixel_total : 11697 time to create 1 rle with old method : 0.01944732666015625 length of segment : 173 time for calcul the mask position with numpy : 0.0019385814666748047 nb_pixel_total : 26260 time to create 1 rle with old method : 0.040212392807006836 length of segment : 208 time for calcul the mask position with numpy : 0.0002689361572265625 nb_pixel_total : 4179 time to create 1 rle with old method : 0.0045413970947265625 length of segment : 74 time for calcul the mask position with numpy : 0.0036940574645996094 nb_pixel_total : 79933 time to create 1 rle with old method : 0.08536696434020996 length of segment : 303 time for calcul the mask position with numpy : 0.0011403560638427734 nb_pixel_total : 27609 time to create 1 rle with old method : 0.028774261474609375 length of segment : 233 time for calcul the mask position with numpy : 0.0025634765625 nb_pixel_total : 54864 time to create 1 rle with old method : 0.05751633644104004 length of segment : 324 time for calcul the mask position with numpy : 0.010597705841064453 nb_pixel_total : 198862 time to create 1 rle with new method : 0.017040252685546875 length of segment : 656 time for calcul the mask position with numpy : 0.002382040023803711 nb_pixel_total : 37627 time to create 1 rle with old method : 0.04160284996032715 length of segment : 277 time for calcul the mask position with numpy : 0.0006327629089355469 nb_pixel_total : 11895 time to create 1 rle with old method : 0.012661457061767578 length of segment : 161 time for calcul the mask position with numpy : 0.005984306335449219 nb_pixel_total : 132642 time to create 1 rle with old method : 0.14032459259033203 length of segment : 498 time for calcul the mask position with numpy : 0.0011343955993652344 nb_pixel_total : 23070 time to create 1 rle with old method : 0.02553701400756836 length of segment : 210 time for calcul the mask position with numpy : 0.004938602447509766 nb_pixel_total : 45872 time to create 1 rle with old method : 0.050348520278930664 length of segment : 299 time for calcul the mask position with numpy : 0.0041484832763671875 nb_pixel_total : 63827 time to create 1 rle with old method : 0.06938934326171875 length of segment : 429 time for calcul the mask position with numpy : 0.002026081085205078 nb_pixel_total : 60278 time to create 1 rle with old method : 0.06356310844421387 length of segment : 241 time for calcul the mask position with numpy : 0.0019474029541015625 nb_pixel_total : 33164 time to create 1 rle with old method : 0.036492347717285156 length of segment : 385 time for calcul the mask position with numpy : 0.0006537437438964844 nb_pixel_total : 10524 time to create 1 rle with old method : 0.011861562728881836 length of segment : 105 time for calcul the mask position with numpy : 0.001958131790161133 nb_pixel_total : 51131 time to create 1 rle with old method : 0.056375980377197266 length of segment : 332 time for calcul the mask position with numpy : 0.010934114456176758 nb_pixel_total : 207811 time to create 1 rle with new method : 0.01953911781311035 length of segment : 642 time for calcul the mask position with numpy : 0.0007488727569580078 nb_pixel_total : 11551 time to create 1 rle with old method : 0.013471364974975586 length of segment : 158 time for calcul the mask position with numpy : 0.0030930042266845703 nb_pixel_total : 40109 time to create 1 rle with old method : 0.04344773292541504 length of segment : 493 time for calcul the mask position with numpy : 0.008583784103393555 nb_pixel_total : 102702 time to create 1 rle with old method : 0.11313819885253906 length of segment : 693 time for calcul the mask position with numpy : 0.0017960071563720703 nb_pixel_total : 33801 time to create 1 rle with old method : 0.03680157661437988 length of segment : 260 time for calcul the mask position with numpy : 0.0069103240966796875 nb_pixel_total : 141899 time to create 1 rle with old method : 0.15040135383605957 length of segment : 559 time for calcul the mask position with numpy : 0.0030889511108398438 nb_pixel_total : 54662 time to create 1 rle with old method : 0.05935931205749512 length of segment : 343 time for calcul the mask position with numpy : 0.0029807090759277344 nb_pixel_total : 28668 time to create 1 rle with old method : 0.03268861770629883 length of segment : 488 time for calcul the mask position with numpy : 0.0002930164337158203 nb_pixel_total : 13669 time to create 1 rle with old method : 0.01540231704711914 length of segment : 170 time for calcul the mask position with numpy : 0.008669376373291016 nb_pixel_total : 141426 time to create 1 rle with old method : 0.17889142036437988 length of segment : 729 time spent for convertir_results : 13.30591082572937 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 163 chid ids of type : 3594 Number RLEs to save : 44185 save missing photos in datou_result : time spend for datou_step_exec : 86.13675904273987 time spend to save output : 2.4693968296051025 total time spend for step 1 : 88.60615587234497 step2:crop_condition Wed Feb 5 19:11:58 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 7 ! batch 1 Loaded 163 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 134 About to insert : list_path_to_insert length 134 new photo from crops ! About to upload 134 photos upload in portfolio : 3736932 init cache_photo without model_param we have 134 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738779147_569182 we have uploaded 134 photos in the portfolio 3736932 time of upload the photos Elapsed time : 32.82824420928955 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 22 About to insert : list_path_to_insert length 22 new photo from crops ! About to upload 22 photos upload in portfolio : 3736932 init cache_photo without model_param we have 22 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738779186_569182 we have uploaded 22 photos in the portfolio 3736932 time of upload the photos Elapsed time : 5.490957975387573 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 5 About to insert : list_path_to_insert length 5 new photo from crops ! About to upload 5 photos upload in portfolio : 3736932 init cache_photo without model_param we have 5 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738779194_569182 we have uploaded 5 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.8755104541778564 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738779197_569182 we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.7848734855651855 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1334999515, 1334999508, 1334999426, 1334999419, 1334999416, 1334999379, 1334999340] Looping around the photos to save general results len do output : 163 /1335009158Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009159Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009160Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009161Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009163Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009164Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009165Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009166Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009167Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009168Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009169Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009170Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009171Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009172Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009173Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009174Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009176Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009177Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009178Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009179Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009180Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009181Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009182Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009183Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009184Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009185Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009186Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009187Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009188Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009189Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009190Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009191Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009192Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009193Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009194Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009195Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009196Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009197Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009198Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009199Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009200Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009201Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009202Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009203Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009204Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009205Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009206Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009207Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009208Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009209Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009210Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009211Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009212Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009213Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009214Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009215Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009216Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009217Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009218Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009219Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009220Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009221Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009222Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009223Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009224Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009225Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009226Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009227Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009228Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009229Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009230Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009231Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009232Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009233Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009234Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009235Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009236Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009237Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009238Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009239Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009240Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009241Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009242Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009243Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009244Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009245Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009246Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009247Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009248Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009249Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009250Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009251Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009252Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009253Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009254Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009255Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009256Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009257Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009258Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009259Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009260Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009261Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009262Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009263Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009264Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009265Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009266Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009268Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009269Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009270Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009271Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009272Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009273Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009275Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009276Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009277Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009278Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009279Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009280Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009281Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009282Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009283Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009284Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009285Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009286Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009287Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009288Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009289Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009290Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009291Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009292Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009293Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009294Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009295Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009299Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009300Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009301Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009302Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009303Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009304Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009305Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009306Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009307Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009308Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009309Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009310Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009311Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009312Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009313Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009314Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009315Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009316Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009317Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009318Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009319Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009320Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009323Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009324Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009325Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009326Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009328Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009330Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1335009331Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2553456') ('3318', '20270434', '1334999515', None, None, None, None, None, '2553456') ('3318', None, None, None, None, None, None, None, '2553456') ('3318', '20270434', '1334999508', None, None, None, None, None, '2553456') ('3318', None, None, None, None, None, None, None, '2553456') ('3318', '20270434', '1334999426', None, None, None, None, None, '2553456') ('3318', None, None, None, None, None, None, None, '2553456') ('3318', '20270434', '1334999419', None, None, None, None, None, '2553456') ('3318', None, None, None, None, None, None, None, '2553456') ('3318', '20270434', '1334999416', None, None, None, None, None, '2553456') ('3318', None, None, None, None, None, None, None, '2553456') ('3318', '20270434', '1334999379', None, None, None, None, None, '2553456') ('3318', None, None, None, None, None, None, None, '2553456') ('3318', '20270434', '1334999340', None, None, None, None, None, '2553456') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 496 time used for this insertion : 0.030420303344726562 save_final save missing photos in datou_result : time spend for datou_step_exec : 79.63666296005249 time spend to save output : 0.03496813774108887 total time spend for step 2 : 79.67163109779358 step3:rle_unique_nms_with_priority Wed Feb 5 19:13:17 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 163 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 20 nb_hashtags : 3 time to prepare the origin masks : 3.7495598793029785 time for calcul the mask position with numpy : 0.34645795822143555 nb_pixel_total : 7667423 time to create 1 rle with new method : 0.60133957862854 time for calcul the mask position with numpy : 0.025073766708374023 nb_pixel_total : 2649 time to create 1 rle with old method : 0.003179311752319336 time for calcul the mask position with numpy : 0.024695158004760742 nb_pixel_total : 430 time to create 1 rle with old method : 0.000537872314453125 time for calcul the mask position with numpy : 0.025060176849365234 nb_pixel_total : 24423 time to create 1 rle with old method : 0.028041362762451172 time for calcul the mask position with numpy : 0.025458812713623047 nb_pixel_total : 13160 time to create 1 rle with old method : 0.0156402587890625 time for calcul the mask position with numpy : 0.027991294860839844 nb_pixel_total : 208447 time to create 1 rle with new method : 0.5932104587554932 time for calcul the mask position with numpy : 0.025282859802246094 nb_pixel_total : 14682 time to create 1 rle with old method : 0.025693893432617188 time for calcul the mask position with numpy : 0.028631925582885742 nb_pixel_total : 127287 time to create 1 rle with old method : 0.14699769020080566 time for calcul the mask position with numpy : 0.023522138595581055 nb_pixel_total : 11215 time to create 1 rle with old method : 0.012201309204101562 time for calcul the mask position with numpy : 0.028076171875 nb_pixel_total : 5910 time to create 1 rle with old method : 0.00701594352722168 time for calcul the mask position with numpy : 0.02747511863708496 nb_pixel_total : 23634 time to create 1 rle with old method : 0.02638530731201172 time for calcul the mask position with numpy : 0.0262296199798584 nb_pixel_total : 9060 time to create 1 rle with old method : 0.010415077209472656 time for calcul the mask position with numpy : 0.031332969665527344 nb_pixel_total : 12992 time to create 1 rle with old method : 0.014958620071411133 time for calcul the mask position with numpy : 0.024289846420288086 nb_pixel_total : 21431 time to create 1 rle with old method : 0.023375988006591797 time for calcul the mask position with numpy : 0.025098800659179688 nb_pixel_total : 24643 time to create 1 rle with old method : 0.026812076568603516 time for calcul the mask position with numpy : 0.025224924087524414 nb_pixel_total : 13298 time to create 1 rle with old method : 0.014286518096923828 time for calcul the mask position with numpy : 0.02430582046508789 nb_pixel_total : 27885 time to create 1 rle with old method : 0.03778982162475586 time for calcul the mask position with numpy : 0.02750873565673828 nb_pixel_total : 10102 time to create 1 rle with old method : 0.016193151473999023 time for calcul the mask position with numpy : 0.026640892028808594 nb_pixel_total : 15623 time to create 1 rle with old method : 0.016940832138061523 time for calcul the mask position with numpy : 0.024863243103027344 nb_pixel_total : 34671 time to create 1 rle with old method : 0.03744244575500488 time for calcul the mask position with numpy : 0.024300336837768555 nb_pixel_total : 25435 time to create 1 rle with old method : 0.03376626968383789 create new chi : 2.6206703186035156 time to delete rle : 0.02404499053955078 batch 1 Loaded 42 chid ids of type : 3594 ++++++++++++++++++++++++++++++++Number RLEs to save : 9654 TO DO : save crop sub photo not yet done ! save time : 0.6902012825012207 nb_obj : 15 nb_hashtags : 4 time to prepare the origin masks : 3.3297715187072754 time for calcul the mask position with numpy : 0.5284998416900635 nb_pixel_total : 7755713 time to create 1 rle with new method : 0.659686803817749 time for calcul the mask position with numpy : 0.024397611618041992 nb_pixel_total : 27218 time to create 1 rle with old method : 0.02993607521057129 time for calcul the mask position with numpy : 0.025921344757080078 nb_pixel_total : 14017 time to create 1 rle with old method : 0.015479564666748047 time for calcul the mask position with numpy : 0.02440643310546875 nb_pixel_total : 17313 time to create 1 rle with old method : 0.01893472671508789 time for calcul the mask position with numpy : 0.02468085289001465 nb_pixel_total : 59273 time to create 1 rle with old method : 0.06541705131530762 time for calcul the mask position with numpy : 0.027422189712524414 nb_pixel_total : 25614 time to create 1 rle with old method : 0.027547359466552734 time for calcul the mask position with numpy : 0.025088071823120117 nb_pixel_total : 19201 time to create 1 rle with old method : 0.022508859634399414 time for calcul the mask position with numpy : 0.029764652252197266 nb_pixel_total : 64707 time to create 1 rle with old method : 0.07679986953735352 time for calcul the mask position with numpy : 0.026024341583251953 nb_pixel_total : 24757 time to create 1 rle with old method : 0.026797056198120117 time for calcul the mask position with numpy : 0.02415323257446289 nb_pixel_total : 31244 time to create 1 rle with old method : 0.03806471824645996 time for calcul the mask position with numpy : 0.026192426681518555 nb_pixel_total : 102648 time to create 1 rle with old method : 0.1116628646850586 time for calcul the mask position with numpy : 0.024910688400268555 nb_pixel_total : 27201 time to create 1 rle with old method : 0.029646873474121094 time for calcul the mask position with numpy : 0.025543689727783203 nb_pixel_total : 37266 time to create 1 rle with old method : 0.042510271072387695 time for calcul the mask position with numpy : 0.02461385726928711 nb_pixel_total : 12512 time to create 1 rle with old method : 0.013666152954101562 time for calcul the mask position with numpy : 0.023679018020629883 nb_pixel_total : 25826 time to create 1 rle with old method : 0.028128385543823242 time for calcul the mask position with numpy : 0.023661136627197266 nb_pixel_total : 49890 time to create 1 rle with old method : 0.05307579040527344 create new chi : 2.2156472206115723 time to delete rle : 0.0014891624450683594 batch 1 Loaded 31 chid ids of type : 3594 ++++++++++++++++++++++Number RLEs to save : 10168 TO DO : save crop sub photo not yet done ! save time : 0.9529368877410889 nb_obj : 30 nb_hashtags : 3 time to prepare the origin masks : 4.035163640975952 time for calcul the mask position with numpy : 0.08392119407653809 nb_pixel_total : 7229652 time to create 1 rle with new method : 0.17040443420410156 time for calcul the mask position with numpy : 0.03614616394042969 nb_pixel_total : 138093 time to create 1 rle with old method : 0.14989900588989258 time for calcul the mask position with numpy : 0.033612728118896484 nb_pixel_total : 57378 time to create 1 rle with old method : 0.06253790855407715 time for calcul the mask position with numpy : 0.032968997955322266 nb_pixel_total : 25794 time to create 1 rle with old method : 0.02824997901916504 time for calcul the mask position with numpy : 0.03254199028015137 nb_pixel_total : 15127 time to create 1 rle with old method : 0.016550779342651367 time for calcul the mask position with numpy : 0.03279471397399902 nb_pixel_total : 27865 time to create 1 rle with old method : 0.029748916625976562 time for calcul the mask position with numpy : 0.032561540603637695 nb_pixel_total : 25089 time to create 1 rle with old method : 0.027480363845825195 time for calcul the mask position with numpy : 0.03238248825073242 nb_pixel_total : 27615 time to create 1 rle with old method : 0.029788970947265625 time for calcul the mask position with numpy : 0.03239941596984863 nb_pixel_total : 17039 time to create 1 rle with old method : 0.018532752990722656 time for calcul the mask position with numpy : 0.0329132080078125 nb_pixel_total : 30692 time to create 1 rle with old method : 0.03793478012084961 time for calcul the mask position with numpy : 0.03906559944152832 nb_pixel_total : 32908 time to create 1 rle with old method : 0.04623556137084961 time for calcul the mask position with numpy : 0.03366684913635254 nb_pixel_total : 49494 time to create 1 rle with old method : 0.05620121955871582 time for calcul the mask position with numpy : 0.033323049545288086 nb_pixel_total : 89978 time to create 1 rle with old method : 0.09888577461242676 time for calcul the mask position with numpy : 0.034128665924072266 nb_pixel_total : 70255 time to create 1 rle with old method : 0.0793466567993164 time for calcul the mask position with numpy : 0.03420424461364746 nb_pixel_total : 105096 time to create 1 rle with old method : 0.11672234535217285 time for calcul the mask position with numpy : 0.034139394760131836 nb_pixel_total : 145317 time to create 1 rle with old method : 0.15547633171081543 time for calcul the mask position with numpy : 0.034036874771118164 nb_pixel_total : 49862 time to create 1 rle with old method : 0.053671836853027344 time for calcul the mask position with numpy : 0.03343009948730469 nb_pixel_total : 6160 time to create 1 rle with old method : 0.0072290897369384766 time for calcul the mask position with numpy : 0.04031777381896973 nb_pixel_total : 11492 time to create 1 rle with old method : 0.017994165420532227 time for calcul the mask position with numpy : 0.03910207748413086 nb_pixel_total : 10347 time to create 1 rle with old method : 0.011626720428466797 time for calcul the mask position with numpy : 0.03339529037475586 nb_pixel_total : 34354 time to create 1 rle with old method : 0.03722715377807617 time for calcul the mask position with numpy : 0.03457331657409668 nb_pixel_total : 8116 time to create 1 rle with old method : 0.012217283248901367 time for calcul the mask position with numpy : 0.04244399070739746 nb_pixel_total : 17413 time to create 1 rle with old method : 0.0194244384765625 time for calcul the mask position with numpy : 0.034496307373046875 nb_pixel_total : 8243 time to create 1 rle with old method : 0.009602546691894531 time for calcul the mask position with numpy : 0.034978389739990234 nb_pixel_total : 7807 time to create 1 rle with old method : 0.008458375930786133 time for calcul the mask position with numpy : 0.03345465660095215 nb_pixel_total : 8253 time to create 1 rle with old method : 0.009472131729125977 time for calcul the mask position with numpy : 0.03297877311706543 nb_pixel_total : 8762 time to create 1 rle with old method : 0.010044097900390625 time for calcul the mask position with numpy : 0.03345513343811035 nb_pixel_total : 1697 time to create 1 rle with old method : 0.0020940303802490234 time for calcul the mask position with numpy : 0.033666133880615234 nb_pixel_total : 6939 time to create 1 rle with old method : 0.007714986801147461 time for calcul the mask position with numpy : 0.03417682647705078 nb_pixel_total : 19643 time to create 1 rle with old method : 0.02536773681640625 time for calcul the mask position with numpy : 0.03289294242858887 nb_pixel_total : 7920 time to create 1 rle with old method : 0.008518695831298828 create new chi : 2.501133918762207 time to delete rle : 0.003950595855712891 batch 1 Loaded 61 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 16238 TO DO : save crop sub photo not yet done ! save time : 0.921288013458252 nb_obj : 20 nb_hashtags : 2 time to prepare the origin masks : 3.0613853931427 time for calcul the mask position with numpy : 0.5470376014709473 nb_pixel_total : 7358167 time to create 1 rle with new method : 0.8274228572845459 time for calcul the mask position with numpy : 0.023737430572509766 nb_pixel_total : 9037 time to create 1 rle with old method : 0.010025739669799805 time for calcul the mask position with numpy : 0.023857831954956055 nb_pixel_total : 19741 time to create 1 rle with old method : 0.021913766860961914 time for calcul the mask position with numpy : 0.02472233772277832 nb_pixel_total : 36385 time to create 1 rle with old method : 0.04011416435241699 time for calcul the mask position with numpy : 0.02394843101501465 nb_pixel_total : 4805 time to create 1 rle with old method : 0.005330324172973633 time for calcul the mask position with numpy : 0.023788928985595703 nb_pixel_total : 25874 time to create 1 rle with old method : 0.029405593872070312 time for calcul the mask position with numpy : 0.025143861770629883 nb_pixel_total : 25596 time to create 1 rle with old method : 0.028560400009155273 time for calcul the mask position with numpy : 0.026303768157958984 nb_pixel_total : 236362 time to create 1 rle with new method : 0.6286990642547607 time for calcul the mask position with numpy : 0.023790836334228516 nb_pixel_total : 27181 time to create 1 rle with old method : 0.02952098846435547 time for calcul the mask position with numpy : 0.0235443115234375 nb_pixel_total : 9065 time to create 1 rle with old method : 0.010016441345214844 time for calcul the mask position with numpy : 0.02451920509338379 nb_pixel_total : 29679 time to create 1 rle with old method : 0.03303337097167969 time for calcul the mask position with numpy : 0.02528238296508789 nb_pixel_total : 24115 time to create 1 rle with old method : 0.026569843292236328 time for calcul the mask position with numpy : 0.024590492248535156 nb_pixel_total : 39916 time to create 1 rle with old method : 0.04484295845031738 time for calcul the mask position with numpy : 0.02451014518737793 nb_pixel_total : 17237 time to create 1 rle with old method : 0.0181732177734375 time for calcul the mask position with numpy : 0.024829864501953125 nb_pixel_total : 34706 time to create 1 rle with old method : 0.03641796112060547 time for calcul the mask position with numpy : 0.02420639991760254 nb_pixel_total : 13578 time to create 1 rle with old method : 0.014619827270507812 time for calcul the mask position with numpy : 0.02352619171142578 nb_pixel_total : 30168 time to create 1 rle with old method : 0.03253293037414551 time for calcul the mask position with numpy : 0.024305105209350586 nb_pixel_total : 167915 time to create 1 rle with new method : 0.5806481838226318 time for calcul the mask position with numpy : 0.02601337432861328 nb_pixel_total : 14643 time to create 1 rle with old method : 0.016522645950317383 time for calcul the mask position with numpy : 0.027107715606689453 nb_pixel_total : 100400 time to create 1 rle with old method : 0.11051154136657715 time for calcul the mask position with numpy : 0.025099515914916992 nb_pixel_total : 69830 time to create 1 rle with old method : 0.07504534721374512 create new chi : 3.748727560043335 time to delete rle : 0.0018463134765625 batch 1 Loaded 41 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++Number RLEs to save : 12804 TO DO : save crop sub photo not yet done ! save time : 0.7198789119720459 nb_obj : 25 nb_hashtags : 3 time to prepare the origin masks : 4.7159035205841064 time for calcul the mask position with numpy : 0.4775865077972412 nb_pixel_total : 7131714 time to create 1 rle with new method : 0.7416188716888428 time for calcul the mask position with numpy : 0.0246279239654541 nb_pixel_total : 43077 time to create 1 rle with old method : 0.04656243324279785 time for calcul the mask position with numpy : 0.02414226531982422 nb_pixel_total : 29826 time to create 1 rle with old method : 0.03256511688232422 time for calcul the mask position with numpy : 0.025338411331176758 nb_pixel_total : 33775 time to create 1 rle with old method : 0.03800344467163086 time for calcul the mask position with numpy : 0.024457693099975586 nb_pixel_total : 43632 time to create 1 rle with old method : 0.04590415954589844 time for calcul the mask position with numpy : 0.022850751876831055 nb_pixel_total : 9261 time to create 1 rle with old method : 0.009915351867675781 time for calcul the mask position with numpy : 0.02402782440185547 nb_pixel_total : 109021 time to create 1 rle with old method : 0.1143195629119873 time for calcul the mask position with numpy : 0.03363466262817383 nb_pixel_total : 93755 time to create 1 rle with old method : 0.10627436637878418 time for calcul the mask position with numpy : 0.025777816772460938 nb_pixel_total : 71540 time to create 1 rle with old method : 0.08091449737548828 time for calcul the mask position with numpy : 0.02337646484375 nb_pixel_total : 25339 time to create 1 rle with old method : 0.02852177619934082 time for calcul the mask position with numpy : 0.02282571792602539 nb_pixel_total : 57939 time to create 1 rle with old method : 0.062233924865722656 time for calcul the mask position with numpy : 0.024588584899902344 nb_pixel_total : 31280 time to create 1 rle with old method : 0.03368830680847168 time for calcul the mask position with numpy : 0.023895740509033203 nb_pixel_total : 32482 time to create 1 rle with old method : 0.03537559509277344 time for calcul the mask position with numpy : 0.024999380111694336 nb_pixel_total : 52879 time to create 1 rle with old method : 0.06023526191711426 time for calcul the mask position with numpy : 0.028867244720458984 nb_pixel_total : 109071 time to create 1 rle with old method : 0.12424445152282715 time for calcul the mask position with numpy : 0.025387048721313477 nb_pixel_total : 91187 time to create 1 rle with old method : 0.09639573097229004 time for calcul the mask position with numpy : 0.024595260620117188 nb_pixel_total : 42903 time to create 1 rle with old method : 0.04530930519104004 time for calcul the mask position with numpy : 0.024026155471801758 nb_pixel_total : 21659 time to create 1 rle with old method : 0.02223825454711914 time for calcul the mask position with numpy : 0.024377107620239258 nb_pixel_total : 126689 time to create 1 rle with old method : 0.1319897174835205 time for calcul the mask position with numpy : 0.02314281463623047 nb_pixel_total : 15325 time to create 1 rle with old method : 0.01683521270751953 time for calcul the mask position with numpy : 0.02368021011352539 nb_pixel_total : 15464 time to create 1 rle with old method : 0.01669144630432129 time for calcul the mask position with numpy : 0.023516178131103516 nb_pixel_total : 7366 time to create 1 rle with old method : 0.008271217346191406 time for calcul the mask position with numpy : 0.024048566818237305 nb_pixel_total : 12373 time to create 1 rle with old method : 0.01368260383605957 time for calcul the mask position with numpy : 0.025763511657714844 nb_pixel_total : 51460 time to create 1 rle with old method : 0.06896305084228516 time for calcul the mask position with numpy : 0.03450155258178711 nb_pixel_total : 20115 time to create 1 rle with old method : 0.033295392990112305 time for calcul the mask position with numpy : 0.030127525329589844 nb_pixel_total : 15268 time to create 1 rle with old method : 0.01889204978942871 create new chi : 3.191118001937866 time to delete rle : 0.0024051666259765625 batch 1 Loaded 51 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++Number RLEs to save : 14828 TO DO : save crop sub photo not yet done ! save time : 0.8337228298187256 nb_obj : 24 nb_hashtags : 2 time to prepare the origin masks : 4.033560037612915 time for calcul the mask position with numpy : 0.614422082901001 nb_pixel_total : 7274098 time to create 1 rle with new method : 0.9243111610412598 time for calcul the mask position with numpy : 0.02301168441772461 nb_pixel_total : 93697 time to create 1 rle with old method : 0.10082268714904785 time for calcul the mask position with numpy : 0.024547815322875977 nb_pixel_total : 132055 time to create 1 rle with old method : 0.14368796348571777 time for calcul the mask position with numpy : 0.02414536476135254 nb_pixel_total : 38227 time to create 1 rle with old method : 0.04290890693664551 time for calcul the mask position with numpy : 0.024361371994018555 nb_pixel_total : 17873 time to create 1 rle with old method : 0.020451784133911133 time for calcul the mask position with numpy : 0.023794889450073242 nb_pixel_total : 24133 time to create 1 rle with old method : 0.02658224105834961 time for calcul the mask position with numpy : 0.02403855323791504 nb_pixel_total : 35962 time to create 1 rle with old method : 0.03812098503112793 time for calcul the mask position with numpy : 0.022811174392700195 nb_pixel_total : 29740 time to create 1 rle with old method : 0.03274273872375488 time for calcul the mask position with numpy : 0.025959491729736328 nb_pixel_total : 44036 time to create 1 rle with old method : 0.048866987228393555 time for calcul the mask position with numpy : 0.024276018142700195 nb_pixel_total : 5328 time to create 1 rle with old method : 0.006022214889526367 time for calcul the mask position with numpy : 0.024691343307495117 nb_pixel_total : 49640 time to create 1 rle with old method : 0.05568337440490723 time for calcul the mask position with numpy : 0.025998830795288086 nb_pixel_total : 68744 time to create 1 rle with old method : 0.07570838928222656 time for calcul the mask position with numpy : 0.028414011001586914 nb_pixel_total : 33090 time to create 1 rle with old method : 0.036720991134643555 time for calcul the mask position with numpy : 0.026029109954833984 nb_pixel_total : 156170 time to create 1 rle with new method : 0.6488680839538574 time for calcul the mask position with numpy : 0.025552034378051758 nb_pixel_total : 44775 time to create 1 rle with old method : 0.04946112632751465 time for calcul the mask position with numpy : 0.027303457260131836 nb_pixel_total : 16764 time to create 1 rle with old method : 0.018500328063964844 time for calcul the mask position with numpy : 0.023910045623779297 nb_pixel_total : 10285 time to create 1 rle with old method : 0.011986255645751953 time for calcul the mask position with numpy : 0.026386260986328125 nb_pixel_total : 26110 time to create 1 rle with old method : 0.029560565948486328 time for calcul the mask position with numpy : 0.03143882751464844 nb_pixel_total : 23639 time to create 1 rle with old method : 0.0264132022857666 time for calcul the mask position with numpy : 0.02400350570678711 nb_pixel_total : 18758 time to create 1 rle with old method : 0.02122950553894043 time for calcul the mask position with numpy : 0.025644302368164062 nb_pixel_total : 43246 time to create 1 rle with old method : 0.04655718803405762 time for calcul the mask position with numpy : 0.02579045295715332 nb_pixel_total : 15994 time to create 1 rle with old method : 0.01759052276611328 time for calcul the mask position with numpy : 0.02529454231262207 nb_pixel_total : 21354 time to create 1 rle with old method : 0.023591995239257812 time for calcul the mask position with numpy : 0.03319573402404785 nb_pixel_total : 55704 time to create 1 rle with old method : 0.05951070785522461 time for calcul the mask position with numpy : 0.02464771270751953 nb_pixel_total : 14978 time to create 1 rle with old method : 0.016382932662963867 create new chi : 3.8205230236053467 time to delete rle : 0.0021529197692871094 batch 1 Loaded 49 chid ids of type : 3594 ++++++++++++++++++++++++++++++++Number RLEs to save : 15514 TO DO : save crop sub photo not yet done ! save time : 0.8979287147521973 nb_obj : 28 nb_hashtags : 3 time to prepare the origin masks : 4.461494207382202 time for calcul the mask position with numpy : 0.08215498924255371 nb_pixel_total : 6670795 time to create 1 rle with new method : 0.16233587265014648 time for calcul the mask position with numpy : 0.03338885307312012 nb_pixel_total : 141899 time to create 1 rle with old method : 0.14890527725219727 time for calcul the mask position with numpy : 0.03146529197692871 nb_pixel_total : 28668 time to create 1 rle with old method : 0.03216361999511719 time for calcul the mask position with numpy : 0.03453993797302246 nb_pixel_total : 10524 time to create 1 rle with old method : 0.01201486587524414 time for calcul the mask position with numpy : 0.03338027000427246 nb_pixel_total : 103829 time to create 1 rle with old method : 0.11239361763000488 time for calcul the mask position with numpy : 0.033975839614868164 nb_pixel_total : 40109 time to create 1 rle with old method : 0.044622182846069336 time for calcul the mask position with numpy : 0.032831668853759766 nb_pixel_total : 23070 time to create 1 rle with old method : 0.024974822998046875 time for calcul the mask position with numpy : 0.033998727798461914 nb_pixel_total : 45872 time to create 1 rle with old method : 0.05057859420776367 time for calcul the mask position with numpy : 0.034114837646484375 nb_pixel_total : 33801 time to create 1 rle with old method : 0.03813743591308594 time for calcul the mask position with numpy : 0.033611297607421875 nb_pixel_total : 63827 time to create 1 rle with old method : 0.06925320625305176 time for calcul the mask position with numpy : 0.0337672233581543 nb_pixel_total : 60278 time to create 1 rle with old method : 0.06515121459960938 time for calcul the mask position with numpy : 0.03335380554199219 nb_pixel_total : 132642 time to create 1 rle with old method : 0.14209342002868652 time for calcul the mask position with numpy : 0.03389167785644531 nb_pixel_total : 11895 time to create 1 rle with old method : 0.013217687606811523 time for calcul the mask position with numpy : 0.03362011909484863 nb_pixel_total : 54662 time to create 1 rle with old method : 0.05871987342834473 time for calcul the mask position with numpy : 0.03310132026672363 nb_pixel_total : 102702 time to create 1 rle with old method : 0.10671615600585938 time for calcul the mask position with numpy : 0.032466888427734375 nb_pixel_total : 54864 time to create 1 rle with old method : 0.05978131294250488 time for calcul the mask position with numpy : 0.03277158737182617 nb_pixel_total : 207811 time to create 1 rle with new method : 0.14545798301696777 time for calcul the mask position with numpy : 0.03254246711730957 nb_pixel_total : 37627 time to create 1 rle with old method : 0.040862321853637695 time for calcul the mask position with numpy : 0.03374838829040527 nb_pixel_total : 198862 time to create 1 rle with new method : 0.145399808883667 time for calcul the mask position with numpy : 0.03863930702209473 nb_pixel_total : 6924 time to create 1 rle with old method : 0.011080503463745117 time for calcul the mask position with numpy : 0.03723859786987305 nb_pixel_total : 11551 time to create 1 rle with old method : 0.012236356735229492 time for calcul the mask position with numpy : 0.03168463706970215 nb_pixel_total : 4179 time to create 1 rle with old method : 0.004461050033569336 time for calcul the mask position with numpy : 0.03199338912963867 nb_pixel_total : 33164 time to create 1 rle with old method : 0.03522539138793945 time for calcul the mask position with numpy : 0.03282928466796875 nb_pixel_total : 51131 time to create 1 rle with old method : 0.05301403999328613 time for calcul the mask position with numpy : 0.03426074981689453 nb_pixel_total : 79933 time to create 1 rle with old method : 0.0846250057220459 time for calcul the mask position with numpy : 0.03302502632141113 nb_pixel_total : 27609 time to create 1 rle with old method : 0.029622793197631836 time for calcul the mask position with numpy : 0.034613847732543945 nb_pixel_total : 26260 time to create 1 rle with old method : 0.027438640594482422 time for calcul the mask position with numpy : 0.03587937355041504 nb_pixel_total : 18215 time to create 1 rle with old method : 0.028574228286743164 time for calcul the mask position with numpy : 0.03794384002685547 nb_pixel_total : 11697 time to create 1 rle with old method : 0.013440370559692383 create new chi : 2.850940465927124 time to delete rle : 0.0027196407318115234 batch 1 Loaded 57 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 20920 TO DO : save crop sub photo not yet done ! save time : 1.1607670783996582 map_output_result : {1334999515: (0.0, 'Should be the crop_list due to order', 0.0), 1334999508: (0.0, 'Should be the crop_list due to order', 0.0), 1334999426: (0.0, 'Should be the crop_list due to order', 0.0), 1334999419: (0.0, 'Should be the crop_list due to order', 0.0), 1334999416: (0.0, 'Should be the crop_list due to order', 0.0), 1334999379: (0.0, 'Should be the crop_list due to order', 0.0), 1334999340: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1334999515, 1334999508, 1334999426, 1334999419, 1334999416, 1334999379, 1334999340] Looping around the photos to save general results len do output : 7 /1334999515.Didn't retrieve data . /1334999508.Didn't retrieve data . /1334999426.Didn't retrieve data . /1334999419.Didn't retrieve data . /1334999416.Didn't retrieve data . /1334999379.Didn't retrieve data . /1334999340.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2553456') ('3318', '20270434', '1334999515', None, None, None, None, None, '2553456') ('3318', None, None, None, None, None, None, None, '2553456') ('3318', '20270434', '1334999508', None, None, None, None, None, '2553456') ('3318', None, None, None, None, None, None, None, '2553456') ('3318', '20270434', '1334999426', None, None, None, None, None, '2553456') ('3318', None, None, None, None, None, None, None, '2553456') ('3318', '20270434', '1334999419', None, None, None, None, None, '2553456') ('3318', None, None, None, None, None, None, None, '2553456') ('3318', '20270434', '1334999416', None, None, None, None, None, '2553456') ('3318', None, None, None, None, None, None, None, '2553456') ('3318', '20270434', '1334999379', None, None, None, None, None, '2553456') ('3318', None, None, None, None, None, None, None, '2553456') ('3318', '20270434', '1334999340', None, None, None, None, None, '2553456') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 21 time used for this insertion : 0.01172327995300293 save_final save missing photos in datou_result : time spend for datou_step_exec : 55.519214153289795 time spend to save output : 0.012111186981201172 total time spend for step 3 : 55.531325340270996 step4:ventilate_hashtags_in_portfolio Wed Feb 5 19:14:13 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 20270434 get user id for portfolio 20270434 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20270434 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','flou','pet_clair','metal','environnement','pet_fonce','carton','mal_croppe','background','autre','pehd')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20270434 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','flou','pet_clair','metal','environnement','pet_fonce','carton','mal_croppe','background','autre','pehd')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20270434 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','flou','pet_clair','metal','environnement','pet_fonce','carton','mal_croppe','background','autre','pehd')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/20270565,20270566,20270567,20270568,20270569,20270570,20270571,20270572,20270573,20270574,20270575?tags=papier,flou,pet_clair,metal,environnement,pet_fonce,carton,mal_croppe,background,autre,pehd Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1334999515, 1334999508, 1334999426, 1334999419, 1334999416, 1334999379, 1334999340] Looping around the photos to save general results len do output : 1 /20270434. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2553456') ('3318', '20270434', '1334999515', None, None, None, None, None, '2553456') ('3318', None, None, None, None, None, None, None, '2553456') ('3318', '20270434', '1334999508', None, None, None, None, None, '2553456') ('3318', None, None, None, None, None, None, None, '2553456') ('3318', '20270434', '1334999426', None, None, None, None, None, '2553456') ('3318', None, None, None, None, None, None, None, '2553456') ('3318', '20270434', '1334999419', None, None, None, None, None, '2553456') ('3318', None, None, None, None, None, None, None, '2553456') ('3318', '20270434', '1334999416', None, None, None, None, None, '2553456') ('3318', None, None, None, None, None, None, None, '2553456') ('3318', '20270434', '1334999379', None, None, None, None, None, '2553456') ('3318', None, None, None, None, None, None, None, '2553456') ('3318', '20270434', '1334999340', None, None, None, None, None, '2553456') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.01395869255065918 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.4914381504058838 time spend to save output : 0.01425313949584961 total time spend for step 4 : 1.5056912899017334 step5:final Wed Feb 5 19:14:14 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1334999515: ('0.12010234099426807',), 1334999508: ('0.12010234099426807',), 1334999426: ('0.12010234099426807',), 1334999419: ('0.12010234099426807',), 1334999416: ('0.12010234099426807',), 1334999379: ('0.12010234099426807',), 1334999340: ('0.12010234099426807',)} new output for save of step final : {1334999515: ('0.12010234099426807',), 1334999508: ('0.12010234099426807',), 1334999426: ('0.12010234099426807',), 1334999419: ('0.12010234099426807',), 1334999416: ('0.12010234099426807',), 1334999379: ('0.12010234099426807',), 1334999340: ('0.12010234099426807',)} [1334999515, 1334999508, 1334999426, 1334999419, 1334999416, 1334999379, 1334999340] Looping around the photos to save general results len do output : 7 /1334999515.Didn't retrieve data . /1334999508.Didn't retrieve data . /1334999426.Didn't retrieve data . /1334999419.Didn't retrieve data . /1334999416.Didn't retrieve data . /1334999379.Didn't retrieve data . /1334999340.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2553456') ('3318', '20270434', '1334999515', None, None, None, None, None, '2553456') ('3318', None, None, None, None, None, None, None, '2553456') ('3318', '20270434', '1334999508', None, None, None, None, None, '2553456') ('3318', None, None, None, None, None, None, None, '2553456') ('3318', '20270434', '1334999426', None, None, None, None, None, '2553456') ('3318', None, None, None, None, None, None, None, '2553456') ('3318', '20270434', '1334999419', None, None, None, None, None, '2553456') ('3318', None, None, None, None, None, None, None, '2553456') ('3318', '20270434', '1334999416', None, None, None, None, None, '2553456') ('3318', None, None, None, None, None, None, None, '2553456') ('3318', '20270434', '1334999379', None, None, None, None, None, '2553456') ('3318', None, None, None, None, None, None, None, '2553456') ('3318', '20270434', '1334999340', None, None, None, None, None, '2553456') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 21 time used for this insertion : 0.012635469436645508 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.12086367607116699 time spend to save output : 0.013046026229858398 total time spend for step 5 : 0.1339097023010254 step6:blur_detection Wed Feb 5 19:14:15 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1738779028_569182_1334999515_572c06ac387200113f1ebfc03804c1f1.jpg resize: (2160, 3840) 1334999515 -5.269527433770004 treat image : temp/1738779028_569182_1334999508_7a9085066816a2cc0e0107f8e5da7bcf.jpg resize: (2160, 3840) 1334999508 -6.177078040644168 treat image : temp/1738779028_569182_1334999426_9cb452a20be6d7fece3d3c9a9cd0af1a.jpg resize: (2160, 3840) 1334999426 -5.344350988646328 treat image : temp/1738779028_569182_1334999419_1cb92de622d8942a37322f3dd6c9e453.jpg resize: (2160, 3840) 1334999419 -5.138999316002709 treat image : temp/1738779028_569182_1334999416_f965f1d3af29dc3c44e2ad6e4e7697d2.jpg resize: (2160, 3840) 1334999416 -5.6724584102957385 treat image : temp/1738779028_569182_1334999379_a55541aebc5ae7f8793cff3b1918d7b0.jpg resize: (2160, 3840) 1334999379 -6.219101964841624 treat image : temp/1738779028_569182_1334999340_687687070c1a68a88ca46a732c8857d9.jpg resize: (2160, 3840) 1334999340 -5.3092561657370325 treat image : temp/1738779028_569182_1334999515_572c06ac387200113f1ebfc03804c1f1_rle_crop_3656465208_0.png resize: (173, 127) 1335009158 -3.468399394079659 treat image : temp/1738779028_569182_1334999515_572c06ac387200113f1ebfc03804c1f1_rle_crop_3656465207_0.png resize: (702, 530) 1335009159 -3.93663853419409 treat image : temp/1738779028_569182_1334999515_572c06ac387200113f1ebfc03804c1f1_rle_crop_3656465197_0.png resize: (141, 134) 1335009160 0.5060659830687576 treat image : temp/1738779028_569182_1334999515_572c06ac387200113f1ebfc03804c1f1_rle_crop_3656465205_0.png resize: (373, 773) 1335009161 -4.282091415476756 treat image : temp/1738779028_569182_1334999515_572c06ac387200113f1ebfc03804c1f1_rle_crop_3656465193_0.png resize: (229, 256) 1335009163 -3.7220354361812102 treat image : temp/1738779028_569182_1334999515_572c06ac387200113f1ebfc03804c1f1_rle_crop_3656465206_0.png resize: (144, 182) 1335009164 -3.269380850277287 treat image : temp/1738779028_569182_1334999515_572c06ac387200113f1ebfc03804c1f1_rle_crop_3656465211_0.png resize: (156, 193) 1335009165 -3.2280099246578553 treat image : temp/1738779028_569182_1334999515_572c06ac387200113f1ebfc03804c1f1_rle_crop_3656465200_0.png resize: (102, 201) 1335009166 -1.176657060528717 treat image : temp/1738779028_569182_1334999515_572c06ac387200113f1ebfc03804c1f1_rle_crop_3656465203_0.png resize: (92, 94) 1335009167 -3.361029445117544 treat image : temp/1738779028_569182_1334999515_572c06ac387200113f1ebfc03804c1f1_rle_crop_3656465202_0.png resize: (151, 187) 1335009168 -2.019509942495833 treat image : temp/1738779028_569182_1334999515_572c06ac387200113f1ebfc03804c1f1_rle_crop_3656465201_0.png resize: (73, 178) 1335009169 -3.128908962088658 treat image : temp/1738779028_569182_1334999515_572c06ac387200113f1ebfc03804c1f1_rle_crop_3656465192_0.png resize: (154, 201) 1335009170 -1.9657511646307795 treat image : temp/1738779028_569182_1334999515_572c06ac387200113f1ebfc03804c1f1_rle_crop_3656465210_0.png resize: (144, 86) 1335009171 -3.564314459009913 treat image : temp/1738779028_569182_1334999515_572c06ac387200113f1ebfc03804c1f1_rle_crop_3656465212_0.png resize: (176, 153) 1335009172 -2.307245113449576 treat image : temp/1738779028_569182_1334999515_572c06ac387200113f1ebfc03804c1f1_rle_crop_3656465204_0.png resize: (125, 133) 1335009173 -2.8890794694002677 treat image : temp/1738779028_569182_1334999515_572c06ac387200113f1ebfc03804c1f1_rle_crop_3656465198_0.png resize: (171, 179) 1335009174 -3.303963772122516 treat image : temp/1738779028_569182_1334999515_572c06ac387200113f1ebfc03804c1f1_rle_crop_3656465195_0.png resize: (130, 141) 1335009176 -0.8459578638214008 treat image : temp/1738779028_569182_1334999515_572c06ac387200113f1ebfc03804c1f1_rle_crop_3656465209_0.png resize: (170, 177) 1335009177 -1.7811213646300512 treat image : temp/1738779028_569182_1334999508_7a9085066816a2cc0e0107f8e5da7bcf_rle_crop_3656465217_0.png resize: (162, 232) 1335009178 -3.569682067231509 treat image : temp/1738779028_569182_1334999508_7a9085066816a2cc0e0107f8e5da7bcf_rle_crop_3656465214_0.png resize: (321, 111) 1335009179 -3.572971467989632 treat image : temp/1738779028_569182_1334999508_7a9085066816a2cc0e0107f8e5da7bcf_rle_crop_3656465224_0.png resize: (312, 263) 1335009180 -1.6996619473610557 treat image : temp/1738779028_569182_1334999508_7a9085066816a2cc0e0107f8e5da7bcf_rle_crop_3656465213_0.png resize: (313, 209) 1335009181 -1.5837585203650149 treat image : temp/1738779028_569182_1334999508_7a9085066816a2cc0e0107f8e5da7bcf_rle_crop_3656465215_0.png resize: (140, 104) 1335009182 1.2152565105967394 treat image : temp/1738779028_569182_1334999508_7a9085066816a2cc0e0107f8e5da7bcf_rle_crop_3656465222_0.png resize: (198, 120) 1335009183 -1.788353751079463 treat image : temp/1738779028_569182_1334999508_7a9085066816a2cc0e0107f8e5da7bcf_rle_crop_3656465221_0.png resize: (351, 260) 1335009184 -4.244419593579244 treat image : temp/1738779028_569182_1334999508_7a9085066816a2cc0e0107f8e5da7bcf_rle_crop_3656465225_0.png resize: (130, 152) 1335009185 -1.6566973024831824 treat image : temp/1738779028_569182_1334999508_7a9085066816a2cc0e0107f8e5da7bcf_rle_crop_3656465223_0.png resize: (198, 239) 1335009186 -1.970363108113173 treat image : temp/1738779028_569182_1334999426_9cb452a20be6d7fece3d3c9a9cd0af1a_rle_crop_3656465245_0.png resize: (197, 106) 1335009187 -0.5970809416555947 treat image : temp/1738779028_569182_1334999426_9cb452a20be6d7fece3d3c9a9cd0af1a_rle_crop_3656465234_0.png resize: (219, 310) 1335009188 -1.7838922803638073 treat image : temp/1738779028_569182_1334999426_9cb452a20be6d7fece3d3c9a9cd0af1a_rle_crop_3656465233_0.png resize: (386, 569) 1335009189 -3.472406069961919 treat image : temp/1738779028_569182_1334999426_9cb452a20be6d7fece3d3c9a9cd0af1a_rle_crop_3656465249_0.png resize: (238, 168) 1335009190 -3.1887584625224292 treat image : temp/1738779028_569182_1334999426_9cb452a20be6d7fece3d3c9a9cd0af1a_rle_crop_3656465237_0.png resize: (239, 226) 1335009191 -4.136348609076818 treat image : temp/1738779028_569182_1334999426_9cb452a20be6d7fece3d3c9a9cd0af1a_rle_crop_3656465242_0.png resize: (248, 131) 1335009192 -3.6691722973990846 treat image : temp/1738779028_569182_1334999426_9cb452a20be6d7fece3d3c9a9cd0af1a_rle_crop_3656465243_0.png resize: (198, 190) 1335009193 -2.5562329502116805 treat image : temp/1738779028_569182_1334999426_9cb452a20be6d7fece3d3c9a9cd0af1a_rle_crop_3656465229_0.png resize: (105, 108) 1335009194 -2.2869156834333366 treat image : temp/1738779028_569182_1334999426_9cb452a20be6d7fece3d3c9a9cd0af1a_rle_crop_3656465236_0.png resize: (356, 898) 1335009195 -1.900676921935806 treat image : temp/1738779028_569182_1334999426_9cb452a20be6d7fece3d3c9a9cd0af1a_rle_crop_3656465239_0.png resize: (358, 319) 1335009196 -2.908376551471704 treat image : temp/1738779028_569182_1334999426_9cb452a20be6d7fece3d3c9a9cd0af1a_rle_crop_3656465235_0.png resize: (426, 442) 1335009197 -3.1367191845363362 treat image : temp/1738779028_569182_1334999426_9cb452a20be6d7fece3d3c9a9cd0af1a_rle_crop_3656465231_0.png resize: (77, 127) 1335009198 -2.6005752580124217 treat image : temp/1738779028_569182_1334999426_9cb452a20be6d7fece3d3c9a9cd0af1a_rle_crop_3656465252_0.png resize: (89, 128) 1335009199 -4.571616803128775 treat image : temp/1738779028_569182_1334999426_9cb452a20be6d7fece3d3c9a9cd0af1a_rle_crop_3656465228_0.png resize: (85, 119) 1335009200 -0.9047094961144614 treat image : temp/1738779028_569182_1334999426_9cb452a20be6d7fece3d3c9a9cd0af1a_rle_crop_3656465230_0.png resize: (89, 280) 1335009201 -3.85754123090519 treat image : temp/1738779028_569182_1334999426_9cb452a20be6d7fece3d3c9a9cd0af1a_rle_crop_3656465232_0.png resize: (68, 142) 1335009202 -0.24949889346872978 treat image : temp/1738779028_569182_1334999426_9cb452a20be6d7fece3d3c9a9cd0af1a_rle_crop_3656465257_0.png resize: (122, 194) 1335009203 -3.541454736324019 treat image : temp/1738779028_569182_1334999426_9cb452a20be6d7fece3d3c9a9cd0af1a_rle_crop_3656465241_0.png resize: (106, 125) 1335009204 -1.9373546326455928 treat image : temp/1738779028_569182_1334999426_9cb452a20be6d7fece3d3c9a9cd0af1a_rle_crop_3656465255_0.png resize: (185, 208) 1335009205 -2.9723192799199305 treat image : temp/1738779028_569182_1334999426_9cb452a20be6d7fece3d3c9a9cd0af1a_rle_crop_3656465251_0.png resize: (304, 509) 1335009206 -3.2665716338253747 treat image : temp/1738779028_569182_1334999426_9cb452a20be6d7fece3d3c9a9cd0af1a_rle_crop_3656465253_0.png resize: (258, 284) 1335009207 -1.8045133116669854 treat image : temp/1738779028_569182_1334999426_9cb452a20be6d7fece3d3c9a9cd0af1a_rle_crop_3656465254_0.png resize: (170, 144) 1335009208 -2.857196876274511 treat image : temp/1738779028_569182_1334999426_9cb452a20be6d7fece3d3c9a9cd0af1a_rle_crop_3656465240_0.png resize: (136, 103) 1335009209 -2.8088982846932726 treat image : temp/1738779028_569182_1334999426_9cb452a20be6d7fece3d3c9a9cd0af1a_rle_crop_3656465250_0.png resize: (125, 79) 1335009210 -1.9414142005471928 treat image : temp/1738779028_569182_1334999426_9cb452a20be6d7fece3d3c9a9cd0af1a_rle_crop_3656465246_0.png resize: (106, 98) 1335009211 -2.548969180584756 treat image : temp/1738779028_569182_1334999426_9cb452a20be6d7fece3d3c9a9cd0af1a_rle_crop_3656465248_0.png resize: (94, 93) 1335009212 -2.5179851495303267 treat image : temp/1738779028_569182_1334999419_1cb92de622d8942a37322f3dd6c9e453_rle_crop_3656465275_0.png resize: (271, 194) 1335009213 -3.5395602915205044 treat image : temp/1738779028_569182_1334999419_1cb92de622d8942a37322f3dd6c9e453_rle_crop_3656465268_0.png resize: (154, 288) 1335009214 -3.355381560084504 treat image : temp/1738779028_569182_1334999419_1cb92de622d8942a37322f3dd6c9e453_rle_crop_3656465265_0.png resize: (152, 167) 1335009215 -2.5804203349344585 treat image : temp/1738779028_569182_1334999419_1cb92de622d8942a37322f3dd6c9e453_rle_crop_3656465266_0.png resize: (190, 258) 1335009216 -1.4073993812549126 treat image : temp/1738779028_569182_1334999419_1cb92de622d8942a37322f3dd6c9e453_rle_crop_3656465271_0.png resize: (643, 620) 1335009217 -3.3201156195438184 treat image : temp/1738779028_569182_1334999419_1cb92de622d8942a37322f3dd6c9e453_rle_crop_3656465261_0.png resize: (629, 682) 1335009218 -2.5272119229305816 treat image : temp/1738779028_569182_1334999419_1cb92de622d8942a37322f3dd6c9e453_rle_crop_3656465258_0.png resize: (378, 341) 1335009219 -2.301681114216403 treat image : temp/1738779028_569182_1334999419_1cb92de622d8942a37322f3dd6c9e453_rle_crop_3656465259_0.png resize: (323, 451) 1335009220 -3.304384636513827 treat image : temp/1738779028_569182_1334999419_1cb92de622d8942a37322f3dd6c9e453_rle_crop_3656465267_0.png resize: (188, 283) 1335009221 -3.000397112332842 treat image : temp/1738779028_569182_1334999419_1cb92de622d8942a37322f3dd6c9e453_rle_crop_3656465262_0.png resize: (253, 293) 1335009222 -3.1424467445236246 treat image : temp/1738779028_569182_1334999419_1cb92de622d8942a37322f3dd6c9e453_rle_crop_3656465274_0.png resize: (112, 91) 1335009223 -3.4309016079356045 treat image : temp/1738779028_569182_1334999419_1cb92de622d8942a37322f3dd6c9e453_rle_crop_3656465270_0.png resize: (166, 247) 1335009224 -2.1250404851726743 treat image : temp/1738779028_569182_1334999419_1cb92de622d8942a37322f3dd6c9e453_rle_crop_3656465269_0.png resize: (97, 142) 1335009225 -1.928577375501616 treat image : temp/1738779028_569182_1334999419_1cb92de622d8942a37322f3dd6c9e453_rle_crop_3656465260_0.png resize: (187, 130) 1335009226 -0.9940901946318881 treat image : temp/1738779028_569182_1334999419_1cb92de622d8942a37322f3dd6c9e453_rle_crop_3656465263_0.png resize: (101, 169) 1335009227 -0.5056095938192572 treat image : temp/1738779028_569182_1334999419_1cb92de622d8942a37322f3dd6c9e453_rle_crop_3656465272_0.png resize: (204, 154) 1335009228 -4.073109644827955 treat image : temp/1738779028_569182_1334999419_1cb92de622d8942a37322f3dd6c9e453_rle_crop_3656465264_0.png resize: (173, 352) 1335009229 -3.025115870774703 treat image : temp/1738779028_569182_1334999419_1cb92de622d8942a37322f3dd6c9e453_rle_crop_3656465276_0.png resize: (220, 128) 1335009230 -3.69591579866992 treat image : temp/1738779028_569182_1334999419_1cb92de622d8942a37322f3dd6c9e453_rle_crop_3656465277_0.png resize: (160, 77) 1335009231 -1.5453231147023796 treat image : temp/1738779028_569182_1334999416_f965f1d3af29dc3c44e2ad6e4e7697d2_rle_crop_3656465296_0.png resize: (405, 280) 1335009232 -1.2826810228969465 treat image : temp/1738779028_569182_1334999416_f965f1d3af29dc3c44e2ad6e4e7697d2_rle_crop_3656465289_0.png resize: (368, 546) 1335009233 -4.004481665294864 treat image : temp/1738779028_569182_1334999416_f965f1d3af29dc3c44e2ad6e4e7697d2_rle_crop_3656465298_0.png resize: (136, 117) 1335009234 -3.4608900093475428 treat image : temp/1738779028_569182_1334999416_f965f1d3af29dc3c44e2ad6e4e7697d2_rle_crop_3656465282_0.png resize: (74, 144) 1335009235 -2.8415041942636323 treat image : temp/1738779028_569182_1334999416_f965f1d3af29dc3c44e2ad6e4e7697d2_rle_crop_3656465281_0.png resize: (120, 130) 1335009236 -3.3774111910792075 treat image : temp/1738779028_569182_1334999416_f965f1d3af29dc3c44e2ad6e4e7697d2_rle_crop_3656465279_0.png resize: (129, 206) 1335009237 -2.5707870542167193 treat image : temp/1738779028_569182_1334999416_f965f1d3af29dc3c44e2ad6e4e7697d2_rle_crop_3656465284_0.png resize: (147, 157) 1335009238 -2.4579951850235404 treat image : temp/1738779028_569182_1334999416_f965f1d3af29dc3c44e2ad6e4e7697d2_rle_crop_3656465299_0.png resize: (348, 242) 1335009239 -3.279041314878498 treat image : temp/1738779028_569182_1334999416_f965f1d3af29dc3c44e2ad6e4e7697d2_rle_crop_3656465300_0.png resize: (254, 255) 1335009240 -3.364905832461139 treat image : temp/1738779028_569182_1334999416_f965f1d3af29dc3c44e2ad6e4e7697d2_rle_crop_3656465288_0.png resize: (353, 470) 1335009241 -3.836499375798758 treat image : temp/1738779028_569182_1334999416_f965f1d3af29dc3c44e2ad6e4e7697d2_rle_crop_3656465301_0.png resize: (204, 191) 1335009242 -2.7341858079609502 treat image : temp/1738779028_569182_1334999416_f965f1d3af29dc3c44e2ad6e4e7697d2_rle_crop_3656465283_0.png resize: (115, 163) 1335009243 -0.5357694716896256 treat image : temp/1738779028_569182_1334999416_f965f1d3af29dc3c44e2ad6e4e7697d2_rle_crop_3656465294_0.png resize: (164, 238) 1335009244 -3.179430616536569 treat image : temp/1738779028_569182_1334999416_f965f1d3af29dc3c44e2ad6e4e7697d2_rle_crop_3656465291_0.png resize: (238, 186) 1335009245 -3.0547259742811446 treat image : temp/1738779028_569182_1334999416_f965f1d3af29dc3c44e2ad6e4e7697d2_rle_crop_3656465278_0.png resize: (106, 218) 1335009246 -3.0569877477214478 treat image : temp/1738779028_569182_1334999416_f965f1d3af29dc3c44e2ad6e4e7697d2_rle_crop_3656465295_0.png resize: (325, 353) 1335009247 -3.589859520794181 treat image : temp/1738779028_569182_1334999416_f965f1d3af29dc3c44e2ad6e4e7697d2_rle_crop_3656465280_0.png resize: (356, 206) 1335009248 -3.3506951608958064 treat image : temp/1738779028_569182_1334999379_a55541aebc5ae7f8793cff3b1918d7b0_rle_crop_3656465311_0.png resize: (73, 178) 1335009249 -1.5932513619031015 treat image : temp/1738779028_569182_1334999379_a55541aebc5ae7f8793cff3b1918d7b0_rle_crop_3656465326_0.png resize: (530, 246) 1335009250 -3.5632364218648065 treat image : temp/1738779028_569182_1334999379_a55541aebc5ae7f8793cff3b1918d7b0_rle_crop_3656465323_0.png resize: (203, 122) 1335009251 -4.177519279261526 treat image : temp/1738779028_569182_1334999379_a55541aebc5ae7f8793cff3b1918d7b0_rle_crop_3656465304_0.png resize: (228, 326) 1335009252 -3.114352681523727 treat image : temp/1738779028_569182_1334999379_a55541aebc5ae7f8793cff3b1918d7b0_rle_crop_3656465312_0.png resize: (138, 176) 1335009253 -3.3562695246521934 treat image : temp/1738779028_569182_1334999379_a55541aebc5ae7f8793cff3b1918d7b0_rle_crop_3656465308_0.png resize: (110, 232) 1335009254 0.08612060476840096 treat image : temp/1738779028_569182_1334999379_a55541aebc5ae7f8793cff3b1918d7b0_rle_crop_3656465316_0.png resize: (347, 343) 1335009255 -2.937505186188452 treat image : temp/1738779028_569182_1334999379_a55541aebc5ae7f8793cff3b1918d7b0_rle_crop_3656465321_0.png resize: (250, 246) 1335009256 -0.2585042259148501 treat image : temp/1738779028_569182_1334999379_a55541aebc5ae7f8793cff3b1918d7b0_rle_crop_3656465314_0.png resize: (457, 551) 1335009257 -3.8672043715985835 treat image : temp/1738779028_569182_1334999379_a55541aebc5ae7f8793cff3b1918d7b0_rle_crop_3656465309_0.png resize: (271, 213) 1335009258 -3.7987445068406434 treat image : temp/1738779028_569182_1334999379_a55541aebc5ae7f8793cff3b1918d7b0_rle_crop_3656465313_0.png resize: (300, 206) 1335009259 -1.6017583723320192 treat image : temp/1738779028_569182_1334999379_a55541aebc5ae7f8793cff3b1918d7b0_rle_crop_3656465303_0.png resize: (180, 177) 1335009260 -2.638263007677067 treat image : temp/1738779028_569182_1334999379_a55541aebc5ae7f8793cff3b1918d7b0_rle_crop_3656465325_0.png resize: (644, 376) 1335009261 -4.030500762445152 treat image : temp/1738779028_569182_1334999379_a55541aebc5ae7f8793cff3b1918d7b0_rle_crop_3656465306_0.png resize: (140, 139) 1335009262 -2.8978886629689127 treat image : temp/1738779028_569182_1334999379_a55541aebc5ae7f8793cff3b1918d7b0_rle_crop_3656465317_0.png resize: (316, 211) 1335009263 -2.894309909248972 treat image : temp/1738779028_569182_1334999379_a55541aebc5ae7f8793cff3b1918d7b0_rle_crop_3656465310_0.png resize: (257, 160) 1335009264 -3.4836279631453735 treat image : temp/1738779028_569182_1334999379_a55541aebc5ae7f8793cff3b1918d7b0_rle_crop_3656465318_0.png resize: (102, 71) 1335009265 -1.9589900799170556 treat image : temp/1738779028_569182_1334999379_a55541aebc5ae7f8793cff3b1918d7b0_rle_crop_3656465305_0.png resize: (254, 136) 1335009266 -4.147033292740233 treat image : temp/1738779028_569182_1334999379_a55541aebc5ae7f8793cff3b1918d7b0_rle_crop_3656465322_0.png resize: (174, 281) 1335009268 -2.9751580392033885 treat image : temp/1738779028_569182_1334999379_a55541aebc5ae7f8793cff3b1918d7b0_rle_crop_3656465307_0.png resize: (276, 285) 1335009269 -1.71628104262338 treat image : temp/1738779028_569182_1334999340_687687070c1a68a88ca46a732c8857d9_rle_crop_3656465345_0.png resize: (554, 610) 1335009270 -4.089181603781984 treat image : temp/1738779028_569182_1334999340_687687070c1a68a88ca46a732c8857d9_rle_crop_3656465331_0.png resize: (258, 468) 1335009271 -3.1686970447716694 treat image : temp/1738779028_569182_1334999340_687687070c1a68a88ca46a732c8857d9_rle_crop_3656465343_0.png resize: (105, 141) 1335009272 0.2746690886920982 treat image : temp/1738779028_569182_1334999340_687687070c1a68a88ca46a732c8857d9_rle_crop_3656465337_0.png resize: (498, 370) 1335009273 -2.216253253002822 treat image : temp/1738779028_569182_1334999340_687687070c1a68a88ca46a732c8857d9_rle_crop_3656465330_0.png resize: (73, 82) 1335009275 -3.5972971258634767 treat image : temp/1738779028_569182_1334999340_687687070c1a68a88ca46a732c8857d9_rle_crop_3656465335_0.png resize: (262, 296) 1335009276 -3.3369444520919016 treat image : temp/1738779028_569182_1334999340_687687070c1a68a88ca46a732c8857d9_rle_crop_3656465329_0.png resize: (206, 236) 1335009277 -3.2120039262581006 treat image : temp/1738779028_569182_1334999340_687687070c1a68a88ca46a732c8857d9_rle_crop_3656465338_0.png resize: (210, 151) 1335009278 -2.3967541948488806 treat image : temp/1738779028_569182_1334999340_687687070c1a68a88ca46a732c8857d9_rle_crop_3656465334_0.png resize: (559, 702) 1335009279 -2.851034013974642 treat image : temp/1738779028_569182_1334999340_687687070c1a68a88ca46a732c8857d9_rle_crop_3656465349_0.png resize: (211, 277) 1335009280 -2.958947605769255 treat image : temp/1738779028_569182_1334999340_687687070c1a68a88ca46a732c8857d9_rle_crop_3656465342_0.png resize: (345, 182) 1335009281 -3.65325678532879 treat image : temp/1738779028_569182_1334999340_687687070c1a68a88ca46a732c8857d9_rle_crop_3656465346_0.png resize: (158, 124) 1335009282 -3.6625384887127237 treat image : temp/1738779028_569182_1334999340_687687070c1a68a88ca46a732c8857d9_rle_crop_3656465340_0.png resize: (416, 229) 1335009283 -2.4086547584315112 treat image : temp/1738779028_569182_1334999340_687687070c1a68a88ca46a732c8857d9_rle_crop_3656465333_0.png resize: (303, 230) 1335009284 -2.63786797624572 treat image : temp/1738779028_569182_1334999340_687687070c1a68a88ca46a732c8857d9_rle_crop_3656465350_0.png resize: (486, 511) 1335009285 -2.690919876632861 treat image : temp/1738779028_569182_1334999340_687687070c1a68a88ca46a732c8857d9_rle_crop_3656465328_0.png resize: (173, 146) 1335009286 -3.412267864894095 treat image : temp/1738779028_569182_1334999340_687687070c1a68a88ca46a732c8857d9_rle_crop_3656465327_0.png resize: (115, 177) 1335009287 -0.2519116177617175 treat image : temp/1738779028_569182_1334999340_687687070c1a68a88ca46a732c8857d9_rle_crop_3656465332_0.png resize: (230, 149) 1335009288 -2.567679432670317 treat image : temp/1738779028_569182_1334999340_687687070c1a68a88ca46a732c8857d9_rle_crop_3656465352_0.png resize: (325, 281) 1335009289 -3.026419637151111 treat image : temp/1738779028_569182_1334999340_687687070c1a68a88ca46a732c8857d9_rle_crop_3656465336_0.png resize: (160, 100) 1335009290 -3.3959353000136137 treat image : temp/1738779028_569182_1334999340_687687070c1a68a88ca46a732c8857d9_rle_crop_3656465348_0.png resize: (664, 472) 1335009291 -3.583978541445534 treat image : temp/1738779028_569182_1334999340_687687070c1a68a88ca46a732c8857d9_rle_crop_3656465353_0.png resize: (170, 98) 1335009292 -2.4024833208513656 treat image : temp/1738779028_569182_1334999340_687687070c1a68a88ca46a732c8857d9_rle_crop_3656465344_0.png resize: (324, 218) 1335009293 -3.835636033763202 treat image : temp/1738779028_569182_1334999340_687687070c1a68a88ca46a732c8857d9_rle_crop_3656465354_0.png resize: (649, 514) 1335009294 -3.125163537637675 treat image : temp/1738779028_569182_1334999340_687687070c1a68a88ca46a732c8857d9_rle_crop_3656465347_0.png resize: (422, 189) 1335009295 -3.0263961742922008 treat image : temp/1738779028_569182_1334999515_572c06ac387200113f1ebfc03804c1f1_rle_crop_3656465194_0.png resize: (168, 135) 1335009299 -2.2537417010567546 treat image : temp/1738779028_569182_1334999515_572c06ac387200113f1ebfc03804c1f1_rle_crop_3656465196_0.png resize: (176, 197) 1335009300 -1.0736618389603094 treat image : temp/1738779028_569182_1334999508_7a9085066816a2cc0e0107f8e5da7bcf_rle_crop_3656465226_0.png resize: (197, 164) 1335009301 -2.623793508738156 treat image : temp/1738779028_569182_1334999508_7a9085066816a2cc0e0107f8e5da7bcf_rle_crop_3656465220_0.png resize: (297, 129) 1335009302 -3.0455260644347035 treat image : temp/1738779028_569182_1334999508_7a9085066816a2cc0e0107f8e5da7bcf_rle_crop_3656465216_0.png resize: (251, 221) 1335009303 -2.302779196328543 treat image : temp/1738779028_569182_1334999508_7a9085066816a2cc0e0107f8e5da7bcf_rle_crop_3656465227_0.png resize: (271, 135) 1335009304 -2.5229786332970185 treat image : temp/1738779028_569182_1334999426_9cb452a20be6d7fece3d3c9a9cd0af1a_rle_crop_3656465238_0.png resize: (159, 201) 1335009305 -2.3452206963625164 treat image : temp/1738779028_569182_1334999426_9cb452a20be6d7fece3d3c9a9cd0af1a_rle_crop_3656465256_0.png resize: (209, 222) 1335009306 -3.2739228875300848 treat image : temp/1738779028_569182_1334999426_9cb452a20be6d7fece3d3c9a9cd0af1a_rle_crop_3656465244_0.png resize: (199, 190) 1335009307 -3.914593273813085 treat image : temp/1738779028_569182_1334999419_1cb92de622d8942a37322f3dd6c9e453_rle_crop_3656465273_0.png resize: (248, 140) 1335009308 -2.6665343098542786 treat image : temp/1738779028_569182_1334999416_f965f1d3af29dc3c44e2ad6e4e7697d2_rle_crop_3656465285_0.png resize: (260, 710) 1335009309 -3.0297162844083885 treat image : temp/1738779028_569182_1334999416_f965f1d3af29dc3c44e2ad6e4e7697d2_rle_crop_3656465292_0.png resize: (318, 153) 1335009310 -3.0953960613201903 treat image : temp/1738779028_569182_1334999416_f965f1d3af29dc3c44e2ad6e4e7697d2_rle_crop_3656465293_0.png resize: (288, 293) 1335009311 -3.7637583965351884 treat image : temp/1738779028_569182_1334999416_f965f1d3af29dc3c44e2ad6e4e7697d2_rle_crop_3656465302_0.png resize: (274, 259) 1335009312 -4.158746733734748 treat image : temp/1738779028_569182_1334999416_f965f1d3af29dc3c44e2ad6e4e7697d2_rle_crop_3656465287_0.png resize: (113, 422) 1335009313 -3.0576274701232924 treat image : temp/1738779028_569182_1334999416_f965f1d3af29dc3c44e2ad6e4e7697d2_rle_crop_3656465290_0.png resize: (255, 312) 1335009314 -3.0212332057538 treat image : temp/1738779028_569182_1334999416_f965f1d3af29dc3c44e2ad6e4e7697d2_rle_crop_3656465286_0.png resize: (205, 145) 1335009315 -3.129575287670705 treat image : temp/1738779028_569182_1334999379_a55541aebc5ae7f8793cff3b1918d7b0_rle_crop_3656465319_0.png resize: (271, 263) 1335009316 -4.40849598679093 treat image : temp/1738779028_569182_1334999379_a55541aebc5ae7f8793cff3b1918d7b0_rle_crop_3656465320_0.png resize: (272, 171) 1335009317 -2.3911921185337657 treat image : temp/1738779028_569182_1334999379_a55541aebc5ae7f8793cff3b1918d7b0_rle_crop_3656465324_0.png resize: (260, 256) 1335009318 -3.7900576264012527 treat image : temp/1738779028_569182_1334999379_a55541aebc5ae7f8793cff3b1918d7b0_rle_crop_3656465315_0.png resize: (187, 199) 1335009319 -1.583160332937971 treat image : temp/1738779028_569182_1334999340_687687070c1a68a88ca46a732c8857d9_rle_crop_3656465339_0.png resize: (288, 277) 1335009320 -3.6496139075155516 treat image : temp/1738779028_569182_1334999508_7a9085066816a2cc0e0107f8e5da7bcf_rle_crop_3656465218_0.png resize: (265, 569) 1335009323 -4.845997049869189 treat image : temp/1738779028_569182_1334999426_9cb452a20be6d7fece3d3c9a9cd0af1a_rle_crop_3656465247_0.png resize: (572, 271) 1335009324 -4.733104237184437 treat image : temp/1738779028_569182_1334999416_f965f1d3af29dc3c44e2ad6e4e7697d2_rle_crop_3656465297_0.png resize: (295, 473) 1335009325 -3.5254384409321378 treat image : temp/1738779028_569182_1334999340_687687070c1a68a88ca46a732c8857d9_rle_crop_3656465351_0.png resize: (362, 352) 1335009326 -3.4292117471157684 treat image : temp/1738779028_569182_1334999340_687687070c1a68a88ca46a732c8857d9_rle_crop_3656465341_0.png resize: (228, 318) 1335009328 -3.4265051192356495 treat image : temp/1738779028_569182_1334999515_572c06ac387200113f1ebfc03804c1f1_rle_crop_3656465199_0.png resize: (166, 157) 1335009330 -1.9449109025501103 treat image : temp/1738779028_569182_1334999508_7a9085066816a2cc0e0107f8e5da7bcf_rle_crop_3656465219_0.png resize: (194, 305) 1335009331 -2.660182839806947 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 170 time used for this insertion : 0.018916606903076172 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 170 time used for this insertion : 0.03184032440185547 save missing photos in datou_result : time spend for datou_step_exec : 27.10809326171875 time spend to save output : 0.05588245391845703 total time spend for step 6 : 27.163975715637207 step7:brightness Wed Feb 5 19:14:42 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1738779028_569182_1334999515_572c06ac387200113f1ebfc03804c1f1.jpg treat image : temp/1738779028_569182_1334999508_7a9085066816a2cc0e0107f8e5da7bcf.jpg treat image : temp/1738779028_569182_1334999426_9cb452a20be6d7fece3d3c9a9cd0af1a.jpg treat image : temp/1738779028_569182_1334999419_1cb92de622d8942a37322f3dd6c9e453.jpg treat image : temp/1738779028_569182_1334999416_f965f1d3af29dc3c44e2ad6e4e7697d2.jpg treat image : temp/1738779028_569182_1334999379_a55541aebc5ae7f8793cff3b1918d7b0.jpg treat image : temp/1738779028_569182_1334999340_687687070c1a68a88ca46a732c8857d9.jpg treat image : temp/1738779028_569182_1334999515_572c06ac387200113f1ebfc03804c1f1_rle_crop_3656465208_0.png treat image : temp/1738779028_569182_1334999515_572c06ac387200113f1ebfc03804c1f1_rle_crop_3656465207_0.png treat image : temp/1738779028_569182_1334999515_572c06ac387200113f1ebfc03804c1f1_rle_crop_3656465197_0.png treat image : temp/1738779028_569182_1334999515_572c06ac387200113f1ebfc03804c1f1_rle_crop_3656465205_0.png treat image : temp/1738779028_569182_1334999515_572c06ac387200113f1ebfc03804c1f1_rle_crop_3656465193_0.png treat image : temp/1738779028_569182_1334999515_572c06ac387200113f1ebfc03804c1f1_rle_crop_3656465206_0.png treat image : temp/1738779028_569182_1334999515_572c06ac387200113f1ebfc03804c1f1_rle_crop_3656465211_0.png treat image : temp/1738779028_569182_1334999515_572c06ac387200113f1ebfc03804c1f1_rle_crop_3656465200_0.png treat image : temp/1738779028_569182_1334999515_572c06ac387200113f1ebfc03804c1f1_rle_crop_3656465203_0.png treat image : temp/1738779028_569182_1334999515_572c06ac387200113f1ebfc03804c1f1_rle_crop_3656465202_0.png treat image : temp/1738779028_569182_1334999515_572c06ac387200113f1ebfc03804c1f1_rle_crop_3656465201_0.png treat image : temp/1738779028_569182_1334999515_572c06ac387200113f1ebfc03804c1f1_rle_crop_3656465192_0.png treat image : temp/1738779028_569182_1334999515_572c06ac387200113f1ebfc03804c1f1_rle_crop_3656465210_0.png treat image : temp/1738779028_569182_1334999515_572c06ac387200113f1ebfc03804c1f1_rle_crop_3656465212_0.png treat image : temp/1738779028_569182_1334999515_572c06ac387200113f1ebfc03804c1f1_rle_crop_3656465204_0.png treat image : temp/1738779028_569182_1334999515_572c06ac387200113f1ebfc03804c1f1_rle_crop_3656465198_0.png treat image : temp/1738779028_569182_1334999515_572c06ac387200113f1ebfc03804c1f1_rle_crop_3656465195_0.png treat image : temp/1738779028_569182_1334999515_572c06ac387200113f1ebfc03804c1f1_rle_crop_3656465209_0.png treat image : temp/1738779028_569182_1334999508_7a9085066816a2cc0e0107f8e5da7bcf_rle_crop_3656465217_0.png treat image : temp/1738779028_569182_1334999508_7a9085066816a2cc0e0107f8e5da7bcf_rle_crop_3656465214_0.png treat image : temp/1738779028_569182_1334999508_7a9085066816a2cc0e0107f8e5da7bcf_rle_crop_3656465224_0.png treat image : temp/1738779028_569182_1334999508_7a9085066816a2cc0e0107f8e5da7bcf_rle_crop_3656465213_0.png treat image : temp/1738779028_569182_1334999508_7a9085066816a2cc0e0107f8e5da7bcf_rle_crop_3656465215_0.png treat image : temp/1738779028_569182_1334999508_7a9085066816a2cc0e0107f8e5da7bcf_rle_crop_3656465222_0.png treat image : temp/1738779028_569182_1334999508_7a9085066816a2cc0e0107f8e5da7bcf_rle_crop_3656465221_0.png treat image : temp/1738779028_569182_1334999508_7a9085066816a2cc0e0107f8e5da7bcf_rle_crop_3656465225_0.png treat image : temp/1738779028_569182_1334999508_7a9085066816a2cc0e0107f8e5da7bcf_rle_crop_3656465223_0.png treat image : temp/1738779028_569182_1334999426_9cb452a20be6d7fece3d3c9a9cd0af1a_rle_crop_3656465245_0.png treat image : temp/1738779028_569182_1334999426_9cb452a20be6d7fece3d3c9a9cd0af1a_rle_crop_3656465234_0.png treat image : temp/1738779028_569182_1334999426_9cb452a20be6d7fece3d3c9a9cd0af1a_rle_crop_3656465233_0.png treat image : temp/1738779028_569182_1334999426_9cb452a20be6d7fece3d3c9a9cd0af1a_rle_crop_3656465249_0.png treat image : temp/1738779028_569182_1334999426_9cb452a20be6d7fece3d3c9a9cd0af1a_rle_crop_3656465237_0.png treat image : temp/1738779028_569182_1334999426_9cb452a20be6d7fece3d3c9a9cd0af1a_rle_crop_3656465242_0.png treat image : temp/1738779028_569182_1334999426_9cb452a20be6d7fece3d3c9a9cd0af1a_rle_crop_3656465243_0.png treat image : temp/1738779028_569182_1334999426_9cb452a20be6d7fece3d3c9a9cd0af1a_rle_crop_3656465229_0.png treat image : temp/1738779028_569182_1334999426_9cb452a20be6d7fece3d3c9a9cd0af1a_rle_crop_3656465236_0.png treat image : temp/1738779028_569182_1334999426_9cb452a20be6d7fece3d3c9a9cd0af1a_rle_crop_3656465239_0.png treat image : temp/1738779028_569182_1334999426_9cb452a20be6d7fece3d3c9a9cd0af1a_rle_crop_3656465235_0.png treat image : temp/1738779028_569182_1334999426_9cb452a20be6d7fece3d3c9a9cd0af1a_rle_crop_3656465231_0.png treat image : temp/1738779028_569182_1334999426_9cb452a20be6d7fece3d3c9a9cd0af1a_rle_crop_3656465252_0.png treat image : temp/1738779028_569182_1334999426_9cb452a20be6d7fece3d3c9a9cd0af1a_rle_crop_3656465228_0.png treat image : temp/1738779028_569182_1334999426_9cb452a20be6d7fece3d3c9a9cd0af1a_rle_crop_3656465230_0.png treat image : temp/1738779028_569182_1334999426_9cb452a20be6d7fece3d3c9a9cd0af1a_rle_crop_3656465232_0.png treat image : temp/1738779028_569182_1334999426_9cb452a20be6d7fece3d3c9a9cd0af1a_rle_crop_3656465257_0.png treat image : temp/1738779028_569182_1334999426_9cb452a20be6d7fece3d3c9a9cd0af1a_rle_crop_3656465241_0.png treat image : temp/1738779028_569182_1334999426_9cb452a20be6d7fece3d3c9a9cd0af1a_rle_crop_3656465255_0.png treat image : temp/1738779028_569182_1334999426_9cb452a20be6d7fece3d3c9a9cd0af1a_rle_crop_3656465251_0.png treat image : temp/1738779028_569182_1334999426_9cb452a20be6d7fece3d3c9a9cd0af1a_rle_crop_3656465253_0.png treat image : temp/1738779028_569182_1334999426_9cb452a20be6d7fece3d3c9a9cd0af1a_rle_crop_3656465254_0.png treat image : temp/1738779028_569182_1334999426_9cb452a20be6d7fece3d3c9a9cd0af1a_rle_crop_3656465240_0.png treat image : temp/1738779028_569182_1334999426_9cb452a20be6d7fece3d3c9a9cd0af1a_rle_crop_3656465250_0.png treat image : temp/1738779028_569182_1334999426_9cb452a20be6d7fece3d3c9a9cd0af1a_rle_crop_3656465246_0.png treat image : temp/1738779028_569182_1334999426_9cb452a20be6d7fece3d3c9a9cd0af1a_rle_crop_3656465248_0.png treat image : temp/1738779028_569182_1334999419_1cb92de622d8942a37322f3dd6c9e453_rle_crop_3656465275_0.png treat image : temp/1738779028_569182_1334999419_1cb92de622d8942a37322f3dd6c9e453_rle_crop_3656465268_0.png treat image : temp/1738779028_569182_1334999419_1cb92de622d8942a37322f3dd6c9e453_rle_crop_3656465265_0.png treat image : temp/1738779028_569182_1334999419_1cb92de622d8942a37322f3dd6c9e453_rle_crop_3656465266_0.png treat image : temp/1738779028_569182_1334999419_1cb92de622d8942a37322f3dd6c9e453_rle_crop_3656465271_0.png treat image : temp/1738779028_569182_1334999419_1cb92de622d8942a37322f3dd6c9e453_rle_crop_3656465261_0.png treat image : temp/1738779028_569182_1334999419_1cb92de622d8942a37322f3dd6c9e453_rle_crop_3656465258_0.png treat image : temp/1738779028_569182_1334999419_1cb92de622d8942a37322f3dd6c9e453_rle_crop_3656465259_0.png treat image : temp/1738779028_569182_1334999419_1cb92de622d8942a37322f3dd6c9e453_rle_crop_3656465267_0.png treat image : temp/1738779028_569182_1334999419_1cb92de622d8942a37322f3dd6c9e453_rle_crop_3656465262_0.png treat image : temp/1738779028_569182_1334999419_1cb92de622d8942a37322f3dd6c9e453_rle_crop_3656465274_0.png treat image : temp/1738779028_569182_1334999419_1cb92de622d8942a37322f3dd6c9e453_rle_crop_3656465270_0.png treat image : temp/1738779028_569182_1334999419_1cb92de622d8942a37322f3dd6c9e453_rle_crop_3656465269_0.png treat image : temp/1738779028_569182_1334999419_1cb92de622d8942a37322f3dd6c9e453_rle_crop_3656465260_0.png treat image : temp/1738779028_569182_1334999419_1cb92de622d8942a37322f3dd6c9e453_rle_crop_3656465263_0.png treat image : temp/1738779028_569182_1334999419_1cb92de622d8942a37322f3dd6c9e453_rle_crop_3656465272_0.png treat image : temp/1738779028_569182_1334999419_1cb92de622d8942a37322f3dd6c9e453_rle_crop_3656465264_0.png treat image : temp/1738779028_569182_1334999419_1cb92de622d8942a37322f3dd6c9e453_rle_crop_3656465276_0.png treat image : temp/1738779028_569182_1334999419_1cb92de622d8942a37322f3dd6c9e453_rle_crop_3656465277_0.png treat image : temp/1738779028_569182_1334999416_f965f1d3af29dc3c44e2ad6e4e7697d2_rle_crop_3656465296_0.png treat image : temp/1738779028_569182_1334999416_f965f1d3af29dc3c44e2ad6e4e7697d2_rle_crop_3656465289_0.png treat image : temp/1738779028_569182_1334999416_f965f1d3af29dc3c44e2ad6e4e7697d2_rle_crop_3656465298_0.png treat image : temp/1738779028_569182_1334999416_f965f1d3af29dc3c44e2ad6e4e7697d2_rle_crop_3656465282_0.png treat image : temp/1738779028_569182_1334999416_f965f1d3af29dc3c44e2ad6e4e7697d2_rle_crop_3656465281_0.png treat image : temp/1738779028_569182_1334999416_f965f1d3af29dc3c44e2ad6e4e7697d2_rle_crop_3656465279_0.png treat image : temp/1738779028_569182_1334999416_f965f1d3af29dc3c44e2ad6e4e7697d2_rle_crop_3656465284_0.png treat image : temp/1738779028_569182_1334999416_f965f1d3af29dc3c44e2ad6e4e7697d2_rle_crop_3656465299_0.png treat image : temp/1738779028_569182_1334999416_f965f1d3af29dc3c44e2ad6e4e7697d2_rle_crop_3656465300_0.png treat image : temp/1738779028_569182_1334999416_f965f1d3af29dc3c44e2ad6e4e7697d2_rle_crop_3656465288_0.png treat image : temp/1738779028_569182_1334999416_f965f1d3af29dc3c44e2ad6e4e7697d2_rle_crop_3656465301_0.png treat image : temp/1738779028_569182_1334999416_f965f1d3af29dc3c44e2ad6e4e7697d2_rle_crop_3656465283_0.png treat image : temp/1738779028_569182_1334999416_f965f1d3af29dc3c44e2ad6e4e7697d2_rle_crop_3656465294_0.png treat image : temp/1738779028_569182_1334999416_f965f1d3af29dc3c44e2ad6e4e7697d2_rle_crop_3656465291_0.png treat image : temp/1738779028_569182_1334999416_f965f1d3af29dc3c44e2ad6e4e7697d2_rle_crop_3656465278_0.png treat image : temp/1738779028_569182_1334999416_f965f1d3af29dc3c44e2ad6e4e7697d2_rle_crop_3656465295_0.png treat image : temp/1738779028_569182_1334999416_f965f1d3af29dc3c44e2ad6e4e7697d2_rle_crop_3656465280_0.png treat image : temp/1738779028_569182_1334999379_a55541aebc5ae7f8793cff3b1918d7b0_rle_crop_3656465311_0.png treat image : temp/1738779028_569182_1334999379_a55541aebc5ae7f8793cff3b1918d7b0_rle_crop_3656465326_0.png treat image : temp/1738779028_569182_1334999379_a55541aebc5ae7f8793cff3b1918d7b0_rle_crop_3656465323_0.png treat image : temp/1738779028_569182_1334999379_a55541aebc5ae7f8793cff3b1918d7b0_rle_crop_3656465304_0.png treat image : temp/1738779028_569182_1334999379_a55541aebc5ae7f8793cff3b1918d7b0_rle_crop_3656465312_0.png treat image : temp/1738779028_569182_1334999379_a55541aebc5ae7f8793cff3b1918d7b0_rle_crop_3656465308_0.png treat image : temp/1738779028_569182_1334999379_a55541aebc5ae7f8793cff3b1918d7b0_rle_crop_3656465316_0.png treat image : temp/1738779028_569182_1334999379_a55541aebc5ae7f8793cff3b1918d7b0_rle_crop_3656465321_0.png treat image : temp/1738779028_569182_1334999379_a55541aebc5ae7f8793cff3b1918d7b0_rle_crop_3656465314_0.png treat image : temp/1738779028_569182_1334999379_a55541aebc5ae7f8793cff3b1918d7b0_rle_crop_3656465309_0.png treat image : temp/1738779028_569182_1334999379_a55541aebc5ae7f8793cff3b1918d7b0_rle_crop_3656465313_0.png treat image : temp/1738779028_569182_1334999379_a55541aebc5ae7f8793cff3b1918d7b0_rle_crop_3656465303_0.png treat image : temp/1738779028_569182_1334999379_a55541aebc5ae7f8793cff3b1918d7b0_rle_crop_3656465325_0.png treat image : temp/1738779028_569182_1334999379_a55541aebc5ae7f8793cff3b1918d7b0_rle_crop_3656465306_0.png treat image : temp/1738779028_569182_1334999379_a55541aebc5ae7f8793cff3b1918d7b0_rle_crop_3656465317_0.png treat image : temp/1738779028_569182_1334999379_a55541aebc5ae7f8793cff3b1918d7b0_rle_crop_3656465310_0.png treat image : temp/1738779028_569182_1334999379_a55541aebc5ae7f8793cff3b1918d7b0_rle_crop_3656465318_0.png treat image : temp/1738779028_569182_1334999379_a55541aebc5ae7f8793cff3b1918d7b0_rle_crop_3656465305_0.png treat image : temp/1738779028_569182_1334999379_a55541aebc5ae7f8793cff3b1918d7b0_rle_crop_3656465322_0.png treat image : temp/1738779028_569182_1334999379_a55541aebc5ae7f8793cff3b1918d7b0_rle_crop_3656465307_0.png treat image : temp/1738779028_569182_1334999340_687687070c1a68a88ca46a732c8857d9_rle_crop_3656465345_0.png treat image : temp/1738779028_569182_1334999340_687687070c1a68a88ca46a732c8857d9_rle_crop_3656465331_0.png treat image : temp/1738779028_569182_1334999340_687687070c1a68a88ca46a732c8857d9_rle_crop_3656465343_0.png treat image : temp/1738779028_569182_1334999340_687687070c1a68a88ca46a732c8857d9_rle_crop_3656465337_0.png treat image : temp/1738779028_569182_1334999340_687687070c1a68a88ca46a732c8857d9_rle_crop_3656465330_0.png treat image : temp/1738779028_569182_1334999340_687687070c1a68a88ca46a732c8857d9_rle_crop_3656465335_0.png treat image : temp/1738779028_569182_1334999340_687687070c1a68a88ca46a732c8857d9_rle_crop_3656465329_0.png treat image : temp/1738779028_569182_1334999340_687687070c1a68a88ca46a732c8857d9_rle_crop_3656465338_0.png treat image : temp/1738779028_569182_1334999340_687687070c1a68a88ca46a732c8857d9_rle_crop_3656465334_0.png treat image : temp/1738779028_569182_1334999340_687687070c1a68a88ca46a732c8857d9_rle_crop_3656465349_0.png treat image : temp/1738779028_569182_1334999340_687687070c1a68a88ca46a732c8857d9_rle_crop_3656465342_0.png treat image : temp/1738779028_569182_1334999340_687687070c1a68a88ca46a732c8857d9_rle_crop_3656465346_0.png treat image : temp/1738779028_569182_1334999340_687687070c1a68a88ca46a732c8857d9_rle_crop_3656465340_0.png treat image : temp/1738779028_569182_1334999340_687687070c1a68a88ca46a732c8857d9_rle_crop_3656465333_0.png treat image : temp/1738779028_569182_1334999340_687687070c1a68a88ca46a732c8857d9_rle_crop_3656465350_0.png treat image : temp/1738779028_569182_1334999340_687687070c1a68a88ca46a732c8857d9_rle_crop_3656465328_0.png treat image : temp/1738779028_569182_1334999340_687687070c1a68a88ca46a732c8857d9_rle_crop_3656465327_0.png treat image : temp/1738779028_569182_1334999340_687687070c1a68a88ca46a732c8857d9_rle_crop_3656465332_0.png treat image : temp/1738779028_569182_1334999340_687687070c1a68a88ca46a732c8857d9_rle_crop_3656465352_0.png treat image : temp/1738779028_569182_1334999340_687687070c1a68a88ca46a732c8857d9_rle_crop_3656465336_0.png treat image : temp/1738779028_569182_1334999340_687687070c1a68a88ca46a732c8857d9_rle_crop_3656465348_0.png treat image : temp/1738779028_569182_1334999340_687687070c1a68a88ca46a732c8857d9_rle_crop_3656465353_0.png treat image : temp/1738779028_569182_1334999340_687687070c1a68a88ca46a732c8857d9_rle_crop_3656465344_0.png treat image : temp/1738779028_569182_1334999340_687687070c1a68a88ca46a732c8857d9_rle_crop_3656465354_0.png treat image : temp/1738779028_569182_1334999340_687687070c1a68a88ca46a732c8857d9_rle_crop_3656465347_0.png treat image : temp/1738779028_569182_1334999515_572c06ac387200113f1ebfc03804c1f1_rle_crop_3656465194_0.png treat image : temp/1738779028_569182_1334999515_572c06ac387200113f1ebfc03804c1f1_rle_crop_3656465196_0.png treat image : temp/1738779028_569182_1334999508_7a9085066816a2cc0e0107f8e5da7bcf_rle_crop_3656465226_0.png treat image : temp/1738779028_569182_1334999508_7a9085066816a2cc0e0107f8e5da7bcf_rle_crop_3656465220_0.png treat image : temp/1738779028_569182_1334999508_7a9085066816a2cc0e0107f8e5da7bcf_rle_crop_3656465216_0.png treat image : temp/1738779028_569182_1334999508_7a9085066816a2cc0e0107f8e5da7bcf_rle_crop_3656465227_0.png treat image : temp/1738779028_569182_1334999426_9cb452a20be6d7fece3d3c9a9cd0af1a_rle_crop_3656465238_0.png treat image : temp/1738779028_569182_1334999426_9cb452a20be6d7fece3d3c9a9cd0af1a_rle_crop_3656465256_0.png treat image : temp/1738779028_569182_1334999426_9cb452a20be6d7fece3d3c9a9cd0af1a_rle_crop_3656465244_0.png treat image : temp/1738779028_569182_1334999419_1cb92de622d8942a37322f3dd6c9e453_rle_crop_3656465273_0.png treat image : temp/1738779028_569182_1334999416_f965f1d3af29dc3c44e2ad6e4e7697d2_rle_crop_3656465285_0.png treat image : temp/1738779028_569182_1334999416_f965f1d3af29dc3c44e2ad6e4e7697d2_rle_crop_3656465292_0.png treat image : temp/1738779028_569182_1334999416_f965f1d3af29dc3c44e2ad6e4e7697d2_rle_crop_3656465293_0.png treat image : temp/1738779028_569182_1334999416_f965f1d3af29dc3c44e2ad6e4e7697d2_rle_crop_3656465302_0.png treat image : temp/1738779028_569182_1334999416_f965f1d3af29dc3c44e2ad6e4e7697d2_rle_crop_3656465287_0.png treat image : temp/1738779028_569182_1334999416_f965f1d3af29dc3c44e2ad6e4e7697d2_rle_crop_3656465290_0.png treat image : temp/1738779028_569182_1334999416_f965f1d3af29dc3c44e2ad6e4e7697d2_rle_crop_3656465286_0.png treat image : temp/1738779028_569182_1334999379_a55541aebc5ae7f8793cff3b1918d7b0_rle_crop_3656465319_0.png treat image : temp/1738779028_569182_1334999379_a55541aebc5ae7f8793cff3b1918d7b0_rle_crop_3656465320_0.png treat image : temp/1738779028_569182_1334999379_a55541aebc5ae7f8793cff3b1918d7b0_rle_crop_3656465324_0.png treat image : temp/1738779028_569182_1334999379_a55541aebc5ae7f8793cff3b1918d7b0_rle_crop_3656465315_0.png treat image : temp/1738779028_569182_1334999340_687687070c1a68a88ca46a732c8857d9_rle_crop_3656465339_0.png treat image : temp/1738779028_569182_1334999508_7a9085066816a2cc0e0107f8e5da7bcf_rle_crop_3656465218_0.png treat image : temp/1738779028_569182_1334999426_9cb452a20be6d7fece3d3c9a9cd0af1a_rle_crop_3656465247_0.png treat image : temp/1738779028_569182_1334999416_f965f1d3af29dc3c44e2ad6e4e7697d2_rle_crop_3656465297_0.png treat image : temp/1738779028_569182_1334999340_687687070c1a68a88ca46a732c8857d9_rle_crop_3656465351_0.png treat image : temp/1738779028_569182_1334999340_687687070c1a68a88ca46a732c8857d9_rle_crop_3656465341_0.png treat image : temp/1738779028_569182_1334999515_572c06ac387200113f1ebfc03804c1f1_rle_crop_3656465199_0.png treat image : temp/1738779028_569182_1334999508_7a9085066816a2cc0e0107f8e5da7bcf_rle_crop_3656465219_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 170 time used for this insertion : 0.01703643798828125 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 170 time used for this insertion : 0.029886960983276367 save missing photos in datou_result : time spend for datou_step_exec : 8.235244750976562 time spend to save output : 0.053714752197265625 total time spend for step 7 : 8.288959503173828 step8:velours_tree Wed Feb 5 19:14:50 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.09735536575317383 time spend to save output : 5.0067901611328125e-05 total time spend for step 8 : 0.09740543365478516 step9:send_mail_cod Wed Feb 5 19:14:50 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P20270434_05-02-2025_19_14_50.pdf 20270565 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette202705651738779290 20270566 imagette202705661738779291 20270567 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette202705671738779291 20270568 imagette202705681738779292 20270570 imagette202705701738779292 20270571 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette202705711738779292 20270572 imagette202705721738779293 20270573 imagette202705731738779293 20270574 change filename to text .change filename to text .imagette202705741738779293 20270575 imagette202705751738779294 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=20270434 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/20270565,20270566,20270567,20270568,20270569,20270570,20270571,20270572,20270573,20270574,20270575?tags=papier,flou,pet_clair,metal,environnement,pet_fonce,carton,mal_croppe,background,autre,pehd args[1334999515] : ((1334999515, -5.269527433770004, 492609224), (1334999515, -0.015311510329023508, 2107752395), '0.12010234099426807') apple ((1334999515, -5.269527433770004, 492609224), (1334999515, -0.015311510329023508, 2107752395), '0.12010234099426807') We are sending mail with results at report@fotonower.com args[1334999508] : ((1334999508, -6.177078040644168, 492609224), (1334999508, 0.33773458277664264, 2107752395), '0.12010234099426807') apple ((1334999508, -6.177078040644168, 492609224), (1334999508, 0.33773458277664264, 2107752395), '0.12010234099426807') We are sending mail with results at report@fotonower.com args[1334999426] : ((1334999426, -5.344350988646328, 492609224), (1334999426, 0.15080734322153974, 2107752395), '0.12010234099426807') apple ((1334999426, -5.344350988646328, 492609224), (1334999426, 0.15080734322153974, 2107752395), '0.12010234099426807') We are sending mail with results at report@fotonower.com args[1334999419] : ((1334999419, -5.138999316002709, 492609224), (1334999419, 0.14035375623523244, 2107752395), '0.12010234099426807') apple ((1334999419, -5.138999316002709, 492609224), (1334999419, 0.14035375623523244, 2107752395), '0.12010234099426807') We are sending mail with results at report@fotonower.com args[1334999416] : ((1334999416, -5.6724584102957385, 492609224), (1334999416, 0.1496777235575221, 2107752395), '0.12010234099426807') apple ((1334999416, -5.6724584102957385, 492609224), (1334999416, 0.1496777235575221, 2107752395), '0.12010234099426807') We are sending mail with results at report@fotonower.com args[1334999379] : ((1334999379, -6.219101964841624, 492609224), (1334999379, 0.5444396868616566, 2107752395), '0.12010234099426807') apple ((1334999379, -6.219101964841624, 492609224), (1334999379, 0.5444396868616566, 2107752395), '0.12010234099426807') We are sending mail with results at report@fotonower.com args[1334999340] : ((1334999340, -5.3092561657370325, 492609224), (1334999340, 0.2517811345865807, 2107752395), '0.12010234099426807') apple ((1334999340, -5.3092561657370325, 492609224), (1334999340, 0.2517811345865807, 2107752395), '0.12010234099426807') We are sending mail with results at report@fotonower.com refus_total : 0.12010234099426807 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20270434 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20270434_05-02-2025_19_14_50.pdf results_Auto_P20270434_05-02-2025_19_14_50.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20270434_05-02-2025_19_14_50.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','20270434','results_Auto_P20270434_05-02-2025_19_14_50.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20270434_05-02-2025_19_14_50.pdf','pdf','','0.53','0.12010234099426807') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/20270434

https://www.fotonower.com/image?json=false&list_photos_id=1334999515
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1334999508
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1334999426
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1334999419
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1334999416
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1334999379
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1334999340
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 12.01%
Veuillez trouver les photos des contaminants.

exemples de contaminants: papier: https://www.fotonower.com/view/20270565?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/20270567?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/20270571?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/20270574?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20270434_05-02-2025_19_14_50.pdf.

Lien vers velours :https://www.fotonower.com/velours/20270565,20270566,20270567,20270568,20270569,20270570,20270571,20270572,20270573,20270574,20270575?tags=papier,flou,pet_clair,metal,environnement,pet_fonce,carton,mal_croppe,background,autre,pehd.


L'équipe Fotonower 202 b'' Server: nginx Date: Wed, 05 Feb 2025 18:14:56 GMT Content-Length: 0 Connection: close X-Message-Id: zaNJ8okDSK28teYQ9DfbsA Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1334999515, 1334999508, 1334999426, 1334999419, 1334999416, 1334999379, 1334999340] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2553456') ('3318', '20270434', '1334999515', None, None, None, None, None, '2553456') ('3318', None, None, None, None, None, None, None, '2553456') ('3318', '20270434', '1334999508', None, None, None, None, None, '2553456') ('3318', None, None, None, None, None, None, None, '2553456') ('3318', '20270434', '1334999426', None, None, None, None, None, '2553456') ('3318', None, None, None, None, None, None, None, '2553456') ('3318', '20270434', '1334999419', None, None, None, None, None, '2553456') ('3318', None, None, None, None, None, None, None, '2553456') ('3318', '20270434', '1334999416', None, None, None, None, None, '2553456') ('3318', None, None, None, None, None, None, None, '2553456') ('3318', '20270434', '1334999379', None, None, None, None, None, '2553456') ('3318', None, None, None, None, None, None, None, '2553456') ('3318', '20270434', '1334999340', None, None, None, None, None, '2553456') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 7 time used for this insertion : 0.012408733367919922 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.753003120422363 time spend to save output : 0.012665987014770508 total time spend for step 9 : 5.765669107437134 step10:split_time_score Wed Feb 5 19:14:56 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('18', 7),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 05022025 20270434 Nombre de photos uploadées : 7 / 23040 (0%) 05022025 20270434 Nombre de photos taguées (types de déchets): 0 / 7 (0%) 05022025 20270434 Nombre de photos taguées (volume) : 0 / 7 (0%) elapsed_time : load_data_split_time_score 3.5762786865234375e-06 elapsed_time : order_list_meta_photo_and_scores 1.0728836059570312e-05 ??????? elapsed_time : fill_and_build_computed_from_old_data 0.00037384033203125 elapsed_time : insert_dashboard_record_day_entry 0.023740291595458984 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.014657525968493172 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20254250_05-02-2025_13_35_20.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20254250 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20254250 AND mptpi.`type`=3726 To do Qualite : 0.10689558952760635 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20247543_05-02-2025_08_51_37.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20247543 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20247543 AND mptpi.`type`=3594 To do Qualite : 0.04574998454115179 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20253024_05-02-2025_13_49_14.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20253024 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20253024 AND mptpi.`type`=3726 To do Qualite : 0.08379314825531547 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20255775_05-02-2025_13_44_16.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20255775 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20255775 AND mptpi.`type`=3594 To do Qualite : 0.01122176723197168 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20255776_05-02-2025_12_54_26.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20255776 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20255776 AND mptpi.`type`=3726 To do Qualite : 0.04241041021319384 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20266076_05-02-2025_17_15_03.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20266076 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20266076 AND mptpi.`type`=3726 To do Qualite : 0.042923889842558724 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20258545_05-02-2025_14_14_57.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20258545 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20258545 AND mptpi.`type`=3726 To do Qualite : 0.04841966037524176 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20263698_05-02-2025_18_24_12.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20263698 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20263698 AND mptpi.`type`=3726 To do Qualite : 0.01926834108789147 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20270433_05-02-2025_19_05_53.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20270433 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20270433 AND mptpi.`type`=3726 To do Qualite : 0.12010234099426807 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20270434_05-02-2025_19_14_50.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20270434 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20270434 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'05022025': {'nb_upload': 7, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1334999515, 1334999508, 1334999426, 1334999419, 1334999416, 1334999379, 1334999340] Looping around the photos to save general results len do output : 1 /20270434Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2553456') ('3318', '20270434', '1334999515', None, None, None, None, None, '2553456') ('3318', None, None, None, None, None, None, None, '2553456') ('3318', '20270434', '1334999508', None, None, None, None, None, '2553456') ('3318', None, None, None, None, None, None, None, '2553456') ('3318', '20270434', '1334999426', None, None, None, None, None, '2553456') ('3318', None, None, None, None, None, None, None, '2553456') ('3318', '20270434', '1334999419', None, None, None, None, None, '2553456') ('3318', None, None, None, None, None, None, None, '2553456') ('3318', '20270434', '1334999416', None, None, None, None, None, '2553456') ('3318', None, None, None, None, None, None, None, '2553456') ('3318', '20270434', '1334999379', None, None, None, None, None, '2553456') ('3318', None, None, None, None, None, None, None, '2553456') ('3318', '20270434', '1334999340', None, None, None, None, None, '2553456') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.013184070587158203 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.8003401756286621 time spend to save output : 0.013330221176147461 total time spend for step 10 : 0.8136703968048096 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 7 set_done_treatment 138.84user 84.22system 4:31.96elapsed 82%CPU (0avgtext+0avgdata 5893360maxresident)k 56424inputs+112360outputs (106major+12496199minor)pagefaults 0swaps