python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2007129 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2837781'] with mtr_portfolio_ids : ['22915108'] and first list_photo_ids : [] new path : /proc/2007129/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 8 ; length of list_pids : 8 ; length of list_args : 8 time to download the photos : 1.188551664352417 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Tue May 13 09:40:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 4111 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-13 09:40:32.608678: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-13 09:40:32.635228: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-13 09:40:32.637085: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fb01c000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-13 09:40:32.637128: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-13 09:40:32.639976: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-13 09:40:32.876883: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x1342af00 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-13 09:40:32.876938: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-13 09:40:32.878019: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-13 09:40:32.878408: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-13 09:40:32.881573: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-13 09:40:32.884138: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-13 09:40:32.884621: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-13 09:40:32.887543: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-13 09:40:32.888789: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-13 09:40:32.894059: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-13 09:40:32.895146: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-13 09:40:32.895217: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-13 09:40:32.895789: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-13 09:40:32.895804: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-13 09:40:32.895813: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-13 09:40:32.896826: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 3659 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-13 09:40:33.273533: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-13 09:40:33.273617: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-13 09:40:33.273638: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-13 09:40:33.273660: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-13 09:40:33.273678: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-13 09:40:33.273696: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-13 09:40:33.273713: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-13 09:40:33.273731: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-13 09:40:33.274836: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-13 09:40:33.275921: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-13 09:40:33.275962: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-13 09:40:33.275981: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-13 09:40:33.275998: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-13 09:40:33.276015: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-13 09:40:33.276032: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-13 09:40:33.276049: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-13 09:40:33.276066: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-13 09:40:33.277124: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-13 09:40:33.277154: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-13 09:40:33.277165: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-13 09:40:33.277174: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-13 09:40:33.278287: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 3659 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-05-13 09:40:43.492814: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-13 09:40:43.665516: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-13 09:40:44.909535: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.07G (3301834752 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-13 09:40:45.707642: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 3.29GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-13 09:40:45.707682: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 3.29GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 8 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 31 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 15.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 23 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 15.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 42 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 21.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 23 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 7.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 27 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 17 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 32 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 39 Detection mask done ! Trying to reset tf kernel 2007801 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 84 tf kernel not reseted sub process len(results) : 8 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 8 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 4111 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0006735324859619141 nb_pixel_total : 20709 time to create 1 rle with old method : 0.023991107940673828 length of segment : 206 time for calcul the mask position with numpy : 0.00047397613525390625 nb_pixel_total : 6442 time to create 1 rle with old method : 0.007787942886352539 length of segment : 186 time for calcul the mask position with numpy : 0.0012378692626953125 nb_pixel_total : 71341 time to create 1 rle with old method : 0.08206033706665039 length of segment : 464 time for calcul the mask position with numpy : 0.0029294490814208984 nb_pixel_total : 103761 time to create 1 rle with old method : 0.1201016902923584 length of segment : 512 time for calcul the mask position with numpy : 0.0009522438049316406 nb_pixel_total : 63233 time to create 1 rle with old method : 0.07347345352172852 length of segment : 264 time for calcul the mask position with numpy : 0.0005524158477783203 nb_pixel_total : 28175 time to create 1 rle with old method : 0.032883405685424805 length of segment : 215 time for calcul the mask position with numpy : 0.00142669677734375 nb_pixel_total : 89086 time to create 1 rle with old method : 0.10225629806518555 length of segment : 393 time for calcul the mask position with numpy : 0.0003197193145751953 nb_pixel_total : 15605 time to create 1 rle with old method : 0.023675918579101562 length of segment : 199 time for calcul the mask position with numpy : 0.0004601478576660156 nb_pixel_total : 6846 time to create 1 rle with old method : 0.011579513549804688 length of segment : 412 time for calcul the mask position with numpy : 0.0003132820129394531 nb_pixel_total : 18231 time to create 1 rle with old method : 0.021981239318847656 length of segment : 136 time for calcul the mask position with numpy : 0.0029027462005615234 nb_pixel_total : 150718 time to create 1 rle with new method : 0.005873918533325195 length of segment : 247 time for calcul the mask position with numpy : 0.0006442070007324219 nb_pixel_total : 35564 time to create 1 rle with old method : 0.040683746337890625 length of segment : 219 time for calcul the mask position with numpy : 0.015191078186035156 nb_pixel_total : 320069 time to create 1 rle with new method : 0.8963005542755127 length of segment : 1087 time for calcul the mask position with numpy : 0.00015735626220703125 nb_pixel_total : 5430 time to create 1 rle with old method : 0.0064351558685302734 length of segment : 87 time for calcul the mask position with numpy : 0.0020668506622314453 nb_pixel_total : 160925 time to create 1 rle with new method : 0.005769252777099609 length of segment : 485 time for calcul the mask position with numpy : 0.005988359451293945 nb_pixel_total : 391856 time to create 1 rle with new method : 0.028594017028808594 length of segment : 816 time for calcul the mask position with numpy : 0.0014719963073730469 nb_pixel_total : 87238 time to create 1 rle with old method : 0.09929728507995605 length of segment : 446 time for calcul the mask position with numpy : 0.003060579299926758 nb_pixel_total : 184155 time to create 1 rle with new method : 0.01144552230834961 length of segment : 519 time for calcul the mask position with numpy : 0.00033736228942871094 nb_pixel_total : 15486 time to create 1 rle with old method : 0.01807427406311035 length of segment : 157 time for calcul the mask position with numpy : 0.0008666515350341797 nb_pixel_total : 48206 time to create 1 rle with old method : 0.055480241775512695 length of segment : 374 time for calcul the mask position with numpy : 0.000774383544921875 nb_pixel_total : 28841 time to create 1 rle with old method : 0.03302717208862305 length of segment : 400 time for calcul the mask position with numpy : 0.0005238056182861328 nb_pixel_total : 20503 time to create 1 rle with old method : 0.02404022216796875 length of segment : 334 time for calcul the mask position with numpy : 0.0006041526794433594 nb_pixel_total : 34966 time to create 1 rle with old method : 0.04062652587890625 length of segment : 236 time for calcul the mask position with numpy : 0.0002944469451904297 nb_pixel_total : 17266 time to create 1 rle with old method : 0.02034282684326172 length of segment : 122 time for calcul the mask position with numpy : 0.0005600452423095703 nb_pixel_total : 28286 time to create 1 rle with old method : 0.03212428092956543 length of segment : 312 time for calcul the mask position with numpy : 0.002218961715698242 nb_pixel_total : 163781 time to create 1 rle with new method : 0.008281946182250977 length of segment : 544 time for calcul the mask position with numpy : 0.0009932518005371094 nb_pixel_total : 65893 time to create 1 rle with old method : 0.07435345649719238 length of segment : 310 time for calcul the mask position with numpy : 0.0006346702575683594 nb_pixel_total : 44742 time to create 1 rle with old method : 0.050069570541381836 length of segment : 226 time for calcul the mask position with numpy : 0.00021958351135253906 nb_pixel_total : 13171 time to create 1 rle with old method : 0.015679121017456055 length of segment : 123 time for calcul the mask position with numpy : 0.0004942417144775391 nb_pixel_total : 28291 time to create 1 rle with old method : 0.032861948013305664 length of segment : 469 time for calcul the mask position with numpy : 0.001283884048461914 nb_pixel_total : 61423 time to create 1 rle with old method : 0.07088112831115723 length of segment : 462 time for calcul the mask position with numpy : 0.0006768703460693359 nb_pixel_total : 23638 time to create 1 rle with old method : 0.027585268020629883 length of segment : 328 time for calcul the mask position with numpy : 0.0018649101257324219 nb_pixel_total : 40694 time to create 1 rle with old method : 0.046484947204589844 length of segment : 257 time for calcul the mask position with numpy : 0.0023508071899414062 nb_pixel_total : 74022 time to create 1 rle with old method : 0.08318972587585449 length of segment : 341 time for calcul the mask position with numpy : 0.0032417774200439453 nb_pixel_total : 69421 time to create 1 rle with old method : 0.07842707633972168 length of segment : 323 time for calcul the mask position with numpy : 0.0011448860168457031 nb_pixel_total : 39093 time to create 1 rle with old method : 0.045908212661743164 length of segment : 213 time for calcul the mask position with numpy : 0.0020492076873779297 nb_pixel_total : 45515 time to create 1 rle with old method : 0.05272936820983887 length of segment : 469 time for calcul the mask position with numpy : 0.0006630420684814453 nb_pixel_total : 11486 time to create 1 rle with old method : 0.013457298278808594 length of segment : 182 time for calcul the mask position with numpy : 0.0013072490692138672 nb_pixel_total : 39781 time to create 1 rle with old method : 0.045149803161621094 length of segment : 249 time for calcul the mask position with numpy : 0.0011661052703857422 nb_pixel_total : 32217 time to create 1 rle with old method : 0.04133105278015137 length of segment : 328 time for calcul the mask position with numpy : 0.0005309581756591797 nb_pixel_total : 13757 time to create 1 rle with old method : 0.016442537307739258 length of segment : 97 time for calcul the mask position with numpy : 0.0006110668182373047 nb_pixel_total : 12192 time to create 1 rle with old method : 0.014307498931884766 length of segment : 151 time for calcul the mask position with numpy : 0.0017998218536376953 nb_pixel_total : 52394 time to create 1 rle with old method : 0.05971169471740723 length of segment : 273 time for calcul the mask position with numpy : 0.0021767616271972656 nb_pixel_total : 38823 time to create 1 rle with old method : 0.04527139663696289 length of segment : 345 time for calcul the mask position with numpy : 0.0008656978607177734 nb_pixel_total : 27190 time to create 1 rle with old method : 0.03328728675842285 length of segment : 152 time for calcul the mask position with numpy : 0.001608133316040039 nb_pixel_total : 46742 time to create 1 rle with old method : 0.055321455001831055 length of segment : 303 time for calcul the mask position with numpy : 0.0007598400115966797 nb_pixel_total : 22618 time to create 1 rle with old method : 0.029160737991333008 length of segment : 186 time for calcul the mask position with numpy : 0.0016055107116699219 nb_pixel_total : 48044 time to create 1 rle with old method : 0.05669260025024414 length of segment : 199 time for calcul the mask position with numpy : 0.0003845691680908203 nb_pixel_total : 13679 time to create 1 rle with old method : 0.015938520431518555 length of segment : 98 time for calcul the mask position with numpy : 0.001966714859008789 nb_pixel_total : 56491 time to create 1 rle with old method : 0.06404829025268555 length of segment : 299 time for calcul the mask position with numpy : 0.0005536079406738281 nb_pixel_total : 15028 time to create 1 rle with old method : 0.01772904396057129 length of segment : 144 time for calcul the mask position with numpy : 0.0008835792541503906 nb_pixel_total : 9605 time to create 1 rle with old method : 0.011294841766357422 length of segment : 326 time for calcul the mask position with numpy : 0.002750396728515625 nb_pixel_total : 74364 time to create 1 rle with old method : 0.08624005317687988 length of segment : 273 time for calcul the mask position with numpy : 0.0009741783142089844 nb_pixel_total : 33961 time to create 1 rle with old method : 0.03882932662963867 length of segment : 243 time for calcul the mask position with numpy : 0.0032494068145751953 nb_pixel_total : 122171 time to create 1 rle with old method : 0.16509747505187988 length of segment : 287 time for calcul the mask position with numpy : 0.001028299331665039 nb_pixel_total : 37672 time to create 1 rle with old method : 0.043839216232299805 length of segment : 221 time for calcul the mask position with numpy : 0.0006401538848876953 nb_pixel_total : 27414 time to create 1 rle with old method : 0.03124260902404785 length of segment : 118 time for calcul the mask position with numpy : 0.0024056434631347656 nb_pixel_total : 29534 time to create 1 rle with old method : 0.03554701805114746 length of segment : 242 time for calcul the mask position with numpy : 0.0010523796081542969 nb_pixel_total : 39674 time to create 1 rle with old method : 0.045264244079589844 length of segment : 212 time for calcul the mask position with numpy : 0.0017173290252685547 nb_pixel_total : 43091 time to create 1 rle with old method : 0.049559593200683594 length of segment : 284 time for calcul the mask position with numpy : 0.0033638477325439453 nb_pixel_total : 130971 time to create 1 rle with old method : 0.14702081680297852 length of segment : 471 time for calcul the mask position with numpy : 0.0009877681732177734 nb_pixel_total : 28877 time to create 1 rle with old method : 0.03516221046447754 length of segment : 206 time for calcul the mask position with numpy : 0.0012617111206054688 nb_pixel_total : 41616 time to create 1 rle with old method : 0.05128622055053711 length of segment : 140 time for calcul the mask position with numpy : 0.00041484832763671875 nb_pixel_total : 18780 time to create 1 rle with old method : 0.02240467071533203 length of segment : 137 time for calcul the mask position with numpy : 0.0026102066040039062 nb_pixel_total : 80264 time to create 1 rle with old method : 0.09459042549133301 length of segment : 480 time for calcul the mask position with numpy : 0.0028460025787353516 nb_pixel_total : 91769 time to create 1 rle with old method : 0.11355113983154297 length of segment : 248 time for calcul the mask position with numpy : 0.0015037059783935547 nb_pixel_total : 51038 time to create 1 rle with old method : 0.06308865547180176 length of segment : 157 time for calcul the mask position with numpy : 0.0007495880126953125 nb_pixel_total : 13632 time to create 1 rle with old method : 0.016440391540527344 length of segment : 175 time for calcul the mask position with numpy : 0.002949237823486328 nb_pixel_total : 85718 time to create 1 rle with old method : 0.1027226448059082 length of segment : 418 time for calcul the mask position with numpy : 0.0003871917724609375 nb_pixel_total : 11739 time to create 1 rle with old method : 0.014940261840820312 length of segment : 143 time for calcul the mask position with numpy : 0.0002124309539794922 nb_pixel_total : 6426 time to create 1 rle with old method : 0.008220911026000977 length of segment : 101 time for calcul the mask position with numpy : 0.0024182796478271484 nb_pixel_total : 90040 time to create 1 rle with old method : 0.10754513740539551 length of segment : 319 time for calcul the mask position with numpy : 0.00042247772216796875 nb_pixel_total : 14451 time to create 1 rle with old method : 0.016808748245239258 length of segment : 175 time for calcul the mask position with numpy : 0.002222299575805664 nb_pixel_total : 109128 time to create 1 rle with old method : 0.12843799591064453 length of segment : 397 time for calcul the mask position with numpy : 0.0004296302795410156 nb_pixel_total : 12196 time to create 1 rle with old method : 0.014395713806152344 length of segment : 200 time for calcul the mask position with numpy : 0.001729726791381836 nb_pixel_total : 107246 time to create 1 rle with old method : 0.154343843460083 length of segment : 383 time for calcul the mask position with numpy : 0.0009672641754150391 nb_pixel_total : 34507 time to create 1 rle with old method : 0.047887563705444336 length of segment : 252 time for calcul the mask position with numpy : 0.0004184246063232422 nb_pixel_total : 11025 time to create 1 rle with old method : 0.013766765594482422 length of segment : 78 time for calcul the mask position with numpy : 0.0007688999176025391 nb_pixel_total : 12504 time to create 1 rle with old method : 0.015300989151000977 length of segment : 402 time for calcul the mask position with numpy : 0.0029001235961914062 nb_pixel_total : 105018 time to create 1 rle with old method : 0.14653515815734863 length of segment : 258 time for calcul the mask position with numpy : 0.0027582645416259766 nb_pixel_total : 132259 time to create 1 rle with old method : 0.15974736213684082 length of segment : 391 time for calcul the mask position with numpy : 0.00018668174743652344 nb_pixel_total : 6479 time to create 1 rle with old method : 0.007937908172607422 length of segment : 87 time for calcul the mask position with numpy : 0.0005676746368408203 nb_pixel_total : 38611 time to create 1 rle with old method : 0.04517412185668945 length of segment : 235 time for calcul the mask position with numpy : 0.0007367134094238281 nb_pixel_total : 23030 time to create 1 rle with old method : 0.027024269104003906 length of segment : 220 time for calcul the mask position with numpy : 0.002591371536254883 nb_pixel_total : 129002 time to create 1 rle with old method : 0.1475996971130371 length of segment : 480 time for calcul the mask position with numpy : 0.0032541751861572266 nb_pixel_total : 113341 time to create 1 rle with old method : 0.12851405143737793 length of segment : 656 time for calcul the mask position with numpy : 0.005553722381591797 nb_pixel_total : 162731 time to create 1 rle with new method : 0.01777958869934082 length of segment : 908 time for calcul the mask position with numpy : 0.0016624927520751953 nb_pixel_total : 75195 time to create 1 rle with old method : 0.08928799629211426 length of segment : 446 time for calcul the mask position with numpy : 0.00043201446533203125 nb_pixel_total : 20920 time to create 1 rle with old method : 0.026091814041137695 length of segment : 210 time for calcul the mask position with numpy : 0.000476837158203125 nb_pixel_total : 11826 time to create 1 rle with old method : 0.01642465591430664 length of segment : 94 time for calcul the mask position with numpy : 0.001129150390625 nb_pixel_total : 52962 time to create 1 rle with old method : 0.06206512451171875 length of segment : 302 time for calcul the mask position with numpy : 0.0011227130889892578 nb_pixel_total : 38791 time to create 1 rle with old method : 0.044419050216674805 length of segment : 271 time for calcul the mask position with numpy : 0.0013937950134277344 nb_pixel_total : 52130 time to create 1 rle with old method : 0.060129404067993164 length of segment : 330 time for calcul the mask position with numpy : 0.0029468536376953125 nb_pixel_total : 139029 time to create 1 rle with old method : 0.15726184844970703 length of segment : 268 time for calcul the mask position with numpy : 0.0014448165893554688 nb_pixel_total : 26474 time to create 1 rle with old method : 0.02950453758239746 length of segment : 313 time for calcul the mask position with numpy : 0.0006861686706542969 nb_pixel_total : 28743 time to create 1 rle with old method : 0.033721208572387695 length of segment : 223 time for calcul the mask position with numpy : 0.0009605884552001953 nb_pixel_total : 33771 time to create 1 rle with old method : 0.041512250900268555 length of segment : 323 time for calcul the mask position with numpy : 0.0009207725524902344 nb_pixel_total : 26196 time to create 1 rle with old method : 0.030225515365600586 length of segment : 173 time for calcul the mask position with numpy : 0.0006051063537597656 nb_pixel_total : 30955 time to create 1 rle with old method : 0.03669548034667969 length of segment : 218 time for calcul the mask position with numpy : 0.039449214935302734 nb_pixel_total : 654436 time to create 1 rle with new method : 0.0689687728881836 length of segment : 1083 time for calcul the mask position with numpy : 0.0005457401275634766 nb_pixel_total : 27845 time to create 1 rle with old method : 0.03195786476135254 length of segment : 229 time for calcul the mask position with numpy : 0.0008490085601806641 nb_pixel_total : 40215 time to create 1 rle with old method : 0.048012733459472656 length of segment : 194 time for calcul the mask position with numpy : 0.0019195079803466797 nb_pixel_total : 62886 time to create 1 rle with old method : 0.07552003860473633 length of segment : 328 time for calcul the mask position with numpy : 0.01466059684753418 nb_pixel_total : 685891 time to create 1 rle with new method : 0.08719801902770996 length of segment : 897 time for calcul the mask position with numpy : 0.0021696090698242188 nb_pixel_total : 103987 time to create 1 rle with old method : 0.12424492835998535 length of segment : 317 time for calcul the mask position with numpy : 0.0018198490142822266 nb_pixel_total : 19422 time to create 1 rle with old method : 0.0323939323425293 length of segment : 267 time for calcul the mask position with numpy : 0.0002899169921875 nb_pixel_total : 10108 time to create 1 rle with old method : 0.0160062313079834 length of segment : 106 time for calcul the mask position with numpy : 0.0002803802490234375 nb_pixel_total : 5614 time to create 1 rle with old method : 0.0068988800048828125 length of segment : 72 time for calcul the mask position with numpy : 0.0017304420471191406 nb_pixel_total : 57495 time to create 1 rle with old method : 0.06893754005432129 length of segment : 229 time for calcul the mask position with numpy : 0.0035381317138671875 nb_pixel_total : 93937 time to create 1 rle with old method : 0.10936617851257324 length of segment : 403 time for calcul the mask position with numpy : 0.0012764930725097656 nb_pixel_total : 42648 time to create 1 rle with old method : 0.051331520080566406 length of segment : 367 time for calcul the mask position with numpy : 0.0038983821868896484 nb_pixel_total : 87323 time to create 1 rle with old method : 0.12673735618591309 length of segment : 269 time for calcul the mask position with numpy : 0.0023949146270751953 nb_pixel_total : 59037 time to create 1 rle with old method : 0.07132554054260254 length of segment : 505 time for calcul the mask position with numpy : 0.007628202438354492 nb_pixel_total : 190919 time to create 1 rle with new method : 0.008933305740356445 length of segment : 581 time for calcul the mask position with numpy : 0.0006380081176757812 nb_pixel_total : 12010 time to create 1 rle with old method : 0.015764951705932617 length of segment : 183 time for calcul the mask position with numpy : 0.0009140968322753906 nb_pixel_total : 22001 time to create 1 rle with old method : 0.028072118759155273 length of segment : 198 time for calcul the mask position with numpy : 0.0009720325469970703 nb_pixel_total : 12782 time to create 1 rle with old method : 0.016888141632080078 length of segment : 177 time for calcul the mask position with numpy : 0.005137443542480469 nb_pixel_total : 166253 time to create 1 rle with new method : 0.008578300476074219 length of segment : 519 time for calcul the mask position with numpy : 0.0009870529174804688 nb_pixel_total : 18607 time to create 1 rle with old method : 0.023177623748779297 length of segment : 373 time for calcul the mask position with numpy : 0.0008015632629394531 nb_pixel_total : 19120 time to create 1 rle with old method : 0.023513317108154297 length of segment : 204 time for calcul the mask position with numpy : 0.0006189346313476562 nb_pixel_total : 13868 time to create 1 rle with old method : 0.01681232452392578 length of segment : 197 time for calcul the mask position with numpy : 0.0004153251647949219 nb_pixel_total : 11383 time to create 1 rle with old method : 0.013936519622802734 length of segment : 117 time for calcul the mask position with numpy : 0.005826473236083984 nb_pixel_total : 263985 time to create 1 rle with new method : 0.008211612701416016 length of segment : 512 time spent for convertir_results : 12.860020637512207 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 123 chid ids of type : 3594 Number RLEs to save : 37720 save missing photos in datou_result : time spend for datou_step_exec : 70.1500232219696 time spend to save output : 59.58407497406006 total time spend for step 1 : 129.73409819602966 step2:crop_condition Tue May 13 09:42:39 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 8 ! batch 1 Loaded 123 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 63 About to insert : list_path_to_insert length 63 new photo from crops ! About to upload 63 photos upload in portfolio : 3736932 init cache_photo without model_param we have 63 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747122176_2007129 we have uploaded 63 photos in the portfolio 3736932 time of upload the photos Elapsed time : 13.059635400772095 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 10 About to insert : list_path_to_insert length 10 new photo from crops ! About to upload 10 photos upload in portfolio : 3736932 init cache_photo without model_param we have 10 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747122194_2007129 we have uploaded 10 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.3573875427246094 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747122197_2007129 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.7099575996398926 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 45 About to insert : list_path_to_insert length 45 new photo from crops ! About to upload 45 photos upload in portfolio : 3736932 init cache_photo without model_param we have 45 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747122216_2007129 we have uploaded 45 photos in the portfolio 3736932 time of upload the photos Elapsed time : 10.578064203262329 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3736932 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747122229_2007129 we have uploaded 4 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.2050573825836182 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1357780327, 1357780270, 1357780212, 1357779920, 1357779892, 1357779864, 1357779834, 1357779805] Looping around the photos to save general results len do output : 123 /1357792586Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792587Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792588Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792589Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792591Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792592Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792593Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792595Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792596Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792597Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792598Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792599Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792600Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792601Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792602Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792603Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792604Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792605Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792606Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792607Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792608Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792609Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792610Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792611Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792613Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792614Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792615Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792616Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792617Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792618Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792619Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792620Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792621Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792622Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792623Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792624Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792625Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792626Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792627Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792628Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792629Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792630Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792631Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792632Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792633Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792634Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792636Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792637Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792638Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792640Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792641Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792642Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792643Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792644Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792645Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792646Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792647Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792648Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792649Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792650Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792651Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792652Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792653Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792655Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792656Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792657Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792658Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792659Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792660Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792661Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792662Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792663Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792664Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792665Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792677Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792678Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792680Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792681Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792682Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792683Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792684Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792686Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792687Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792688Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792689Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792690Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792691Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792692Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792693Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792694Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792695Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792696Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792697Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792698Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792699Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792700Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792702Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792703Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792704Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792705Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792706Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792707Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792708Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792709Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792710Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792711Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792712Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792713Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792714Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792715Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792716Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792717Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792718Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792719Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792720Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792721Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792722Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792723Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792724Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792728Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792729Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792730Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1357792731Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2837781') ('3318', '22915108', '1357780327', None, None, None, None, None, '2837781') ('3318', None, None, None, None, None, None, None, '2837781') ('3318', '22915108', '1357780270', None, None, None, None, None, '2837781') ('3318', None, None, None, None, None, None, None, '2837781') ('3318', '22915108', '1357780212', None, None, None, None, None, '2837781') ('3318', None, None, None, None, None, None, None, '2837781') ('3318', '22915108', '1357779920', None, None, None, None, None, '2837781') ('3318', None, None, None, None, None, None, None, '2837781') ('3318', '22915108', '1357779892', None, None, None, None, None, '2837781') ('3318', None, None, None, None, None, None, None, '2837781') ('3318', '22915108', '1357779864', None, None, None, None, None, '2837781') ('3318', None, None, None, None, None, None, None, '2837781') ('3318', '22915108', '1357779834', None, None, None, None, None, '2837781') ('3318', None, None, None, None, None, None, None, '2837781') ('3318', '22915108', '1357779805', None, None, None, None, None, '2837781') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 377 time used for this insertion : 0.422454833984375 save_final save missing photos in datou_result : time spend for datou_step_exec : 70.754075050354 time spend to save output : 0.42588090896606445 total time spend for step 2 : 71.17995595932007 step3:rle_unique_nms_with_priority Tue May 13 09:43:50 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 123 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 18 nb_hashtags : 4 time to prepare the origin masks : 7.325302600860596 time for calcul the mask position with numpy : 0.4176194667816162 nb_pixel_total : 5300218 time to create 1 rle with new method : 0.8433473110198975 time for calcul the mask position with numpy : 0.02196788787841797 nb_pixel_total : 184155 time to create 1 rle with new method : 0.5593886375427246 time for calcul the mask position with numpy : 0.020972728729248047 nb_pixel_total : 87238 time to create 1 rle with old method : 0.09455752372741699 time for calcul the mask position with numpy : 0.023519277572631836 nb_pixel_total : 387378 time to create 1 rle with new method : 0.7270488739013672 time for calcul the mask position with numpy : 0.02114081382751465 nb_pixel_total : 160925 time to create 1 rle with new method : 0.5722556114196777 time for calcul the mask position with numpy : 0.021236658096313477 nb_pixel_total : 549 time to create 1 rle with old method : 0.0007205009460449219 time for calcul the mask position with numpy : 0.023982524871826172 nb_pixel_total : 320069 time to create 1 rle with new method : 0.9726705551147461 time for calcul the mask position with numpy : 0.021097183227539062 nb_pixel_total : 35564 time to create 1 rle with old method : 0.039429664611816406 time for calcul the mask position with numpy : 0.020884037017822266 nb_pixel_total : 150718 time to create 1 rle with new method : 0.5985457897186279 time for calcul the mask position with numpy : 0.0330808162689209 nb_pixel_total : 18231 time to create 1 rle with old method : 0.020099878311157227 time for calcul the mask position with numpy : 0.03217339515686035 nb_pixel_total : 6846 time to create 1 rle with old method : 0.007815837860107422 time for calcul the mask position with numpy : 0.032608747482299805 nb_pixel_total : 15605 time to create 1 rle with old method : 0.017398357391357422 time for calcul the mask position with numpy : 0.03381037712097168 nb_pixel_total : 89086 time to create 1 rle with old method : 0.10123109817504883 time for calcul the mask position with numpy : 0.03183317184448242 nb_pixel_total : 28175 time to create 1 rle with old method : 0.030991077423095703 time for calcul the mask position with numpy : 0.03388547897338867 nb_pixel_total : 63233 time to create 1 rle with old method : 0.07299423217773438 time for calcul the mask position with numpy : 0.0354158878326416 nb_pixel_total : 103761 time to create 1 rle with old method : 0.11626982688903809 time for calcul the mask position with numpy : 0.03254222869873047 nb_pixel_total : 71341 time to create 1 rle with old method : 0.07901191711425781 time for calcul the mask position with numpy : 0.032334327697753906 nb_pixel_total : 6439 time to create 1 rle with old method : 0.007122039794921875 time for calcul the mask position with numpy : 0.03313183784484863 nb_pixel_total : 20709 time to create 1 rle with old method : 0.02185821533203125 create new chi : 5.942814826965332 time to delete rle : 0.026089191436767578 batch 1 Loaded 37 chid ids of type : 3594 ++++++++++++++++++++++++++++++Number RLEs to save : 15741 TO DO : save crop sub photo not yet done ! save time : 5.258423805236816 nb_obj : 14 nb_hashtags : 3 time to prepare the origin masks : 7.196308851242065 time for calcul the mask position with numpy : 0.47233057022094727 nb_pixel_total : 6455747 time to create 1 rle with new method : 0.584780216217041 time for calcul the mask position with numpy : 0.03463935852050781 nb_pixel_total : 23638 time to create 1 rle with old method : 0.02678680419921875 time for calcul the mask position with numpy : 0.03474116325378418 nb_pixel_total : 61423 time to create 1 rle with old method : 0.0701146125793457 time for calcul the mask position with numpy : 0.03400754928588867 nb_pixel_total : 28291 time to create 1 rle with old method : 0.031491756439208984 time for calcul the mask position with numpy : 0.03286862373352051 nb_pixel_total : 13171 time to create 1 rle with old method : 0.014962911605834961 time for calcul the mask position with numpy : 0.03424382209777832 nb_pixel_total : 44742 time to create 1 rle with old method : 0.0496976375579834 time for calcul the mask position with numpy : 0.03310513496398926 nb_pixel_total : 65893 time to create 1 rle with old method : 0.0742490291595459 time for calcul the mask position with numpy : 0.024291038513183594 nb_pixel_total : 163781 time to create 1 rle with new method : 0.8778939247131348 time for calcul the mask position with numpy : 0.021892070770263672 nb_pixel_total : 28286 time to create 1 rle with old method : 0.03161215782165527 time for calcul the mask position with numpy : 0.02186894416809082 nb_pixel_total : 17266 time to create 1 rle with old method : 0.02099132537841797 time for calcul the mask position with numpy : 0.021505355834960938 nb_pixel_total : 34966 time to create 1 rle with old method : 0.03948187828063965 time for calcul the mask position with numpy : 0.02165699005126953 nb_pixel_total : 20503 time to create 1 rle with old method : 0.023540496826171875 time for calcul the mask position with numpy : 0.021820545196533203 nb_pixel_total : 28841 time to create 1 rle with old method : 0.03294086456298828 time for calcul the mask position with numpy : 0.025712251663208008 nb_pixel_total : 48206 time to create 1 rle with old method : 0.055045366287231445 time for calcul the mask position with numpy : 0.023810386657714844 nb_pixel_total : 15486 time to create 1 rle with old method : 0.01784038543701172 create new chi : 2.8685905933380127 time to delete rle : 0.002810239791870117 batch 1 Loaded 29 chid ids of type : 3594 +++++++++++++++++++++++++++Number RLEs to save : 10954 TO DO : save crop sub photo not yet done ! save time : 4.174492120742798 nb_obj : 21 nb_hashtags : 4 time to prepare the origin masks : 8.077288150787354 time for calcul the mask position with numpy : 0.5313413143157959 nb_pixel_total : 6267649 time to create 1 rle with new method : 0.8969266414642334 time for calcul the mask position with numpy : 0.03902435302734375 nb_pixel_total : 74364 time to create 1 rle with old method : 0.1021425724029541 time for calcul the mask position with numpy : 0.024763107299804688 nb_pixel_total : 9605 time to create 1 rle with old method : 0.013869762420654297 time for calcul the mask position with numpy : 0.020906925201416016 nb_pixel_total : 15028 time to create 1 rle with old method : 0.01695394515991211 time for calcul the mask position with numpy : 0.02077174186706543 nb_pixel_total : 56491 time to create 1 rle with old method : 0.06572628021240234 time for calcul the mask position with numpy : 0.021132469177246094 nb_pixel_total : 13135 time to create 1 rle with old method : 0.015386581420898438 time for calcul the mask position with numpy : 0.021611452102661133 nb_pixel_total : 48044 time to create 1 rle with old method : 0.0556492805480957 time for calcul the mask position with numpy : 0.023708105087280273 nb_pixel_total : 22597 time to create 1 rle with old method : 0.029886960983276367 time for calcul the mask position with numpy : 0.023096799850463867 nb_pixel_total : 46742 time to create 1 rle with old method : 0.054015159606933594 time for calcul the mask position with numpy : 0.02329707145690918 nb_pixel_total : 27190 time to create 1 rle with old method : 0.0366511344909668 time for calcul the mask position with numpy : 0.028298377990722656 nb_pixel_total : 38823 time to create 1 rle with old method : 0.04875493049621582 time for calcul the mask position with numpy : 0.02687549591064453 nb_pixel_total : 52394 time to create 1 rle with old method : 0.07679605484008789 time for calcul the mask position with numpy : 0.023438692092895508 nb_pixel_total : 12192 time to create 1 rle with old method : 0.01702570915222168 time for calcul the mask position with numpy : 0.02226090431213379 nb_pixel_total : 13757 time to create 1 rle with old method : 0.01592254638671875 time for calcul the mask position with numpy : 0.02160167694091797 nb_pixel_total : 32217 time to create 1 rle with old method : 0.037403106689453125 time for calcul the mask position with numpy : 0.021642446517944336 nb_pixel_total : 39781 time to create 1 rle with old method : 0.04625821113586426 time for calcul the mask position with numpy : 0.02182912826538086 nb_pixel_total : 11486 time to create 1 rle with old method : 0.013401508331298828 time for calcul the mask position with numpy : 0.02133345603942871 nb_pixel_total : 45515 time to create 1 rle with old method : 0.05498838424682617 time for calcul the mask position with numpy : 0.023027420043945312 nb_pixel_total : 39093 time to create 1 rle with old method : 0.04642367362976074 time for calcul the mask position with numpy : 0.022253036499023438 nb_pixel_total : 69421 time to create 1 rle with old method : 0.09224581718444824 time for calcul the mask position with numpy : 0.024434804916381836 nb_pixel_total : 74022 time to create 1 rle with old method : 0.09274148941040039 time for calcul the mask position with numpy : 0.02453470230102539 nb_pixel_total : 40694 time to create 1 rle with old method : 0.05156540870666504 create new chi : 2.9556379318237305 time to delete rle : 0.001957416534423828 batch 1 Loaded 43 chid ids of type : 3594 ++++++++++++++++++++++++++++++++Number RLEs to save : 12516 TO DO : save crop sub photo not yet done ! save time : 4.060009717941284 nb_obj : 14 nb_hashtags : 3 time to prepare the origin masks : 6.210954189300537 time for calcul the mask position with numpy : 0.9301953315734863 nb_pixel_total : 6278320 time to create 1 rle with new method : 1.0881130695343018 time for calcul the mask position with numpy : 0.03574085235595703 nb_pixel_total : 51038 time to create 1 rle with old method : 0.0586695671081543 time for calcul the mask position with numpy : 0.037210702896118164 nb_pixel_total : 91769 time to create 1 rle with old method : 0.10842347145080566 time for calcul the mask position with numpy : 0.04034256935119629 nb_pixel_total : 75352 time to create 1 rle with old method : 0.09601068496704102 time for calcul the mask position with numpy : 0.03647446632385254 nb_pixel_total : 18780 time to create 1 rle with old method : 0.022786617279052734 time for calcul the mask position with numpy : 0.03646564483642578 nb_pixel_total : 41616 time to create 1 rle with old method : 0.0493927001953125 time for calcul the mask position with numpy : 0.03591203689575195 nb_pixel_total : 28877 time to create 1 rle with old method : 0.03368234634399414 time for calcul the mask position with numpy : 0.03800487518310547 nb_pixel_total : 130971 time to create 1 rle with old method : 0.1513659954071045 time for calcul the mask position with numpy : 0.03767895698547363 nb_pixel_total : 43091 time to create 1 rle with old method : 0.05010247230529785 time for calcul the mask position with numpy : 0.036690473556518555 nb_pixel_total : 39674 time to create 1 rle with old method : 0.04577970504760742 time for calcul the mask position with numpy : 0.03476142883300781 nb_pixel_total : 29534 time to create 1 rle with old method : 0.03449869155883789 time for calcul the mask position with numpy : 0.03661155700683594 nb_pixel_total : 27414 time to create 1 rle with old method : 0.03175973892211914 time for calcul the mask position with numpy : 0.03625059127807617 nb_pixel_total : 37672 time to create 1 rle with old method : 0.048406362533569336 time for calcul the mask position with numpy : 0.037271738052368164 nb_pixel_total : 122171 time to create 1 rle with old method : 0.15083718299865723 time for calcul the mask position with numpy : 0.029180526733398438 nb_pixel_total : 33961 time to create 1 rle with old method : 0.03948378562927246 create new chi : 3.4888837337493896 time to delete rle : 0.0014543533325195312 batch 1 Loaded 29 chid ids of type : 3594 +++++++++++++++++Number RLEs to save : 8820 TO DO : save crop sub photo not yet done ! save time : 20.822911739349365 nb_obj : 16 nb_hashtags : 3 time to prepare the origin masks : 6.656710147857666 time for calcul the mask position with numpy : 0.6782512664794922 nb_pixel_total : 6400179 time to create 1 rle with new method : 0.8474829196929932 time for calcul the mask position with numpy : 0.029194355010986328 nb_pixel_total : 3061 time to create 1 rle with old method : 0.003748655319213867 time for calcul the mask position with numpy : 0.020301103591918945 nb_pixel_total : 6479 time to create 1 rle with old method : 0.007419109344482422 time for calcul the mask position with numpy : 0.021536588668823242 nb_pixel_total : 132259 time to create 1 rle with old method : 0.14806580543518066 time for calcul the mask position with numpy : 0.021490812301635742 nb_pixel_total : 105018 time to create 1 rle with old method : 0.11652851104736328 time for calcul the mask position with numpy : 0.022536277770996094 nb_pixel_total : 12504 time to create 1 rle with old method : 0.014391660690307617 time for calcul the mask position with numpy : 0.02117776870727539 nb_pixel_total : 11025 time to create 1 rle with old method : 0.012483835220336914 time for calcul the mask position with numpy : 0.021520137786865234 nb_pixel_total : 34507 time to create 1 rle with old method : 0.03990507125854492 time for calcul the mask position with numpy : 0.02038407325744629 nb_pixel_total : 1878 time to create 1 rle with old method : 0.002544403076171875 time for calcul the mask position with numpy : 0.0202639102935791 nb_pixel_total : 12196 time to create 1 rle with old method : 0.013776540756225586 time for calcul the mask position with numpy : 0.020626306533813477 nb_pixel_total : 109128 time to create 1 rle with old method : 0.12146329879760742 time for calcul the mask position with numpy : 0.022809505462646484 nb_pixel_total : 14451 time to create 1 rle with old method : 0.017507076263427734 time for calcul the mask position with numpy : 0.0221707820892334 nb_pixel_total : 90040 time to create 1 rle with old method : 0.10285353660583496 time for calcul the mask position with numpy : 0.021625280380249023 nb_pixel_total : 6426 time to create 1 rle with old method : 0.007142543792724609 time for calcul the mask position with numpy : 0.02153921127319336 nb_pixel_total : 11739 time to create 1 rle with old method : 0.01333928108215332 time for calcul the mask position with numpy : 0.023125648498535156 nb_pixel_total : 85718 time to create 1 rle with old method : 0.09936046600341797 time for calcul the mask position with numpy : 0.021280288696289062 nb_pixel_total : 13632 time to create 1 rle with old method : 0.015356779098510742 create new chi : 2.6528120040893555 time to delete rle : 0.0014736652374267578 batch 1 Loaded 33 chid ids of type : 3594 +++++++++++++++++++Number RLEs to save : 9461 TO DO : save crop sub photo not yet done ! save time : 33.25985097885132 nb_obj : 9 nb_hashtags : 3 time to prepare the origin masks : 4.621996879577637 time for calcul the mask position with numpy : 0.3925161361694336 nb_pixel_total : 6422580 time to create 1 rle with new method : 0.7959909439086914 time for calcul the mask position with numpy : 0.0362553596496582 nb_pixel_total : 38791 time to create 1 rle with old method : 0.0451204776763916 time for calcul the mask position with numpy : 0.03647041320800781 nb_pixel_total : 52962 time to create 1 rle with old method : 0.06342530250549316 time for calcul the mask position with numpy : 0.0215609073638916 nb_pixel_total : 11826 time to create 1 rle with old method : 0.01624274253845215 time for calcul the mask position with numpy : 0.020401954650878906 nb_pixel_total : 20920 time to create 1 rle with old method : 0.023983478546142578 time for calcul the mask position with numpy : 0.02133774757385254 nb_pixel_total : 75057 time to create 1 rle with old method : 0.09347653388977051 time for calcul the mask position with numpy : 0.022125959396362305 nb_pixel_total : 162731 time to create 1 rle with new method : 0.6316053867340088 time for calcul the mask position with numpy : 0.01975703239440918 nb_pixel_total : 113341 time to create 1 rle with old method : 0.1224977970123291 time for calcul the mask position with numpy : 0.020174026489257812 nb_pixel_total : 129002 time to create 1 rle with old method : 0.14338469505310059 time for calcul the mask position with numpy : 0.02095317840576172 nb_pixel_total : 23030 time to create 1 rle with old method : 0.02670431137084961 create new chi : 2.6349098682403564 time to delete rle : 0.0013887882232666016 batch 1 Loaded 19 chid ids of type : 3594 ++++++++++++++++Number RLEs to save : 9307 TO DO : save crop sub photo not yet done ! save time : 31.593891859054565 nb_obj : 15 nb_hashtags : 4 time to prepare the origin masks : 7.356006383895874 time for calcul the mask position with numpy : 0.8157577514648438 nb_pixel_total : 5805978 time to create 1 rle with new method : 0.8235769271850586 time for calcul the mask position with numpy : 0.020674943923950195 nb_pixel_total : 10108 time to create 1 rle with old method : 0.011645317077636719 time for calcul the mask position with numpy : 0.02182793617248535 nb_pixel_total : 19422 time to create 1 rle with old method : 0.022294044494628906 time for calcul the mask position with numpy : 0.02319192886352539 nb_pixel_total : 103987 time to create 1 rle with old method : 0.11742281913757324 time for calcul the mask position with numpy : 0.02293252944946289 nb_pixel_total : 19199 time to create 1 rle with old method : 0.023826122283935547 time for calcul the mask position with numpy : 0.021676301956176758 nb_pixel_total : 62886 time to create 1 rle with old method : 0.07190895080566406 time for calcul the mask position with numpy : 0.02163553237915039 nb_pixel_total : 40215 time to create 1 rle with old method : 0.04762697219848633 time for calcul the mask position with numpy : 0.02036595344543457 nb_pixel_total : 27845 time to create 1 rle with old method : 0.033403635025024414 time for calcul the mask position with numpy : 0.027247905731201172 nb_pixel_total : 623302 time to create 1 rle with new method : 0.5066118240356445 time for calcul the mask position with numpy : 0.021425962448120117 nb_pixel_total : 30955 time to create 1 rle with old method : 0.03567385673522949 time for calcul the mask position with numpy : 0.024433374404907227 nb_pixel_total : 26196 time to create 1 rle with old method : 0.029809236526489258 time for calcul the mask position with numpy : 0.02207660675048828 nb_pixel_total : 33771 time to create 1 rle with old method : 0.03840470314025879 time for calcul the mask position with numpy : 0.021489620208740234 nb_pixel_total : 28743 time to create 1 rle with old method : 0.03663492202758789 time for calcul the mask position with numpy : 0.0219881534576416 nb_pixel_total : 26474 time to create 1 rle with old method : 0.030022621154785156 time for calcul the mask position with numpy : 0.02800154685974121 nb_pixel_total : 139029 time to create 1 rle with old method : 0.17372655868530273 time for calcul the mask position with numpy : 0.034319400787353516 nb_pixel_total : 52130 time to create 1 rle with old method : 0.058919429779052734 create new chi : 3.292154312133789 time to delete rle : 0.0018188953399658203 batch 1 Loaded 31 chid ids of type : 3594 ++++++++++++++++++++Number RLEs to save : 11402 TO DO : save crop sub photo not yet done ! save time : 29.403486490249634 nb_obj : 16 nb_hashtags : 3 time to prepare the origin masks : 5.532481670379639 time for calcul the mask position with numpy : 0.4987215995788574 nb_pixel_total : 5973315 time to create 1 rle with new method : 0.44348573684692383 time for calcul the mask position with numpy : 0.03568148612976074 nb_pixel_total : 263928 time to create 1 rle with new method : 0.6349999904632568 time for calcul the mask position with numpy : 0.021730661392211914 nb_pixel_total : 11383 time to create 1 rle with old method : 0.012908220291137695 time for calcul the mask position with numpy : 0.0228424072265625 nb_pixel_total : 13868 time to create 1 rle with old method : 0.01566314697265625 time for calcul the mask position with numpy : 0.0213930606842041 nb_pixel_total : 19120 time to create 1 rle with old method : 0.02213120460510254 time for calcul the mask position with numpy : 0.021971702575683594 nb_pixel_total : 18607 time to create 1 rle with old method : 0.0211181640625 time for calcul the mask position with numpy : 0.023527145385742188 nb_pixel_total : 166253 time to create 1 rle with new method : 0.4084925651550293 time for calcul the mask position with numpy : 0.02069091796875 nb_pixel_total : 12782 time to create 1 rle with old method : 0.014416933059692383 time for calcul the mask position with numpy : 0.022358179092407227 nb_pixel_total : 22001 time to create 1 rle with old method : 0.02442169189453125 time for calcul the mask position with numpy : 0.021358251571655273 nb_pixel_total : 12010 time to create 1 rle with old method : 0.013072729110717773 time for calcul the mask position with numpy : 0.0213315486907959 nb_pixel_total : 190919 time to create 1 rle with new method : 0.5895717144012451 time for calcul the mask position with numpy : 0.03520917892456055 nb_pixel_total : 59037 time to create 1 rle with old method : 0.06798911094665527 time for calcul the mask position with numpy : 0.035735368728637695 nb_pixel_total : 87323 time to create 1 rle with old method : 0.09879732131958008 time for calcul the mask position with numpy : 0.03784918785095215 nb_pixel_total : 42648 time to create 1 rle with old method : 0.047890663146972656 time for calcul the mask position with numpy : 0.03444027900695801 nb_pixel_total : 93937 time to create 1 rle with old method : 0.10754752159118652 time for calcul the mask position with numpy : 0.03557538986206055 nb_pixel_total : 57495 time to create 1 rle with old method : 0.06601786613464355 time for calcul the mask position with numpy : 0.03399229049682617 nb_pixel_total : 5614 time to create 1 rle with old method : 0.009368419647216797 create new chi : 3.657421588897705 time to delete rle : 0.0026488304138183594 batch 1 Loaded 33 chid ids of type : 3594 +++++++++++++++++++++Number RLEs to save : 11930 TO DO : save crop sub photo not yet done ! save time : 0.9401276111602783 map_output_result : {1357780327: (0.0, 'Should be the crop_list due to order', 0), 1357780270: (0.0, 'Should be the crop_list due to order', 0), 1357780212: (0.0, 'Should be the crop_list due to order', 0), 1357779920: (0.0, 'Should be the crop_list due to order', 0), 1357779892: (0.0, 'Should be the crop_list due to order', 0), 1357779864: (0.0, 'Should be the crop_list due to order', 0), 1357779834: (0.0, 'Should be the crop_list due to order', 0), 1357779805: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1357780327, 1357780270, 1357780212, 1357779920, 1357779892, 1357779864, 1357779834, 1357779805] Looping around the photos to save general results len do output : 8 /1357780327.Didn't retrieve data . /1357780270.Didn't retrieve data . /1357780212.Didn't retrieve data . /1357779920.Didn't retrieve data . /1357779892.Didn't retrieve data . /1357779864.Didn't retrieve data . /1357779834.Didn't retrieve data . /1357779805.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2837781') ('3318', '22915108', '1357780327', None, None, None, None, None, '2837781') ('3318', None, None, None, None, None, None, None, '2837781') ('3318', '22915108', '1357780270', None, None, None, None, None, '2837781') ('3318', None, None, None, None, None, None, None, '2837781') ('3318', '22915108', '1357780212', None, None, None, None, None, '2837781') ('3318', None, None, None, None, None, None, None, '2837781') ('3318', '22915108', '1357779920', None, None, None, None, None, '2837781') ('3318', None, None, None, None, None, None, None, '2837781') ('3318', '22915108', '1357779892', None, None, None, None, None, '2837781') ('3318', None, None, None, None, None, None, None, '2837781') ('3318', '22915108', '1357779864', None, None, None, None, None, '2837781') ('3318', None, None, None, None, None, None, None, '2837781') ('3318', '22915108', '1357779834', None, None, None, None, None, '2837781') ('3318', None, None, None, None, None, None, None, '2837781') ('3318', '22915108', '1357779805', None, None, None, None, None, '2837781') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.01343846321105957 save_final save missing photos in datou_result : time spend for datou_step_exec : 211.45355033874512 time spend to save output : 0.013938665390014648 total time spend for step 3 : 211.46748900413513 step4:ventilate_hashtags_in_portfolio Tue May 13 09:47:22 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 22915108 get user id for portfolio 22915108 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22915108 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','pet_fonce','environnement','pehd','mal_croppe','carton','flou','background','metal','autre','pet_clair')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22915108 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','pet_fonce','environnement','pehd','mal_croppe','carton','flou','background','metal','autre','pet_clair')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22915108 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','pet_fonce','environnement','pehd','mal_croppe','carton','flou','background','metal','autre','pet_clair')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/22915258,22915259,22915260,22915261,22915262,22915263,22915264,22915265,22915266,22915267,22915268?tags=papier,pet_fonce,environnement,pehd,mal_croppe,carton,flou,background,metal,autre,pet_clair Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1357780327, 1357780270, 1357780212, 1357779920, 1357779892, 1357779864, 1357779834, 1357779805] Looping around the photos to save general results len do output : 1 /22915108. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2837781') ('3318', '22915108', '1357780327', None, None, None, None, None, '2837781') ('3318', None, None, None, None, None, None, None, '2837781') ('3318', '22915108', '1357780270', None, None, None, None, None, '2837781') ('3318', None, None, None, None, None, None, None, '2837781') ('3318', '22915108', '1357780212', None, None, None, None, None, '2837781') ('3318', None, None, None, None, None, None, None, '2837781') ('3318', '22915108', '1357779920', None, None, None, None, None, '2837781') ('3318', None, None, None, None, None, None, None, '2837781') ('3318', '22915108', '1357779892', None, None, None, None, None, '2837781') ('3318', None, None, None, None, None, None, None, '2837781') ('3318', '22915108', '1357779864', None, None, None, None, None, '2837781') ('3318', None, None, None, None, None, None, None, '2837781') ('3318', '22915108', '1357779834', None, None, None, None, None, '2837781') ('3318', None, None, None, None, None, None, None, '2837781') ('3318', '22915108', '1357779805', None, None, None, None, None, '2837781') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.03936886787414551 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.6039540767669678 time spend to save output : 0.039702653884887695 total time spend for step 4 : 1.6436567306518555 step5:final Tue May 13 09:47:23 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1357780327: ('0.13293756666439724',), 1357780270: ('0.13293756666439724',), 1357780212: ('0.13293756666439724',), 1357779920: ('0.13293756666439724',), 1357779892: ('0.13293756666439724',), 1357779864: ('0.13293756666439724',), 1357779834: ('0.13293756666439724',), 1357779805: ('0.13293756666439724',)} new output for save of step final : {1357780327: ('0.13293756666439724',), 1357780270: ('0.13293756666439724',), 1357780212: ('0.13293756666439724',), 1357779920: ('0.13293756666439724',), 1357779892: ('0.13293756666439724',), 1357779864: ('0.13293756666439724',), 1357779834: ('0.13293756666439724',), 1357779805: ('0.13293756666439724',)} [1357780327, 1357780270, 1357780212, 1357779920, 1357779892, 1357779864, 1357779834, 1357779805] Looping around the photos to save general results len do output : 8 /1357780327.Didn't retrieve data . /1357780270.Didn't retrieve data . /1357780212.Didn't retrieve data . /1357779920.Didn't retrieve data . /1357779892.Didn't retrieve data . /1357779864.Didn't retrieve data . /1357779834.Didn't retrieve data . /1357779805.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2837781') ('3318', '22915108', '1357780327', None, None, None, None, None, '2837781') ('3318', None, None, None, None, None, None, None, '2837781') ('3318', '22915108', '1357780270', None, None, None, None, None, '2837781') ('3318', None, None, None, None, None, None, None, '2837781') ('3318', '22915108', '1357780212', None, None, None, None, None, '2837781') ('3318', None, None, None, None, None, None, None, '2837781') ('3318', '22915108', '1357779920', None, None, None, None, None, '2837781') ('3318', None, None, None, None, None, None, None, '2837781') ('3318', '22915108', '1357779892', None, None, None, None, None, '2837781') ('3318', None, None, None, None, None, None, None, '2837781') ('3318', '22915108', '1357779864', None, None, None, None, None, '2837781') ('3318', None, None, None, None, None, None, None, '2837781') ('3318', '22915108', '1357779834', None, None, None, None, None, '2837781') ('3318', None, None, None, None, None, None, None, '2837781') ('3318', '22915108', '1357779805', None, None, None, None, None, '2837781') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.03926801681518555 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.14164137840270996 time spend to save output : 0.03962135314941406 total time spend for step 5 : 0.18126273155212402 step6:blur_detection Tue May 13 09:47:23 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1747122028_2007129_1357780327_8a45d823fb9722890c63bc64afc5aa1a.jpg resize: (2160, 3264) 1357780327 -0.647779839203833 treat image : temp/1747122028_2007129_1357780270_68fa8cf3a30ddb9441842ad87f1c759b.jpg resize: (2160, 3264) 1357780270 1.1016588101724567 treat image : temp/1747122028_2007129_1357780212_3e0e8e8a63d544a4bd426eb18ead86ae.jpg resize: (2160, 3264) 1357780212 -3.4849652514675458 treat image : temp/1747122028_2007129_1357779920_efcad9d59ff9eba624570c06f6b4a492.jpg resize: (2160, 3264) 1357779920 -0.38532808921797873 treat image : temp/1747122028_2007129_1357779892_572e21c625619c877be3b626abb81c4c.jpg resize: (2160, 3264) 1357779892 1.9386742550000666 treat image : temp/1747122028_2007129_1357779864_f7a63752136ee09ecfed5bafd80ad9ff.jpg resize: (2160, 3264) 1357779864 0.688222835698106 treat image : temp/1747122028_2007129_1357779834_e9d5f6f4ed92271edf5cc3c3c7107f3a.jpg resize: (2160, 3264) 1357779834 -0.9046180416698832 treat image : temp/1747122028_2007129_1357779805_57637535c38eb94000cba8a1d0e39f62.jpg resize: (2160, 3264) 1357779805 -5.040045845361828 treat image : temp/1747122028_2007129_1357780327_8a45d823fb9722890c63bc64afc5aa1a_rle_crop_3794796556_0.png resize: (135, 185) 1357792586 -0.9969779222405402 treat image : temp/1747122028_2007129_1357780327_8a45d823fb9722890c63bc64afc5aa1a_rle_crop_3794796555_0.png resize: (420, 73) 1357792587 -3.770602187281046 treat image : temp/1747122028_2007129_1357780327_8a45d823fb9722890c63bc64afc5aa1a_rle_crop_3794796548_0.png resize: (279, 143) 1357792588 -2.07128572206687 treat image : temp/1747122028_2007129_1357780327_8a45d823fb9722890c63bc64afc5aa1a_rle_crop_3794796547_0.png resize: (206, 171) 1357792589 -1.5002842975832131 treat image : temp/1747122028_2007129_1357780327_8a45d823fb9722890c63bc64afc5aa1a_rle_crop_3794796554_0.png resize: (192, 137) 1357792591 -1.9507849444197378 treat image : temp/1747122028_2007129_1357780327_8a45d823fb9722890c63bc64afc5aa1a_rle_crop_3794796550_0.png resize: (363, 587) 1357792592 -1.1671793355994027 treat image : temp/1747122028_2007129_1357780327_8a45d823fb9722890c63bc64afc5aa1a_rle_crop_3794796560_0.png resize: (86, 107) 1357792593 -0.4533042235027872 treat image : temp/1747122028_2007129_1357780327_8a45d823fb9722890c63bc64afc5aa1a_rle_crop_3794796559_0.png resize: (921, 569) 1357792595 -1.0187405395516929 treat image : temp/1747122028_2007129_1357780327_8a45d823fb9722890c63bc64afc5aa1a_rle_crop_3794796551_0.png resize: (220, 376) 1357792596 -0.9910847794811892 treat image : temp/1747122028_2007129_1357780327_8a45d823fb9722890c63bc64afc5aa1a_rle_crop_3794796558_0.png resize: (210, 252) 1357792597 0.308191081062272 treat image : temp/1747122028_2007129_1357780270_68fa8cf3a30ddb9441842ad87f1c759b_rle_crop_3794796570_0.png resize: (120, 183) 1357792598 -0.6201601544903927 treat image : temp/1747122028_2007129_1357780270_68fa8cf3a30ddb9441842ad87f1c759b_rle_crop_3794796571_0.png resize: (303, 158) 1357792599 -2.458208580270371 treat image : temp/1747122028_2007129_1357780270_68fa8cf3a30ddb9441842ad87f1c759b_rle_crop_3794796568_0.png resize: (267, 185) 1357792600 -2.5038776226449553 treat image : temp/1747122028_2007129_1357780270_68fa8cf3a30ddb9441842ad87f1c759b_rle_crop_3794796574_0.png resize: (216, 253) 1357792601 -1.1386504185968862 treat image : temp/1747122028_2007129_1357780270_68fa8cf3a30ddb9441842ad87f1c759b_rle_crop_3794796573_0.png resize: (310, 372) 1357792602 -1.02034312493205 treat image : temp/1747122028_2007129_1357780270_68fa8cf3a30ddb9441842ad87f1c759b_rle_crop_3794796569_0.png resize: (217, 283) 1357792603 -1.3049371761367754 treat image : temp/1747122028_2007129_1357780270_68fa8cf3a30ddb9441842ad87f1c759b_rle_crop_3794796566_0.png resize: (363, 251) 1357792604 -0.9548928959870843 treat image : temp/1747122028_2007129_1357780270_68fa8cf3a30ddb9441842ad87f1c759b_rle_crop_3794796565_0.png resize: (150, 168) 1357792605 -1.3159700091085214 treat image : temp/1747122028_2007129_1357780270_68fa8cf3a30ddb9441842ad87f1c759b_rle_crop_3794796576_0.png resize: (275, 187) 1357792606 -1.9181289688884373 treat image : temp/1747122028_2007129_1357780270_68fa8cf3a30ddb9441842ad87f1c759b_rle_crop_3794796567_0.png resize: (381, 263) 1357792607 -1.0526015077738677 treat image : temp/1747122028_2007129_1357780212_3e0e8e8a63d544a4bd426eb18ead86ae_rle_crop_3794796583_0.png resize: (426, 155) 1357792608 -1.005118979919706 treat image : temp/1747122028_2007129_1357780212_3e0e8e8a63d544a4bd426eb18ead86ae_rle_crop_3794796582_0.png resize: (195, 255) 1357792609 -1.1508497272891958 treat image : temp/1747122028_2007129_1357780212_3e0e8e8a63d544a4bd426eb18ead86ae_rle_crop_3794796580_0.png resize: (314, 334) 1357792610 -0.9884997235884551 treat image : temp/1747122028_2007129_1357780212_3e0e8e8a63d544a4bd426eb18ead86ae_rle_crop_3794796584_0.png resize: (179, 84) 1357792611 -0.9845480495865616 treat image : temp/1747122028_2007129_1357780212_3e0e8e8a63d544a4bd426eb18ead86ae_rle_crop_3794796594_0.png resize: (185, 328) 1357792613 -0.17395302392194867 treat image : temp/1747122028_2007129_1357780212_3e0e8e8a63d544a4bd426eb18ead86ae_rle_crop_3794796586_0.png resize: (179, 258) 1357792614 -1.988558022855368 treat image : temp/1747122028_2007129_1357780212_3e0e8e8a63d544a4bd426eb18ead86ae_rle_crop_3794796585_0.png resize: (237, 197) 1357792615 -1.7261767859697124 treat image : temp/1747122028_2007129_1357780212_3e0e8e8a63d544a4bd426eb18ead86ae_rle_crop_3794796598_0.png resize: (208, 138) 1357792616 -2.365961885272329 treat image : temp/1747122028_2007129_1357779920_efcad9d59ff9eba624570c06f6b4a492_rle_crop_3794796606_0.png resize: (219, 314) 1357792617 -2.9669289814131736 treat image : temp/1747122028_2007129_1357779920_efcad9d59ff9eba624570c06f6b4a492_rle_crop_3794796609_0.png resize: (135, 406) 1357792618 -0.5595804053501942 treat image : temp/1747122028_2007129_1357779920_efcad9d59ff9eba624570c06f6b4a492_rle_crop_3794796603_0.png resize: (116, 289) 1357792619 0.7549887408661025 treat image : temp/1747122028_2007129_1357779920_efcad9d59ff9eba624570c06f6b4a492_rle_crop_3794796605_0.png resize: (207, 263) 1357792620 0.34920165902509376 treat image : temp/1747122028_2007129_1357779892_572e21c625619c877be3b626abb81c4c_rle_crop_3794796616_0.png resize: (143, 105) 1357792621 -0.9076921003068049 treat image : temp/1747122028_2007129_1357779892_572e21c625619c877be3b626abb81c4c_rle_crop_3794796622_0.png resize: (383, 471) 1357792622 -1.4872661538183336 treat image : temp/1747122028_2007129_1357779892_572e21c625619c877be3b626abb81c4c_rle_crop_3794796615_0.png resize: (411, 334) 1357792623 -1.8080508621840732 treat image : temp/1747122028_2007129_1357779892_572e21c625619c877be3b626abb81c4c_rle_crop_3794796619_0.png resize: (175, 131) 1357792624 -1.5519794380919938 treat image : temp/1747122028_2007129_1357779892_572e21c625619c877be3b626abb81c4c_rle_crop_3794796617_0.png resize: (101, 87) 1357792625 -1.2621573706060645 treat image : temp/1747122028_2007129_1357779892_572e21c625619c877be3b626abb81c4c_rle_crop_3794796614_0.png resize: (175, 159) 1357792626 -1.4878107945352361 treat image : temp/1747122028_2007129_1357779892_572e21c625619c877be3b626abb81c4c_rle_crop_3794796626_0.png resize: (257, 781) 1357792627 -0.9628998852525941 treat image : temp/1747122028_2007129_1357779892_572e21c625619c877be3b626abb81c4c_rle_crop_3794796627_0.png resize: (391, 546) 1357792628 1.379035927622549 treat image : temp/1747122028_2007129_1357779892_572e21c625619c877be3b626abb81c4c_rle_crop_3794796624_0.png resize: (77, 177) 1357792629 0.6900041046078305 treat image : temp/1747122028_2007129_1357779892_572e21c625619c877be3b626abb81c4c_rle_crop_3794796618_0.png resize: (267, 441) 1357792630 1.4597010352925717 treat image : temp/1747122028_2007129_1357779892_572e21c625619c877be3b626abb81c4c_rle_crop_3794796625_0.png resize: (219, 164) 1357792631 -2.3288277395136414 treat image : temp/1747122028_2007129_1357779892_572e21c625619c877be3b626abb81c4c_rle_crop_3794796621_0.png resize: (161, 102) 1357792632 -1.307954801412755 treat image : temp/1747122028_2007129_1357779864_f7a63752136ee09ecfed5bafd80ad9ff_rle_crop_3794796630_0.png resize: (175, 171) 1357792633 -0.4822401699781999 treat image : temp/1747122028_2007129_1357779864_f7a63752136ee09ecfed5bafd80ad9ff_rle_crop_3794796637_0.png resize: (302, 290) 1357792634 -0.2998702264100342 treat image : temp/1747122028_2007129_1357779864_f7a63752136ee09ecfed5bafd80ad9ff_rle_crop_3794796633_0.png resize: (892, 406) 1357792636 -0.1357050022126761 treat image : temp/1747122028_2007129_1357779864_f7a63752136ee09ecfed5bafd80ad9ff_rle_crop_3794796636_0.png resize: (81, 256) 1357792637 -2.2719977196444914 treat image : temp/1747122028_2007129_1357779834_e9d5f6f4ed92271edf5cc3c3c7107f3a_rle_crop_3794796640_0.png resize: (251, 758) 1357792638 -0.6447611093476263 treat image : temp/1747122028_2007129_1357779834_e9d5f6f4ed92271edf5cc3c3c7107f3a_rle_crop_3794796641_0.png resize: (313, 153) 1357792640 -1.4747095115485815 treat image : temp/1747122028_2007129_1357779834_e9d5f6f4ed92271edf5cc3c3c7107f3a_rle_crop_3794796650_0.png resize: (892, 1251) 1357792641 0.24815582144319742 treat image : temp/1747122028_2007129_1357779834_e9d5f6f4ed92271edf5cc3c3c7107f3a_rle_crop_3794796642_0.png resize: (223, 167) 1357792642 0.04383874401066719 treat image : temp/1747122028_2007129_1357779834_e9d5f6f4ed92271edf5cc3c3c7107f3a_rle_crop_3794796643_0.png resize: (302, 180) 1357792643 -0.15741014002337492 treat image : temp/1747122028_2007129_1357779834_e9d5f6f4ed92271edf5cc3c3c7107f3a_rle_crop_3794796652_0.png resize: (254, 101) 1357792644 -0.5914003690458471 treat image : temp/1747122028_2007129_1357779834_e9d5f6f4ed92271edf5cc3c3c7107f3a_rle_crop_3794796648_0.png resize: (177, 354) 1357792645 -1.4432059749901107 treat image : temp/1747122028_2007129_1357779805_57637535c38eb94000cba8a1d0e39f62_rle_crop_3794796665_0.png resize: (301, 118) 1357792646 -2.204615066165055 treat image : temp/1747122028_2007129_1357779805_57637535c38eb94000cba8a1d0e39f62_rle_crop_3794796662_0.png resize: (198, 170) 1357792647 -2.946578205643725 treat image : temp/1747122028_2007129_1357779805_57637535c38eb94000cba8a1d0e39f62_rle_crop_3794796666_0.png resize: (204, 174) 1357792648 -4.375911679955416 treat image : temp/1747122028_2007129_1357779805_57637535c38eb94000cba8a1d0e39f62_rle_crop_3794796663_0.png resize: (177, 149) 1357792649 -2.483312400931891 treat image : temp/1747122028_2007129_1357779805_57637535c38eb94000cba8a1d0e39f62_rle_crop_3794796668_0.png resize: (117, 149) 1357792650 -3.3425786573883394 treat image : temp/1747122028_2007129_1357779805_57637535c38eb94000cba8a1d0e39f62_rle_crop_3794796657_0.png resize: (367, 152) 1357792651 -4.013068533789963 treat image : temp/1747122028_2007129_1357779805_57637535c38eb94000cba8a1d0e39f62_rle_crop_3794796654_0.png resize: (72, 100) 1357792652 0.3826194537817903 treat image : temp/1747122028_2007129_1357779805_57637535c38eb94000cba8a1d0e39f62_rle_crop_3794796661_0.png resize: (183, 91) 1357792653 -3.428555990160942 treat image : temp/1747122028_2007129_1357780327_8a45d823fb9722890c63bc64afc5aa1a_rle_crop_3794796552_0.png resize: (182, 245) 1357792655 -2.144611454142509 treat image : temp/1747122028_2007129_1357780212_3e0e8e8a63d544a4bd426eb18ead86ae_rle_crop_3794796597_0.png resize: (144, 135) 1357792656 -0.9453919801142743 treat image : temp/1747122028_2007129_1357780212_3e0e8e8a63d544a4bd426eb18ead86ae_rle_crop_3794796579_0.png resize: (231, 275) 1357792657 -1.352103443285847 treat image : temp/1747122028_2007129_1357779920_efcad9d59ff9eba624570c06f6b4a492_rle_crop_3794796600_0.png resize: (242, 208) 1357792658 0.38418414686409724 treat image : temp/1747122028_2007129_1357779920_efcad9d59ff9eba624570c06f6b4a492_rle_crop_3794796602_0.png resize: (221, 245) 1357792659 -0.6847524483552511 treat image : temp/1747122028_2007129_1357779892_572e21c625619c877be3b626abb81c4c_rle_crop_3794796628_0.png resize: (87, 93) 1357792660 -0.639839743708957 treat image : temp/1747122028_2007129_1357779864_f7a63752136ee09ecfed5bafd80ad9ff_rle_crop_3794796638_0.png resize: (271, 245) 1357792661 -1.061173388176176 treat image : temp/1747122028_2007129_1357779834_e9d5f6f4ed92271edf5cc3c3c7107f3a_rle_crop_3794796653_0.png resize: (106, 127) 1357792662 0.23569266107243322 treat image : temp/1747122028_2007129_1357779834_e9d5f6f4ed92271edf5cc3c3c7107f3a_rle_crop_3794796646_0.png resize: (989, 1190) 1357792663 0.2450302198472951 treat image : temp/1747122028_2007129_1357779805_57637535c38eb94000cba8a1d0e39f62_rle_crop_3794796667_0.png resize: (182, 100) 1357792664 -0.7109592268302786 treat image : temp/1747122028_2007129_1357780270_68fa8cf3a30ddb9441842ad87f1c759b_rle_crop_3794796575_0.png resize: (123, 135) 1357792665 -1.5896814214871815 treat image : temp/1747122028_2007129_1357780327_8a45d823fb9722890c63bc64afc5aa1a_rle_crop_3794796564_0.png resize: (512, 499) 1357792677 -0.3773194285821069 treat image : temp/1747122028_2007129_1357780327_8a45d823fb9722890c63bc64afc5aa1a_rle_crop_3794796563_0.png resize: (392, 319) 1357792678 -3.7709918750293507 treat image : temp/1747122028_2007129_1357780327_8a45d823fb9722890c63bc64afc5aa1a_rle_crop_3794796562_0.png resize: (810, 696) 1357792680 -0.30960331437539357 treat image : temp/1747122028_2007129_1357780327_8a45d823fb9722890c63bc64afc5aa1a_rle_crop_3794796557_0.png resize: (233, 802) 1357792681 -0.06773654790416596 treat image : temp/1747122028_2007129_1357780327_8a45d823fb9722890c63bc64afc5aa1a_rle_crop_3794796553_0.png resize: (392, 305) 1357792682 -2.230201651914278 treat image : temp/1747122028_2007129_1357780327_8a45d823fb9722890c63bc64afc5aa1a_rle_crop_3794796549_0.png resize: (461, 179) 1357792683 -0.06687779596294266 treat image : temp/1747122028_2007129_1357780270_68fa8cf3a30ddb9441842ad87f1c759b_rle_crop_3794796577_0.png resize: (404, 276) 1357792684 -0.8302642876827742 treat image : temp/1747122028_2007129_1357780270_68fa8cf3a30ddb9441842ad87f1c759b_rle_crop_3794796578_0.png resize: (290, 192) 1357792686 -1.2417714261510713 treat image : temp/1747122028_2007129_1357780270_68fa8cf3a30ddb9441842ad87f1c759b_rle_crop_3794796572_0.png resize: (544, 441) 1357792687 -0.45443057408495924 treat image : temp/1747122028_2007129_1357780212_3e0e8e8a63d544a4bd426eb18ead86ae_rle_crop_3794796592_0.png resize: (289, 266) 1357792688 -1.6729868738550422 treat image : temp/1747122028_2007129_1357780212_3e0e8e8a63d544a4bd426eb18ead86ae_rle_crop_3794796581_0.png resize: (311, 376) 1357792689 -2.860508767578959 treat image : temp/1747122028_2007129_1357780212_3e0e8e8a63d544a4bd426eb18ead86ae_rle_crop_3794796593_0.png resize: (158, 276) 1357792690 -1.7631286822667238 treat image : temp/1747122028_2007129_1357780212_3e0e8e8a63d544a4bd426eb18ead86ae_rle_crop_3794796587_0.png resize: (97, 172) 1357792691 -0.32710757055833123 treat image : temp/1747122028_2007129_1357780212_3e0e8e8a63d544a4bd426eb18ead86ae_rle_crop_3794796590_0.png resize: (219, 292) 1357792692 -2.9821091981272976 treat image : temp/1747122028_2007129_1357780212_3e0e8e8a63d544a4bd426eb18ead86ae_rle_crop_3794796599_0.png resize: (268, 425) 1357792693 -2.6343280825207223 treat image : temp/1747122028_2007129_1357780212_3e0e8e8a63d544a4bd426eb18ead86ae_rle_crop_3794796595_0.png resize: (96, 196) 1357792694 -0.24146455803190037 treat image : temp/1747122028_2007129_1357780212_3e0e8e8a63d544a4bd426eb18ead86ae_rle_crop_3794796596_0.png resize: (298, 265) 1357792695 -2.4334937030954173 treat image : temp/1747122028_2007129_1357780212_3e0e8e8a63d544a4bd426eb18ead86ae_rle_crop_3794796591_0.png resize: (151, 219) 1357792696 -2.0269886821712855 treat image : temp/1747122028_2007129_1357780212_3e0e8e8a63d544a4bd426eb18ead86ae_rle_crop_3794796589_0.png resize: (273, 264) 1357792697 -2.1105257301532423 treat image : temp/1747122028_2007129_1357779920_efcad9d59ff9eba624570c06f6b4a492_rle_crop_3794796612_0.png resize: (236, 634) 1357792698 -1.18358129579359 treat image : temp/1747122028_2007129_1357779920_efcad9d59ff9eba624570c06f6b4a492_rle_crop_3794796601_0.png resize: (283, 679) 1357792699 -0.8032322720081938 treat image : temp/1747122028_2007129_1357779920_efcad9d59ff9eba624570c06f6b4a492_rle_crop_3794796608_0.png resize: (178, 241) 1357792700 -1.5215716424253547 treat image : temp/1747122028_2007129_1357779920_efcad9d59ff9eba624570c06f6b4a492_rle_crop_3794796604_0.png resize: (180, 545) 1357792702 -1.5884230065118181 treat image : temp/1747122028_2007129_1357779920_efcad9d59ff9eba624570c06f6b4a492_rle_crop_3794796611_0.png resize: (422, 529) 1357792703 -0.9948583043849358 treat image : temp/1747122028_2007129_1357779920_efcad9d59ff9eba624570c06f6b4a492_rle_crop_3794796610_0.png resize: (135, 179) 1357792704 0.5116822197951981 treat image : temp/1747122028_2007129_1357779920_efcad9d59ff9eba624570c06f6b4a492_rle_crop_3794796607_0.png resize: (467, 424) 1357792705 -1.9355401843815265 treat image : temp/1747122028_2007129_1357779920_efcad9d59ff9eba624570c06f6b4a492_rle_crop_3794796613_0.png resize: (155, 422) 1357792706 0.22966456493162835 treat image : temp/1747122028_2007129_1357779892_572e21c625619c877be3b626abb81c4c_rle_crop_3794796620_0.png resize: (397, 467) 1357792707 -1.5023670945879397 treat image : temp/1747122028_2007129_1357779892_572e21c625619c877be3b626abb81c4c_rle_crop_3794796629_0.png resize: (235, 213) 1357792708 -2.1383331811159354 treat image : temp/1747122028_2007129_1357779892_572e21c625619c877be3b626abb81c4c_rle_crop_3794796623_0.png resize: (251, 227) 1357792709 -0.7603181544843353 treat image : temp/1747122028_2007129_1357779864_f7a63752136ee09ecfed5bafd80ad9ff_rle_crop_3794796631_0.png resize: (452, 350) 1357792710 -1.3334264583501325 treat image : temp/1747122028_2007129_1357779864_f7a63752136ee09ecfed5bafd80ad9ff_rle_crop_3794796634_0.png resize: (422, 254) 1357792711 -1.690180027552285 treat image : temp/1747122028_2007129_1357779864_f7a63752136ee09ecfed5bafd80ad9ff_rle_crop_3794796635_0.png resize: (209, 143) 1357792712 -1.8385472235557383 treat image : temp/1747122028_2007129_1357779864_f7a63752136ee09ecfed5bafd80ad9ff_rle_crop_3794796632_0.png resize: (452, 381) 1357792713 -0.9661523101853168 treat image : temp/1747122028_2007129_1357779834_e9d5f6f4ed92271edf5cc3c3c7107f3a_rle_crop_3794796649_0.png resize: (297, 359) 1357792714 -0.9252288258564811 treat image : temp/1747122028_2007129_1357779834_e9d5f6f4ed92271edf5cc3c3c7107f3a_rle_crop_3794796639_0.png resize: (328, 220) 1357792715 -0.4077301215927717 treat image : temp/1747122028_2007129_1357779834_e9d5f6f4ed92271edf5cc3c3c7107f3a_rle_crop_3794796644_0.png resize: (172, 210) 1357792716 -2.455289826840468 treat image : temp/1747122028_2007129_1357779834_e9d5f6f4ed92271edf5cc3c3c7107f3a_rle_crop_3794796651_0.png resize: (316, 449) 1357792717 -1.380346912679883 treat image : temp/1747122028_2007129_1357779805_57637535c38eb94000cba8a1d0e39f62_rle_crop_3794796659_0.png resize: (504, 146) 1357792718 -1.1485085809268216 treat image : temp/1747122028_2007129_1357779805_57637535c38eb94000cba8a1d0e39f62_rle_crop_3794796660_0.png resize: (568, 443) 1357792719 -0.6613243455461554 treat image : temp/1747122028_2007129_1357779805_57637535c38eb94000cba8a1d0e39f62_rle_crop_3794796669_0.png resize: (497, 614) 1357792720 -1.3572913468675571 treat image : temp/1747122028_2007129_1357779805_57637535c38eb94000cba8a1d0e39f62_rle_crop_3794796655_0.png resize: (204, 422) 1357792721 -3.41582638604753 treat image : temp/1747122028_2007129_1357779805_57637535c38eb94000cba8a1d0e39f62_rle_crop_3794796664_0.png resize: (479, 558) 1357792722 -4.37806004500648 treat image : temp/1747122028_2007129_1357779805_57637535c38eb94000cba8a1d0e39f62_rle_crop_3794796658_0.png resize: (267, 513) 1357792723 -2.3565119197301776 treat image : temp/1747122028_2007129_1357779805_57637535c38eb94000cba8a1d0e39f62_rle_crop_3794796656_0.png resize: (350, 401) 1357792724 -1.9482845746585706 treat image : temp/1747122028_2007129_1357780327_8a45d823fb9722890c63bc64afc5aa1a_rle_crop_3794796561_0.png resize: (483, 421) 1357792728 -0.32297752566934473 treat image : temp/1747122028_2007129_1357780212_3e0e8e8a63d544a4bd426eb18ead86ae_rle_crop_3794796588_0.png resize: (151, 119) 1357792729 -1.8801731748525738 treat image : temp/1747122028_2007129_1357779834_e9d5f6f4ed92271edf5cc3c3c7107f3a_rle_crop_3794796647_0.png resize: (229, 200) 1357792730 -1.6456397332945165 treat image : temp/1747122028_2007129_1357779834_e9d5f6f4ed92271edf5cc3c3c7107f3a_rle_crop_3794796645_0.png resize: (215, 210) 1357792731 -1.147709779732337 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 131 time used for this insertion : 0.05749988555908203 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 131 time used for this insertion : 0.10956311225891113 save missing photos in datou_result : time spend for datou_step_exec : 32.77208089828491 time spend to save output : 0.17277979850769043 total time spend for step 6 : 32.9448606967926 step7:brightness Tue May 13 09:47:56 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1747122028_2007129_1357780327_8a45d823fb9722890c63bc64afc5aa1a.jpg treat image : temp/1747122028_2007129_1357780270_68fa8cf3a30ddb9441842ad87f1c759b.jpg treat image : temp/1747122028_2007129_1357780212_3e0e8e8a63d544a4bd426eb18ead86ae.jpg treat image : temp/1747122028_2007129_1357779920_efcad9d59ff9eba624570c06f6b4a492.jpg treat image : temp/1747122028_2007129_1357779892_572e21c625619c877be3b626abb81c4c.jpg treat image : temp/1747122028_2007129_1357779864_f7a63752136ee09ecfed5bafd80ad9ff.jpg treat image : temp/1747122028_2007129_1357779834_e9d5f6f4ed92271edf5cc3c3c7107f3a.jpg treat image : temp/1747122028_2007129_1357779805_57637535c38eb94000cba8a1d0e39f62.jpg treat image : temp/1747122028_2007129_1357780327_8a45d823fb9722890c63bc64afc5aa1a_rle_crop_3794796556_0.png treat image : temp/1747122028_2007129_1357780327_8a45d823fb9722890c63bc64afc5aa1a_rle_crop_3794796555_0.png treat image : temp/1747122028_2007129_1357780327_8a45d823fb9722890c63bc64afc5aa1a_rle_crop_3794796548_0.png treat image : temp/1747122028_2007129_1357780327_8a45d823fb9722890c63bc64afc5aa1a_rle_crop_3794796547_0.png treat image : temp/1747122028_2007129_1357780327_8a45d823fb9722890c63bc64afc5aa1a_rle_crop_3794796554_0.png treat image : temp/1747122028_2007129_1357780327_8a45d823fb9722890c63bc64afc5aa1a_rle_crop_3794796550_0.png treat image : temp/1747122028_2007129_1357780327_8a45d823fb9722890c63bc64afc5aa1a_rle_crop_3794796560_0.png treat image : temp/1747122028_2007129_1357780327_8a45d823fb9722890c63bc64afc5aa1a_rle_crop_3794796559_0.png treat image : temp/1747122028_2007129_1357780327_8a45d823fb9722890c63bc64afc5aa1a_rle_crop_3794796551_0.png treat image : temp/1747122028_2007129_1357780327_8a45d823fb9722890c63bc64afc5aa1a_rle_crop_3794796558_0.png treat image : temp/1747122028_2007129_1357780270_68fa8cf3a30ddb9441842ad87f1c759b_rle_crop_3794796570_0.png treat image : temp/1747122028_2007129_1357780270_68fa8cf3a30ddb9441842ad87f1c759b_rle_crop_3794796571_0.png treat image : temp/1747122028_2007129_1357780270_68fa8cf3a30ddb9441842ad87f1c759b_rle_crop_3794796568_0.png treat image : temp/1747122028_2007129_1357780270_68fa8cf3a30ddb9441842ad87f1c759b_rle_crop_3794796574_0.png treat image : temp/1747122028_2007129_1357780270_68fa8cf3a30ddb9441842ad87f1c759b_rle_crop_3794796573_0.png treat image : temp/1747122028_2007129_1357780270_68fa8cf3a30ddb9441842ad87f1c759b_rle_crop_3794796569_0.png treat image : temp/1747122028_2007129_1357780270_68fa8cf3a30ddb9441842ad87f1c759b_rle_crop_3794796566_0.png treat image : temp/1747122028_2007129_1357780270_68fa8cf3a30ddb9441842ad87f1c759b_rle_crop_3794796565_0.png treat image : temp/1747122028_2007129_1357780270_68fa8cf3a30ddb9441842ad87f1c759b_rle_crop_3794796576_0.png treat image : temp/1747122028_2007129_1357780270_68fa8cf3a30ddb9441842ad87f1c759b_rle_crop_3794796567_0.png treat image : temp/1747122028_2007129_1357780212_3e0e8e8a63d544a4bd426eb18ead86ae_rle_crop_3794796583_0.png treat image : temp/1747122028_2007129_1357780212_3e0e8e8a63d544a4bd426eb18ead86ae_rle_crop_3794796582_0.png treat image : temp/1747122028_2007129_1357780212_3e0e8e8a63d544a4bd426eb18ead86ae_rle_crop_3794796580_0.png treat image : temp/1747122028_2007129_1357780212_3e0e8e8a63d544a4bd426eb18ead86ae_rle_crop_3794796584_0.png treat image : temp/1747122028_2007129_1357780212_3e0e8e8a63d544a4bd426eb18ead86ae_rle_crop_3794796594_0.png treat image : temp/1747122028_2007129_1357780212_3e0e8e8a63d544a4bd426eb18ead86ae_rle_crop_3794796586_0.png treat image : temp/1747122028_2007129_1357780212_3e0e8e8a63d544a4bd426eb18ead86ae_rle_crop_3794796585_0.png treat image : temp/1747122028_2007129_1357780212_3e0e8e8a63d544a4bd426eb18ead86ae_rle_crop_3794796598_0.png treat image : temp/1747122028_2007129_1357779920_efcad9d59ff9eba624570c06f6b4a492_rle_crop_3794796606_0.png treat image : temp/1747122028_2007129_1357779920_efcad9d59ff9eba624570c06f6b4a492_rle_crop_3794796609_0.png treat image : temp/1747122028_2007129_1357779920_efcad9d59ff9eba624570c06f6b4a492_rle_crop_3794796603_0.png treat image : temp/1747122028_2007129_1357779920_efcad9d59ff9eba624570c06f6b4a492_rle_crop_3794796605_0.png treat image : temp/1747122028_2007129_1357779892_572e21c625619c877be3b626abb81c4c_rle_crop_3794796616_0.png treat image : temp/1747122028_2007129_1357779892_572e21c625619c877be3b626abb81c4c_rle_crop_3794796622_0.png treat image : temp/1747122028_2007129_1357779892_572e21c625619c877be3b626abb81c4c_rle_crop_3794796615_0.png treat image : temp/1747122028_2007129_1357779892_572e21c625619c877be3b626abb81c4c_rle_crop_3794796619_0.png treat image : temp/1747122028_2007129_1357779892_572e21c625619c877be3b626abb81c4c_rle_crop_3794796617_0.png treat image : temp/1747122028_2007129_1357779892_572e21c625619c877be3b626abb81c4c_rle_crop_3794796614_0.png treat image : temp/1747122028_2007129_1357779892_572e21c625619c877be3b626abb81c4c_rle_crop_3794796626_0.png treat image : temp/1747122028_2007129_1357779892_572e21c625619c877be3b626abb81c4c_rle_crop_3794796627_0.png treat image : temp/1747122028_2007129_1357779892_572e21c625619c877be3b626abb81c4c_rle_crop_3794796624_0.png treat image : temp/1747122028_2007129_1357779892_572e21c625619c877be3b626abb81c4c_rle_crop_3794796618_0.png treat image : temp/1747122028_2007129_1357779892_572e21c625619c877be3b626abb81c4c_rle_crop_3794796625_0.png treat image : temp/1747122028_2007129_1357779892_572e21c625619c877be3b626abb81c4c_rle_crop_3794796621_0.png treat image : temp/1747122028_2007129_1357779864_f7a63752136ee09ecfed5bafd80ad9ff_rle_crop_3794796630_0.png treat image : temp/1747122028_2007129_1357779864_f7a63752136ee09ecfed5bafd80ad9ff_rle_crop_3794796637_0.png treat image : temp/1747122028_2007129_1357779864_f7a63752136ee09ecfed5bafd80ad9ff_rle_crop_3794796633_0.png treat image : temp/1747122028_2007129_1357779864_f7a63752136ee09ecfed5bafd80ad9ff_rle_crop_3794796636_0.png treat image : temp/1747122028_2007129_1357779834_e9d5f6f4ed92271edf5cc3c3c7107f3a_rle_crop_3794796640_0.png treat image : temp/1747122028_2007129_1357779834_e9d5f6f4ed92271edf5cc3c3c7107f3a_rle_crop_3794796641_0.png treat image : temp/1747122028_2007129_1357779834_e9d5f6f4ed92271edf5cc3c3c7107f3a_rle_crop_3794796650_0.png treat image : temp/1747122028_2007129_1357779834_e9d5f6f4ed92271edf5cc3c3c7107f3a_rle_crop_3794796642_0.png treat image : temp/1747122028_2007129_1357779834_e9d5f6f4ed92271edf5cc3c3c7107f3a_rle_crop_3794796643_0.png treat image : temp/1747122028_2007129_1357779834_e9d5f6f4ed92271edf5cc3c3c7107f3a_rle_crop_3794796652_0.png treat image : temp/1747122028_2007129_1357779834_e9d5f6f4ed92271edf5cc3c3c7107f3a_rle_crop_3794796648_0.png treat image : temp/1747122028_2007129_1357779805_57637535c38eb94000cba8a1d0e39f62_rle_crop_3794796665_0.png treat image : temp/1747122028_2007129_1357779805_57637535c38eb94000cba8a1d0e39f62_rle_crop_3794796662_0.png treat image : temp/1747122028_2007129_1357779805_57637535c38eb94000cba8a1d0e39f62_rle_crop_3794796666_0.png treat image : temp/1747122028_2007129_1357779805_57637535c38eb94000cba8a1d0e39f62_rle_crop_3794796663_0.png treat image : temp/1747122028_2007129_1357779805_57637535c38eb94000cba8a1d0e39f62_rle_crop_3794796668_0.png treat image : temp/1747122028_2007129_1357779805_57637535c38eb94000cba8a1d0e39f62_rle_crop_3794796657_0.png treat image : temp/1747122028_2007129_1357779805_57637535c38eb94000cba8a1d0e39f62_rle_crop_3794796654_0.png treat image : temp/1747122028_2007129_1357779805_57637535c38eb94000cba8a1d0e39f62_rle_crop_3794796661_0.png treat image : temp/1747122028_2007129_1357780327_8a45d823fb9722890c63bc64afc5aa1a_rle_crop_3794796552_0.png treat image : temp/1747122028_2007129_1357780212_3e0e8e8a63d544a4bd426eb18ead86ae_rle_crop_3794796597_0.png treat image : temp/1747122028_2007129_1357780212_3e0e8e8a63d544a4bd426eb18ead86ae_rle_crop_3794796579_0.png treat image : temp/1747122028_2007129_1357779920_efcad9d59ff9eba624570c06f6b4a492_rle_crop_3794796600_0.png treat image : temp/1747122028_2007129_1357779920_efcad9d59ff9eba624570c06f6b4a492_rle_crop_3794796602_0.png treat image : temp/1747122028_2007129_1357779892_572e21c625619c877be3b626abb81c4c_rle_crop_3794796628_0.png treat image : temp/1747122028_2007129_1357779864_f7a63752136ee09ecfed5bafd80ad9ff_rle_crop_3794796638_0.png treat image : temp/1747122028_2007129_1357779834_e9d5f6f4ed92271edf5cc3c3c7107f3a_rle_crop_3794796653_0.png treat image : temp/1747122028_2007129_1357779834_e9d5f6f4ed92271edf5cc3c3c7107f3a_rle_crop_3794796646_0.png treat image : temp/1747122028_2007129_1357779805_57637535c38eb94000cba8a1d0e39f62_rle_crop_3794796667_0.png treat image : temp/1747122028_2007129_1357780270_68fa8cf3a30ddb9441842ad87f1c759b_rle_crop_3794796575_0.png treat image : temp/1747122028_2007129_1357780327_8a45d823fb9722890c63bc64afc5aa1a_rle_crop_3794796564_0.png treat image : temp/1747122028_2007129_1357780327_8a45d823fb9722890c63bc64afc5aa1a_rle_crop_3794796563_0.png treat image : temp/1747122028_2007129_1357780327_8a45d823fb9722890c63bc64afc5aa1a_rle_crop_3794796562_0.png treat image : temp/1747122028_2007129_1357780327_8a45d823fb9722890c63bc64afc5aa1a_rle_crop_3794796557_0.png treat image : temp/1747122028_2007129_1357780327_8a45d823fb9722890c63bc64afc5aa1a_rle_crop_3794796553_0.png treat image : temp/1747122028_2007129_1357780327_8a45d823fb9722890c63bc64afc5aa1a_rle_crop_3794796549_0.png treat image : temp/1747122028_2007129_1357780270_68fa8cf3a30ddb9441842ad87f1c759b_rle_crop_3794796577_0.png treat image : temp/1747122028_2007129_1357780270_68fa8cf3a30ddb9441842ad87f1c759b_rle_crop_3794796578_0.png treat image : temp/1747122028_2007129_1357780270_68fa8cf3a30ddb9441842ad87f1c759b_rle_crop_3794796572_0.png treat image : temp/1747122028_2007129_1357780212_3e0e8e8a63d544a4bd426eb18ead86ae_rle_crop_3794796592_0.png treat image : temp/1747122028_2007129_1357780212_3e0e8e8a63d544a4bd426eb18ead86ae_rle_crop_3794796581_0.png treat image : temp/1747122028_2007129_1357780212_3e0e8e8a63d544a4bd426eb18ead86ae_rle_crop_3794796593_0.png treat image : temp/1747122028_2007129_1357780212_3e0e8e8a63d544a4bd426eb18ead86ae_rle_crop_3794796587_0.png treat image : temp/1747122028_2007129_1357780212_3e0e8e8a63d544a4bd426eb18ead86ae_rle_crop_3794796590_0.png treat image : temp/1747122028_2007129_1357780212_3e0e8e8a63d544a4bd426eb18ead86ae_rle_crop_3794796599_0.png treat image : temp/1747122028_2007129_1357780212_3e0e8e8a63d544a4bd426eb18ead86ae_rle_crop_3794796595_0.png treat image : temp/1747122028_2007129_1357780212_3e0e8e8a63d544a4bd426eb18ead86ae_rle_crop_3794796596_0.png treat image : temp/1747122028_2007129_1357780212_3e0e8e8a63d544a4bd426eb18ead86ae_rle_crop_3794796591_0.png treat image : temp/1747122028_2007129_1357780212_3e0e8e8a63d544a4bd426eb18ead86ae_rle_crop_3794796589_0.png treat image : temp/1747122028_2007129_1357779920_efcad9d59ff9eba624570c06f6b4a492_rle_crop_3794796612_0.png treat image : temp/1747122028_2007129_1357779920_efcad9d59ff9eba624570c06f6b4a492_rle_crop_3794796601_0.png treat image : temp/1747122028_2007129_1357779920_efcad9d59ff9eba624570c06f6b4a492_rle_crop_3794796608_0.png treat image : temp/1747122028_2007129_1357779920_efcad9d59ff9eba624570c06f6b4a492_rle_crop_3794796604_0.png treat image : temp/1747122028_2007129_1357779920_efcad9d59ff9eba624570c06f6b4a492_rle_crop_3794796611_0.png treat image : temp/1747122028_2007129_1357779920_efcad9d59ff9eba624570c06f6b4a492_rle_crop_3794796610_0.png treat image : temp/1747122028_2007129_1357779920_efcad9d59ff9eba624570c06f6b4a492_rle_crop_3794796607_0.png treat image : temp/1747122028_2007129_1357779920_efcad9d59ff9eba624570c06f6b4a492_rle_crop_3794796613_0.png treat image : temp/1747122028_2007129_1357779892_572e21c625619c877be3b626abb81c4c_rle_crop_3794796620_0.png treat image : temp/1747122028_2007129_1357779892_572e21c625619c877be3b626abb81c4c_rle_crop_3794796629_0.png treat image : temp/1747122028_2007129_1357779892_572e21c625619c877be3b626abb81c4c_rle_crop_3794796623_0.png treat image : temp/1747122028_2007129_1357779864_f7a63752136ee09ecfed5bafd80ad9ff_rle_crop_3794796631_0.png treat image : temp/1747122028_2007129_1357779864_f7a63752136ee09ecfed5bafd80ad9ff_rle_crop_3794796634_0.png treat image : temp/1747122028_2007129_1357779864_f7a63752136ee09ecfed5bafd80ad9ff_rle_crop_3794796635_0.png treat image : temp/1747122028_2007129_1357779864_f7a63752136ee09ecfed5bafd80ad9ff_rle_crop_3794796632_0.png treat image : temp/1747122028_2007129_1357779834_e9d5f6f4ed92271edf5cc3c3c7107f3a_rle_crop_3794796649_0.png treat image : temp/1747122028_2007129_1357779834_e9d5f6f4ed92271edf5cc3c3c7107f3a_rle_crop_3794796639_0.png treat image : temp/1747122028_2007129_1357779834_e9d5f6f4ed92271edf5cc3c3c7107f3a_rle_crop_3794796644_0.png treat image : temp/1747122028_2007129_1357779834_e9d5f6f4ed92271edf5cc3c3c7107f3a_rle_crop_3794796651_0.png treat image : temp/1747122028_2007129_1357779805_57637535c38eb94000cba8a1d0e39f62_rle_crop_3794796659_0.png treat image : temp/1747122028_2007129_1357779805_57637535c38eb94000cba8a1d0e39f62_rle_crop_3794796660_0.png treat image : temp/1747122028_2007129_1357779805_57637535c38eb94000cba8a1d0e39f62_rle_crop_3794796669_0.png treat image : temp/1747122028_2007129_1357779805_57637535c38eb94000cba8a1d0e39f62_rle_crop_3794796655_0.png treat image : temp/1747122028_2007129_1357779805_57637535c38eb94000cba8a1d0e39f62_rle_crop_3794796664_0.png treat image : temp/1747122028_2007129_1357779805_57637535c38eb94000cba8a1d0e39f62_rle_crop_3794796658_0.png treat image : temp/1747122028_2007129_1357779805_57637535c38eb94000cba8a1d0e39f62_rle_crop_3794796656_0.png treat image : temp/1747122028_2007129_1357780327_8a45d823fb9722890c63bc64afc5aa1a_rle_crop_3794796561_0.png treat image : temp/1747122028_2007129_1357780212_3e0e8e8a63d544a4bd426eb18ead86ae_rle_crop_3794796588_0.png treat image : temp/1747122028_2007129_1357779834_e9d5f6f4ed92271edf5cc3c3c7107f3a_rle_crop_3794796647_0.png treat image : temp/1747122028_2007129_1357779834_e9d5f6f4ed92271edf5cc3c3c7107f3a_rle_crop_3794796645_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 131 time used for this insertion : 0.027627229690551758 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 131 time used for this insertion : 0.35766172409057617 save missing photos in datou_result : time spend for datou_step_exec : 7.692229747772217 time spend to save output : 0.3904585838317871 total time spend for step 7 : 8.082688331604004 step8:velours_tree Tue May 13 09:48:04 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.2313377857208252 time spend to save output : 6.604194641113281e-05 total time spend for step 8 : 0.23140382766723633 step9:send_mail_cod Tue May 13 09:48:05 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P22915108_13-05-2025_09_48_05.pdf 22915258 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette229152581747122485 22915259 imagette229152591747122487 22915261 imagette229152611747122487 22915262 imagette229152621747122487 22915263 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette229152631747122487 22915264 imagette229152641747122488 22915265 imagette229152651747122488 22915266 change filename to text .imagette229152661747122488 22915267 change filename to text .change filename to text .change filename to text .change filename to text .imagette229152671747122488 22915268 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette229152681747122488 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=22915108 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/22915258,22915259,22915260,22915261,22915262,22915263,22915264,22915265,22915266,22915267,22915268?tags=papier,pet_fonce,environnement,pehd,mal_croppe,carton,flou,background,metal,autre,pet_clair args[1357780327] : ((1357780327, -0.647779839203833, 492688767), (1357780327, 0.052777604666311984, 2107752395), '0.13293756666439724') We are sending mail with results at report@fotonower.com args[1357780270] : ((1357780270, 1.1016588101724567, 492688767), (1357780270, 0.09714689760368454, 2107752395), '0.13293756666439724') We are sending mail with results at report@fotonower.com args[1357780212] : ((1357780212, -3.4849652514675458, 492609224), (1357780212, 0.2814860217984102, 2107752395), '0.13293756666439724') We are sending mail with results at report@fotonower.com args[1357779920] : ((1357779920, -0.38532808921797873, 492688767), (1357779920, 0.26364728053882486, 2107752395), '0.13293756666439724') We are sending mail with results at report@fotonower.com args[1357779892] : ((1357779892, 1.9386742550000666, 492688767), (1357779892, -0.0760564682471821, 496442774), '0.13293756666439724') We are sending mail with results at report@fotonower.com args[1357779864] : ((1357779864, 0.688222835698106, 492688767), (1357779864, 0.023964769418168757, 2107752395), '0.13293756666439724') We are sending mail with results at report@fotonower.com args[1357779834] : ((1357779834, -0.9046180416698832, 492688767), (1357779834, 0.2702127214400306, 2107752395), '0.13293756666439724') We are sending mail with results at report@fotonower.com args[1357779805] : ((1357779805, -5.040045845361828, 492609224), (1357779805, -0.031574775247125646, 2107752395), '0.13293756666439724') We are sending mail with results at report@fotonower.com refus_total : 0.13293756666439724 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=22915108 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22915108_13-05-2025_09_48_05.pdf results_Auto_P22915108_13-05-2025_09_48_05.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22915108_13-05-2025_09_48_05.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','22915108','results_Auto_P22915108_13-05-2025_09_48_05.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22915108_13-05-2025_09_48_05.pdf','pdf','','0.7','0.13293756666439724') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/22915108

https://www.fotonower.com/image?json=false&list_photos_id=1357780327
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1357780270
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.1016588101724567)
https://www.fotonower.com/image?json=false&list_photos_id=1357780212
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1357779920
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1357779892
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.9386742550000666)
https://www.fotonower.com/image?json=false&list_photos_id=1357779864
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1357779834
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1357779805
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 13.29%
Veuillez trouver les photos des contaminants.

exemples de contaminants: papier: https://www.fotonower.com/view/22915258?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/22915263?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/22915266?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/22915267?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/22915268?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22915108_13-05-2025_09_48_05.pdf.

Lien vers velours :https://www.fotonower.com/velours/22915258,22915259,22915260,22915261,22915262,22915263,22915264,22915265,22915266,22915267,22915268?tags=papier,pet_fonce,environnement,pehd,mal_croppe,carton,flou,background,metal,autre,pet_clair.


L'équipe Fotonower 202 b'' Server: nginx Date: Tue, 13 May 2025 07:48:12 GMT Content-Length: 0 Connection: close X-Message-Id: TuxvjtvcQ_2lx5C0DcnV-w Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1357780327, 1357780270, 1357780212, 1357779920, 1357779892, 1357779864, 1357779834, 1357779805] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2837781') ('3318', '22915108', '1357780327', None, None, None, None, None, '2837781') ('3318', None, None, None, None, None, None, None, '2837781') ('3318', '22915108', '1357780270', None, None, None, None, None, '2837781') ('3318', None, None, None, None, None, None, None, '2837781') ('3318', '22915108', '1357780212', None, None, None, None, None, '2837781') ('3318', None, None, None, None, None, None, None, '2837781') ('3318', '22915108', '1357779920', None, None, None, None, None, '2837781') ('3318', None, None, None, None, None, None, None, '2837781') ('3318', '22915108', '1357779892', None, None, None, None, None, '2837781') ('3318', None, None, None, None, None, None, None, '2837781') ('3318', '22915108', '1357779864', None, None, None, None, None, '2837781') ('3318', None, None, None, None, None, None, None, '2837781') ('3318', '22915108', '1357779834', None, None, None, None, None, '2837781') ('3318', None, None, None, None, None, None, None, '2837781') ('3318', '22915108', '1357779805', None, None, None, None, None, '2837781') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.08516263961791992 save_final save missing photos in datou_result : time spend for datou_step_exec : 7.774441480636597 time spend to save output : 0.08548879623413086 total time spend for step 9 : 7.8599302768707275 step10:split_time_score Tue May 13 09:48:13 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('08', 8),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 13052025 22915108 Nombre de photos uploadées : 8 / 23040 (0%) 13052025 22915108 Nombre de photos taguées (types de déchets): 0 / 8 (0%) 13052025 22915108 Nombre de photos taguées (volume) : 0 / 8 (0%) elapsed_time : load_data_split_time_score 3.337860107421875e-06 elapsed_time : order_list_meta_photo_and_scores 1.0251998901367188e-05 ???????? elapsed_time : fill_and_build_computed_from_old_data 0.0005688667297363281 elapsed_time : insert_dashboard_record_day_entry 0.026306629180908203 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22915102 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22915104 order by id desc limit 1 Qualite : 0.13293756666439724 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P22915108_13-05-2025_09_48_05.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 22915108 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=22915108 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'13052025': {'nb_upload': 8, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1357780327, 1357780270, 1357780212, 1357779920, 1357779892, 1357779864, 1357779834, 1357779805] Looping around the photos to save general results len do output : 1 /22915108Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2837781') ('3318', '22915108', '1357780327', None, None, None, None, None, '2837781') ('3318', None, None, None, None, None, None, None, '2837781') ('3318', '22915108', '1357780270', None, None, None, None, None, '2837781') ('3318', None, None, None, None, None, None, None, '2837781') ('3318', '22915108', '1357780212', None, None, None, None, None, '2837781') ('3318', None, None, None, None, None, None, None, '2837781') ('3318', '22915108', '1357779920', None, None, None, None, None, '2837781') ('3318', None, None, None, None, None, None, None, '2837781') ('3318', '22915108', '1357779892', None, None, None, None, None, '2837781') ('3318', None, None, None, None, None, None, None, '2837781') ('3318', '22915108', '1357779864', None, None, None, None, None, '2837781') ('3318', None, None, None, None, None, None, None, '2837781') ('3318', '22915108', '1357779834', None, None, None, None, None, '2837781') ('3318', None, None, None, None, None, None, None, '2837781') ('3318', '22915108', '1357779805', None, None, None, None, None, '2837781') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.01494741439819336 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.0792741775512695 time spend to save output : 0.015114784240722656 total time spend for step 10 : 2.094388961791992 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 8 set_done_treatment 125.55user 119.07system 7:50.16elapsed 52%CPU (0avgtext+0avgdata 4896428maxresident)k 645000inputs+79024outputs (546major+11426291minor)pagefaults 0swaps