python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 522432 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2956399'] with mtr_portfolio_ids : ['23347836'] and first list_photo_ids : [] new path : /proc/522432/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 9 ; length of list_pids : 9 ; length of list_args : 9 time to download the photos : 1.3682963848114014 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Mon May 26 17:20:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 6997 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-26 17:20:33.347455: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-26 17:20:33.375239: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-26 17:20:33.377634: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fa718000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-26 17:20:33.377709: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-26 17:20:33.382285: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-26 17:20:33.623274: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0xddd4f90 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-26 17:20:33.623358: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-26 17:20:33.624824: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-26 17:20:33.625344: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-26 17:20:33.628980: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-26 17:20:33.632340: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-26 17:20:33.632823: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-26 17:20:33.636235: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-26 17:20:33.637919: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-26 17:20:33.644118: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-26 17:20:33.645557: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-26 17:20:33.645658: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-26 17:20:33.646413: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-26 17:20:33.646439: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-26 17:20:33.646451: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-26 17:20:33.651633: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 6435 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-26 17:20:34.005887: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-26 17:20:34.006032: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-26 17:20:34.006070: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-26 17:20:34.006105: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-26 17:20:34.006139: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-26 17:20:34.006172: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-26 17:20:34.006203: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-26 17:20:34.006237: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-26 17:20:34.008128: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-26 17:20:34.010072: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-26 17:20:34.010226: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-26 17:20:34.010261: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-26 17:20:34.010289: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-26 17:20:34.010316: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-26 17:20:34.010344: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-26 17:20:34.010372: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-26 17:20:34.010401: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-26 17:20:34.012335: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-26 17:20:34.012408: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-26 17:20:34.012425: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-26 17:20:34.012438: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-26 17:20:34.014120: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 6435 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-05-26 17:20:46.250162: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-26 17:20:46.471611: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-26 17:20:48.056787: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 9 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 17.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 21 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 5.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 34 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 31 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 36 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 24 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 30 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 19.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 30 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 16.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 21 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 23 Detection mask done ! Trying to reset tf kernel 522972 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1797 tf kernel not reseted sub process len(results) : 9 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 9 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 6198 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0009493827819824219 nb_pixel_total : 28765 time to create 1 rle with old method : 0.03565359115600586 length of segment : 217 time for calcul the mask position with numpy : 0.004208564758300781 nb_pixel_total : 131603 time to create 1 rle with old method : 0.1629633903503418 length of segment : 446 time for calcul the mask position with numpy : 0.0005099773406982422 nb_pixel_total : 14351 time to create 1 rle with old method : 0.02290487289428711 length of segment : 159 time for calcul the mask position with numpy : 0.0007519721984863281 nb_pixel_total : 21265 time to create 1 rle with old method : 0.025270700454711914 length of segment : 323 time for calcul the mask position with numpy : 0.0007517337799072266 nb_pixel_total : 41084 time to create 1 rle with old method : 0.05218768119812012 length of segment : 174 time for calcul the mask position with numpy : 0.0008594989776611328 nb_pixel_total : 56559 time to create 1 rle with old method : 0.06887984275817871 length of segment : 177 time for calcul the mask position with numpy : 0.0003604888916015625 nb_pixel_total : 9958 time to create 1 rle with old method : 0.011762380599975586 length of segment : 152 time for calcul the mask position with numpy : 0.001733541488647461 nb_pixel_total : 56971 time to create 1 rle with old method : 0.06938529014587402 length of segment : 365 time for calcul the mask position with numpy : 0.0007832050323486328 nb_pixel_total : 34088 time to create 1 rle with old method : 0.04003453254699707 length of segment : 221 time for calcul the mask position with numpy : 0.005097150802612305 nb_pixel_total : 179308 time to create 1 rle with new method : 0.012104034423828125 length of segment : 532 time for calcul the mask position with numpy : 0.0023224353790283203 nb_pixel_total : 76335 time to create 1 rle with old method : 0.10493874549865723 length of segment : 305 time for calcul the mask position with numpy : 0.002519845962524414 nb_pixel_total : 119713 time to create 1 rle with old method : 0.1402573585510254 length of segment : 366 time for calcul the mask position with numpy : 0.0010139942169189453 nb_pixel_total : 50802 time to create 1 rle with old method : 0.06260299682617188 length of segment : 224 time for calcul the mask position with numpy : 0.0007381439208984375 nb_pixel_total : 37233 time to create 1 rle with old method : 0.04302501678466797 length of segment : 144 time for calcul the mask position with numpy : 0.0007848739624023438 nb_pixel_total : 43855 time to create 1 rle with old method : 0.05092668533325195 length of segment : 185 time for calcul the mask position with numpy : 0.00029158592224121094 nb_pixel_total : 14156 time to create 1 rle with old method : 0.016566991806030273 length of segment : 140 time for calcul the mask position with numpy : 0.0005588531494140625 nb_pixel_total : 24335 time to create 1 rle with old method : 0.033605337142944336 length of segment : 166 time for calcul the mask position with numpy : 0.005288362503051758 nb_pixel_total : 214464 time to create 1 rle with new method : 0.012847661972045898 length of segment : 529 time for calcul the mask position with numpy : 0.0003814697265625 nb_pixel_total : 17198 time to create 1 rle with old method : 0.020093202590942383 length of segment : 140 time for calcul the mask position with numpy : 0.0020389556884765625 nb_pixel_total : 89543 time to create 1 rle with old method : 0.10536503791809082 length of segment : 315 time for calcul the mask position with numpy : 0.0003447532653808594 nb_pixel_total : 14072 time to create 1 rle with old method : 0.016256093978881836 length of segment : 124 time for calcul the mask position with numpy : 0.001893758773803711 nb_pixel_total : 50004 time to create 1 rle with old method : 0.05761313438415527 length of segment : 278 time for calcul the mask position with numpy : 0.000759124755859375 nb_pixel_total : 35760 time to create 1 rle with old method : 0.05761361122131348 length of segment : 336 time for calcul the mask position with numpy : 0.0036134719848632812 nb_pixel_total : 93746 time to create 1 rle with old method : 0.10798525810241699 length of segment : 294 time for calcul the mask position with numpy : 0.0008807182312011719 nb_pixel_total : 20564 time to create 1 rle with old method : 0.024605274200439453 length of segment : 123 time for calcul the mask position with numpy : 0.004357099533081055 nb_pixel_total : 87828 time to create 1 rle with old method : 0.10456633567810059 length of segment : 608 time for calcul the mask position with numpy : 0.002878904342651367 nb_pixel_total : 70850 time to create 1 rle with old method : 0.08062338829040527 length of segment : 547 time for calcul the mask position with numpy : 0.00046706199645996094 nb_pixel_total : 9637 time to create 1 rle with old method : 0.01119375228881836 length of segment : 115 time for calcul the mask position with numpy : 0.0008020401000976562 nb_pixel_total : 19353 time to create 1 rle with old method : 0.022873640060424805 length of segment : 189 time for calcul the mask position with numpy : 0.0044939517974853516 nb_pixel_total : 118366 time to create 1 rle with old method : 0.13900017738342285 length of segment : 344 time for calcul the mask position with numpy : 0.00043511390686035156 nb_pixel_total : 8089 time to create 1 rle with old method : 0.009575128555297852 length of segment : 133 time for calcul the mask position with numpy : 0.00048804283142089844 nb_pixel_total : 10938 time to create 1 rle with old method : 0.012594461441040039 length of segment : 166 time for calcul the mask position with numpy : 0.0012426376342773438 nb_pixel_total : 35047 time to create 1 rle with old method : 0.04012727737426758 length of segment : 218 time for calcul the mask position with numpy : 0.0012199878692626953 nb_pixel_total : 33851 time to create 1 rle with old method : 0.0394744873046875 length of segment : 347 time for calcul the mask position with numpy : 0.0006568431854248047 nb_pixel_total : 13518 time to create 1 rle with old method : 0.01607489585876465 length of segment : 127 time for calcul the mask position with numpy : 0.001619577407836914 nb_pixel_total : 28879 time to create 1 rle with old method : 0.03438591957092285 length of segment : 192 time for calcul the mask position with numpy : 0.0017962455749511719 nb_pixel_total : 48682 time to create 1 rle with old method : 0.056606292724609375 length of segment : 226 time for calcul the mask position with numpy : 0.0026514530181884766 nb_pixel_total : 55482 time to create 1 rle with old method : 0.06818532943725586 length of segment : 367 time for calcul the mask position with numpy : 0.0027751922607421875 nb_pixel_total : 46651 time to create 1 rle with old method : 0.053495168685913086 length of segment : 310 time for calcul the mask position with numpy : 0.0016298294067382812 nb_pixel_total : 45871 time to create 1 rle with old method : 0.053200483322143555 length of segment : 366 time for calcul the mask position with numpy : 0.0008692741394042969 nb_pixel_total : 13726 time to create 1 rle with old method : 0.01596856117248535 length of segment : 127 time for calcul the mask position with numpy : 0.0013511180877685547 nb_pixel_total : 22535 time to create 1 rle with old method : 0.02793097496032715 length of segment : 226 time for calcul the mask position with numpy : 0.0028891563415527344 nb_pixel_total : 59592 time to create 1 rle with old method : 0.07399749755859375 length of segment : 471 time for calcul the mask position with numpy : 0.002463817596435547 nb_pixel_total : 68499 time to create 1 rle with old method : 0.08197355270385742 length of segment : 264 time for calcul the mask position with numpy : 0.0011205673217773438 nb_pixel_total : 22206 time to create 1 rle with old method : 0.036797523498535156 length of segment : 140 time for calcul the mask position with numpy : 0.0010001659393310547 nb_pixel_total : 26542 time to create 1 rle with old method : 0.030173301696777344 length of segment : 238 time for calcul the mask position with numpy : 0.0013153553009033203 nb_pixel_total : 38967 time to create 1 rle with old method : 0.04626965522766113 length of segment : 205 time for calcul the mask position with numpy : 0.0014123916625976562 nb_pixel_total : 48680 time to create 1 rle with old method : 0.057653188705444336 length of segment : 185 time for calcul the mask position with numpy : 0.0011096000671386719 nb_pixel_total : 23732 time to create 1 rle with old method : 0.027840852737426758 length of segment : 139 time for calcul the mask position with numpy : 0.007300376892089844 nb_pixel_total : 176852 time to create 1 rle with new method : 0.014099359512329102 length of segment : 630 time for calcul the mask position with numpy : 0.003598928451538086 nb_pixel_total : 75361 time to create 1 rle with old method : 0.08742809295654297 length of segment : 460 time for calcul the mask position with numpy : 0.0005865097045898438 nb_pixel_total : 13231 time to create 1 rle with old method : 0.015186071395874023 length of segment : 155 time for calcul the mask position with numpy : 0.0005846023559570312 nb_pixel_total : 13024 time to create 1 rle with old method : 0.015169382095336914 length of segment : 155 time for calcul the mask position with numpy : 0.001405477523803711 nb_pixel_total : 41220 time to create 1 rle with old method : 0.04750418663024902 length of segment : 223 time for calcul the mask position with numpy : 0.00032401084899902344 nb_pixel_total : 5458 time to create 1 rle with old method : 0.006542205810546875 length of segment : 69 time for calcul the mask position with numpy : 0.0031728744506835938 nb_pixel_total : 75867 time to create 1 rle with old method : 0.08610224723815918 length of segment : 311 time for calcul the mask position with numpy : 0.0027806758880615234 nb_pixel_total : 104937 time to create 1 rle with old method : 0.11824154853820801 length of segment : 362 time for calcul the mask position with numpy : 0.001965045928955078 nb_pixel_total : 19497 time to create 1 rle with old method : 0.022803544998168945 length of segment : 213 time for calcul the mask position with numpy : 0.0013248920440673828 nb_pixel_total : 32899 time to create 1 rle with old method : 0.03840517997741699 length of segment : 170 time for calcul the mask position with numpy : 0.001394510269165039 nb_pixel_total : 52416 time to create 1 rle with old method : 0.06320905685424805 length of segment : 227 time for calcul the mask position with numpy : 0.002264738082885742 nb_pixel_total : 73235 time to create 1 rle with old method : 0.0822150707244873 length of segment : 329 time for calcul the mask position with numpy : 0.0006232261657714844 nb_pixel_total : 21256 time to create 1 rle with old method : 0.02430248260498047 length of segment : 122 time for calcul the mask position with numpy : 0.0022249221801757812 nb_pixel_total : 72124 time to create 1 rle with old method : 0.08556556701660156 length of segment : 332 time for calcul the mask position with numpy : 0.0009140968322753906 nb_pixel_total : 29822 time to create 1 rle with old method : 0.03430461883544922 length of segment : 168 time for calcul the mask position with numpy : 0.0011615753173828125 nb_pixel_total : 54215 time to create 1 rle with old method : 0.06323122978210449 length of segment : 133 time for calcul the mask position with numpy : 0.003959178924560547 nb_pixel_total : 138493 time to create 1 rle with old method : 0.15993261337280273 length of segment : 357 time for calcul the mask position with numpy : 0.0016169548034667969 nb_pixel_total : 56884 time to create 1 rle with old method : 0.06465435028076172 length of segment : 252 time for calcul the mask position with numpy : 0.0012156963348388672 nb_pixel_total : 35761 time to create 1 rle with old method : 0.04126548767089844 length of segment : 203 time for calcul the mask position with numpy : 0.0015444755554199219 nb_pixel_total : 67365 time to create 1 rle with old method : 0.07761669158935547 length of segment : 334 time for calcul the mask position with numpy : 0.0006389617919921875 nb_pixel_total : 15225 time to create 1 rle with old method : 0.017416715621948242 length of segment : 125 time for calcul the mask position with numpy : 0.001478433609008789 nb_pixel_total : 55504 time to create 1 rle with old method : 0.064117431640625 length of segment : 241 time for calcul the mask position with numpy : 0.0004913806915283203 nb_pixel_total : 11610 time to create 1 rle with old method : 0.013820171356201172 length of segment : 115 time for calcul the mask position with numpy : 0.0019268989562988281 nb_pixel_total : 76639 time to create 1 rle with old method : 0.08793282508850098 length of segment : 309 time for calcul the mask position with numpy : 0.0012362003326416016 nb_pixel_total : 21957 time to create 1 rle with old method : 0.02541828155517578 length of segment : 262 time for calcul the mask position with numpy : 0.0012693405151367188 nb_pixel_total : 45216 time to create 1 rle with old method : 0.052758216857910156 length of segment : 154 time for calcul the mask position with numpy : 0.005748271942138672 nb_pixel_total : 162436 time to create 1 rle with new method : 0.0117950439453125 length of segment : 586 time for calcul the mask position with numpy : 0.0030243396759033203 nb_pixel_total : 109078 time to create 1 rle with old method : 0.12273406982421875 length of segment : 387 time for calcul the mask position with numpy : 0.0021431446075439453 nb_pixel_total : 65336 time to create 1 rle with old method : 0.07430696487426758 length of segment : 197 time for calcul the mask position with numpy : 0.0015711784362792969 nb_pixel_total : 45312 time to create 1 rle with old method : 0.0524594783782959 length of segment : 274 time for calcul the mask position with numpy : 0.0008914470672607422 nb_pixel_total : 32437 time to create 1 rle with old method : 0.0387575626373291 length of segment : 100 time for calcul the mask position with numpy : 0.0007867813110351562 nb_pixel_total : 17790 time to create 1 rle with old method : 0.022792577743530273 length of segment : 101 time for calcul the mask position with numpy : 0.00030803680419921875 nb_pixel_total : 8389 time to create 1 rle with old method : 0.009969711303710938 length of segment : 66 time for calcul the mask position with numpy : 0.0021305084228515625 nb_pixel_total : 62179 time to create 1 rle with old method : 0.07222390174865723 length of segment : 227 time for calcul the mask position with numpy : 0.002040386199951172 nb_pixel_total : 58503 time to create 1 rle with old method : 0.06659793853759766 length of segment : 383 time for calcul the mask position with numpy : 0.000431060791015625 nb_pixel_total : 15496 time to create 1 rle with old method : 0.01822209358215332 length of segment : 104 time for calcul the mask position with numpy : 0.0013890266418457031 nb_pixel_total : 28254 time to create 1 rle with old method : 0.03254199028015137 length of segment : 275 time for calcul the mask position with numpy : 0.0020132064819335938 nb_pixel_total : 46981 time to create 1 rle with old method : 0.05417037010192871 length of segment : 335 time for calcul the mask position with numpy : 0.0013275146484375 nb_pixel_total : 46287 time to create 1 rle with old method : 0.05325937271118164 length of segment : 246 time for calcul the mask position with numpy : 0.0017342567443847656 nb_pixel_total : 44929 time to create 1 rle with old method : 0.05295062065124512 length of segment : 220 time for calcul the mask position with numpy : 0.0034499168395996094 nb_pixel_total : 130178 time to create 1 rle with old method : 0.158050537109375 length of segment : 510 time for calcul the mask position with numpy : 0.00130462646484375 nb_pixel_total : 30360 time to create 1 rle with old method : 0.03501152992248535 length of segment : 267 time for calcul the mask position with numpy : 0.0020644664764404297 nb_pixel_total : 55456 time to create 1 rle with old method : 0.06567096710205078 length of segment : 256 time for calcul the mask position with numpy : 0.0015552043914794922 nb_pixel_total : 37358 time to create 1 rle with old method : 0.04268980026245117 length of segment : 291 time for calcul the mask position with numpy : 0.000982522964477539 nb_pixel_total : 23010 time to create 1 rle with old method : 0.026699066162109375 length of segment : 225 time for calcul the mask position with numpy : 0.0010800361633300781 nb_pixel_total : 20075 time to create 1 rle with old method : 0.023756742477416992 length of segment : 258 time for calcul the mask position with numpy : 0.0008304119110107422 nb_pixel_total : 22877 time to create 1 rle with old method : 0.030770301818847656 length of segment : 129 time for calcul the mask position with numpy : 0.009710311889648438 nb_pixel_total : 130808 time to create 1 rle with old method : 0.1521003246307373 length of segment : 412 time for calcul the mask position with numpy : 0.0027556419372558594 nb_pixel_total : 105105 time to create 1 rle with old method : 0.12039661407470703 length of segment : 319 time for calcul the mask position with numpy : 0.009221315383911133 nb_pixel_total : 261399 time to create 1 rle with new method : 0.03412580490112305 length of segment : 597 time for calcul the mask position with numpy : 0.000553131103515625 nb_pixel_total : 11876 time to create 1 rle with old method : 0.013873815536499023 length of segment : 151 time for calcul the mask position with numpy : 0.00043964385986328125 nb_pixel_total : 11194 time to create 1 rle with old method : 0.013356447219848633 length of segment : 89 time for calcul the mask position with numpy : 0.003498554229736328 nb_pixel_total : 98402 time to create 1 rle with old method : 0.11266303062438965 length of segment : 560 time for calcul the mask position with numpy : 0.0009057521820068359 nb_pixel_total : 30752 time to create 1 rle with old method : 0.03536367416381836 length of segment : 234 time for calcul the mask position with numpy : 0.0007283687591552734 nb_pixel_total : 24311 time to create 1 rle with old method : 0.028079986572265625 length of segment : 141 time for calcul the mask position with numpy : 0.0016350746154785156 nb_pixel_total : 54170 time to create 1 rle with old method : 0.0625007152557373 length of segment : 310 time for calcul the mask position with numpy : 0.0003705024719238281 nb_pixel_total : 6997 time to create 1 rle with old method : 0.008280515670776367 length of segment : 102 time for calcul the mask position with numpy : 0.002667665481567383 nb_pixel_total : 80244 time to create 1 rle with old method : 0.0913398265838623 length of segment : 329 time for calcul the mask position with numpy : 0.0005850791931152344 nb_pixel_total : 15460 time to create 1 rle with old method : 0.02550029754638672 length of segment : 131 time for calcul the mask position with numpy : 0.0006220340728759766 nb_pixel_total : 16435 time to create 1 rle with old method : 0.01905536651611328 length of segment : 163 time for calcul the mask position with numpy : 0.0010194778442382812 nb_pixel_total : 27767 time to create 1 rle with old method : 0.031694889068603516 length of segment : 210 time for calcul the mask position with numpy : 0.006085395812988281 nb_pixel_total : 165400 time to create 1 rle with new method : 0.015186786651611328 length of segment : 551 time for calcul the mask position with numpy : 0.0005352497100830078 nb_pixel_total : 13223 time to create 1 rle with old method : 0.01554250717163086 length of segment : 139 time for calcul the mask position with numpy : 0.0007758140563964844 nb_pixel_total : 18042 time to create 1 rle with old method : 0.02056264877319336 length of segment : 252 time for calcul the mask position with numpy : 0.005473613739013672 nb_pixel_total : 117338 time to create 1 rle with old method : 0.13417625427246094 length of segment : 357 time for calcul the mask position with numpy : 0.00043082237243652344 nb_pixel_total : 11787 time to create 1 rle with old method : 0.013669252395629883 length of segment : 95 time for calcul the mask position with numpy : 0.004259347915649414 nb_pixel_total : 101084 time to create 1 rle with old method : 0.11245274543762207 length of segment : 387 time for calcul the mask position with numpy : 0.0011131763458251953 nb_pixel_total : 33210 time to create 1 rle with old method : 0.03715682029724121 length of segment : 373 time for calcul the mask position with numpy : 0.0008516311645507812 nb_pixel_total : 12883 time to create 1 rle with old method : 0.01466989517211914 length of segment : 232 time for calcul the mask position with numpy : 0.0008320808410644531 nb_pixel_total : 26955 time to create 1 rle with old method : 0.0307161808013916 length of segment : 200 time for calcul the mask position with numpy : 0.0006744861602783203 nb_pixel_total : 15214 time to create 1 rle with old method : 0.017956256866455078 length of segment : 130 time for calcul the mask position with numpy : 0.00032830238342285156 nb_pixel_total : 6473 time to create 1 rle with old method : 0.007727861404418945 length of segment : 93 time spent for convertir_results : 11.411579608917236 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 121 chid ids of type : 3594 Number RLEs to save : 31090 save missing photos in datou_result : time spend for datou_step_exec : 74.86589431762695 time spend to save output : 1.868837594985962 total time spend for step 1 : 76.73473191261292 step2:crop_condition Mon May 26 17:21:47 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 9 ! batch 1 Loaded 121 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 58 About to insert : list_path_to_insert length 58 new photo from crops ! About to upload 58 photos upload in portfolio : 3736932 init cache_photo without model_param we have 58 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748272921_522432 we have uploaded 58 photos in the portfolio 3736932 time of upload the photos Elapsed time : 12.90553331375122 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 10 About to insert : list_path_to_insert length 10 new photo from crops ! About to upload 10 photos upload in portfolio : 3736932 init cache_photo without model_param we have 10 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748272937_522432 we have uploaded 10 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.4805121421813965 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 51 About to insert : list_path_to_insert length 51 new photo from crops ! About to upload 51 photos upload in portfolio : 3736932 init cache_photo without model_param we have 51 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748272958_522432 we have uploaded 51 photos in the portfolio 3736932 time of upload the photos Elapsed time : 12.005744695663452 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1748272971_522432 we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.6834921836853027 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1361088944, 1361088898, 1361088813, 1361088774, 1361088772, 1361088770, 1361088749, 1361088745, 1361088742] Looping around the photos to save general results len do output : 121 /1361118351Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118352Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118353Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118354Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118355Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118356Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118357Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118358Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118359Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118360Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118361Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118362Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118363Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118364Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118365Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118366Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118367Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118368Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118369Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118370Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118371Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118372Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118373Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118374Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118376Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118377Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118378Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118379Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118380Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118381Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118382Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118383Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118384Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118385Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118386Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118387Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118388Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118389Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118390Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118391Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118392Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118393Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118394Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118395Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118396Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118397Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118398Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118399Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118401Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118402Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118403Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118404Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118405Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118406Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118407Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118409Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118410Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118411Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118417Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118418Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118419Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118420Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118421Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118422Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118423Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118424Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118425Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118426Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118455Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118456Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118457Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118458Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118459Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118460Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118461Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118462Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118464Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118465Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118466Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118467Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118468Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118469Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118470Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118471Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118472Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118473Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118474Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118475Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118476Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118477Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118478Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118479Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118480Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118481Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118482Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118483Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118484Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118485Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118486Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118487Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118488Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118489Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118490Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118491Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118492Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118493Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118494Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118495Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118496Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118497Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118498Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118499Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118500Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118501Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118502Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118503Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118504Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118505Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118506Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118509Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1361118510Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2956399') ('3318', '23347836', '1361088944', None, None, None, None, None, '2956399') ('3318', None, None, None, None, None, None, None, '2956399') ('3318', '23347836', '1361088898', None, None, None, None, None, '2956399') ('3318', None, None, None, None, None, None, None, '2956399') ('3318', '23347836', '1361088813', None, None, None, None, None, '2956399') ('3318', None, None, None, None, None, None, None, '2956399') ('3318', '23347836', '1361088774', None, None, None, None, None, '2956399') ('3318', None, None, None, None, None, None, None, '2956399') ('3318', '23347836', '1361088772', None, None, None, None, None, '2956399') ('3318', None, None, None, None, None, None, None, '2956399') ('3318', '23347836', '1361088770', None, None, None, None, None, '2956399') ('3318', None, None, None, None, None, None, None, '2956399') ('3318', '23347836', '1361088749', None, None, None, None, None, '2956399') ('3318', None, None, None, None, None, None, None, '2956399') ('3318', '23347836', '1361088745', None, None, None, None, None, '2956399') ('3318', None, None, None, None, None, None, None, '2956399') ('3318', '23347836', '1361088742', None, None, None, None, None, '2956399') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 372 time used for this insertion : 0.02857804298400879 save_final save missing photos in datou_result : time spend for datou_step_exec : 64.88898396492004 time spend to save output : 0.03314614295959473 total time spend for step 2 : 64.92213010787964 step3:rle_unique_nms_with_priority Mon May 26 17:22:52 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 121 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 9 nb_hashtags : 3 time to prepare the origin masks : 5.551193952560425 time for calcul the mask position with numpy : 0.9337427616119385 nb_pixel_total : 6655596 time to create 1 rle with new method : 1.0169546604156494 time for calcul the mask position with numpy : 0.038103580474853516 nb_pixel_total : 34088 time to create 1 rle with old method : 0.03863263130187988 time for calcul the mask position with numpy : 0.036373138427734375 nb_pixel_total : 56971 time to create 1 rle with old method : 0.06473350524902344 time for calcul the mask position with numpy : 0.02241230010986328 nb_pixel_total : 9958 time to create 1 rle with old method : 0.01649951934814453 time for calcul the mask position with numpy : 0.023456811904907227 nb_pixel_total : 56559 time to create 1 rle with old method : 0.0658266544342041 time for calcul the mask position with numpy : 0.023374080657958984 nb_pixel_total : 41084 time to create 1 rle with old method : 0.04556536674499512 time for calcul the mask position with numpy : 0.024071455001831055 nb_pixel_total : 21265 time to create 1 rle with old method : 0.02444911003112793 time for calcul the mask position with numpy : 0.02427077293395996 nb_pixel_total : 14351 time to create 1 rle with old method : 0.01645660400390625 time for calcul the mask position with numpy : 0.024771928787231445 nb_pixel_total : 131603 time to create 1 rle with old method : 0.1544640064239502 time for calcul the mask position with numpy : 0.023684978485107422 nb_pixel_total : 28765 time to create 1 rle with old method : 0.03228592872619629 create new chi : 2.6938273906707764 time to delete rle : 0.030651569366455078 batch 1 Loaded 19 chid ids of type : 3594 ++++++++++++++++Number RLEs to save : 6628 TO DO : save crop sub photo not yet done ! save time : 0.42547082901000977 nb_obj : 21 nb_hashtags : 2 time to prepare the origin masks : 11.423863887786865 time for calcul the mask position with numpy : 0.3838386535644531 nb_pixel_total : 5663118 time to create 1 rle with new method : 1.1150472164154053 time for calcul the mask position with numpy : 0.04062628746032715 nb_pixel_total : 118366 time to create 1 rle with old method : 0.13421297073364258 time for calcul the mask position with numpy : 0.03544211387634277 nb_pixel_total : 19353 time to create 1 rle with old method : 0.02156209945678711 time for calcul the mask position with numpy : 0.03528332710266113 nb_pixel_total : 9637 time to create 1 rle with old method : 0.011212587356567383 time for calcul the mask position with numpy : 0.04294943809509277 nb_pixel_total : 70850 time to create 1 rle with old method : 0.08606505393981934 time for calcul the mask position with numpy : 0.03648185729980469 nb_pixel_total : 87828 time to create 1 rle with old method : 0.11078023910522461 time for calcul the mask position with numpy : 0.02605915069580078 nb_pixel_total : 20564 time to create 1 rle with old method : 0.025827646255493164 time for calcul the mask position with numpy : 0.0252685546875 nb_pixel_total : 93746 time to create 1 rle with old method : 0.10270333290100098 time for calcul the mask position with numpy : 0.023066282272338867 nb_pixel_total : 35760 time to create 1 rle with old method : 0.04156208038330078 time for calcul the mask position with numpy : 0.02922511100769043 nb_pixel_total : 50004 time to create 1 rle with old method : 0.05632448196411133 time for calcul the mask position with numpy : 0.02420520782470703 nb_pixel_total : 14072 time to create 1 rle with old method : 0.016379594802856445 time for calcul the mask position with numpy : 0.024072647094726562 nb_pixel_total : 89543 time to create 1 rle with old method : 0.10102272033691406 time for calcul the mask position with numpy : 0.03324079513549805 nb_pixel_total : 17198 time to create 1 rle with old method : 0.022707462310791016 time for calcul the mask position with numpy : 0.02694869041442871 nb_pixel_total : 214464 time to create 1 rle with new method : 0.7777810096740723 time for calcul the mask position with numpy : 0.021526098251342773 nb_pixel_total : 24335 time to create 1 rle with old method : 0.027132034301757812 time for calcul the mask position with numpy : 0.021324634552001953 nb_pixel_total : 14156 time to create 1 rle with old method : 0.015509366989135742 time for calcul the mask position with numpy : 0.021869897842407227 nb_pixel_total : 43855 time to create 1 rle with old method : 0.04783463478088379 time for calcul the mask position with numpy : 0.021782875061035156 nb_pixel_total : 37233 time to create 1 rle with old method : 0.041216135025024414 time for calcul the mask position with numpy : 0.021760940551757812 nb_pixel_total : 50802 time to create 1 rle with old method : 0.05887866020202637 time for calcul the mask position with numpy : 0.021843433380126953 nb_pixel_total : 119713 time to create 1 rle with old method : 0.1311633586883545 time for calcul the mask position with numpy : 0.02206110954284668 nb_pixel_total : 76335 time to create 1 rle with old method : 0.08261656761169434 time for calcul the mask position with numpy : 0.02248978614807129 nb_pixel_total : 179308 time to create 1 rle with new method : 0.6272556781768799 create new chi : 4.706785202026367 time to delete rle : 0.0020418167114257812 batch 1 Loaded 43 chid ids of type : 3594 +++++++++++++++++++++++++Number RLEs to save : 14168 TO DO : save crop sub photo not yet done ! save time : 0.8736822605133057 nb_obj : 11 nb_hashtags : 3 time to prepare the origin masks : 5.199254035949707 time for calcul the mask position with numpy : 0.9187600612640381 nb_pixel_total : 6709506 time to create 1 rle with new method : 1.126577377319336 time for calcul the mask position with numpy : 0.024681806564331055 nb_pixel_total : 13726 time to create 1 rle with old method : 0.015386581420898438 time for calcul the mask position with numpy : 0.027363061904907227 nb_pixel_total : 45871 time to create 1 rle with old method : 0.05638408660888672 time for calcul the mask position with numpy : 0.02306342124938965 nb_pixel_total : 46651 time to create 1 rle with old method : 0.05304670333862305 time for calcul the mask position with numpy : 0.023906946182250977 nb_pixel_total : 55482 time to create 1 rle with old method : 0.06278753280639648 time for calcul the mask position with numpy : 0.0233917236328125 nb_pixel_total : 48682 time to create 1 rle with old method : 0.054318904876708984 time for calcul the mask position with numpy : 0.023700475692749023 nb_pixel_total : 28879 time to create 1 rle with old method : 0.03190159797668457 time for calcul the mask position with numpy : 0.022895097732543945 nb_pixel_total : 13518 time to create 1 rle with old method : 0.01517939567565918 time for calcul the mask position with numpy : 0.03285026550292969 nb_pixel_total : 33851 time to create 1 rle with old method : 0.036618947982788086 time for calcul the mask position with numpy : 0.03371763229370117 nb_pixel_total : 35047 time to create 1 rle with old method : 0.03950333595275879 time for calcul the mask position with numpy : 0.0356287956237793 nb_pixel_total : 10938 time to create 1 rle with old method : 0.012469768524169922 time for calcul the mask position with numpy : 0.03343033790588379 nb_pixel_total : 8089 time to create 1 rle with old method : 0.008804798126220703 create new chi : 2.781843662261963 time to delete rle : 0.0012674331665039062 batch 1 Loaded 23 chid ids of type : 3594 ++++++++++++++++Number RLEs to save : 7318 TO DO : save crop sub photo not yet done ! save time : 0.5167710781097412 nb_obj : 15 nb_hashtags : 3 time to prepare the origin masks : 7.06086802482605 time for calcul the mask position with numpy : 0.7062873840332031 nb_pixel_total : 6338474 time to create 1 rle with new method : 1.813014268875122 time for calcul the mask position with numpy : 0.03771853446960449 nb_pixel_total : 75867 time to create 1 rle with old method : 0.09240078926086426 time for calcul the mask position with numpy : 0.041712045669555664 nb_pixel_total : 5458 time to create 1 rle with old method : 0.006308078765869141 time for calcul the mask position with numpy : 0.03847384452819824 nb_pixel_total : 41220 time to create 1 rle with old method : 0.047026634216308594 time for calcul the mask position with numpy : 0.03625631332397461 nb_pixel_total : 13024 time to create 1 rle with old method : 0.014629602432250977 time for calcul the mask position with numpy : 0.03854632377624512 nb_pixel_total : 13231 time to create 1 rle with old method : 0.014823675155639648 time for calcul the mask position with numpy : 0.040444374084472656 nb_pixel_total : 75361 time to create 1 rle with old method : 0.08771324157714844 time for calcul the mask position with numpy : 0.0391390323638916 nb_pixel_total : 176852 time to create 1 rle with new method : 0.62746262550354 time for calcul the mask position with numpy : 0.03706526756286621 nb_pixel_total : 23732 time to create 1 rle with old method : 0.026716947555541992 time for calcul the mask position with numpy : 0.0400083065032959 nb_pixel_total : 48680 time to create 1 rle with old method : 0.07298111915588379 time for calcul the mask position with numpy : 0.046894073486328125 nb_pixel_total : 38967 time to create 1 rle with old method : 0.04334115982055664 time for calcul the mask position with numpy : 0.03957319259643555 nb_pixel_total : 26542 time to create 1 rle with old method : 0.033470869064331055 time for calcul the mask position with numpy : 0.04102802276611328 nb_pixel_total : 22206 time to create 1 rle with old method : 0.024862289428710938 time for calcul the mask position with numpy : 0.03203845024108887 nb_pixel_total : 68499 time to create 1 rle with old method : 0.09380865097045898 time for calcul the mask position with numpy : 0.03137707710266113 nb_pixel_total : 59592 time to create 1 rle with old method : 0.0664205551147461 time for calcul the mask position with numpy : 0.024077653884887695 nb_pixel_total : 22535 time to create 1 rle with old method : 0.026633024215698242 create new chi : 4.431689262390137 time to delete rle : 0.002149343490600586 batch 1 Loaded 31 chid ids of type : 3594 +++++++++++++++++Number RLEs to save : 9902 TO DO : save crop sub photo not yet done ! save time : 0.6238288879394531 nb_obj : 17 nb_hashtags : 3 time to prepare the origin masks : 9.763628721237183 time for calcul the mask position with numpy : 0.6145198345184326 nb_pixel_total : 6132358 time to create 1 rle with new method : 0.7110116481781006 time for calcul the mask position with numpy : 0.03490281105041504 nb_pixel_total : 76639 time to create 1 rle with old method : 0.0844261646270752 time for calcul the mask position with numpy : 0.03434920310974121 nb_pixel_total : 11610 time to create 1 rle with old method : 0.013496875762939453 time for calcul the mask position with numpy : 0.03443408012390137 nb_pixel_total : 55504 time to create 1 rle with old method : 0.06068539619445801 time for calcul the mask position with numpy : 0.033522844314575195 nb_pixel_total : 15225 time to create 1 rle with old method : 0.01642465591430664 time for calcul the mask position with numpy : 0.03423881530761719 nb_pixel_total : 67365 time to create 1 rle with old method : 0.07269072532653809 time for calcul the mask position with numpy : 0.03404808044433594 nb_pixel_total : 35761 time to create 1 rle with old method : 0.03778648376464844 time for calcul the mask position with numpy : 0.031671762466430664 nb_pixel_total : 56884 time to create 1 rle with old method : 0.06447410583496094 time for calcul the mask position with numpy : 0.03380393981933594 nb_pixel_total : 138493 time to create 1 rle with old method : 0.14680838584899902 time for calcul the mask position with numpy : 0.03192019462585449 nb_pixel_total : 54215 time to create 1 rle with old method : 0.05762028694152832 time for calcul the mask position with numpy : 0.021135807037353516 nb_pixel_total : 29822 time to create 1 rle with old method : 0.03201413154602051 time for calcul the mask position with numpy : 0.020034313201904297 nb_pixel_total : 72124 time to create 1 rle with old method : 0.07581043243408203 time for calcul the mask position with numpy : 0.020522117614746094 nb_pixel_total : 21256 time to create 1 rle with old method : 0.022432565689086914 time for calcul the mask position with numpy : 0.01990342140197754 nb_pixel_total : 73235 time to create 1 rle with old method : 0.07628893852233887 time for calcul the mask position with numpy : 0.01957988739013672 nb_pixel_total : 52416 time to create 1 rle with old method : 0.05408835411071777 time for calcul the mask position with numpy : 0.020119428634643555 nb_pixel_total : 32899 time to create 1 rle with old method : 0.03549456596374512 time for calcul the mask position with numpy : 0.021077632904052734 nb_pixel_total : 19497 time to create 1 rle with old method : 0.02096080780029297 time for calcul the mask position with numpy : 0.021026611328125 nb_pixel_total : 104937 time to create 1 rle with old method : 0.1119852066040039 create new chi : 2.8134074211120605 time to delete rle : 0.001512289047241211 batch 1 Loaded 35 chid ids of type : 3594 ++++++++++++++++++Number RLEs to save : 10144 TO DO : save crop sub photo not yet done ! save time : 0.6441755294799805 nb_obj : 15 nb_hashtags : 4 time to prepare the origin masks : 8.930522203445435 time for calcul the mask position with numpy : 0.5679473876953125 nb_pixel_total : 6284589 time to create 1 rle with new method : 0.6683404445648193 time for calcul the mask position with numpy : 0.04205727577209473 nb_pixel_total : 46287 time to create 1 rle with old method : 0.05283498764038086 time for calcul the mask position with numpy : 0.024916648864746094 nb_pixel_total : 46981 time to create 1 rle with old method : 0.055082082748413086 time for calcul the mask position with numpy : 0.02368783950805664 nb_pixel_total : 28254 time to create 1 rle with old method : 0.03265094757080078 time for calcul the mask position with numpy : 0.024992942810058594 nb_pixel_total : 15496 time to create 1 rle with old method : 0.018352985382080078 time for calcul the mask position with numpy : 0.028798818588256836 nb_pixel_total : 58503 time to create 1 rle with old method : 0.06685757637023926 time for calcul the mask position with numpy : 0.024979114532470703 nb_pixel_total : 62179 time to create 1 rle with old method : 0.07087373733520508 time for calcul the mask position with numpy : 0.022595882415771484 nb_pixel_total : 8389 time to create 1 rle with old method : 0.009827375411987305 time for calcul the mask position with numpy : 0.026702165603637695 nb_pixel_total : 17790 time to create 1 rle with old method : 0.02044200897216797 time for calcul the mask position with numpy : 0.027233123779296875 nb_pixel_total : 32437 time to create 1 rle with old method : 0.03972959518432617 time for calcul the mask position with numpy : 0.028568029403686523 nb_pixel_total : 45312 time to create 1 rle with old method : 0.05130600929260254 time for calcul the mask position with numpy : 0.027454614639282227 nb_pixel_total : 65336 time to create 1 rle with old method : 0.07331585884094238 time for calcul the mask position with numpy : 0.026215314865112305 nb_pixel_total : 109078 time to create 1 rle with old method : 0.12263870239257812 time for calcul the mask position with numpy : 0.029308557510375977 nb_pixel_total : 162436 time to create 1 rle with new method : 0.5095970630645752 time for calcul the mask position with numpy : 0.025207042694091797 nb_pixel_total : 45216 time to create 1 rle with old method : 0.050289154052734375 time for calcul the mask position with numpy : 0.02781510353088379 nb_pixel_total : 21957 time to create 1 rle with old method : 0.024642229080200195 create new chi : 2.923426866531372 time to delete rle : 0.002870321273803711 batch 1 Loaded 31 chid ids of type : 3594 +++++++++++++++Number RLEs to save : 9554 TO DO : save crop sub photo not yet done ! save time : 0.9537196159362793 nb_obj : 11 nb_hashtags : 3 time to prepare the origin masks : 5.698830604553223 time for calcul the mask position with numpy : 1.0093135833740234 nb_pixel_total : 6211562 time to create 1 rle with new method : 0.6223907470703125 time for calcul the mask position with numpy : 0.039011478424072266 nb_pixel_total : 238522 time to create 1 rle with new method : 0.47040843963623047 time for calcul the mask position with numpy : 0.03809332847595215 nb_pixel_total : 105105 time to create 1 rle with old method : 0.13333892822265625 time for calcul the mask position with numpy : 0.04042243957519531 nb_pixel_total : 130808 time to create 1 rle with old method : 0.17264461517333984 time for calcul the mask position with numpy : 0.03800606727600098 nb_pixel_total : 22877 time to create 1 rle with old method : 0.025469064712524414 time for calcul the mask position with numpy : 0.04004263877868652 nb_pixel_total : 20075 time to create 1 rle with old method : 0.028153419494628906 time for calcul the mask position with numpy : 0.04245448112487793 nb_pixel_total : 23010 time to create 1 rle with old method : 0.02574324607849121 time for calcul the mask position with numpy : 0.035570383071899414 nb_pixel_total : 37358 time to create 1 rle with old method : 0.041878700256347656 time for calcul the mask position with numpy : 0.03671073913574219 nb_pixel_total : 55456 time to create 1 rle with old method : 0.06595158576965332 time for calcul the mask position with numpy : 0.04325413703918457 nb_pixel_total : 30360 time to create 1 rle with old method : 0.03493952751159668 time for calcul the mask position with numpy : 0.04157114028930664 nb_pixel_total : 130178 time to create 1 rle with old method : 0.14933228492736816 time for calcul the mask position with numpy : 0.0362551212310791 nb_pixel_total : 44929 time to create 1 rle with old method : 0.04960274696350098 create new chi : 3.326436758041382 time to delete rle : 0.002379179000854492 batch 1 Loaded 23 chid ids of type : 3594 +++++++++++++Number RLEs to save : 9128 TO DO : save crop sub photo not yet done ! save time : 0.5782239437103271 nb_obj : 9 nb_hashtags : 4 time to prepare the origin masks : 4.5726542472839355 time for calcul the mask position with numpy : 0.961097002029419 nb_pixel_total : 6716834 time to create 1 rle with new method : 0.618593692779541 time for calcul the mask position with numpy : 0.038689613342285156 nb_pixel_total : 15460 time to create 1 rle with old method : 0.01880931854248047 time for calcul the mask position with numpy : 0.038123130798339844 nb_pixel_total : 80244 time to create 1 rle with old method : 0.08787894248962402 time for calcul the mask position with numpy : 0.022353410720825195 nb_pixel_total : 6997 time to create 1 rle with old method : 0.007822513580322266 time for calcul the mask position with numpy : 0.042234182357788086 nb_pixel_total : 54170 time to create 1 rle with old method : 0.05920100212097168 time for calcul the mask position with numpy : 0.03916740417480469 nb_pixel_total : 24311 time to create 1 rle with old method : 0.027247190475463867 time for calcul the mask position with numpy : 0.03654074668884277 nb_pixel_total : 30752 time to create 1 rle with old method : 0.035288095474243164 time for calcul the mask position with numpy : 0.038590192794799805 nb_pixel_total : 98402 time to create 1 rle with old method : 0.1094207763671875 time for calcul the mask position with numpy : 0.03959321975708008 nb_pixel_total : 11194 time to create 1 rle with old method : 0.012524604797363281 time for calcul the mask position with numpy : 0.03679847717285156 nb_pixel_total : 11876 time to create 1 rle with old method : 0.013248205184936523 create new chi : 2.327143430709839 time to delete rle : 0.0012791156768798828 batch 1 Loaded 19 chid ids of type : 3594 +++++++++Number RLEs to save : 6254 TO DO : save crop sub photo not yet done ! save time : 0.4357483386993408 nb_obj : 13 nb_hashtags : 3 time to prepare the origin masks : 8.408715963363647 time for calcul the mask position with numpy : 0.7517054080963135 nb_pixel_total : 6484429 time to create 1 rle with new method : 0.43400073051452637 time for calcul the mask position with numpy : 0.03769564628601074 nb_pixel_total : 6473 time to create 1 rle with old method : 0.007097482681274414 time for calcul the mask position with numpy : 0.03433871269226074 nb_pixel_total : 15214 time to create 1 rle with old method : 0.016752243041992188 time for calcul the mask position with numpy : 0.023763656616210938 nb_pixel_total : 26955 time to create 1 rle with old method : 0.029425621032714844 time for calcul the mask position with numpy : 0.022711992263793945 nb_pixel_total : 12883 time to create 1 rle with old method : 0.02094125747680664 time for calcul the mask position with numpy : 0.02489948272705078 nb_pixel_total : 33210 time to create 1 rle with old method : 0.04969382286071777 time for calcul the mask position with numpy : 0.024230003356933594 nb_pixel_total : 101084 time to create 1 rle with old method : 0.11152529716491699 time for calcul the mask position with numpy : 0.024644136428833008 nb_pixel_total : 11787 time to create 1 rle with old method : 0.013076543807983398 time for calcul the mask position with numpy : 0.023291826248168945 nb_pixel_total : 117338 time to create 1 rle with old method : 0.15361833572387695 time for calcul the mask position with numpy : 0.021979093551635742 nb_pixel_total : 18042 time to create 1 rle with old method : 0.020023345947265625 time for calcul the mask position with numpy : 0.026632070541381836 nb_pixel_total : 13223 time to create 1 rle with old method : 0.014710664749145508 time for calcul the mask position with numpy : 0.03657197952270508 nb_pixel_total : 165400 time to create 1 rle with new method : 0.3741123676300049 time for calcul the mask position with numpy : 0.03697609901428223 nb_pixel_total : 27767 time to create 1 rle with old method : 0.032958269119262695 time for calcul the mask position with numpy : 0.03738093376159668 nb_pixel_total : 16435 time to create 1 rle with old method : 0.01809072494506836 create new chi : 2.4935293197631836 time to delete rle : 0.0015306472778320312 batch 1 Loaded 27 chid ids of type : 3594 ++++++++++++++++++Number RLEs to save : 8524 TO DO : save crop sub photo not yet done ! save time : 0.5336654186248779 map_output_result : {1361088944: (0.0, 'Should be the crop_list due to order', 0), 1361088898: (0.0, 'Should be the crop_list due to order', 0), 1361088813: (0.0, 'Should be the crop_list due to order', 0), 1361088774: (0.0, 'Should be the crop_list due to order', 0), 1361088772: (0.0, 'Should be the crop_list due to order', 0), 1361088770: (0.0, 'Should be the crop_list due to order', 0), 1361088749: (0.0, 'Should be the crop_list due to order', 0), 1361088745: (0.0, 'Should be the crop_list due to order', 0), 1361088742: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1361088944, 1361088898, 1361088813, 1361088774, 1361088772, 1361088770, 1361088749, 1361088745, 1361088742] Looping around the photos to save general results len do output : 9 /1361088944.Didn't retrieve data . /1361088898.Didn't retrieve data . /1361088813.Didn't retrieve data . /1361088774.Didn't retrieve data . /1361088772.Didn't retrieve data . /1361088770.Didn't retrieve data . /1361088749.Didn't retrieve data . /1361088745.Didn't retrieve data . /1361088742.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2956399') ('3318', '23347836', '1361088944', None, None, None, None, None, '2956399') ('3318', None, None, None, None, None, None, None, '2956399') ('3318', '23347836', '1361088898', None, None, None, None, None, '2956399') ('3318', None, None, None, None, None, None, None, '2956399') ('3318', '23347836', '1361088813', None, None, None, None, None, '2956399') ('3318', None, None, None, None, None, None, None, '2956399') ('3318', '23347836', '1361088774', None, None, None, None, None, '2956399') ('3318', None, None, None, None, None, None, None, '2956399') ('3318', '23347836', '1361088772', None, None, None, None, None, '2956399') ('3318', None, None, None, None, None, None, None, '2956399') ('3318', '23347836', '1361088770', None, None, None, None, None, '2956399') ('3318', None, None, None, None, None, None, None, '2956399') ('3318', '23347836', '1361088749', None, None, None, None, None, '2956399') ('3318', None, None, None, None, None, None, None, '2956399') ('3318', '23347836', '1361088745', None, None, None, None, None, '2956399') ('3318', None, None, None, None, None, None, None, '2956399') ('3318', '23347836', '1361088742', None, None, None, None, None, '2956399') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 27 time used for this insertion : 0.01449894905090332 save_final save missing photos in datou_result : time spend for datou_step_exec : 102.41672873497009 time spend to save output : 0.015100717544555664 total time spend for step 3 : 102.43182945251465 step4:ventilate_hashtags_in_portfolio Mon May 26 17:24:34 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 23347836 get user id for portfolio 23347836 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23347836 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','papier','carton','environnement','mal_croppe','background','metal','pehd','pet_clair','autre','flou')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23347836 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','papier','carton','environnement','mal_croppe','background','metal','pehd','pet_clair','autre','flou')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23347836 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','papier','carton','environnement','mal_croppe','background','metal','pehd','pet_clair','autre','flou')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/23348274,23348275,23348276,23348277,23348278,23348279,23348281,23348282,23348283,23348284,23348285?tags=pet_fonce,papier,carton,environnement,mal_croppe,background,metal,pehd,pet_clair,autre,flou Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1361088944, 1361088898, 1361088813, 1361088774, 1361088772, 1361088770, 1361088749, 1361088745, 1361088742] Looping around the photos to save general results len do output : 1 /23347836. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2956399') ('3318', '23347836', '1361088944', None, None, None, None, None, '2956399') ('3318', None, None, None, None, None, None, None, '2956399') ('3318', '23347836', '1361088898', None, None, None, None, None, '2956399') ('3318', None, None, None, None, None, None, None, '2956399') ('3318', '23347836', '1361088813', None, None, None, None, None, '2956399') ('3318', None, None, None, None, None, None, None, '2956399') ('3318', '23347836', '1361088774', None, None, None, None, None, '2956399') ('3318', None, None, None, None, None, None, None, '2956399') ('3318', '23347836', '1361088772', None, None, None, None, None, '2956399') ('3318', None, None, None, None, None, None, None, '2956399') ('3318', '23347836', '1361088770', None, None, None, None, None, '2956399') ('3318', None, None, None, None, None, None, None, '2956399') ('3318', '23347836', '1361088749', None, None, None, None, None, '2956399') ('3318', None, None, None, None, None, None, None, '2956399') ('3318', '23347836', '1361088745', None, None, None, None, None, '2956399') ('3318', None, None, None, None, None, None, None, '2956399') ('3318', '23347836', '1361088742', None, None, None, None, None, '2956399') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.014139175415039062 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.5373258590698242 time spend to save output : 0.014477968215942383 total time spend for step 4 : 1.5518038272857666 step5:final Mon May 26 17:24:36 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1361088944: ('0.09858914180384085',), 1361088898: ('0.09858914180384085',), 1361088813: ('0.09858914180384085',), 1361088774: ('0.09858914180384085',), 1361088772: ('0.09858914180384085',), 1361088770: ('0.09858914180384085',), 1361088749: ('0.09858914180384085',), 1361088745: ('0.09858914180384085',), 1361088742: ('0.09858914180384085',)} new output for save of step final : {1361088944: ('0.09858914180384085',), 1361088898: ('0.09858914180384085',), 1361088813: ('0.09858914180384085',), 1361088774: ('0.09858914180384085',), 1361088772: ('0.09858914180384085',), 1361088770: ('0.09858914180384085',), 1361088749: ('0.09858914180384085',), 1361088745: ('0.09858914180384085',), 1361088742: ('0.09858914180384085',)} [1361088944, 1361088898, 1361088813, 1361088774, 1361088772, 1361088770, 1361088749, 1361088745, 1361088742] Looping around the photos to save general results len do output : 9 /1361088944.Didn't retrieve data . /1361088898.Didn't retrieve data . /1361088813.Didn't retrieve data . /1361088774.Didn't retrieve data . /1361088772.Didn't retrieve data . /1361088770.Didn't retrieve data . /1361088749.Didn't retrieve data . /1361088745.Didn't retrieve data . /1361088742.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2956399') ('3318', '23347836', '1361088944', None, None, None, None, None, '2956399') ('3318', None, None, None, None, None, None, None, '2956399') ('3318', '23347836', '1361088898', None, None, None, None, None, '2956399') ('3318', None, None, None, None, None, None, None, '2956399') ('3318', '23347836', '1361088813', None, None, None, None, None, '2956399') ('3318', None, None, None, None, None, None, None, '2956399') ('3318', '23347836', '1361088774', None, None, None, None, None, '2956399') ('3318', None, None, None, None, None, None, None, '2956399') ('3318', '23347836', '1361088772', None, None, None, None, None, '2956399') ('3318', None, None, None, None, None, None, None, '2956399') ('3318', '23347836', '1361088770', None, None, None, None, None, '2956399') ('3318', None, None, None, None, None, None, None, '2956399') ('3318', '23347836', '1361088749', None, None, None, None, None, '2956399') ('3318', None, None, None, None, None, None, None, '2956399') ('3318', '23347836', '1361088745', None, None, None, None, None, '2956399') ('3318', None, None, None, None, None, None, None, '2956399') ('3318', '23347836', '1361088742', None, None, None, None, None, '2956399') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 27 time used for this insertion : 0.012408256530761719 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.10781097412109375 time spend to save output : 0.01304316520690918 total time spend for step 5 : 0.12085413932800293 step6:blur_detection Mon May 26 17:24:36 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1748272829_522432_1361088944_3a968c665c4cdc1c00bd49781e9db80d.jpg resize: (2160, 3264) 1361088944 -0.3758569648385428 treat image : temp/1748272829_522432_1361088898_41d31241dc4daf8c99645227b8899fbe.jpg resize: (2160, 3264) 1361088898 -3.2231685413915687 treat image : temp/1748272829_522432_1361088813_abc458605a9ab51bfee26cfe5a4b7911.jpg resize: (2160, 3264) 1361088813 -3.1801671579765096 treat image : temp/1748272829_522432_1361088774_7a23cf07db8f896829bbed3f1c442e86.jpg resize: (2160, 3264) 1361088774 -2.311405677956743 treat image : temp/1748272829_522432_1361088772_3cc68c4efee7816ecdb764875284d408.jpg resize: (2160, 3264) 1361088772 -1.5758220099544145 treat image : temp/1748272829_522432_1361088770_64b5fe9c12a89ccc7a6a6e464515682a.jpg resize: (2160, 3264) 1361088770 -1.025495005550872 treat image : temp/1748272829_522432_1361088749_7cd39eda64f084900cc20fbb3cad0688.jpg resize: (2160, 3264) 1361088749 -2.2549587496230146 treat image : temp/1748272829_522432_1361088745_2d76b0d229b979c16ea6180efa9a6f1b.jpg resize: (2160, 3264) 1361088745 -3.4639826166590053 treat image : temp/1748272829_522432_1361088742_490b07e21960cc575ed749bd7c7fccea.jpg resize: (2160, 3264) 1361088742 -3.446725401964773 treat image : temp/1748272829_522432_1361088944_3a968c665c4cdc1c00bd49781e9db80d_rle_crop_3813275579_0.png resize: (159, 150) 1361118351 -1.2628783496964229 treat image : temp/1748272829_522432_1361088944_3a968c665c4cdc1c00bd49781e9db80d_rle_crop_3813275580_0.png resize: (265, 215) 1361118352 -1.9213062500290141 treat image : temp/1748272829_522432_1361088944_3a968c665c4cdc1c00bd49781e9db80d_rle_crop_3813275583_0.png resize: (151, 99) 1361118353 -0.04281925657092698 treat image : temp/1748272829_522432_1361088944_3a968c665c4cdc1c00bd49781e9db80d_rle_crop_3813275584_0.png resize: (231, 641) 1361118354 -1.5397128285025834 treat image : temp/1748272829_522432_1361088898_41d31241dc4daf8c99645227b8899fbe_rle_crop_3813275586_0.png resize: (532, 507) 1361118355 -0.5935843889550665 treat image : temp/1748272829_522432_1361088898_41d31241dc4daf8c99645227b8899fbe_rle_crop_3813275590_0.png resize: (144, 394) 1361118356 -2.188999719859522 treat image : temp/1748272829_522432_1361088898_41d31241dc4daf8c99645227b8899fbe_rle_crop_3813275592_0.png resize: (136, 151) 1361118357 -0.1437527527781429 treat image : temp/1748272829_522432_1361088898_41d31241dc4daf8c99645227b8899fbe_rle_crop_3813275593_0.png resize: (154, 254) 1361118358 -1.6037172733116407 treat image : temp/1748272829_522432_1361088898_41d31241dc4daf8c99645227b8899fbe_rle_crop_3813275595_0.png resize: (139, 176) 1361118359 -1.4107172256850873 treat image : temp/1748272829_522432_1361088898_41d31241dc4daf8c99645227b8899fbe_rle_crop_3813275596_0.png resize: (315, 464) 1361118360 -2.6549220445910513 treat image : temp/1748272829_522432_1361088898_41d31241dc4daf8c99645227b8899fbe_rle_crop_3813275597_0.png resize: (123, 168) 1361118361 -1.4853668700530849 treat image : temp/1748272829_522432_1361088898_41d31241dc4daf8c99645227b8899fbe_rle_crop_3813275600_0.png resize: (276, 542) 1361118362 -2.2119449560965663 treat image : temp/1748272829_522432_1361088898_41d31241dc4daf8c99645227b8899fbe_rle_crop_3813275604_0.png resize: (113, 125) 1361118363 -0.08331259277793897 treat image : temp/1748272829_522432_1361088898_41d31241dc4daf8c99645227b8899fbe_rle_crop_3813275605_0.png resize: (160, 206) 1361118364 -1.8207644064419508 treat image : temp/1748272829_522432_1361088813_abc458605a9ab51bfee26cfe5a4b7911_rle_crop_3813275607_0.png resize: (133, 106) 1361118365 -1.553270058009156 treat image : temp/1748272829_522432_1361088813_abc458605a9ab51bfee26cfe5a4b7911_rle_crop_3813275608_0.png resize: (157, 96) 1361118366 -1.6096885421613971 treat image : temp/1748272829_522432_1361088813_abc458605a9ab51bfee26cfe5a4b7911_rle_crop_3813275609_0.png resize: (216, 234) 1361118367 -0.7406608647625651 treat image : temp/1748272829_522432_1361088813_abc458605a9ab51bfee26cfe5a4b7911_rle_crop_3813275610_0.png resize: (236, 210) 1361118368 -3.0831037159900863 treat image : temp/1748272829_522432_1361088813_abc458605a9ab51bfee26cfe5a4b7911_rle_crop_3813275611_0.png resize: (127, 213) 1361118369 -1.6632655130089915 treat image : temp/1748272829_522432_1361088813_abc458605a9ab51bfee26cfe5a4b7911_rle_crop_3813275613_0.png resize: (193, 366) 1361118370 -1.7697582457248506 treat image : temp/1748272829_522432_1361088813_abc458605a9ab51bfee26cfe5a4b7911_rle_crop_3813275617_0.png resize: (127, 176) 1361118371 -1.5441386571357416 treat image : temp/1748272829_522432_1361088774_7a23cf07db8f896829bbed3f1c442e86_rle_crop_3813275618_0.png resize: (224, 152) 1361118372 -1.0790228222368488 treat image : temp/1748272829_522432_1361088774_7a23cf07db8f896829bbed3f1c442e86_rle_crop_3813275619_0.png resize: (342, 284) 1361118373 -0.5367995910273448 treat image : temp/1748272829_522432_1361088774_7a23cf07db8f896829bbed3f1c442e86_rle_crop_3813275622_0.png resize: (238, 196) 1361118374 0.5339583690193572 treat image : temp/1748272829_522432_1361088774_7a23cf07db8f896829bbed3f1c442e86_rle_crop_3813275624_0.png resize: (180, 311) 1361118376 0.23783961253301517 treat image : temp/1748272829_522432_1361088774_7a23cf07db8f896829bbed3f1c442e86_rle_crop_3813275627_0.png resize: (460, 276) 1361118377 -1.4491725072901243 treat image : temp/1748272829_522432_1361088774_7a23cf07db8f896829bbed3f1c442e86_rle_crop_3813275628_0.png resize: (154, 101) 1361118378 2.7530075816580717 treat image : temp/1748272829_522432_1361088774_7a23cf07db8f896829bbed3f1c442e86_rle_crop_3813275629_0.png resize: (155, 121) 1361118379 -1.4525966761264277 treat image : temp/1748272829_522432_1361088772_3cc68c4efee7816ecdb764875284d408_rle_crop_3813275639_0.png resize: (311, 288) 1361118380 -0.2942039932266195 treat image : temp/1748272829_522432_1361088772_3cc68c4efee7816ecdb764875284d408_rle_crop_3813275644_0.png resize: (183, 338) 1361118381 -1.3694147545096989 treat image : temp/1748272829_522432_1361088772_3cc68c4efee7816ecdb764875284d408_rle_crop_3813275646_0.png resize: (124, 157) 1361118382 0.5632997364096217 treat image : temp/1748272829_522432_1361088770_64b5fe9c12a89ccc7a6a6e464515682a_rle_crop_3813275652_0.png resize: (577, 453) 1361118383 -0.3888377747481369 treat image : temp/1748272829_522432_1361088770_64b5fe9c12a89ccc7a6a6e464515682a_rle_crop_3813275657_0.png resize: (101, 228) 1361118384 -0.6837399437850659 treat image : temp/1748272829_522432_1361088770_64b5fe9c12a89ccc7a6a6e464515682a_rle_crop_3813275658_0.png resize: (64, 163) 1361118385 0.5711212326748438 treat image : temp/1748272829_522432_1361088770_64b5fe9c12a89ccc7a6a6e464515682a_rle_crop_3813275662_0.png resize: (275, 233) 1361118386 0.15512291804312583 treat image : temp/1748272829_522432_1361088749_7cd39eda64f084900cc20fbb3cad0688_rle_crop_3813275665_0.png resize: (212, 345) 1361118387 0.8220795858691139 treat image : temp/1748272829_522432_1361088749_7cd39eda64f084900cc20fbb3cad0688_rle_crop_3813275666_0.png resize: (425, 424) 1361118388 -2.9466350878951886 treat image : temp/1748272829_522432_1361088749_7cd39eda64f084900cc20fbb3cad0688_rle_crop_3813275667_0.png resize: (197, 289) 1361118389 -1.8477240121770544 treat image : temp/1748272829_522432_1361088749_7cd39eda64f084900cc20fbb3cad0688_rle_crop_3813275668_0.png resize: (248, 310) 1361118390 -1.4940596558421673 treat image : temp/1748272829_522432_1361088749_7cd39eda64f084900cc20fbb3cad0688_rle_crop_3813275669_0.png resize: (316, 157) 1361118391 -0.38751449319018444 treat image : temp/1748272829_522432_1361088749_7cd39eda64f084900cc20fbb3cad0688_rle_crop_3813275670_0.png resize: (219, 160) 1361118392 -0.9283671291245668 treat image : temp/1748272829_522432_1361088749_7cd39eda64f084900cc20fbb3cad0688_rle_crop_3813275672_0.png resize: (127, 243) 1361118393 -1.6071417412052456 treat image : temp/1748272829_522432_1361088749_7cd39eda64f084900cc20fbb3cad0688_rle_crop_3813275673_0.png resize: (488, 669) 1361118394 -0.37595705758276143 treat image : temp/1748272829_522432_1361088749_7cd39eda64f084900cc20fbb3cad0688_rle_crop_3813275675_0.png resize: (597, 754) 1361118395 -1.9068415946080257 treat image : temp/1748272829_522432_1361088745_2d76b0d229b979c16ea6180efa9a6f1b_rle_crop_3813275676_0.png resize: (151, 106) 1361118396 -1.4191940029812233 treat image : temp/1748272829_522432_1361088745_2d76b0d229b979c16ea6180efa9a6f1b_rle_crop_3813275677_0.png resize: (86, 153) 1361118397 2.012608998487835 treat image : temp/1748272829_522432_1361088745_2d76b0d229b979c16ea6180efa9a6f1b_rle_crop_3813275678_0.png resize: (444, 369) 1361118398 -3.120708589807182 treat image : temp/1748272829_522432_1361088745_2d76b0d229b979c16ea6180efa9a6f1b_rle_crop_3813275679_0.png resize: (233, 203) 1361118399 -1.0931493502839713 treat image : temp/1748272829_522432_1361088745_2d76b0d229b979c16ea6180efa9a6f1b_rle_crop_3813275682_0.png resize: (100, 111) 1361118401 -0.09005632366749713 treat image : temp/1748272829_522432_1361088742_490b07e21960cc575ed749bd7c7fccea_rle_crop_3813275685_0.png resize: (146, 161) 1361118402 -2.0631281019435703 treat image : temp/1748272829_522432_1361088742_490b07e21960cc575ed749bd7c7fccea_rle_crop_3813275686_0.png resize: (209, 201) 1361118403 -0.9525034826439132 treat image : temp/1748272829_522432_1361088742_490b07e21960cc575ed749bd7c7fccea_rle_crop_3813275688_0.png resize: (138, 143) 1361118404 -0.9096942720659066 treat image : temp/1748272829_522432_1361088742_490b07e21960cc575ed749bd7c7fccea_rle_crop_3813275689_0.png resize: (251, 83) 1361118405 0.738217461528206 treat image : temp/1748272829_522432_1361088742_490b07e21960cc575ed749bd7c7fccea_rle_crop_3813275690_0.png resize: (334, 589) 1361118406 -1.4795551635689397 treat image : temp/1748272829_522432_1361088742_490b07e21960cc575ed749bd7c7fccea_rle_crop_3813275691_0.png resize: (91, 160) 1361118407 -1.6516954581384335 treat image : temp/1748272829_522432_1361088742_490b07e21960cc575ed749bd7c7fccea_rle_crop_3813275694_0.png resize: (232, 143) 1361118409 -1.679521090078579 treat image : temp/1748272829_522432_1361088742_490b07e21960cc575ed749bd7c7fccea_rle_crop_3813275695_0.png resize: (162, 306) 1361118410 -2.131790470324492 treat image : temp/1748272829_522432_1361088742_490b07e21960cc575ed749bd7c7fccea_rle_crop_3813275697_0.png resize: (92, 96) 1361118411 0.1022693506177708 treat image : temp/1748272829_522432_1361088944_3a968c665c4cdc1c00bd49781e9db80d_rle_crop_3813275577_0.png resize: (211, 216) 1361118417 -0.820642990670431 treat image : temp/1748272829_522432_1361088813_abc458605a9ab51bfee26cfe5a4b7911_rle_crop_3813275615_0.png resize: (242, 310) 1361118418 -1.9548439721020792 treat image : temp/1748272829_522432_1361088774_7a23cf07db8f896829bbed3f1c442e86_rle_crop_3813275623_0.png resize: (177, 309) 1361118419 -0.4774376352890459 treat image : temp/1748272829_522432_1361088774_7a23cf07db8f896829bbed3f1c442e86_rle_crop_3813275630_0.png resize: (220, 267) 1361118420 -0.847013555983695 treat image : temp/1748272829_522432_1361088772_3cc68c4efee7816ecdb764875284d408_rle_crop_3813275640_0.png resize: (168, 283) 1361118421 -0.7224139646118524 treat image : temp/1748272829_522432_1361088772_3cc68c4efee7816ecdb764875284d408_rle_crop_3813275649_0.png resize: (276, 414) 1361118422 -0.4363551368485757 treat image : temp/1748272829_522432_1361088770_64b5fe9c12a89ccc7a6a6e464515682a_rle_crop_3813275650_0.png resize: (193, 225) 1361118423 -1.9393620886998355 treat image : temp/1748272829_522432_1361088749_7cd39eda64f084900cc20fbb3cad0688_rle_crop_3813275671_0.png resize: (258, 140) 1361118424 -1.0818270409332778 treat image : temp/1748272829_522432_1361088745_2d76b0d229b979c16ea6180efa9a6f1b_rle_crop_3813275680_0.png resize: (140, 218) 1361118425 0.17847451180784699 treat image : temp/1748272829_522432_1361088742_490b07e21960cc575ed749bd7c7fccea_rle_crop_3813275693_0.png resize: (373, 107) 1361118426 -1.3207339313940243 treat image : temp/1748272829_522432_1361088944_3a968c665c4cdc1c00bd49781e9db80d_rle_crop_3813275578_0.png resize: (443, 456) 1361118455 -0.6685047870771145 treat image : temp/1748272829_522432_1361088944_3a968c665c4cdc1c00bd49781e9db80d_rle_crop_3813275581_0.png resize: (147, 334) 1361118456 -0.3136916960046082 treat image : temp/1748272829_522432_1361088944_3a968c665c4cdc1c00bd49781e9db80d_rle_crop_3813275582_0.png resize: (175, 429) 1361118457 -1.1182183919798645 treat image : temp/1748272829_522432_1361088944_3a968c665c4cdc1c00bd49781e9db80d_rle_crop_3813275585_0.png resize: (221, 246) 1361118458 -0.24900628647418935 treat image : temp/1748272829_522432_1361088898_41d31241dc4daf8c99645227b8899fbe_rle_crop_3813275587_0.png resize: (298, 395) 1361118459 -0.44977393717177866 treat image : temp/1748272829_522432_1361088898_41d31241dc4daf8c99645227b8899fbe_rle_crop_3813275588_0.png resize: (335, 475) 1361118460 -1.86109953578661 treat image : temp/1748272829_522432_1361088898_41d31241dc4daf8c99645227b8899fbe_rle_crop_3813275589_0.png resize: (175, 355) 1361118461 -1.7466892439425645 treat image : temp/1748272829_522432_1361088898_41d31241dc4daf8c99645227b8899fbe_rle_crop_3813275591_0.png resize: (183, 325) 1361118462 -3.582113597059574 treat image : temp/1748272829_522432_1361088898_41d31241dc4daf8c99645227b8899fbe_rle_crop_3813275594_0.png resize: (527, 579) 1361118464 -4.2691021045048325 treat image : temp/1748272829_522432_1361088898_41d31241dc4daf8c99645227b8899fbe_rle_crop_3813275598_0.png resize: (276, 242) 1361118465 -2.042561553072889 treat image : temp/1748272829_522432_1361088898_41d31241dc4daf8c99645227b8899fbe_rle_crop_3813275599_0.png resize: (320, 136) 1361118466 -1.4366520559093252 treat image : temp/1748272829_522432_1361088898_41d31241dc4daf8c99645227b8899fbe_rle_crop_3813275601_0.png resize: (122, 271) 1361118467 -2.083544740352224 treat image : temp/1748272829_522432_1361088898_41d31241dc4daf8c99645227b8899fbe_rle_crop_3813275602_0.png resize: (377, 538) 1361118468 -1.35639725769837 treat image : temp/1748272829_522432_1361088898_41d31241dc4daf8c99645227b8899fbe_rle_crop_3813275603_0.png resize: (332, 348) 1361118469 -2.927052932090626 treat image : temp/1748272829_522432_1361088898_41d31241dc4daf8c99645227b8899fbe_rle_crop_3813275606_0.png resize: (334, 456) 1361118470 -2.0659200410887992 treat image : temp/1748272829_522432_1361088813_abc458605a9ab51bfee26cfe5a4b7911_rle_crop_3813275612_0.png resize: (133, 440) 1361118471 -1.9047494738458244 treat image : temp/1748272829_522432_1361088813_abc458605a9ab51bfee26cfe5a4b7911_rle_crop_3813275614_0.png resize: (365, 318) 1361118472 -1.970192387444129 treat image : temp/1748272829_522432_1361088813_abc458605a9ab51bfee26cfe5a4b7911_rle_crop_3813275616_0.png resize: (366, 182) 1361118473 -0.9068545675482552 treat image : temp/1748272829_522432_1361088774_7a23cf07db8f896829bbed3f1c442e86_rle_crop_3813275620_0.png resize: (261, 312) 1361118474 -0.9742251326374826 treat image : temp/1748272829_522432_1361088774_7a23cf07db8f896829bbed3f1c442e86_rle_crop_3813275621_0.png resize: (140, 195) 1361118475 -1.5162946012834324 treat image : temp/1748272829_522432_1361088774_7a23cf07db8f896829bbed3f1c442e86_rle_crop_3813275625_0.png resize: (139, 219) 1361118476 -1.4365526274537048 treat image : temp/1748272829_522432_1361088774_7a23cf07db8f896829bbed3f1c442e86_rle_crop_3813275626_0.png resize: (510, 473) 1361118477 -2.9146617883659434 treat image : temp/1748272829_522432_1361088774_7a23cf07db8f896829bbed3f1c442e86_rle_crop_3813275631_0.png resize: (68, 108) 1361118478 -1.9902471912539696 treat image : temp/1748272829_522432_1361088774_7a23cf07db8f896829bbed3f1c442e86_rle_crop_3813275632_0.png resize: (254, 471) 1361118479 -1.0512205724643215 treat image : temp/1748272829_522432_1361088772_3cc68c4efee7816ecdb764875284d408_rle_crop_3813275633_0.png resize: (335, 431) 1361118480 -1.6235236759203828 treat image : temp/1748272829_522432_1361088772_3cc68c4efee7816ecdb764875284d408_rle_crop_3813275634_0.png resize: (211, 119) 1361118481 -0.9771552545521089 treat image : temp/1748272829_522432_1361088772_3cc68c4efee7816ecdb764875284d408_rle_crop_3813275635_0.png resize: (157, 279) 1361118482 -1.4652423750890256 treat image : temp/1748272829_522432_1361088772_3cc68c4efee7816ecdb764875284d408_rle_crop_3813275636_0.png resize: (221, 295) 1361118483 -0.8398490266637142 treat image : temp/1748272829_522432_1361088772_3cc68c4efee7816ecdb764875284d408_rle_crop_3813275637_0.png resize: (329, 321) 1361118484 0.03617626160823422 treat image : temp/1748272829_522432_1361088772_3cc68c4efee7816ecdb764875284d408_rle_crop_3813275638_0.png resize: (120, 239) 1361118485 -3.0327337731834425 treat image : temp/1748272829_522432_1361088772_3cc68c4efee7816ecdb764875284d408_rle_crop_3813275641_0.png resize: (132, 476) 1361118486 -0.29738629296803215 treat image : temp/1748272829_522432_1361088772_3cc68c4efee7816ecdb764875284d408_rle_crop_3813275642_0.png resize: (344, 542) 1361118487 -1.4159596633184945 treat image : temp/1748272829_522432_1361088772_3cc68c4efee7816ecdb764875284d408_rle_crop_3813275643_0.png resize: (223, 395) 1361118488 -0.7201290541853267 treat image : temp/1748272829_522432_1361088772_3cc68c4efee7816ecdb764875284d408_rle_crop_3813275645_0.png resize: (331, 270) 1361118489 -2.135000136074327 treat image : temp/1748272829_522432_1361088772_3cc68c4efee7816ecdb764875284d408_rle_crop_3813275647_0.png resize: (236, 354) 1361118490 -0.5270507693768982 treat image : temp/1748272829_522432_1361088772_3cc68c4efee7816ecdb764875284d408_rle_crop_3813275648_0.png resize: (111, 190) 1361118491 -0.6932354242484596 treat image : temp/1748272829_522432_1361088770_64b5fe9c12a89ccc7a6a6e464515682a_rle_crop_3813275651_0.png resize: (126, 426) 1361118492 -1.008994549137963 treat image : temp/1748272829_522432_1361088770_64b5fe9c12a89ccc7a6a6e464515682a_rle_crop_3813275653_0.png resize: (316, 468) 1361118493 -1.0447326765407887 treat image : temp/1748272829_522432_1361088770_64b5fe9c12a89ccc7a6a6e464515682a_rle_crop_3813275654_0.png resize: (190, 472) 1361118494 -1.4964621539451708 treat image : temp/1748272829_522432_1361088770_64b5fe9c12a89ccc7a6a6e464515682a_rle_crop_3813275655_0.png resize: (269, 210) 1361118495 -0.8155702255615604 treat image : temp/1748272829_522432_1361088770_64b5fe9c12a89ccc7a6a6e464515682a_rle_crop_3813275656_0.png resize: (88, 431) 1361118496 -2.0663975309433007 treat image : temp/1748272829_522432_1361088770_64b5fe9c12a89ccc7a6a6e464515682a_rle_crop_3813275659_0.png resize: (221, 347) 1361118497 -2.6092257378999815 treat image : temp/1748272829_522432_1361088770_64b5fe9c12a89ccc7a6a6e464515682a_rle_crop_3813275660_0.png resize: (379, 216) 1361118498 -0.8873950000777173 treat image : temp/1748272829_522432_1361088770_64b5fe9c12a89ccc7a6a6e464515682a_rle_crop_3813275661_0.png resize: (104, 217) 1361118499 -0.819041858400426 treat image : temp/1748272829_522432_1361088770_64b5fe9c12a89ccc7a6a6e464515682a_rle_crop_3813275663_0.png resize: (330, 182) 1361118500 -0.7333013745402913 treat image : temp/1748272829_522432_1361088749_7cd39eda64f084900cc20fbb3cad0688_rle_crop_3813275674_0.png resize: (311, 418) 1361118501 -2.007878016900642 treat image : temp/1748272829_522432_1361088745_2d76b0d229b979c16ea6180efa9a6f1b_rle_crop_3813275681_0.png resize: (279, 307) 1361118502 -0.7417632207646421 treat image : temp/1748272829_522432_1361088745_2d76b0d229b979c16ea6180efa9a6f1b_rle_crop_3813275683_0.png resize: (329, 346) 1361118503 -3.537458705665175 treat image : temp/1748272829_522432_1361088742_490b07e21960cc575ed749bd7c7fccea_rle_crop_3813275687_0.png resize: (374, 712) 1361118504 -3.2048813728738144 treat image : temp/1748272829_522432_1361088742_490b07e21960cc575ed749bd7c7fccea_rle_crop_3813275692_0.png resize: (359, 381) 1361118505 -2.247832707232831 treat image : temp/1748272829_522432_1361088742_490b07e21960cc575ed749bd7c7fccea_rle_crop_3813275696_0.png resize: (130, 171) 1361118506 -1.594252040032205 treat image : temp/1748272829_522432_1361088770_64b5fe9c12a89ccc7a6a6e464515682a_rle_crop_3813275664_0.png resize: (245, 235) 1361118509 -0.9162360100285006 treat image : temp/1748272829_522432_1361088745_2d76b0d229b979c16ea6180efa9a6f1b_rle_crop_3813275684_0.png resize: (131, 146) 1361118510 -0.05552908739465915 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 130 time used for this insertion : 0.020089149475097656 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 130 time used for this insertion : 0.033418893814086914 save missing photos in datou_result : time spend for datou_step_exec : 35.86517143249512 time spend to save output : 0.0629580020904541 total time spend for step 6 : 35.92812943458557 step7:brightness Mon May 26 17:25:12 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1748272829_522432_1361088944_3a968c665c4cdc1c00bd49781e9db80d.jpg treat image : temp/1748272829_522432_1361088898_41d31241dc4daf8c99645227b8899fbe.jpg treat image : temp/1748272829_522432_1361088813_abc458605a9ab51bfee26cfe5a4b7911.jpg treat image : temp/1748272829_522432_1361088774_7a23cf07db8f896829bbed3f1c442e86.jpg treat image : temp/1748272829_522432_1361088772_3cc68c4efee7816ecdb764875284d408.jpg treat image : temp/1748272829_522432_1361088770_64b5fe9c12a89ccc7a6a6e464515682a.jpg treat image : temp/1748272829_522432_1361088749_7cd39eda64f084900cc20fbb3cad0688.jpg treat image : temp/1748272829_522432_1361088745_2d76b0d229b979c16ea6180efa9a6f1b.jpg treat image : temp/1748272829_522432_1361088742_490b07e21960cc575ed749bd7c7fccea.jpg treat image : temp/1748272829_522432_1361088944_3a968c665c4cdc1c00bd49781e9db80d_rle_crop_3813275579_0.png treat image : temp/1748272829_522432_1361088944_3a968c665c4cdc1c00bd49781e9db80d_rle_crop_3813275580_0.png treat image : temp/1748272829_522432_1361088944_3a968c665c4cdc1c00bd49781e9db80d_rle_crop_3813275583_0.png treat image : temp/1748272829_522432_1361088944_3a968c665c4cdc1c00bd49781e9db80d_rle_crop_3813275584_0.png treat image : temp/1748272829_522432_1361088898_41d31241dc4daf8c99645227b8899fbe_rle_crop_3813275586_0.png treat image : temp/1748272829_522432_1361088898_41d31241dc4daf8c99645227b8899fbe_rle_crop_3813275590_0.png treat image : temp/1748272829_522432_1361088898_41d31241dc4daf8c99645227b8899fbe_rle_crop_3813275592_0.png treat image : temp/1748272829_522432_1361088898_41d31241dc4daf8c99645227b8899fbe_rle_crop_3813275593_0.png treat image : temp/1748272829_522432_1361088898_41d31241dc4daf8c99645227b8899fbe_rle_crop_3813275595_0.png treat image : temp/1748272829_522432_1361088898_41d31241dc4daf8c99645227b8899fbe_rle_crop_3813275596_0.png treat image : temp/1748272829_522432_1361088898_41d31241dc4daf8c99645227b8899fbe_rle_crop_3813275597_0.png treat image : temp/1748272829_522432_1361088898_41d31241dc4daf8c99645227b8899fbe_rle_crop_3813275600_0.png treat image : temp/1748272829_522432_1361088898_41d31241dc4daf8c99645227b8899fbe_rle_crop_3813275604_0.png treat image : temp/1748272829_522432_1361088898_41d31241dc4daf8c99645227b8899fbe_rle_crop_3813275605_0.png treat image : temp/1748272829_522432_1361088813_abc458605a9ab51bfee26cfe5a4b7911_rle_crop_3813275607_0.png treat image : temp/1748272829_522432_1361088813_abc458605a9ab51bfee26cfe5a4b7911_rle_crop_3813275608_0.png treat image : temp/1748272829_522432_1361088813_abc458605a9ab51bfee26cfe5a4b7911_rle_crop_3813275609_0.png treat image : temp/1748272829_522432_1361088813_abc458605a9ab51bfee26cfe5a4b7911_rle_crop_3813275610_0.png treat image : temp/1748272829_522432_1361088813_abc458605a9ab51bfee26cfe5a4b7911_rle_crop_3813275611_0.png treat image : temp/1748272829_522432_1361088813_abc458605a9ab51bfee26cfe5a4b7911_rle_crop_3813275613_0.png treat image : temp/1748272829_522432_1361088813_abc458605a9ab51bfee26cfe5a4b7911_rle_crop_3813275617_0.png treat image : temp/1748272829_522432_1361088774_7a23cf07db8f896829bbed3f1c442e86_rle_crop_3813275618_0.png treat image : temp/1748272829_522432_1361088774_7a23cf07db8f896829bbed3f1c442e86_rle_crop_3813275619_0.png treat image : temp/1748272829_522432_1361088774_7a23cf07db8f896829bbed3f1c442e86_rle_crop_3813275622_0.png treat image : temp/1748272829_522432_1361088774_7a23cf07db8f896829bbed3f1c442e86_rle_crop_3813275624_0.png treat image : temp/1748272829_522432_1361088774_7a23cf07db8f896829bbed3f1c442e86_rle_crop_3813275627_0.png treat image : temp/1748272829_522432_1361088774_7a23cf07db8f896829bbed3f1c442e86_rle_crop_3813275628_0.png treat image : temp/1748272829_522432_1361088774_7a23cf07db8f896829bbed3f1c442e86_rle_crop_3813275629_0.png treat image : temp/1748272829_522432_1361088772_3cc68c4efee7816ecdb764875284d408_rle_crop_3813275639_0.png treat image : temp/1748272829_522432_1361088772_3cc68c4efee7816ecdb764875284d408_rle_crop_3813275644_0.png treat image : temp/1748272829_522432_1361088772_3cc68c4efee7816ecdb764875284d408_rle_crop_3813275646_0.png treat image : temp/1748272829_522432_1361088770_64b5fe9c12a89ccc7a6a6e464515682a_rle_crop_3813275652_0.png treat image : temp/1748272829_522432_1361088770_64b5fe9c12a89ccc7a6a6e464515682a_rle_crop_3813275657_0.png treat image : temp/1748272829_522432_1361088770_64b5fe9c12a89ccc7a6a6e464515682a_rle_crop_3813275658_0.png treat image : temp/1748272829_522432_1361088770_64b5fe9c12a89ccc7a6a6e464515682a_rle_crop_3813275662_0.png treat image : temp/1748272829_522432_1361088749_7cd39eda64f084900cc20fbb3cad0688_rle_crop_3813275665_0.png treat image : temp/1748272829_522432_1361088749_7cd39eda64f084900cc20fbb3cad0688_rle_crop_3813275666_0.png treat image : temp/1748272829_522432_1361088749_7cd39eda64f084900cc20fbb3cad0688_rle_crop_3813275667_0.png treat image : temp/1748272829_522432_1361088749_7cd39eda64f084900cc20fbb3cad0688_rle_crop_3813275668_0.png treat image : temp/1748272829_522432_1361088749_7cd39eda64f084900cc20fbb3cad0688_rle_crop_3813275669_0.png treat image : temp/1748272829_522432_1361088749_7cd39eda64f084900cc20fbb3cad0688_rle_crop_3813275670_0.png treat image : temp/1748272829_522432_1361088749_7cd39eda64f084900cc20fbb3cad0688_rle_crop_3813275672_0.png treat image : temp/1748272829_522432_1361088749_7cd39eda64f084900cc20fbb3cad0688_rle_crop_3813275673_0.png treat image : temp/1748272829_522432_1361088749_7cd39eda64f084900cc20fbb3cad0688_rle_crop_3813275675_0.png treat image : temp/1748272829_522432_1361088745_2d76b0d229b979c16ea6180efa9a6f1b_rle_crop_3813275676_0.png treat image : temp/1748272829_522432_1361088745_2d76b0d229b979c16ea6180efa9a6f1b_rle_crop_3813275677_0.png treat image : temp/1748272829_522432_1361088745_2d76b0d229b979c16ea6180efa9a6f1b_rle_crop_3813275678_0.png treat image : temp/1748272829_522432_1361088745_2d76b0d229b979c16ea6180efa9a6f1b_rle_crop_3813275679_0.png treat image : temp/1748272829_522432_1361088745_2d76b0d229b979c16ea6180efa9a6f1b_rle_crop_3813275682_0.png treat image : temp/1748272829_522432_1361088742_490b07e21960cc575ed749bd7c7fccea_rle_crop_3813275685_0.png treat image : temp/1748272829_522432_1361088742_490b07e21960cc575ed749bd7c7fccea_rle_crop_3813275686_0.png treat image : temp/1748272829_522432_1361088742_490b07e21960cc575ed749bd7c7fccea_rle_crop_3813275688_0.png treat image : temp/1748272829_522432_1361088742_490b07e21960cc575ed749bd7c7fccea_rle_crop_3813275689_0.png treat image : temp/1748272829_522432_1361088742_490b07e21960cc575ed749bd7c7fccea_rle_crop_3813275690_0.png treat image : temp/1748272829_522432_1361088742_490b07e21960cc575ed749bd7c7fccea_rle_crop_3813275691_0.png treat image : temp/1748272829_522432_1361088742_490b07e21960cc575ed749bd7c7fccea_rle_crop_3813275694_0.png treat image : temp/1748272829_522432_1361088742_490b07e21960cc575ed749bd7c7fccea_rle_crop_3813275695_0.png treat image : temp/1748272829_522432_1361088742_490b07e21960cc575ed749bd7c7fccea_rle_crop_3813275697_0.png treat image : temp/1748272829_522432_1361088944_3a968c665c4cdc1c00bd49781e9db80d_rle_crop_3813275577_0.png treat image : temp/1748272829_522432_1361088813_abc458605a9ab51bfee26cfe5a4b7911_rle_crop_3813275615_0.png treat image : temp/1748272829_522432_1361088774_7a23cf07db8f896829bbed3f1c442e86_rle_crop_3813275623_0.png treat image : temp/1748272829_522432_1361088774_7a23cf07db8f896829bbed3f1c442e86_rle_crop_3813275630_0.png treat image : temp/1748272829_522432_1361088772_3cc68c4efee7816ecdb764875284d408_rle_crop_3813275640_0.png treat image : temp/1748272829_522432_1361088772_3cc68c4efee7816ecdb764875284d408_rle_crop_3813275649_0.png treat image : temp/1748272829_522432_1361088770_64b5fe9c12a89ccc7a6a6e464515682a_rle_crop_3813275650_0.png treat image : temp/1748272829_522432_1361088749_7cd39eda64f084900cc20fbb3cad0688_rle_crop_3813275671_0.png treat image : temp/1748272829_522432_1361088745_2d76b0d229b979c16ea6180efa9a6f1b_rle_crop_3813275680_0.png treat image : temp/1748272829_522432_1361088742_490b07e21960cc575ed749bd7c7fccea_rle_crop_3813275693_0.png treat image : temp/1748272829_522432_1361088944_3a968c665c4cdc1c00bd49781e9db80d_rle_crop_3813275578_0.png treat image : temp/1748272829_522432_1361088944_3a968c665c4cdc1c00bd49781e9db80d_rle_crop_3813275581_0.png treat image : temp/1748272829_522432_1361088944_3a968c665c4cdc1c00bd49781e9db80d_rle_crop_3813275582_0.png treat image : temp/1748272829_522432_1361088944_3a968c665c4cdc1c00bd49781e9db80d_rle_crop_3813275585_0.png treat image : temp/1748272829_522432_1361088898_41d31241dc4daf8c99645227b8899fbe_rle_crop_3813275587_0.png treat image : temp/1748272829_522432_1361088898_41d31241dc4daf8c99645227b8899fbe_rle_crop_3813275588_0.png treat image : temp/1748272829_522432_1361088898_41d31241dc4daf8c99645227b8899fbe_rle_crop_3813275589_0.png treat image : temp/1748272829_522432_1361088898_41d31241dc4daf8c99645227b8899fbe_rle_crop_3813275591_0.png treat image : temp/1748272829_522432_1361088898_41d31241dc4daf8c99645227b8899fbe_rle_crop_3813275594_0.png treat image : temp/1748272829_522432_1361088898_41d31241dc4daf8c99645227b8899fbe_rle_crop_3813275598_0.png treat image : temp/1748272829_522432_1361088898_41d31241dc4daf8c99645227b8899fbe_rle_crop_3813275599_0.png treat image : temp/1748272829_522432_1361088898_41d31241dc4daf8c99645227b8899fbe_rle_crop_3813275601_0.png treat image : temp/1748272829_522432_1361088898_41d31241dc4daf8c99645227b8899fbe_rle_crop_3813275602_0.png treat image : temp/1748272829_522432_1361088898_41d31241dc4daf8c99645227b8899fbe_rle_crop_3813275603_0.png treat image : temp/1748272829_522432_1361088898_41d31241dc4daf8c99645227b8899fbe_rle_crop_3813275606_0.png treat image : temp/1748272829_522432_1361088813_abc458605a9ab51bfee26cfe5a4b7911_rle_crop_3813275612_0.png treat image : temp/1748272829_522432_1361088813_abc458605a9ab51bfee26cfe5a4b7911_rle_crop_3813275614_0.png treat image : temp/1748272829_522432_1361088813_abc458605a9ab51bfee26cfe5a4b7911_rle_crop_3813275616_0.png treat image : temp/1748272829_522432_1361088774_7a23cf07db8f896829bbed3f1c442e86_rle_crop_3813275620_0.png treat image : temp/1748272829_522432_1361088774_7a23cf07db8f896829bbed3f1c442e86_rle_crop_3813275621_0.png treat image : temp/1748272829_522432_1361088774_7a23cf07db8f896829bbed3f1c442e86_rle_crop_3813275625_0.png treat image : temp/1748272829_522432_1361088774_7a23cf07db8f896829bbed3f1c442e86_rle_crop_3813275626_0.png treat image : temp/1748272829_522432_1361088774_7a23cf07db8f896829bbed3f1c442e86_rle_crop_3813275631_0.png treat image : temp/1748272829_522432_1361088774_7a23cf07db8f896829bbed3f1c442e86_rle_crop_3813275632_0.png treat image : temp/1748272829_522432_1361088772_3cc68c4efee7816ecdb764875284d408_rle_crop_3813275633_0.png treat image : temp/1748272829_522432_1361088772_3cc68c4efee7816ecdb764875284d408_rle_crop_3813275634_0.png treat image : temp/1748272829_522432_1361088772_3cc68c4efee7816ecdb764875284d408_rle_crop_3813275635_0.png treat image : temp/1748272829_522432_1361088772_3cc68c4efee7816ecdb764875284d408_rle_crop_3813275636_0.png treat image : temp/1748272829_522432_1361088772_3cc68c4efee7816ecdb764875284d408_rle_crop_3813275637_0.png treat image : temp/1748272829_522432_1361088772_3cc68c4efee7816ecdb764875284d408_rle_crop_3813275638_0.png treat image : temp/1748272829_522432_1361088772_3cc68c4efee7816ecdb764875284d408_rle_crop_3813275641_0.png treat image : temp/1748272829_522432_1361088772_3cc68c4efee7816ecdb764875284d408_rle_crop_3813275642_0.png treat image : temp/1748272829_522432_1361088772_3cc68c4efee7816ecdb764875284d408_rle_crop_3813275643_0.png treat image : temp/1748272829_522432_1361088772_3cc68c4efee7816ecdb764875284d408_rle_crop_3813275645_0.png treat image : temp/1748272829_522432_1361088772_3cc68c4efee7816ecdb764875284d408_rle_crop_3813275647_0.png treat image : temp/1748272829_522432_1361088772_3cc68c4efee7816ecdb764875284d408_rle_crop_3813275648_0.png treat image : temp/1748272829_522432_1361088770_64b5fe9c12a89ccc7a6a6e464515682a_rle_crop_3813275651_0.png treat image : temp/1748272829_522432_1361088770_64b5fe9c12a89ccc7a6a6e464515682a_rle_crop_3813275653_0.png treat image : temp/1748272829_522432_1361088770_64b5fe9c12a89ccc7a6a6e464515682a_rle_crop_3813275654_0.png treat image : temp/1748272829_522432_1361088770_64b5fe9c12a89ccc7a6a6e464515682a_rle_crop_3813275655_0.png treat image : temp/1748272829_522432_1361088770_64b5fe9c12a89ccc7a6a6e464515682a_rle_crop_3813275656_0.png treat image : temp/1748272829_522432_1361088770_64b5fe9c12a89ccc7a6a6e464515682a_rle_crop_3813275659_0.png treat image : temp/1748272829_522432_1361088770_64b5fe9c12a89ccc7a6a6e464515682a_rle_crop_3813275660_0.png treat image : temp/1748272829_522432_1361088770_64b5fe9c12a89ccc7a6a6e464515682a_rle_crop_3813275661_0.png treat image : temp/1748272829_522432_1361088770_64b5fe9c12a89ccc7a6a6e464515682a_rle_crop_3813275663_0.png treat image : temp/1748272829_522432_1361088749_7cd39eda64f084900cc20fbb3cad0688_rle_crop_3813275674_0.png treat image : temp/1748272829_522432_1361088745_2d76b0d229b979c16ea6180efa9a6f1b_rle_crop_3813275681_0.png treat image : temp/1748272829_522432_1361088745_2d76b0d229b979c16ea6180efa9a6f1b_rle_crop_3813275683_0.png treat image : temp/1748272829_522432_1361088742_490b07e21960cc575ed749bd7c7fccea_rle_crop_3813275687_0.png treat image : temp/1748272829_522432_1361088742_490b07e21960cc575ed749bd7c7fccea_rle_crop_3813275692_0.png treat image : temp/1748272829_522432_1361088742_490b07e21960cc575ed749bd7c7fccea_rle_crop_3813275696_0.png treat image : temp/1748272829_522432_1361088770_64b5fe9c12a89ccc7a6a6e464515682a_rle_crop_3813275664_0.png treat image : temp/1748272829_522432_1361088745_2d76b0d229b979c16ea6180efa9a6f1b_rle_crop_3813275684_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 130 time used for this insertion : 0.01941514015197754 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 130 time used for this insertion : 0.033599138259887695 save missing photos in datou_result : time spend for datou_step_exec : 8.641500234603882 time spend to save output : 0.058992862701416016 total time spend for step 7 : 8.700493097305298 step8:velours_tree Mon May 26 17:25:20 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.3588597774505615 time spend to save output : 4.9591064453125e-05 total time spend for step 8 : 0.35890936851501465 step9:send_mail_cod Mon May 26 17:25:21 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P23347836_26-05-2025_17_25_21.pdf 23348274 imagette233482741748273121 23348275 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette233482751748273121 23348276 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette233482761748273122 23348278 imagette233482781748273123 23348279 imagette233482791748273123 23348281 imagette233482811748273123 23348282 imagette233482821748273123 23348283 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette233482831748273123 23348284 change filename to text .change filename to text .imagette233482841748273124 23348285 imagette233482851748273124 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=23347836 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/23348274,23348275,23348276,23348277,23348278,23348279,23348281,23348282,23348283,23348284,23348285?tags=pet_fonce,papier,carton,environnement,mal_croppe,background,metal,pehd,pet_clair,autre,flou args[1361088944] : ((1361088944, -0.3758569648385428, 492688767), (1361088944, 0.18996936409513324, 2107752395), '0.09858914180384085') We are sending mail with results at report@fotonower.com args[1361088898] : ((1361088898, -3.2231685413915687, 492609224), (1361088898, 0.1753355805802679, 2107752395), '0.09858914180384085') We are sending mail with results at report@fotonower.com args[1361088813] : ((1361088813, -3.1801671579765096, 492609224), (1361088813, 0.09326068791063119, 2107752395), '0.09858914180384085') We are sending mail with results at report@fotonower.com args[1361088774] : ((1361088774, -2.311405677956743, 492609224), (1361088774, 0.24608090021613474, 2107752395), '0.09858914180384085') We are sending mail with results at report@fotonower.com args[1361088772] : ((1361088772, -1.5758220099544145, 492688767), (1361088772, 0.990249294069318, 2107752395), '0.09858914180384085') We are sending mail with results at report@fotonower.com args[1361088770] : ((1361088770, -1.025495005550872, 492688767), (1361088770, 0.4028350976034528, 2107752395), '0.09858914180384085') We are sending mail with results at report@fotonower.com args[1361088749] : ((1361088749, -2.2549587496230146, 492609224), (1361088749, 0.24496484262350962, 2107752395), '0.09858914180384085') We are sending mail with results at report@fotonower.com args[1361088745] : ((1361088745, -3.4639826166590053, 492609224), (1361088745, 0.1880598714830721, 2107752395), '0.09858914180384085') We are sending mail with results at report@fotonower.com args[1361088742] : ((1361088742, -3.446725401964773, 492609224), (1361088742, 0.18146039555317015, 2107752395), '0.09858914180384085') We are sending mail with results at report@fotonower.com refus_total : 0.09858914180384085 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=23347836 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23347836_26-05-2025_17_25_21.pdf results_Auto_P23347836_26-05-2025_17_25_21.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23347836_26-05-2025_17_25_21.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','23347836','results_Auto_P23347836_26-05-2025_17_25_21.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23347836_26-05-2025_17_25_21.pdf','pdf','','0.56','0.09858914180384085') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/23347836

https://www.fotonower.com/image?json=false&list_photos_id=1361088944
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361088898
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361088813
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361088774
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361088772
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361088770
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361088749
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361088745
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1361088742
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 9.86%
Veuillez trouver les photos des contaminants.

exemples de contaminants: papier: https://www.fotonower.com/view/23348275?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/23348276?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/23348283?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/23348284?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23347836_26-05-2025_17_25_21.pdf.

Lien vers velours :https://www.fotonower.com/velours/23348274,23348275,23348276,23348277,23348278,23348279,23348281,23348282,23348283,23348284,23348285?tags=pet_fonce,papier,carton,environnement,mal_croppe,background,metal,pehd,pet_clair,autre,flou.


L'équipe Fotonower 202 b'' Server: nginx Date: Mon, 26 May 2025 15:25:28 GMT Content-Length: 0 Connection: close X-Message-Id: 85z9e5reTa2cut5aHVS6mA Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1361088944, 1361088898, 1361088813, 1361088774, 1361088772, 1361088770, 1361088749, 1361088745, 1361088742] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2956399') ('3318', '23347836', '1361088944', None, None, None, None, None, '2956399') ('3318', None, None, None, None, None, None, None, '2956399') ('3318', '23347836', '1361088898', None, None, None, None, None, '2956399') ('3318', None, None, None, None, None, None, None, '2956399') ('3318', '23347836', '1361088813', None, None, None, None, None, '2956399') ('3318', None, None, None, None, None, None, None, '2956399') ('3318', '23347836', '1361088774', None, None, None, None, None, '2956399') ('3318', None, None, None, None, None, None, None, '2956399') ('3318', '23347836', '1361088772', None, None, None, None, None, '2956399') ('3318', None, None, None, None, None, None, None, '2956399') ('3318', '23347836', '1361088770', None, None, None, None, None, '2956399') ('3318', None, None, None, None, None, None, None, '2956399') ('3318', '23347836', '1361088749', None, None, None, None, None, '2956399') ('3318', None, None, None, None, None, None, None, '2956399') ('3318', '23347836', '1361088745', None, None, None, None, None, '2956399') ('3318', None, None, None, None, None, None, None, '2956399') ('3318', '23347836', '1361088742', None, None, None, None, None, '2956399') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.014395713806152344 save_final save missing photos in datou_result : time spend for datou_step_exec : 7.186009645462036 time spend to save output : 0.01468515396118164 total time spend for step 9 : 7.200694799423218 step10:split_time_score Mon May 26 17:25:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('15', 9),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 26052025 23347836 Nombre de photos uploadées : 9 / 23040 (0%) 26052025 23347836 Nombre de photos taguées (types de déchets): 0 / 9 (0%) 26052025 23347836 Nombre de photos taguées (volume) : 0 / 9 (0%) elapsed_time : load_data_split_time_score 1.430511474609375e-06 elapsed_time : order_list_meta_photo_and_scores 3.814697265625e-06 ????????? elapsed_time : fill_and_build_computed_from_old_data 0.00033736228942871094 elapsed_time : insert_dashboard_record_day_entry 0.031215429306030273 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23334478 order by id desc limit 1 Qualite : 0.08529745731415458 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23334483_26-05-2025_13_45_09.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23334483 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23334483 AND mptpi.`type`=3594 To do Qualite : 0.10314590041490454 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23334484_26-05-2025_13_39_29.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23334484 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23334484 AND mptpi.`type`=3594 To do Qualite : 0.1298923511823711 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23334517_26-05-2025_13_24_42.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23334517 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23334517 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23347800 order by id desc limit 1 Qualite : 0.09858914180384085 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23347836_26-05-2025_17_25_21.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23347836 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23347836 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'26052025': {'nb_upload': 9, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1361088944, 1361088898, 1361088813, 1361088774, 1361088772, 1361088770, 1361088749, 1361088745, 1361088742] Looping around the photos to save general results len do output : 1 /23347836Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2956399') ('3318', '23347836', '1361088944', None, None, None, None, None, '2956399') ('3318', None, None, None, None, None, None, None, '2956399') ('3318', '23347836', '1361088898', None, None, None, None, None, '2956399') ('3318', None, None, None, None, None, None, None, '2956399') ('3318', '23347836', '1361088813', None, None, None, None, None, '2956399') ('3318', None, None, None, None, None, None, None, '2956399') ('3318', '23347836', '1361088774', None, None, None, None, None, '2956399') ('3318', None, None, None, None, None, None, None, '2956399') ('3318', '23347836', '1361088772', None, None, None, None, None, '2956399') ('3318', None, None, None, None, None, None, None, '2956399') ('3318', '23347836', '1361088770', None, None, None, None, None, '2956399') ('3318', None, None, None, None, None, None, None, '2956399') ('3318', '23347836', '1361088749', None, None, None, None, None, '2956399') ('3318', None, None, None, None, None, None, None, '2956399') ('3318', '23347836', '1361088745', None, None, None, None, None, '2956399') ('3318', None, None, None, None, None, None, None, '2956399') ('3318', '23347836', '1361088742', None, None, None, None, None, '2956399') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.013942480087280273 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.2086212635040283 time spend to save output : 0.014199018478393555 total time spend for step 10 : 2.222820281982422 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 9 set_done_treatment 125.25user 139.67system 5:04.62elapsed 86%CPU (0avgtext+0avgdata 5009868maxresident)k 687880inputs+73568outputs (10095major+12162763minor)pagefaults 0swaps