python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 4107064 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2914173'] with mtr_portfolio_ids : ['23181897'] and first list_photo_ids : [] new path : /proc/4107064/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 8 ; length of list_pids : 8 ; length of list_args : 8 time to download the photos : 1.238938808441162 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Tue May 20 21:50:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10593 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-20 21:50:31.558109: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-20 21:50:31.583156: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-20 21:50:31.585109: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f45a0000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-20 21:50:31.585152: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-20 21:50:31.588698: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-20 21:50:31.694866: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x9e40540 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-20 21:50:31.694916: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-20 21:50:31.696221: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-20 21:50:31.696588: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-20 21:50:31.699457: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-20 21:50:31.702045: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-20 21:50:31.702521: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-20 21:50:31.704994: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-20 21:50:31.705921: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-20 21:50:31.709644: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-20 21:50:31.711093: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-20 21:50:31.711151: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-20 21:50:31.711910: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-20 21:50:31.711925: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-20 21:50:31.711934: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-20 21:50:31.713303: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9671 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-20 21:50:32.005197: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-20 21:50:32.005302: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-20 21:50:32.005325: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-20 21:50:32.005348: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-20 21:50:32.005374: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-20 21:50:32.005404: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-20 21:50:32.005434: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-20 21:50:32.005457: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-20 21:50:32.007158: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-20 21:50:32.008520: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-20 21:50:32.008570: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-20 21:50:32.008591: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-20 21:50:32.008608: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-20 21:50:32.008625: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-20 21:50:32.008653: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-20 21:50:32.008675: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-20 21:50:32.008693: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-20 21:50:32.010069: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-20 21:50:32.010117: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-20 21:50:32.010127: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-20 21:50:32.010136: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-20 21:50:32.011592: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9671 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-05-20 21:50:43.234960: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-20 21:50:43.483574: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 8 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 12.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 24 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 45 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 3.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 40 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 34 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 4.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 34 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 11.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 45 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 36 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 60 Detection mask done ! Trying to reset tf kernel 4107412 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5525 tf kernel not reseted sub process len(results) : 8 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 8 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10814 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0015969276428222656 nb_pixel_total : 41718 time to create 1 rle with old method : 0.044504404067993164 length of segment : 371 time for calcul the mask position with numpy : 0.0015480518341064453 nb_pixel_total : 65935 time to create 1 rle with old method : 0.07195496559143066 length of segment : 276 time for calcul the mask position with numpy : 0.001046895980834961 nb_pixel_total : 61772 time to create 1 rle with old method : 0.06515240669250488 length of segment : 224 time for calcul the mask position with numpy : 0.0007321834564208984 nb_pixel_total : 35580 time to create 1 rle with old method : 0.03849005699157715 length of segment : 294 time for calcul the mask position with numpy : 0.00049591064453125 nb_pixel_total : 22364 time to create 1 rle with old method : 0.02421736717224121 length of segment : 248 time for calcul the mask position with numpy : 0.00033545494079589844 nb_pixel_total : 12115 time to create 1 rle with old method : 0.01338505744934082 length of segment : 180 time for calcul the mask position with numpy : 0.0002486705780029297 nb_pixel_total : 8636 time to create 1 rle with old method : 0.009624958038330078 length of segment : 157 time for calcul the mask position with numpy : 0.0007026195526123047 nb_pixel_total : 35052 time to create 1 rle with old method : 0.03783154487609863 length of segment : 221 time for calcul the mask position with numpy : 0.00019860267639160156 nb_pixel_total : 7415 time to create 1 rle with old method : 0.00832223892211914 length of segment : 94 time for calcul the mask position with numpy : 0.0005743503570556641 nb_pixel_total : 29181 time to create 1 rle with old method : 0.032395362854003906 length of segment : 191 time for calcul the mask position with numpy : 0.0003407001495361328 nb_pixel_total : 19479 time to create 1 rle with old method : 0.022045373916625977 length of segment : 166 time for calcul the mask position with numpy : 0.003743886947631836 nb_pixel_total : 97717 time to create 1 rle with old method : 0.10489463806152344 length of segment : 540 time for calcul the mask position with numpy : 0.0007138252258300781 nb_pixel_total : 40891 time to create 1 rle with old method : 0.047002553939819336 length of segment : 214 time for calcul the mask position with numpy : 0.0004956722259521484 nb_pixel_total : 30250 time to create 1 rle with old method : 0.0336458683013916 length of segment : 162 time for calcul the mask position with numpy : 0.0006639957427978516 nb_pixel_total : 17774 time to create 1 rle with old method : 0.020071983337402344 length of segment : 200 time for calcul the mask position with numpy : 0.0010378360748291016 nb_pixel_total : 41172 time to create 1 rle with old method : 0.044988155364990234 length of segment : 291 time for calcul the mask position with numpy : 0.0004951953887939453 nb_pixel_total : 15059 time to create 1 rle with old method : 0.017804384231567383 length of segment : 161 time for calcul the mask position with numpy : 0.0011813640594482422 nb_pixel_total : 48115 time to create 1 rle with old method : 0.05333113670349121 length of segment : 277 time for calcul the mask position with numpy : 0.003967761993408203 nb_pixel_total : 150216 time to create 1 rle with new method : 0.01244664192199707 length of segment : 602 time for calcul the mask position with numpy : 0.0031595230102539062 nb_pixel_total : 100581 time to create 1 rle with old method : 0.11005687713623047 length of segment : 400 time for calcul the mask position with numpy : 0.0011610984802246094 nb_pixel_total : 39315 time to create 1 rle with old method : 0.04251551628112793 length of segment : 220 time for calcul the mask position with numpy : 0.00061798095703125 nb_pixel_total : 25245 time to create 1 rle with old method : 0.03450274467468262 length of segment : 188 time for calcul the mask position with numpy : 0.0015556812286376953 nb_pixel_total : 43681 time to create 1 rle with old method : 0.055977582931518555 length of segment : 303 time for calcul the mask position with numpy : 0.002026796340942383 nb_pixel_total : 71014 time to create 1 rle with old method : 0.08829116821289062 length of segment : 444 time for calcul the mask position with numpy : 0.0002808570861816406 nb_pixel_total : 7174 time to create 1 rle with old method : 0.008631706237792969 length of segment : 89 time for calcul the mask position with numpy : 0.0018837451934814453 nb_pixel_total : 59941 time to create 1 rle with old method : 0.0698552131652832 length of segment : 303 time for calcul the mask position with numpy : 0.00037360191345214844 nb_pixel_total : 16627 time to create 1 rle with old method : 0.01895880699157715 length of segment : 194 time for calcul the mask position with numpy : 0.0011510848999023438 nb_pixel_total : 45958 time to create 1 rle with old method : 0.05298566818237305 length of segment : 286 time for calcul the mask position with numpy : 0.000278472900390625 nb_pixel_total : 11239 time to create 1 rle with old method : 0.012704610824584961 length of segment : 230 time for calcul the mask position with numpy : 0.0011203289031982422 nb_pixel_total : 38965 time to create 1 rle with old method : 0.04462409019470215 length of segment : 222 time for calcul the mask position with numpy : 0.00029659271240234375 nb_pixel_total : 12899 time to create 1 rle with old method : 0.015294790267944336 length of segment : 99 time for calcul the mask position with numpy : 0.0003733634948730469 nb_pixel_total : 15644 time to create 1 rle with old method : 0.0227358341217041 length of segment : 144 time for calcul the mask position with numpy : 0.0036733150482177734 nb_pixel_total : 129101 time to create 1 rle with old method : 0.15428590774536133 length of segment : 422 time for calcul the mask position with numpy : 0.0010116100311279297 nb_pixel_total : 47825 time to create 1 rle with old method : 0.05602407455444336 length of segment : 350 time for calcul the mask position with numpy : 0.0012822151184082031 nb_pixel_total : 36535 time to create 1 rle with old method : 0.04268813133239746 length of segment : 299 time for calcul the mask position with numpy : 0.0012447834014892578 nb_pixel_total : 55642 time to create 1 rle with old method : 0.06203317642211914 length of segment : 381 time for calcul the mask position with numpy : 0.0009391307830810547 nb_pixel_total : 41846 time to create 1 rle with old method : 0.04756879806518555 length of segment : 225 time for calcul the mask position with numpy : 0.0007789134979248047 nb_pixel_total : 26467 time to create 1 rle with old method : 0.03791928291320801 length of segment : 201 time for calcul the mask position with numpy : 0.001077890396118164 nb_pixel_total : 20952 time to create 1 rle with old method : 0.02479410171508789 length of segment : 250 time for calcul the mask position with numpy : 0.0002925395965576172 nb_pixel_total : 10228 time to create 1 rle with old method : 0.012045860290527344 length of segment : 96 time for calcul the mask position with numpy : 0.0014150142669677734 nb_pixel_total : 58418 time to create 1 rle with old method : 0.06665992736816406 length of segment : 383 time for calcul the mask position with numpy : 0.0005204677581787109 nb_pixel_total : 21506 time to create 1 rle with old method : 0.02861762046813965 length of segment : 184 time for calcul the mask position with numpy : 0.0008344650268554688 nb_pixel_total : 31944 time to create 1 rle with old method : 0.03523683547973633 length of segment : 527 time for calcul the mask position with numpy : 0.00038170814514160156 nb_pixel_total : 16098 time to create 1 rle with old method : 0.018262386322021484 length of segment : 122 time for calcul the mask position with numpy : 0.00020051002502441406 nb_pixel_total : 7118 time to create 1 rle with old method : 0.008278608322143555 length of segment : 92 time for calcul the mask position with numpy : 0.0004324913024902344 nb_pixel_total : 18226 time to create 1 rle with old method : 0.020404577255249023 length of segment : 148 time for calcul the mask position with numpy : 0.0008139610290527344 nb_pixel_total : 42445 time to create 1 rle with old method : 0.05068612098693848 length of segment : 207 time for calcul the mask position with numpy : 0.00027179718017578125 nb_pixel_total : 12425 time to create 1 rle with old method : 0.01379704475402832 length of segment : 127 time for calcul the mask position with numpy : 0.002645254135131836 nb_pixel_total : 95452 time to create 1 rle with old method : 0.10299968719482422 length of segment : 389 time for calcul the mask position with numpy : 0.009714365005493164 nb_pixel_total : 180622 time to create 1 rle with new method : 0.020493745803833008 length of segment : 1042 time for calcul the mask position with numpy : 0.0005092620849609375 nb_pixel_total : 17493 time to create 1 rle with old method : 0.01931309700012207 length of segment : 202 time for calcul the mask position with numpy : 0.0004215240478515625 nb_pixel_total : 13550 time to create 1 rle with old method : 0.014809846878051758 length of segment : 309 time for calcul the mask position with numpy : 0.002610445022583008 nb_pixel_total : 46933 time to create 1 rle with old method : 0.05344438552856445 length of segment : 361 time for calcul the mask position with numpy : 0.003493070602416992 nb_pixel_total : 209352 time to create 1 rle with new method : 0.01161503791809082 length of segment : 428 time for calcul the mask position with numpy : 0.0013363361358642578 nb_pixel_total : 41741 time to create 1 rle with old method : 0.05002450942993164 length of segment : 376 time for calcul the mask position with numpy : 0.002009153366088867 nb_pixel_total : 59243 time to create 1 rle with old method : 0.06501650810241699 length of segment : 184 time for calcul the mask position with numpy : 0.0067102909088134766 nb_pixel_total : 171749 time to create 1 rle with new method : 0.013353347778320312 length of segment : 589 time for calcul the mask position with numpy : 0.0016942024230957031 nb_pixel_total : 24350 time to create 1 rle with old method : 0.027033090591430664 length of segment : 362 time for calcul the mask position with numpy : 0.0017096996307373047 nb_pixel_total : 35477 time to create 1 rle with old method : 0.03824734687805176 length of segment : 260 time for calcul the mask position with numpy : 0.00167083740234375 nb_pixel_total : 34992 time to create 1 rle with old method : 0.038405656814575195 length of segment : 209 time for calcul the mask position with numpy : 0.0009164810180664062 nb_pixel_total : 25873 time to create 1 rle with old method : 0.028246402740478516 length of segment : 150 time for calcul the mask position with numpy : 0.0021708011627197266 nb_pixel_total : 54582 time to create 1 rle with old method : 0.05967569351196289 length of segment : 250 time for calcul the mask position with numpy : 0.0010395050048828125 nb_pixel_total : 28103 time to create 1 rle with old method : 0.03607439994812012 length of segment : 169 time for calcul the mask position with numpy : 0.0005495548248291016 nb_pixel_total : 10275 time to create 1 rle with old method : 0.012039899826049805 length of segment : 129 time for calcul the mask position with numpy : 0.0032930374145507812 nb_pixel_total : 65421 time to create 1 rle with old method : 0.07355451583862305 length of segment : 320 time for calcul the mask position with numpy : 0.0026030540466308594 nb_pixel_total : 64568 time to create 1 rle with old method : 0.06753420829772949 length of segment : 460 time for calcul the mask position with numpy : 0.0018758773803710938 nb_pixel_total : 7629 time to create 1 rle with old method : 0.014527320861816406 length of segment : 238 time for calcul the mask position with numpy : 0.0008471012115478516 nb_pixel_total : 14252 time to create 1 rle with old method : 0.016445159912109375 length of segment : 187 time for calcul the mask position with numpy : 0.0015723705291748047 nb_pixel_total : 59682 time to create 1 rle with old method : 0.0734560489654541 length of segment : 353 time for calcul the mask position with numpy : 0.0004658699035644531 nb_pixel_total : 15410 time to create 1 rle with old method : 0.018388032913208008 length of segment : 121 time for calcul the mask position with numpy : 0.0009267330169677734 nb_pixel_total : 24078 time to create 1 rle with old method : 0.027585268020629883 length of segment : 147 time for calcul the mask position with numpy : 0.002079010009765625 nb_pixel_total : 48658 time to create 1 rle with old method : 0.0538790225982666 length of segment : 358 time for calcul the mask position with numpy : 0.0007581710815429688 nb_pixel_total : 25531 time to create 1 rle with old method : 0.0283200740814209 length of segment : 205 time for calcul the mask position with numpy : 0.0007002353668212891 nb_pixel_total : 18459 time to create 1 rle with old method : 0.021020174026489258 length of segment : 132 time for calcul the mask position with numpy : 0.0005121231079101562 nb_pixel_total : 11155 time to create 1 rle with old method : 0.01332998275756836 length of segment : 88 time for calcul the mask position with numpy : 0.0007767677307128906 nb_pixel_total : 20930 time to create 1 rle with old method : 0.023274898529052734 length of segment : 199 time for calcul the mask position with numpy : 0.0017364025115966797 nb_pixel_total : 32549 time to create 1 rle with old method : 0.0377504825592041 length of segment : 306 time for calcul the mask position with numpy : 0.0021963119506835938 nb_pixel_total : 64698 time to create 1 rle with old method : 0.09864449501037598 length of segment : 324 time for calcul the mask position with numpy : 0.0026984214782714844 nb_pixel_total : 28294 time to create 1 rle with old method : 0.04042530059814453 length of segment : 311 time for calcul the mask position with numpy : 0.0008120536804199219 nb_pixel_total : 21473 time to create 1 rle with old method : 0.02513742446899414 length of segment : 183 time for calcul the mask position with numpy : 0.0016360282897949219 nb_pixel_total : 33404 time to create 1 rle with old method : 0.03911232948303223 length of segment : 216 time for calcul the mask position with numpy : 0.0004811286926269531 nb_pixel_total : 14195 time to create 1 rle with old method : 0.016340255737304688 length of segment : 152 time for calcul the mask position with numpy : 0.0029098987579345703 nb_pixel_total : 54660 time to create 1 rle with old method : 0.062139272689819336 length of segment : 568 time for calcul the mask position with numpy : 0.0003685951232910156 nb_pixel_total : 8192 time to create 1 rle with old method : 0.009641170501708984 length of segment : 95 time for calcul the mask position with numpy : 0.004353761672973633 nb_pixel_total : 158960 time to create 1 rle with new method : 0.007707118988037109 length of segment : 480 time for calcul the mask position with numpy : 0.0003666877746582031 nb_pixel_total : 6828 time to create 1 rle with old method : 0.0077707767486572266 length of segment : 90 time for calcul the mask position with numpy : 0.0004856586456298828 nb_pixel_total : 9493 time to create 1 rle with old method : 0.011450767517089844 length of segment : 86 time for calcul the mask position with numpy : 0.002228260040283203 nb_pixel_total : 37882 time to create 1 rle with old method : 0.043399810791015625 length of segment : 311 time for calcul the mask position with numpy : 0.0020377635955810547 nb_pixel_total : 28143 time to create 1 rle with old method : 0.035228729248046875 length of segment : 306 time for calcul the mask position with numpy : 0.0013599395751953125 nb_pixel_total : 17285 time to create 1 rle with old method : 0.0281527042388916 length of segment : 198 time for calcul the mask position with numpy : 0.0012831687927246094 nb_pixel_total : 43039 time to create 1 rle with old method : 0.04816722869873047 length of segment : 200 time for calcul the mask position with numpy : 0.0004749298095703125 nb_pixel_total : 10930 time to create 1 rle with old method : 0.012294769287109375 length of segment : 110 time for calcul the mask position with numpy : 0.001706838607788086 nb_pixel_total : 36047 time to create 1 rle with old method : 0.05856657028198242 length of segment : 309 time for calcul the mask position with numpy : 0.00030159950256347656 nb_pixel_total : 5031 time to create 1 rle with old method : 0.005944967269897461 length of segment : 99 time for calcul the mask position with numpy : 0.0007181167602539062 nb_pixel_total : 12733 time to create 1 rle with old method : 0.014792442321777344 length of segment : 171 time for calcul the mask position with numpy : 0.001195669174194336 nb_pixel_total : 34096 time to create 1 rle with old method : 0.03933882713317871 length of segment : 149 time for calcul the mask position with numpy : 0.0004875659942626953 nb_pixel_total : 8085 time to create 1 rle with old method : 0.009319543838500977 length of segment : 143 time for calcul the mask position with numpy : 0.0009729862213134766 nb_pixel_total : 17434 time to create 1 rle with old method : 0.01962423324584961 length of segment : 294 time for calcul the mask position with numpy : 0.0009527206420898438 nb_pixel_total : 26559 time to create 1 rle with old method : 0.030672073364257812 length of segment : 193 time for calcul the mask position with numpy : 0.005692481994628906 nb_pixel_total : 80960 time to create 1 rle with old method : 0.09371471405029297 length of segment : 602 time for calcul the mask position with numpy : 0.0004241466522216797 nb_pixel_total : 8613 time to create 1 rle with old method : 0.009775638580322266 length of segment : 97 time for calcul the mask position with numpy : 0.002505779266357422 nb_pixel_total : 45844 time to create 1 rle with old method : 0.051552534103393555 length of segment : 319 time for calcul the mask position with numpy : 0.0008592605590820312 nb_pixel_total : 19537 time to create 1 rle with old method : 0.021898984909057617 length of segment : 222 time for calcul the mask position with numpy : 0.0012159347534179688 nb_pixel_total : 26208 time to create 1 rle with old method : 0.02879643440246582 length of segment : 267 time for calcul the mask position with numpy : 0.0008714199066162109 nb_pixel_total : 26391 time to create 1 rle with old method : 0.029817581176757812 length of segment : 192 time for calcul the mask position with numpy : 0.0015523433685302734 nb_pixel_total : 43980 time to create 1 rle with old method : 0.051325082778930664 length of segment : 276 time for calcul the mask position with numpy : 0.0007882118225097656 nb_pixel_total : 17226 time to create 1 rle with old method : 0.020498275756835938 length of segment : 133 time for calcul the mask position with numpy : 0.0008635520935058594 nb_pixel_total : 18535 time to create 1 rle with old method : 0.02158498764038086 length of segment : 169 time for calcul the mask position with numpy : 0.0024704933166503906 nb_pixel_total : 81373 time to create 1 rle with old method : 0.09275174140930176 length of segment : 267 time for calcul the mask position with numpy : 0.002044677734375 nb_pixel_total : 59020 time to create 1 rle with old method : 0.0766913890838623 length of segment : 290 time for calcul the mask position with numpy : 0.0007712841033935547 nb_pixel_total : 25961 time to create 1 rle with old method : 0.029624223709106445 length of segment : 179 time for calcul the mask position with numpy : 0.001310586929321289 nb_pixel_total : 43767 time to create 1 rle with old method : 0.0499882698059082 length of segment : 163 time for calcul the mask position with numpy : 0.0013554096221923828 nb_pixel_total : 30060 time to create 1 rle with old method : 0.046736717224121094 length of segment : 187 time for calcul the mask position with numpy : 0.0007581710815429688 nb_pixel_total : 13508 time to create 1 rle with old method : 0.020173072814941406 length of segment : 207 time for calcul the mask position with numpy : 0.0007593631744384766 nb_pixel_total : 13165 time to create 1 rle with old method : 0.016980886459350586 length of segment : 115 time for calcul the mask position with numpy : 0.0007910728454589844 nb_pixel_total : 20217 time to create 1 rle with old method : 0.023819684982299805 length of segment : 147 time for calcul the mask position with numpy : 0.0007538795471191406 nb_pixel_total : 13889 time to create 1 rle with old method : 0.016305923461914062 length of segment : 182 time for calcul the mask position with numpy : 0.0005297660827636719 nb_pixel_total : 9171 time to create 1 rle with old method : 0.010634422302246094 length of segment : 146 time for calcul the mask position with numpy : 0.00037670135498046875 nb_pixel_total : 11004 time to create 1 rle with old method : 0.012947559356689453 length of segment : 131 time for calcul the mask position with numpy : 0.008912324905395508 nb_pixel_total : 247812 time to create 1 rle with new method : 0.011367082595825195 length of segment : 717 time for calcul the mask position with numpy : 0.0004868507385253906 nb_pixel_total : 7111 time to create 1 rle with old method : 0.011473894119262695 length of segment : 125 time for calcul the mask position with numpy : 0.0007429122924804688 nb_pixel_total : 10190 time to create 1 rle with old method : 0.01657891273498535 length of segment : 138 time for calcul the mask position with numpy : 0.00029778480529785156 nb_pixel_total : 5723 time to create 1 rle with old method : 0.006781339645385742 length of segment : 131 time for calcul the mask position with numpy : 0.0016436576843261719 nb_pixel_total : 42130 time to create 1 rle with old method : 0.048209428787231445 length of segment : 200 time for calcul the mask position with numpy : 0.0003910064697265625 nb_pixel_total : 10719 time to create 1 rle with old method : 0.012507915496826172 length of segment : 131 time for calcul the mask position with numpy : 0.0011336803436279297 nb_pixel_total : 22072 time to create 1 rle with old method : 0.025774717330932617 length of segment : 196 time for calcul the mask position with numpy : 0.002079010009765625 nb_pixel_total : 42615 time to create 1 rle with old method : 0.048505306243896484 length of segment : 390 time for calcul the mask position with numpy : 0.0008196830749511719 nb_pixel_total : 41318 time to create 1 rle with old method : 0.04657435417175293 length of segment : 205 time for calcul the mask position with numpy : 0.0014181137084960938 nb_pixel_total : 20436 time to create 1 rle with old method : 0.024405479431152344 length of segment : 326 time for calcul the mask position with numpy : 0.0014791488647460938 nb_pixel_total : 20337 time to create 1 rle with old method : 0.023912429809570312 length of segment : 461 time for calcul the mask position with numpy : 0.003233194351196289 nb_pixel_total : 65504 time to create 1 rle with old method : 0.07631802558898926 length of segment : 367 time for calcul the mask position with numpy : 0.001962900161743164 nb_pixel_total : 31775 time to create 1 rle with old method : 0.036561012268066406 length of segment : 322 time for calcul the mask position with numpy : 0.004784107208251953 nb_pixel_total : 69181 time to create 1 rle with old method : 0.07881379127502441 length of segment : 430 time for calcul the mask position with numpy : 0.00093841552734375 nb_pixel_total : 19397 time to create 1 rle with old method : 0.022536277770996094 length of segment : 182 time for calcul the mask position with numpy : 0.0007979869842529297 nb_pixel_total : 15067 time to create 1 rle with old method : 0.017543315887451172 length of segment : 149 time for calcul the mask position with numpy : 0.00048065185546875 nb_pixel_total : 10661 time to create 1 rle with old method : 0.012069225311279297 length of segment : 112 time for calcul the mask position with numpy : 0.0005786418914794922 nb_pixel_total : 14577 time to create 1 rle with old method : 0.017096996307373047 length of segment : 131 time for calcul the mask position with numpy : 0.00099945068359375 nb_pixel_total : 18445 time to create 1 rle with old method : 0.023088455200195312 length of segment : 164 time for calcul the mask position with numpy : 0.004908323287963867 nb_pixel_total : 101930 time to create 1 rle with old method : 0.12092161178588867 length of segment : 371 time for calcul the mask position with numpy : 0.004224061965942383 nb_pixel_total : 109544 time to create 1 rle with old method : 0.12769579887390137 length of segment : 440 time for calcul the mask position with numpy : 0.0005903244018554688 nb_pixel_total : 16822 time to create 1 rle with old method : 0.019359588623046875 length of segment : 163 time for calcul the mask position with numpy : 0.0023429393768310547 nb_pixel_total : 47602 time to create 1 rle with old method : 0.05860567092895508 length of segment : 225 time for calcul the mask position with numpy : 0.0024619102478027344 nb_pixel_total : 25468 time to create 1 rle with old method : 0.03293442726135254 length of segment : 393 time for calcul the mask position with numpy : 0.0061054229736328125 nb_pixel_total : 120828 time to create 1 rle with old method : 0.14045238494873047 length of segment : 468 time for calcul the mask position with numpy : 0.0011167526245117188 nb_pixel_total : 30456 time to create 1 rle with old method : 0.035623788833618164 length of segment : 179 time for calcul the mask position with numpy : 0.00048422813415527344 nb_pixel_total : 9583 time to create 1 rle with old method : 0.011391878128051758 length of segment : 94 time for calcul the mask position with numpy : 0.002041339874267578 nb_pixel_total : 43141 time to create 1 rle with old method : 0.04998660087585449 length of segment : 336 time for calcul the mask position with numpy : 0.0010972023010253906 nb_pixel_total : 21645 time to create 1 rle with old method : 0.025103330612182617 length of segment : 161 time for calcul the mask position with numpy : 0.00196075439453125 nb_pixel_total : 29123 time to create 1 rle with old method : 0.04731869697570801 length of segment : 349 time for calcul the mask position with numpy : 0.001558542251586914 nb_pixel_total : 33356 time to create 1 rle with old method : 0.037589311599731445 length of segment : 193 time for calcul the mask position with numpy : 0.004529714584350586 nb_pixel_total : 60646 time to create 1 rle with old method : 0.07292938232421875 length of segment : 233 time for calcul the mask position with numpy : 0.0007224082946777344 nb_pixel_total : 10268 time to create 1 rle with old method : 0.012064933776855469 length of segment : 140 time for calcul the mask position with numpy : 0.0007154941558837891 nb_pixel_total : 9244 time to create 1 rle with old method : 0.01103973388671875 length of segment : 206 time for calcul the mask position with numpy : 0.0033721923828125 nb_pixel_total : 59633 time to create 1 rle with old method : 0.06647539138793945 length of segment : 357 time for calcul the mask position with numpy : 0.00038123130798339844 nb_pixel_total : 7831 time to create 1 rle with old method : 0.008774042129516602 length of segment : 177 time for calcul the mask position with numpy : 0.0007908344268798828 nb_pixel_total : 11262 time to create 1 rle with old method : 0.01282954216003418 length of segment : 171 time for calcul the mask position with numpy : 0.0002770423889160156 nb_pixel_total : 4295 time to create 1 rle with old method : 0.005779266357421875 length of segment : 91 time for calcul the mask position with numpy : 0.0008604526519775391 nb_pixel_total : 13818 time to create 1 rle with old method : 0.018601655960083008 length of segment : 163 time for calcul the mask position with numpy : 0.04027986526489258 nb_pixel_total : 448527 time to create 1 rle with new method : 0.6167542934417725 length of segment : 966 time spent for convertir_results : 16.641475200653076 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 159 chid ids of type : 3594 Number RLEs to save : 40560 save missing photos in datou_result : time spend for datou_step_exec : 79.88875484466553 time spend to save output : 2.479982852935791 total time spend for step 1 : 82.36873769760132 step2:crop_condition Tue May 20 21:51:51 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 8 ! batch 1 Loaded 159 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 113 About to insert : list_path_to_insert length 113 new photo from crops ! About to upload 113 photos upload in portfolio : 3736932 init cache_photo without model_param we have 113 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747770734_4107064 we have uploaded 113 photos in the portfolio 3736932 time of upload the photos Elapsed time : 25.221638441085815 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 22 About to insert : list_path_to_insert length 22 new photo from crops ! About to upload 22 photos upload in portfolio : 3736932 init cache_photo without model_param we have 22 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747770765_4107064 we have uploaded 22 photos in the portfolio 3736932 time of upload the photos Elapsed time : 16.436676740646362 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 22 About to insert : list_path_to_insert length 22 new photo from crops ! About to upload 22 photos upload in portfolio : 3736932 init cache_photo without model_param we have 22 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747770789_4107064 we have uploaded 22 photos in the portfolio 3736932 time of upload the photos Elapsed time : 6.97041916847229 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747770798_4107064 we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.173264741897583 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1359852690, 1359852678, 1359852666, 1359852659, 1359852656, 1359852593, 1359852589, 1359852586] Looping around the photos to save general results len do output : 159 /1359863273Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863274Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863275Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863276Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863277Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863278Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863279Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863280Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863281Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863282Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863283Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863284Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863285Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863286Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863287Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863288Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863289Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863290Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863291Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863292Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863293Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863294Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863295Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863296Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863297Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863298Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863299Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863300Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863301Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863302Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863303Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863304Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863305Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863306Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863307Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863308Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863309Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863310Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863311Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863312Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863313Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863314Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863315Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863316Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863317Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863318Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863319Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863320Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863321Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863322Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863323Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863324Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863325Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863326Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863327Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863328Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863329Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863330Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863331Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863332Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863333Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863334Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863335Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863336Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863337Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863338Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863339Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863340Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863341Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863342Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863343Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863344Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863345Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863346Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863348Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863350Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863351Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863352Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863353Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863354Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863355Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863356Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863357Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863358Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863359Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863360Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863361Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863362Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863363Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863364Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863365Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863366Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863367Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863368Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863369Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863370Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863371Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863372Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863373Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863374Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863375Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863376Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863377Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863378Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863379Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863380Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863381Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863382Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863383Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863384Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863385Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863386Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863387Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863418Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863419Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863420Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863421Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863422Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863423Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863424Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863425Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863426Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863427Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863428Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863429Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863430Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863431Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863432Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863433Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863434Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863435Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863436Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863437Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863438Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863439Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863444Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863445Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863446Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863447Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863448Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863449Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863450Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863451Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863452Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863453Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863454Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863455Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863456Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863457Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863458Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863459Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863460Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863461Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863462Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863463Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863464Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863465Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863467Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359863468Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2914173') ('3318', '23181897', '1359852690', None, None, None, None, None, '2914173') ('3318', None, None, None, None, None, None, None, '2914173') ('3318', '23181897', '1359852678', None, None, None, None, None, '2914173') ('3318', None, None, None, None, None, None, None, '2914173') ('3318', '23181897', '1359852666', None, None, None, None, None, '2914173') ('3318', None, None, None, None, None, None, None, '2914173') ('3318', '23181897', '1359852659', None, None, None, None, None, '2914173') ('3318', None, None, None, None, None, None, None, '2914173') ('3318', '23181897', '1359852656', None, None, None, None, None, '2914173') ('3318', None, None, None, None, None, None, None, '2914173') ('3318', '23181897', '1359852593', None, None, None, None, None, '2914173') ('3318', None, None, None, None, None, None, None, '2914173') ('3318', '23181897', '1359852589', None, None, None, None, None, '2914173') ('3318', None, None, None, None, None, None, None, '2914173') ('3318', '23181897', '1359852586', None, None, None, None, None, '2914173') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 485 time used for this insertion : 0.03257012367248535 save_final save missing photos in datou_result : time spend for datou_step_exec : 87.61151599884033 time spend to save output : 0.03783082962036133 total time spend for step 2 : 87.6493468284607 step3:rle_unique_nms_with_priority Tue May 20 21:53:19 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 159 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 14 nb_hashtags : 3 time to prepare the origin masks : 5.481942653656006 time for calcul the mask position with numpy : 0.6508755683898926 nb_pixel_total : 6543094 time to create 1 rle with new method : 0.6720736026763916 time for calcul the mask position with numpy : 0.025490522384643555 nb_pixel_total : 30250 time to create 1 rle with old method : 0.03495454788208008 time for calcul the mask position with numpy : 0.023476123809814453 nb_pixel_total : 40891 time to create 1 rle with old method : 0.04603099822998047 time for calcul the mask position with numpy : 0.023874282836914062 nb_pixel_total : 97717 time to create 1 rle with old method : 0.11183929443359375 time for calcul the mask position with numpy : 0.022761821746826172 nb_pixel_total : 19479 time to create 1 rle with old method : 0.02185511589050293 time for calcul the mask position with numpy : 0.023128986358642578 nb_pixel_total : 29181 time to create 1 rle with old method : 0.05054640769958496 time for calcul the mask position with numpy : 0.023726940155029297 nb_pixel_total : 7415 time to create 1 rle with old method : 0.008383512496948242 time for calcul the mask position with numpy : 0.022513628005981445 nb_pixel_total : 35052 time to create 1 rle with old method : 0.039528608322143555 time for calcul the mask position with numpy : 0.021883010864257812 nb_pixel_total : 7678 time to create 1 rle with old method : 0.008805036544799805 time for calcul the mask position with numpy : 0.021651744842529297 nb_pixel_total : 12115 time to create 1 rle with old method : 0.013797283172607422 time for calcul the mask position with numpy : 0.021793842315673828 nb_pixel_total : 22364 time to create 1 rle with old method : 0.025287389755249023 time for calcul the mask position with numpy : 0.022888898849487305 nb_pixel_total : 35580 time to create 1 rle with old method : 0.03977179527282715 time for calcul the mask position with numpy : 0.02475142478942871 nb_pixel_total : 61772 time to create 1 rle with old method : 0.06975007057189941 time for calcul the mask position with numpy : 0.02884221076965332 nb_pixel_total : 65934 time to create 1 rle with old method : 0.07216835021972656 time for calcul the mask position with numpy : 0.022347450256347656 nb_pixel_total : 41718 time to create 1 rle with old method : 0.04564213752746582 create new chi : 2.286064863204956 time to delete rle : 0.0254361629486084 batch 1 Loaded 29 chid ids of type : 3594 ++++++++++++++Number RLEs to save : 8786 TO DO : save crop sub photo not yet done ! save time : 0.5773570537567139 nb_obj : 19 nb_hashtags : 3 time to prepare the origin masks : 6.550379514694214 time for calcul the mask position with numpy : 0.4922208786010742 nb_pixel_total : 6199043 time to create 1 rle with new method : 0.9511325359344482 time for calcul the mask position with numpy : 0.02150726318359375 nb_pixel_total : 129101 time to create 1 rle with old method : 0.13819146156311035 time for calcul the mask position with numpy : 0.020757198333740234 nb_pixel_total : 15644 time to create 1 rle with old method : 0.017304420471191406 time for calcul the mask position with numpy : 0.02017354965209961 nb_pixel_total : 12899 time to create 1 rle with old method : 0.013846158981323242 time for calcul the mask position with numpy : 0.019963979721069336 nb_pixel_total : 442 time to create 1 rle with old method : 0.000667572021484375 time for calcul the mask position with numpy : 0.021236419677734375 nb_pixel_total : 11239 time to create 1 rle with old method : 0.012271404266357422 time for calcul the mask position with numpy : 0.02283453941345215 nb_pixel_total : 45958 time to create 1 rle with old method : 0.04968619346618652 time for calcul the mask position with numpy : 0.021674394607543945 nb_pixel_total : 16627 time to create 1 rle with old method : 0.018214702606201172 time for calcul the mask position with numpy : 0.021351099014282227 nb_pixel_total : 59941 time to create 1 rle with old method : 0.0647881031036377 time for calcul the mask position with numpy : 0.021619558334350586 nb_pixel_total : 7174 time to create 1 rle with old method : 0.007890701293945312 time for calcul the mask position with numpy : 0.024189233779907227 nb_pixel_total : 71014 time to create 1 rle with old method : 0.07694816589355469 time for calcul the mask position with numpy : 0.022287607192993164 nb_pixel_total : 43681 time to create 1 rle with old method : 0.04823565483093262 time for calcul the mask position with numpy : 0.021936893463134766 nb_pixel_total : 25245 time to create 1 rle with old method : 0.027648210525512695 time for calcul the mask position with numpy : 0.021384000778198242 nb_pixel_total : 39315 time to create 1 rle with old method : 0.042664289474487305 time for calcul the mask position with numpy : 0.021846771240234375 nb_pixel_total : 100581 time to create 1 rle with old method : 0.10700297355651855 time for calcul the mask position with numpy : 0.020323991775512695 nb_pixel_total : 150216 time to create 1 rle with new method : 0.6960735321044922 time for calcul the mask position with numpy : 0.021955490112304688 nb_pixel_total : 48115 time to create 1 rle with old method : 0.052748918533325195 time for calcul the mask position with numpy : 0.021921396255493164 nb_pixel_total : 15059 time to create 1 rle with old method : 0.01672506332397461 time for calcul the mask position with numpy : 0.021982192993164062 nb_pixel_total : 41172 time to create 1 rle with old method : 0.04475116729736328 time for calcul the mask position with numpy : 0.021749258041381836 nb_pixel_total : 17774 time to create 1 rle with old method : 0.01920294761657715 create new chi : 3.370445966720581 time to delete rle : 0.0016684532165527344 batch 1 Loaded 39 chid ids of type : 3594 ++++++++++++++++++++++Number RLEs to save : 12037 TO DO : save crop sub photo not yet done ! save time : 0.7542717456817627 nb_obj : 19 nb_hashtags : 4 time to prepare the origin masks : 7.573331356048584 time for calcul the mask position with numpy : 0.4911670684814453 nb_pixel_total : 6317300 time to create 1 rle with new method : 0.7633368968963623 time for calcul the mask position with numpy : 0.02045297622680664 nb_pixel_total : 4091 time to create 1 rle with old method : 0.0044744014739990234 time for calcul the mask position with numpy : 0.020246505737304688 nb_pixel_total : 17493 time to create 1 rle with old method : 0.018498897552490234 time for calcul the mask position with numpy : 0.02021169662475586 nb_pixel_total : 180622 time to create 1 rle with new method : 0.4700961112976074 time for calcul the mask position with numpy : 0.019863605499267578 nb_pixel_total : 95452 time to create 1 rle with old method : 0.0980381965637207 time for calcul the mask position with numpy : 0.019520282745361328 nb_pixel_total : 32 time to create 1 rle with old method : 7.104873657226562e-05 time for calcul the mask position with numpy : 0.02017951011657715 nb_pixel_total : 42445 time to create 1 rle with old method : 0.04598236083984375 time for calcul the mask position with numpy : 0.01976299285888672 nb_pixel_total : 18226 time to create 1 rle with old method : 0.018810033798217773 time for calcul the mask position with numpy : 0.01982259750366211 nb_pixel_total : 7118 time to create 1 rle with old method : 0.007315635681152344 time for calcul the mask position with numpy : 0.020020008087158203 nb_pixel_total : 16098 time to create 1 rle with old method : 0.017395973205566406 time for calcul the mask position with numpy : 0.021554231643676758 nb_pixel_total : 31944 time to create 1 rle with old method : 0.034804582595825195 time for calcul the mask position with numpy : 0.020249605178833008 nb_pixel_total : 21506 time to create 1 rle with old method : 0.02249312400817871 time for calcul the mask position with numpy : 0.021105527877807617 nb_pixel_total : 58418 time to create 1 rle with old method : 0.06202507019042969 time for calcul the mask position with numpy : 0.021378040313720703 nb_pixel_total : 10228 time to create 1 rle with old method : 0.011068105697631836 time for calcul the mask position with numpy : 0.021019458770751953 nb_pixel_total : 20952 time to create 1 rle with old method : 0.022483110427856445 time for calcul the mask position with numpy : 0.02056121826171875 nb_pixel_total : 26467 time to create 1 rle with old method : 0.028218507766723633 time for calcul the mask position with numpy : 0.021579980850219727 nb_pixel_total : 41846 time to create 1 rle with old method : 0.044519662857055664 time for calcul the mask position with numpy : 0.02066802978515625 nb_pixel_total : 55642 time to create 1 rle with old method : 0.05861186981201172 time for calcul the mask position with numpy : 0.02073359489440918 nb_pixel_total : 36535 time to create 1 rle with old method : 0.038496971130371094 time for calcul the mask position with numpy : 0.020936012268066406 nb_pixel_total : 47825 time to create 1 rle with old method : 0.04909324645996094 create new chi : 2.75557804107666 time to delete rle : 0.0016748905181884766 batch 1 Loaded 39 chid ids of type : 3594 +++++++++++++++++++++++++++Number RLEs to save : 12671 TO DO : save crop sub photo not yet done ! save time : 0.7732131481170654 nb_obj : 19 nb_hashtags : 4 time to prepare the origin masks : 7.093762636184692 time for calcul the mask position with numpy : 0.48337602615356445 nb_pixel_total : 6070668 time to create 1 rle with new method : 0.92635178565979 time for calcul the mask position with numpy : 0.022144556045532227 nb_pixel_total : 24078 time to create 1 rle with old method : 0.026986122131347656 time for calcul the mask position with numpy : 0.02125692367553711 nb_pixel_total : 9140 time to create 1 rle with old method : 0.010546684265136719 time for calcul the mask position with numpy : 0.021409034729003906 nb_pixel_total : 55551 time to create 1 rle with old method : 0.062372684478759766 time for calcul the mask position with numpy : 0.02178645133972168 nb_pixel_total : 14252 time to create 1 rle with old method : 0.01604294776916504 time for calcul the mask position with numpy : 0.021946191787719727 nb_pixel_total : 7629 time to create 1 rle with old method : 0.008704662322998047 time for calcul the mask position with numpy : 0.02342391014099121 nb_pixel_total : 64568 time to create 1 rle with old method : 0.07208037376403809 time for calcul the mask position with numpy : 0.024372339248657227 nb_pixel_total : 65421 time to create 1 rle with old method : 0.07161998748779297 time for calcul the mask position with numpy : 0.02602553367614746 nb_pixel_total : 10275 time to create 1 rle with old method : 0.01151132583618164 time for calcul the mask position with numpy : 0.022225141525268555 nb_pixel_total : 28103 time to create 1 rle with old method : 0.03113722801208496 time for calcul the mask position with numpy : 0.021872758865356445 nb_pixel_total : 54582 time to create 1 rle with old method : 0.058804988861083984 time for calcul the mask position with numpy : 0.02092719078063965 nb_pixel_total : 25133 time to create 1 rle with old method : 0.0270388126373291 time for calcul the mask position with numpy : 0.020647764205932617 nb_pixel_total : 34992 time to create 1 rle with old method : 0.03825807571411133 time for calcul the mask position with numpy : 0.021573781967163086 nb_pixel_total : 35477 time to create 1 rle with old method : 0.03817558288574219 time for calcul the mask position with numpy : 0.021587133407592773 nb_pixel_total : 24350 time to create 1 rle with old method : 0.026819944381713867 time for calcul the mask position with numpy : 0.021826982498168945 nb_pixel_total : 171749 time to create 1 rle with new method : 0.4189431667327881 time for calcul the mask position with numpy : 0.02156233787536621 nb_pixel_total : 59243 time to create 1 rle with old method : 0.0649869441986084 time for calcul the mask position with numpy : 0.02160811424255371 nb_pixel_total : 38744 time to create 1 rle with old method : 0.04233980178833008 time for calcul the mask position with numpy : 0.025323152542114258 nb_pixel_total : 209352 time to create 1 rle with new method : 0.7845938205718994 time for calcul the mask position with numpy : 0.022907257080078125 nb_pixel_total : 46933 time to create 1 rle with old method : 0.052010536193847656 create new chi : 3.784050226211548 time to delete rle : 0.0017571449279785156 batch 1 Loaded 39 chid ids of type : 3594 +++++++++++++++++++++++++++++++Number RLEs to save : 12417 TO DO : save crop sub photo not yet done ! save time : 0.7576467990875244 nb_obj : 15 nb_hashtags : 3 time to prepare the origin masks : 6.4229819774627686 time for calcul the mask position with numpy : 0.5458288192749023 nb_pixel_total : 6516333 time to create 1 rle with new method : 0.8964493274688721 time for calcul the mask position with numpy : 0.020983457565307617 nb_pixel_total : 2663 time to create 1 rle with old method : 0.0030393600463867188 time for calcul the mask position with numpy : 0.021756887435913086 nb_pixel_total : 158960 time to create 1 rle with new method : 0.6078016757965088 time for calcul the mask position with numpy : 0.034407615661621094 nb_pixel_total : 8192 time to create 1 rle with old method : 0.009786605834960938 time for calcul the mask position with numpy : 0.034462928771972656 nb_pixel_total : 54660 time to create 1 rle with old method : 0.0632936954498291 time for calcul the mask position with numpy : 0.03693723678588867 nb_pixel_total : 4281 time to create 1 rle with old method : 0.004862308502197266 time for calcul the mask position with numpy : 0.035831451416015625 nb_pixel_total : 33404 time to create 1 rle with old method : 0.04965949058532715 time for calcul the mask position with numpy : 0.02773427963256836 nb_pixel_total : 21473 time to create 1 rle with old method : 0.02316117286682129 time for calcul the mask position with numpy : 0.020380735397338867 nb_pixel_total : 28294 time to create 1 rle with old method : 0.031039953231811523 time for calcul the mask position with numpy : 0.021022796630859375 nb_pixel_total : 64698 time to create 1 rle with old method : 0.07032346725463867 time for calcul the mask position with numpy : 0.021558761596679688 nb_pixel_total : 32549 time to create 1 rle with old method : 0.035916805267333984 time for calcul the mask position with numpy : 0.02109074592590332 nb_pixel_total : 20930 time to create 1 rle with old method : 0.023111581802368164 time for calcul the mask position with numpy : 0.02122020721435547 nb_pixel_total : 11155 time to create 1 rle with old method : 0.012261390686035156 time for calcul the mask position with numpy : 0.02052140235900879 nb_pixel_total : 18459 time to create 1 rle with old method : 0.020304441452026367 time for calcul the mask position with numpy : 0.023020267486572266 nb_pixel_total : 25531 time to create 1 rle with old method : 0.0285642147064209 time for calcul the mask position with numpy : 0.021833419799804688 nb_pixel_total : 48658 time to create 1 rle with old method : 0.05186152458190918 create new chi : 2.9205353260040283 time to delete rle : 0.002367258071899414 batch 1 Loaded 31 chid ids of type : 3594 ++++++++++++++++++Number RLEs to save : 9415 TO DO : save crop sub photo not yet done ! save time : 0.5846066474914551 nb_obj : 18 nb_hashtags : 3 time to prepare the origin masks : 6.361827850341797 time for calcul the mask position with numpy : 0.4589211940765381 nb_pixel_total : 6604335 time to create 1 rle with new method : 0.812502384185791 time for calcul the mask position with numpy : 0.03545689582824707 nb_pixel_total : 26208 time to create 1 rle with old method : 0.028408050537109375 time for calcul the mask position with numpy : 0.033605337142944336 nb_pixel_total : 15508 time to create 1 rle with old method : 0.016968250274658203 time for calcul the mask position with numpy : 0.03398537635803223 nb_pixel_total : 45844 time to create 1 rle with old method : 0.049440622329711914 time for calcul the mask position with numpy : 0.03313040733337402 nb_pixel_total : 569 time to create 1 rle with old method : 0.0007436275482177734 time for calcul the mask position with numpy : 0.033672332763671875 nb_pixel_total : 80960 time to create 1 rle with old method : 0.08868670463562012 time for calcul the mask position with numpy : 0.033808231353759766 nb_pixel_total : 16618 time to create 1 rle with old method : 0.01844501495361328 time for calcul the mask position with numpy : 0.033460140228271484 nb_pixel_total : 17434 time to create 1 rle with old method : 0.019100189208984375 time for calcul the mask position with numpy : 0.03377366065979004 nb_pixel_total : 8085 time to create 1 rle with old method : 0.008840322494506836 time for calcul the mask position with numpy : 0.03183579444885254 nb_pixel_total : 34096 time to create 1 rle with old method : 0.03670215606689453 time for calcul the mask position with numpy : 0.020496606826782227 nb_pixel_total : 12733 time to create 1 rle with old method : 0.013919591903686523 time for calcul the mask position with numpy : 0.02059149742126465 nb_pixel_total : 5031 time to create 1 rle with old method : 0.00559544563293457 time for calcul the mask position with numpy : 0.021015644073486328 nb_pixel_total : 36047 time to create 1 rle with old method : 0.038628578186035156 time for calcul the mask position with numpy : 0.02038717269897461 nb_pixel_total : 10930 time to create 1 rle with old method : 0.011906623840332031 time for calcul the mask position with numpy : 0.020999908447265625 nb_pixel_total : 43039 time to create 1 rle with old method : 0.04648947715759277 time for calcul the mask position with numpy : 0.02119922637939453 nb_pixel_total : 17285 time to create 1 rle with old method : 0.018753528594970703 time for calcul the mask position with numpy : 0.020986557006835938 nb_pixel_total : 28143 time to create 1 rle with old method : 0.030426740646362305 time for calcul the mask position with numpy : 0.020502090454101562 nb_pixel_total : 37882 time to create 1 rle with old method : 0.0406498908996582 time for calcul the mask position with numpy : 0.02128767967224121 nb_pixel_total : 9493 time to create 1 rle with old method : 0.010200023651123047 create new chi : 2.283691167831421 time to delete rle : 0.0015892982482910156 batch 1 Loaded 37 chid ids of type : 3594 +++++++++++++++++++++++++Number RLEs to save : 10024 TO DO : save crop sub photo not yet done ! save time : 0.6175470352172852 nb_obj : 24 nb_hashtags : 3 time to prepare the origin masks : 10.088559627532959 time for calcul the mask position with numpy : 0.5372226238250732 nb_pixel_total : 6233915 time to create 1 rle with new method : 0.7621595859527588 time for calcul the mask position with numpy : 0.03350257873535156 nb_pixel_total : 686 time to create 1 rle with old method : 0.0010428428649902344 time for calcul the mask position with numpy : 0.03348231315612793 nb_pixel_total : 42615 time to create 1 rle with old method : 0.044541120529174805 time for calcul the mask position with numpy : 0.034511566162109375 nb_pixel_total : 22072 time to create 1 rle with old method : 0.023967981338500977 time for calcul the mask position with numpy : 0.033519744873046875 nb_pixel_total : 10719 time to create 1 rle with old method : 0.01123189926147461 time for calcul the mask position with numpy : 0.03368425369262695 nb_pixel_total : 42130 time to create 1 rle with old method : 0.045282602310180664 time for calcul the mask position with numpy : 0.034502267837524414 nb_pixel_total : 5723 time to create 1 rle with old method : 0.006170988082885742 time for calcul the mask position with numpy : 0.0332951545715332 nb_pixel_total : 10190 time to create 1 rle with old method : 0.01124715805053711 time for calcul the mask position with numpy : 0.03318071365356445 nb_pixel_total : 7111 time to create 1 rle with old method : 0.007894754409790039 time for calcul the mask position with numpy : 0.03609824180603027 nb_pixel_total : 247812 time to create 1 rle with new method : 0.45693254470825195 time for calcul the mask position with numpy : 0.033377885818481445 nb_pixel_total : 11004 time to create 1 rle with old method : 0.011983394622802734 time for calcul the mask position with numpy : 0.03296780586242676 nb_pixel_total : 9171 time to create 1 rle with old method : 0.010029077529907227 time for calcul the mask position with numpy : 0.03304243087768555 nb_pixel_total : 13889 time to create 1 rle with old method : 0.015480279922485352 time for calcul the mask position with numpy : 0.03271675109863281 nb_pixel_total : 20217 time to create 1 rle with old method : 0.025432109832763672 time for calcul the mask position with numpy : 0.03838348388671875 nb_pixel_total : 13165 time to create 1 rle with old method : 0.02118825912475586 time for calcul the mask position with numpy : 0.03406667709350586 nb_pixel_total : 13508 time to create 1 rle with old method : 0.015207767486572266 time for calcul the mask position with numpy : 0.02586817741394043 nb_pixel_total : 30060 time to create 1 rle with old method : 0.038359642028808594 time for calcul the mask position with numpy : 0.02339005470275879 nb_pixel_total : 43767 time to create 1 rle with old method : 0.05962824821472168 time for calcul the mask position with numpy : 0.022018909454345703 nb_pixel_total : 25961 time to create 1 rle with old method : 0.028705596923828125 time for calcul the mask position with numpy : 0.021448850631713867 nb_pixel_total : 59020 time to create 1 rle with old method : 0.06781959533691406 time for calcul the mask position with numpy : 0.021026134490966797 nb_pixel_total : 81373 time to create 1 rle with old method : 0.08851075172424316 time for calcul the mask position with numpy : 0.02217841148376465 nb_pixel_total : 18535 time to create 1 rle with old method : 0.020524263381958008 time for calcul the mask position with numpy : 0.021491050720214844 nb_pixel_total : 17226 time to create 1 rle with old method : 0.018825769424438477 time for calcul the mask position with numpy : 0.021614789962768555 nb_pixel_total : 43980 time to create 1 rle with old method : 0.04798436164855957 time for calcul the mask position with numpy : 0.020920991897583008 nb_pixel_total : 26391 time to create 1 rle with old method : 0.028717517852783203 create new chi : 3.1751933097839355 time to delete rle : 0.002591848373413086 batch 1 Loaded 49 chid ids of type : 3594 ++++++++++++++++++++++++++++++Number RLEs to save : 11945 TO DO : save crop sub photo not yet done ! save time : 0.7035391330718994 nb_obj : 31 nb_hashtags : 3 time to prepare the origin masks : 4.041707992553711 time for calcul the mask position with numpy : 0.5873508453369141 nb_pixel_total : 5551775 time to create 1 rle with new method : 0.9089393615722656 time for calcul the mask position with numpy : 0.027789831161499023 nb_pixel_total : 109544 time to create 1 rle with old method : 0.11670112609863281 time for calcul the mask position with numpy : 0.027804136276245117 nb_pixel_total : 25015 time to create 1 rle with old method : 0.026337146759033203 time for calcul the mask position with numpy : 0.03159046173095703 nb_pixel_total : 448527 time to create 1 rle with new method : 0.5721361637115479 time for calcul the mask position with numpy : 0.0295107364654541 nb_pixel_total : 16163 time to create 1 rle with old method : 0.019593000411987305 time for calcul the mask position with numpy : 0.029937744140625 nb_pixel_total : 11262 time to create 1 rle with old method : 0.013182640075683594 time for calcul the mask position with numpy : 0.029892921447753906 nb_pixel_total : 19746 time to create 1 rle with old method : 0.024251222610473633 time for calcul the mask position with numpy : 0.02946925163269043 nb_pixel_total : 9583 time to create 1 rle with old method : 0.010812759399414062 time for calcul the mask position with numpy : 0.028713464736938477 nb_pixel_total : 20436 time to create 1 rle with old method : 0.02256321907043457 time for calcul the mask position with numpy : 0.029089689254760742 nb_pixel_total : 29123 time to create 1 rle with old method : 0.03733015060424805 time for calcul the mask position with numpy : 0.0360260009765625 nb_pixel_total : 19397 time to create 1 rle with old method : 0.021854639053344727 time for calcul the mask position with numpy : 0.02937006950378418 nb_pixel_total : 43093 time to create 1 rle with old method : 0.04784083366394043 time for calcul the mask position with numpy : 0.029259681701660156 nb_pixel_total : 120828 time to create 1 rle with old method : 0.13119864463806152 time for calcul the mask position with numpy : 0.028506040573120117 nb_pixel_total : 30275 time to create 1 rle with old method : 0.03369951248168945 time for calcul the mask position with numpy : 0.02854442596435547 nb_pixel_total : 101930 time to create 1 rle with old method : 0.11028742790222168 time for calcul the mask position with numpy : 0.027662277221679688 nb_pixel_total : 31775 time to create 1 rle with old method : 0.0342867374420166 time for calcul the mask position with numpy : 0.028279542922973633 nb_pixel_total : 33356 time to create 1 rle with old method : 0.0523066520690918 time for calcul the mask position with numpy : 0.033121585845947266 nb_pixel_total : 9244 time to create 1 rle with old method : 0.01046609878540039 time for calcul the mask position with numpy : 0.029116153717041016 nb_pixel_total : 10268 time to create 1 rle with old method : 0.011604070663452148 time for calcul the mask position with numpy : 0.02930927276611328 nb_pixel_total : 65504 time to create 1 rle with old method : 0.07057952880859375 time for calcul the mask position with numpy : 0.027983427047729492 nb_pixel_total : 18445 time to create 1 rle with old method : 0.019831180572509766 time for calcul the mask position with numpy : 0.028634071350097656 nb_pixel_total : 60646 time to create 1 rle with old method : 0.09102106094360352 time for calcul the mask position with numpy : 0.03095078468322754 nb_pixel_total : 59633 time to create 1 rle with old method : 0.06391000747680664 time for calcul the mask position with numpy : 0.027951717376708984 nb_pixel_total : 15067 time to create 1 rle with old method : 0.01602029800415039 time for calcul the mask position with numpy : 0.030581235885620117 nb_pixel_total : 69181 time to create 1 rle with old method : 0.09435582160949707 time for calcul the mask position with numpy : 0.029094457626342773 nb_pixel_total : 47602 time to create 1 rle with old method : 0.058652639389038086 time for calcul the mask position with numpy : 0.02834486961364746 nb_pixel_total : 10661 time to create 1 rle with old method : 0.011757612228393555 time for calcul the mask position with numpy : 0.027820348739624023 nb_pixel_total : 13818 time to create 1 rle with old method : 0.015076398849487305 time for calcul the mask position with numpy : 0.0280148983001709 nb_pixel_total : 14572 time to create 1 rle with old method : 0.015773773193359375 time for calcul the mask position with numpy : 0.028973817825317383 nb_pixel_total : 21645 time to create 1 rle with old method : 0.02391529083251953 time for calcul the mask position with numpy : 0.028209209442138672 nb_pixel_total : 7831 time to create 1 rle with old method : 0.009235143661499023 time for calcul the mask position with numpy : 0.028290510177612305 nb_pixel_total : 4295 time to create 1 rle with old method : 0.00482177734375 create new chi : 4.25283670425415 time to delete rle : 0.0037114620208740234 batch 1 Loaded 63 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 19026 TO DO : save crop sub photo not yet done ! save time : 1.1098060607910156 map_output_result : {1359852690: (0.0, 'Should be the crop_list due to order', 0), 1359852678: (0.0, 'Should be the crop_list due to order', 0), 1359852666: (0.0, 'Should be the crop_list due to order', 0), 1359852659: (0.0, 'Should be the crop_list due to order', 0), 1359852656: (0.0, 'Should be the crop_list due to order', 0), 1359852593: (0.0, 'Should be the crop_list due to order', 0), 1359852589: (0.0, 'Should be the crop_list due to order', 0), 1359852586: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1359852690, 1359852678, 1359852666, 1359852659, 1359852656, 1359852593, 1359852589, 1359852586] Looping around the photos to save general results len do output : 8 /1359852690.Didn't retrieve data . /1359852678.Didn't retrieve data . /1359852666.Didn't retrieve data . /1359852659.Didn't retrieve data . /1359852656.Didn't retrieve data . /1359852593.Didn't retrieve data . /1359852589.Didn't retrieve data . /1359852586.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2914173') ('3318', '23181897', '1359852690', None, None, None, None, None, '2914173') ('3318', None, None, None, None, None, None, None, '2914173') ('3318', '23181897', '1359852678', None, None, None, None, None, '2914173') ('3318', None, None, None, None, None, None, None, '2914173') ('3318', '23181897', '1359852666', None, None, None, None, None, '2914173') ('3318', None, None, None, None, None, None, None, '2914173') ('3318', '23181897', '1359852659', None, None, None, None, None, '2914173') ('3318', None, None, None, None, None, None, None, '2914173') ('3318', '23181897', '1359852656', None, None, None, None, None, '2914173') ('3318', None, None, None, None, None, None, None, '2914173') ('3318', '23181897', '1359852593', None, None, None, None, None, '2914173') ('3318', None, None, None, None, None, None, None, '2914173') ('3318', '23181897', '1359852589', None, None, None, None, None, '2914173') ('3318', None, None, None, None, None, None, None, '2914173') ('3318', '23181897', '1359852586', None, None, None, None, None, '2914173') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.012824058532714844 save_final save missing photos in datou_result : time spend for datou_step_exec : 85.41069459915161 time spend to save output : 0.013358354568481445 total time spend for step 3 : 85.42405295372009 step4:ventilate_hashtags_in_portfolio Tue May 20 21:54:44 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 23181897 get user id for portfolio 23181897 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23181897 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('carton','environnement','pet_fonce','pet_clair','mal_croppe','flou','metal','autre','background','pehd','papier')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23181897 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('carton','environnement','pet_fonce','pet_clair','mal_croppe','flou','metal','autre','background','pehd','papier')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23181897 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('carton','environnement','pet_fonce','pet_clair','mal_croppe','flou','metal','autre','background','pehd','papier')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/23182086,23182087,23182088,23182089,23182090,23182091,23182092,23182093,23182094,23182095,23182096?tags=carton,environnement,pet_fonce,pet_clair,mal_croppe,flou,metal,autre,background,pehd,papier Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1359852690, 1359852678, 1359852666, 1359852659, 1359852656, 1359852593, 1359852589, 1359852586] Looping around the photos to save general results len do output : 1 /23181897. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2914173') ('3318', '23181897', '1359852690', None, None, None, None, None, '2914173') ('3318', None, None, None, None, None, None, None, '2914173') ('3318', '23181897', '1359852678', None, None, None, None, None, '2914173') ('3318', None, None, None, None, None, None, None, '2914173') ('3318', '23181897', '1359852666', None, None, None, None, None, '2914173') ('3318', None, None, None, None, None, None, None, '2914173') ('3318', '23181897', '1359852659', None, None, None, None, None, '2914173') ('3318', None, None, None, None, None, None, None, '2914173') ('3318', '23181897', '1359852656', None, None, None, None, None, '2914173') ('3318', None, None, None, None, None, None, None, '2914173') ('3318', '23181897', '1359852593', None, None, None, None, None, '2914173') ('3318', None, None, None, None, None, None, None, '2914173') ('3318', '23181897', '1359852589', None, None, None, None, None, '2914173') ('3318', None, None, None, None, None, None, None, '2914173') ('3318', '23181897', '1359852586', None, None, None, None, None, '2914173') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.013770103454589844 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.5900452136993408 time spend to save output : 0.014080524444580078 total time spend for step 4 : 1.604125738143921 step5:final Tue May 20 21:54:46 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1359852690: ('0.1128588707618464',), 1359852678: ('0.1128588707618464',), 1359852666: ('0.1128588707618464',), 1359852659: ('0.1128588707618464',), 1359852656: ('0.1128588707618464',), 1359852593: ('0.1128588707618464',), 1359852589: ('0.1128588707618464',), 1359852586: ('0.1128588707618464',)} new output for save of step final : {1359852690: ('0.1128588707618464',), 1359852678: ('0.1128588707618464',), 1359852666: ('0.1128588707618464',), 1359852659: ('0.1128588707618464',), 1359852656: ('0.1128588707618464',), 1359852593: ('0.1128588707618464',), 1359852589: ('0.1128588707618464',), 1359852586: ('0.1128588707618464',)} [1359852690, 1359852678, 1359852666, 1359852659, 1359852656, 1359852593, 1359852589, 1359852586] Looping around the photos to save general results len do output : 8 /1359852690.Didn't retrieve data . /1359852678.Didn't retrieve data . /1359852666.Didn't retrieve data . /1359852659.Didn't retrieve data . /1359852656.Didn't retrieve data . /1359852593.Didn't retrieve data . /1359852589.Didn't retrieve data . /1359852586.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2914173') ('3318', '23181897', '1359852690', None, None, None, None, None, '2914173') ('3318', None, None, None, None, None, None, None, '2914173') ('3318', '23181897', '1359852678', None, None, None, None, None, '2914173') ('3318', None, None, None, None, None, None, None, '2914173') ('3318', '23181897', '1359852666', None, None, None, None, None, '2914173') ('3318', None, None, None, None, None, None, None, '2914173') ('3318', '23181897', '1359852659', None, None, None, None, None, '2914173') ('3318', None, None, None, None, None, None, None, '2914173') ('3318', '23181897', '1359852656', None, None, None, None, None, '2914173') ('3318', None, None, None, None, None, None, None, '2914173') ('3318', '23181897', '1359852593', None, None, None, None, None, '2914173') ('3318', None, None, None, None, None, None, None, '2914173') ('3318', '23181897', '1359852589', None, None, None, None, None, '2914173') ('3318', None, None, None, None, None, None, None, '2914173') ('3318', '23181897', '1359852586', None, None, None, None, None, '2914173') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.012623310089111328 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.10728216171264648 time spend to save output : 0.013085365295410156 total time spend for step 5 : 0.12036752700805664 step6:blur_detection Tue May 20 21:54:46 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1747770627_4107064_1359852690_590970015a5cb015904388913a0fc12a.jpg resize: (2160, 3264) 1359852690 -2.7550842302461462 treat image : temp/1747770627_4107064_1359852678_417ddbee7ecfb6bc4a888466870b8102.jpg resize: (2160, 3264) 1359852678 -2.841148051338666 treat image : temp/1747770627_4107064_1359852666_dcb4ffad0fd71d95081a378d8c9695fd.jpg resize: (2160, 3264) 1359852666 -2.7259627740991346 treat image : temp/1747770627_4107064_1359852659_a74c6c3c32387fd98b518cefa6ada1d9.jpg resize: (2160, 3264) 1359852659 -0.6130143955883302 treat image : temp/1747770627_4107064_1359852656_647d50273da7604c0e522e9e3c9ba4a4.jpg resize: (2160, 3264) 1359852656 -1.4861560903618876 treat image : temp/1747770627_4107064_1359852593_780c5709d9dcceee679b6f5a1e49d4df.jpg resize: (2160, 3264) 1359852593 -2.5317078494122462 treat image : temp/1747770627_4107064_1359852589_4d9fb7c1b2ae38dac7784ecbd076e186.jpg resize: (2160, 3264) 1359852589 -4.036180061561887 treat image : temp/1747770627_4107064_1359852586_2323cf58b8ed443535b0b899306ec82b.jpg resize: (2160, 3264) 1359852586 -2.141009053950533 treat image : temp/1747770627_4107064_1359852690_590970015a5cb015904388913a0fc12a_rle_crop_3806588432_0.png resize: (94, 146) 1359863273 -1.856091526485182 treat image : temp/1747770627_4107064_1359852690_590970015a5cb015904388913a0fc12a_rle_crop_3806588429_0.png resize: (178, 114) 1359863274 -2.3208998059885384 treat image : temp/1747770627_4107064_1359852690_590970015a5cb015904388913a0fc12a_rle_crop_3806588428_0.png resize: (197, 185) 1359863275 -1.9584201620719153 treat image : temp/1747770627_4107064_1359852690_590970015a5cb015904388913a0fc12a_rle_crop_3806588430_0.png resize: (156, 100) 1359863276 -1.7555898289052458 treat image : temp/1747770627_4107064_1359852690_590970015a5cb015904388913a0fc12a_rle_crop_3806588436_0.png resize: (185, 312) 1359863277 -1.378309345457755 treat image : temp/1747770627_4107064_1359852690_590970015a5cb015904388913a0fc12a_rle_crop_3806588424_0.png resize: (357, 298) 1359863278 -0.7428794919572448 treat image : temp/1747770627_4107064_1359852690_590970015a5cb015904388913a0fc12a_rle_crop_3806588425_0.png resize: (270, 408) 1359863279 -1.0647020411908974 treat image : temp/1747770627_4107064_1359852690_590970015a5cb015904388913a0fc12a_rle_crop_3806588433_0.png resize: (188, 304) 1359863280 -2.4692657287015645 treat image : temp/1747770627_4107064_1359852690_590970015a5cb015904388913a0fc12a_rle_crop_3806588435_0.png resize: (540, 378) 1359863281 -0.9796137853655077 treat image : temp/1747770627_4107064_1359852690_590970015a5cb015904388913a0fc12a_rle_crop_3806588427_0.png resize: (285, 199) 1359863282 -0.3791540231200941 treat image : temp/1747770627_4107064_1359852678_417ddbee7ecfb6bc4a888466870b8102_rle_crop_3806588447_0.png resize: (283, 388) 1359863283 -2.632873208211359 treat image : temp/1747770627_4107064_1359852678_417ddbee7ecfb6bc4a888466870b8102_rle_crop_3806588449_0.png resize: (272, 377) 1359863284 -1.5029830017116244 treat image : temp/1747770627_4107064_1359852678_417ddbee7ecfb6bc4a888466870b8102_rle_crop_3806588450_0.png resize: (192, 106) 1359863285 -0.2630435041113137 treat image : temp/1747770627_4107064_1359852678_417ddbee7ecfb6bc4a888466870b8102_rle_crop_3806588445_0.png resize: (137, 258) 1359863286 -0.6352378325199959 treat image : temp/1747770627_4107064_1359852678_417ddbee7ecfb6bc4a888466870b8102_rle_crop_3806588438_0.png resize: (200, 189) 1359863287 -1.4104308154733187 treat image : temp/1747770627_4107064_1359852678_417ddbee7ecfb6bc4a888466870b8102_rle_crop_3806588452_0.png resize: (230, 58) 1359863288 0.6515544394268865 treat image : temp/1747770627_4107064_1359852678_417ddbee7ecfb6bc4a888466870b8102_rle_crop_3806588446_0.png resize: (303, 290) 1359863289 -1.3768955537872225 treat image : temp/1747770627_4107064_1359852678_417ddbee7ecfb6bc4a888466870b8102_rle_crop_3806588455_0.png resize: (143, 155) 1359863290 -0.4045883212320993 treat image : temp/1747770627_4107064_1359852678_417ddbee7ecfb6bc4a888466870b8102_rle_crop_3806588448_0.png resize: (88, 154) 1359863291 -1.7209216111824484 treat image : temp/1747770627_4107064_1359852678_417ddbee7ecfb6bc4a888466870b8102_rle_crop_3806588453_0.png resize: (222, 278) 1359863292 -2.175245486466688 treat image : temp/1747770627_4107064_1359852678_417ddbee7ecfb6bc4a888466870b8102_rle_crop_3806588443_0.png resize: (344, 654) 1359863293 -1.8707672372860473 treat image : temp/1747770627_4107064_1359852678_417ddbee7ecfb6bc4a888466870b8102_rle_crop_3806588440_0.png resize: (147, 170) 1359863294 -1.0873158123590227 treat image : temp/1747770627_4107064_1359852678_417ddbee7ecfb6bc4a888466870b8102_rle_crop_3806588441_0.png resize: (276, 278) 1359863295 -1.6095506405941997 treat image : temp/1747770627_4107064_1359852666_dcb4ffad0fd71d95081a378d8c9695fd_rle_crop_3806588459_0.png resize: (259, 297) 1359863296 -2.1330103863503833 treat image : temp/1747770627_4107064_1359852666_dcb4ffad0fd71d95081a378d8c9695fd_rle_crop_3806588466_0.png resize: (443, 112) 1359863297 -1.9780476111790979 treat image : temp/1747770627_4107064_1359852666_dcb4ffad0fd71d95081a378d8c9695fd_rle_crop_3806588475_0.png resize: (308, 66) 1359863298 -2.4585808837236423 treat image : temp/1747770627_4107064_1359852666_dcb4ffad0fd71d95081a378d8c9695fd_rle_crop_3806588474_0.png resize: (202, 163) 1359863299 -1.1876754419797184 treat image : temp/1747770627_4107064_1359852666_dcb4ffad0fd71d95081a378d8c9695fd_rle_crop_3806588462_0.png resize: (237, 217) 1359863300 -2.2794121246548973 treat image : temp/1747770627_4107064_1359852666_dcb4ffad0fd71d95081a378d8c9695fd_rle_crop_3806588471_0.png resize: (127, 125) 1359863301 -0.6402038827595529 treat image : temp/1747770627_4107064_1359852666_dcb4ffad0fd71d95081a378d8c9695fd_rle_crop_3806588458_0.png resize: (282, 234) 1359863302 -0.976851466458958 treat image : temp/1747770627_4107064_1359852666_dcb4ffad0fd71d95081a378d8c9695fd_rle_crop_3806588464_0.png resize: (381, 226) 1359863303 -1.3847590981899598 treat image : temp/1747770627_4107064_1359852659_a74c6c3c32387fd98b518cefa6ada1d9_rle_crop_3806588476_0.png resize: (257, 675) 1359863304 -2.1431392021640456 treat image : temp/1747770627_4107064_1359852659_a74c6c3c32387fd98b518cefa6ada1d9_rle_crop_3806588494_0.png resize: (146, 206) 1359863305 -0.9653539527167903 treat image : temp/1747770627_4107064_1359852659_a74c6c3c32387fd98b518cefa6ada1d9_rle_crop_3806588486_0.png resize: (169, 210) 1359863306 -0.8487214743175778 treat image : temp/1747770627_4107064_1359852659_a74c6c3c32387fd98b518cefa6ada1d9_rle_crop_3806588493_0.png resize: (88, 326) 1359863307 -2.5145943475482997 treat image : temp/1747770627_4107064_1359852659_a74c6c3c32387fd98b518cefa6ada1d9_rle_crop_3806588485_0.png resize: (228, 339) 1359863308 -1.1994497427810387 treat image : temp/1747770627_4107064_1359852659_a74c6c3c32387fd98b518cefa6ada1d9_rle_crop_3806588480_0.png resize: (577, 426) 1359863309 -0.11127949986595037 treat image : temp/1747770627_4107064_1359852659_a74c6c3c32387fd98b518cefa6ada1d9_rle_crop_3806588491_0.png resize: (186, 170) 1359863310 -1.133162119937783 treat image : temp/1747770627_4107064_1359852659_a74c6c3c32387fd98b518cefa6ada1d9_rle_crop_3806588478_0.png resize: (374, 226) 1359863311 -1.4587927052228544 treat image : temp/1747770627_4107064_1359852659_a74c6c3c32387fd98b518cefa6ada1d9_rle_crop_3806588481_0.png resize: (243, 152) 1359863312 -2.4199069297591214 treat image : temp/1747770627_4107064_1359852659_a74c6c3c32387fd98b518cefa6ada1d9_rle_crop_3806588490_0.png resize: (314, 210) 1359863313 -1.4132936959212017 treat image : temp/1747770627_4107064_1359852659_a74c6c3c32387fd98b518cefa6ada1d9_rle_crop_3806588482_0.png resize: (260, 254) 1359863314 0.0025392599992751044 treat image : temp/1747770627_4107064_1359852659_a74c6c3c32387fd98b518cefa6ada1d9_rle_crop_3806588483_0.png resize: (199, 311) 1359863315 -1.3303933001405657 treat image : temp/1747770627_4107064_1359852659_a74c6c3c32387fd98b518cefa6ada1d9_rle_crop_3806588489_0.png resize: (443, 214) 1359863316 -1.8012508570930161 treat image : temp/1747770627_4107064_1359852656_647d50273da7604c0e522e9e3c9ba4a4_rle_crop_3806588501_0.png resize: (306, 284) 1359863317 -0.38783347004560476 treat image : temp/1747770627_4107064_1359852656_647d50273da7604c0e522e9e3c9ba4a4_rle_crop_3806588500_0.png resize: (199, 292) 1359863318 -2.3116360659595023 treat image : temp/1747770627_4107064_1359852656_647d50273da7604c0e522e9e3c9ba4a4_rle_crop_3806588502_0.png resize: (311, 282) 1359863319 -1.5679047597541185 treat image : temp/1747770627_4107064_1359852656_647d50273da7604c0e522e9e3c9ba4a4_rle_crop_3806588509_0.png resize: (86, 120) 1359863320 -2.0138551716360524 treat image : temp/1747770627_4107064_1359852656_647d50273da7604c0e522e9e3c9ba4a4_rle_crop_3806588495_0.png resize: (340, 219) 1359863321 -1.7407797760203412 treat image : temp/1747770627_4107064_1359852656_647d50273da7604c0e522e9e3c9ba4a4_rle_crop_3806588505_0.png resize: (152, 182) 1359863322 -1.4705031060209097 treat image : temp/1747770627_4107064_1359852656_647d50273da7604c0e522e9e3c9ba4a4_rle_crop_3806588496_0.png resize: (205, 197) 1359863323 -0.9891669648227157 treat image : temp/1747770627_4107064_1359852656_647d50273da7604c0e522e9e3c9ba4a4_rle_crop_3806588507_0.png resize: (92, 127) 1359863324 -0.8079490537603194 treat image : temp/1747770627_4107064_1359852656_647d50273da7604c0e522e9e3c9ba4a4_rle_crop_3806588498_0.png resize: (88, 216) 1359863325 -1.8008114970107993 treat image : temp/1747770627_4107064_1359852656_647d50273da7604c0e522e9e3c9ba4a4_rle_crop_3806588503_0.png resize: (181, 144) 1359863326 -1.1111394214497778 treat image : temp/1747770627_4107064_1359852593_780c5709d9dcceee679b6f5a1e49d4df_rle_crop_3806588525_0.png resize: (315, 219) 1359863327 -1.4846570706651718 treat image : temp/1747770627_4107064_1359852593_780c5709d9dcceee679b6f5a1e49d4df_rle_crop_3806588511_0.png resize: (212, 436) 1359863328 -1.9372341104217854 treat image : temp/1747770627_4107064_1359852593_780c5709d9dcceee679b6f5a1e49d4df_rle_crop_3806588518_0.png resize: (159, 118) 1359863329 -1.735993435870677 treat image : temp/1747770627_4107064_1359852593_780c5709d9dcceee679b6f5a1e49d4df_rle_crop_3806588512_0.png resize: (299, 215) 1359863330 -1.3306751976274838 treat image : temp/1747770627_4107064_1359852593_780c5709d9dcceee679b6f5a1e49d4df_rle_crop_3806588521_0.png resize: (293, 95) 1359863331 -1.3662831840619645 treat image : temp/1747770627_4107064_1359852593_780c5709d9dcceee679b6f5a1e49d4df_rle_crop_3806588526_0.png resize: (221, 129) 1359863332 -1.425608667680961 treat image : temp/1747770627_4107064_1359852593_780c5709d9dcceee679b6f5a1e49d4df_rle_crop_3806588517_0.png resize: (97, 63) 1359863333 2.069298040088702 treat image : temp/1747770627_4107064_1359852593_780c5709d9dcceee679b6f5a1e49d4df_rle_crop_3806588522_0.png resize: (132, 312) 1359863334 -0.9057502264045064 treat image : temp/1747770627_4107064_1359852593_780c5709d9dcceee679b6f5a1e49d4df_rle_crop_3806588515_0.png resize: (109, 113) 1359863335 2.2415856655086333 treat image : temp/1747770627_4107064_1359852593_780c5709d9dcceee679b6f5a1e49d4df_rle_crop_3806588524_0.png resize: (97, 134) 1359863336 1.1957134724441587 treat image : temp/1747770627_4107064_1359852593_780c5709d9dcceee679b6f5a1e49d4df_rle_crop_3806588523_0.png resize: (327, 725) 1359863337 -1.7187035110828957 treat image : temp/1747770627_4107064_1359852593_780c5709d9dcceee679b6f5a1e49d4df_rle_crop_3806588513_0.png resize: (193, 192) 1359863338 -2.4746234276257497 treat image : temp/1747770627_4107064_1359852593_780c5709d9dcceee679b6f5a1e49d4df_rle_crop_3806588527_0.png resize: (259, 197) 1359863339 0.0022847224916011082 treat image : temp/1747770627_4107064_1359852593_780c5709d9dcceee679b6f5a1e49d4df_rle_crop_3806588514_0.png resize: (198, 250) 1359863340 -2.495719212797423 treat image : temp/1747770627_4107064_1359852589_4d9fb7c1b2ae38dac7784ecbd076e186_rle_crop_3806588536_0.png resize: (187, 220) 1359863341 -1.1355348441470356 treat image : temp/1747770627_4107064_1359852589_4d9fb7c1b2ae38dac7784ecbd076e186_rle_crop_3806588528_0.png resize: (183, 219) 1359863342 -2.0350942155538676 treat image : temp/1747770627_4107064_1359852589_4d9fb7c1b2ae38dac7784ecbd076e186_rle_crop_3806588544_0.png resize: (125, 73) 1359863343 -0.05690694300683791 treat image : temp/1747770627_4107064_1359852589_4d9fb7c1b2ae38dac7784ecbd076e186_rle_crop_3806588531_0.png resize: (169, 172) 1359863344 -1.7741004305365262 treat image : temp/1747770627_4107064_1359852589_4d9fb7c1b2ae38dac7784ecbd076e186_rle_crop_3806588530_0.png resize: (133, 224) 1359863345 -1.2741540686089405 treat image : temp/1747770627_4107064_1359852589_4d9fb7c1b2ae38dac7784ecbd076e186_rle_crop_3806588534_0.png resize: (170, 188) 1359863346 -1.8282216862223888 treat image : temp/1747770627_4107064_1359852589_4d9fb7c1b2ae38dac7784ecbd076e186_rle_crop_3806588537_0.png resize: (179, 116) 1359863348 -1.8460260756455908 treat image : temp/1747770627_4107064_1359852589_4d9fb7c1b2ae38dac7784ecbd076e186_rle_crop_3806588546_0.png resize: (116, 62) 1359863350 -1.5592943558842336 treat image : temp/1747770627_4107064_1359852589_4d9fb7c1b2ae38dac7784ecbd076e186_rle_crop_3806588533_0.png resize: (272, 332) 1359863351 -3.130797452060212 treat image : temp/1747770627_4107064_1359852589_4d9fb7c1b2ae38dac7784ecbd076e186_rle_crop_3806588529_0.png resize: (261, 227) 1359863352 -0.614495798376169 treat image : temp/1747770627_4107064_1359852589_4d9fb7c1b2ae38dac7784ecbd076e186_rle_crop_3806588548_0.png resize: (130, 138) 1359863353 -1.543122841541779 treat image : temp/1747770627_4107064_1359852589_4d9fb7c1b2ae38dac7784ecbd076e186_rle_crop_3806588538_0.png resize: (114, 192) 1359863354 -0.6689470156391697 treat image : temp/1747770627_4107064_1359852589_4d9fb7c1b2ae38dac7784ecbd076e186_rle_crop_3806588551_0.png resize: (199, 310) 1359863355 -0.6471548569171294 treat image : temp/1747770627_4107064_1359852589_4d9fb7c1b2ae38dac7784ecbd076e186_rle_crop_3806588550_0.png resize: (335, 281) 1359863356 -3.075511728934908 treat image : temp/1747770627_4107064_1359852589_4d9fb7c1b2ae38dac7784ecbd076e186_rle_crop_3806588539_0.png resize: (147, 214) 1359863357 -1.3638797497693005 treat image : temp/1747770627_4107064_1359852589_4d9fb7c1b2ae38dac7784ecbd076e186_rle_crop_3806588541_0.png resize: (145, 79) 1359863358 -0.6436150314736759 treat image : temp/1747770627_4107064_1359852589_4d9fb7c1b2ae38dac7784ecbd076e186_rle_crop_3806588543_0.png resize: (706, 401) 1359863359 -1.6308878119055126 treat image : temp/1747770627_4107064_1359852589_4d9fb7c1b2ae38dac7784ecbd076e186_rle_crop_3806588540_0.png resize: (182, 122) 1359863360 -1.0782282377730243 treat image : temp/1747770627_4107064_1359852589_4d9fb7c1b2ae38dac7784ecbd076e186_rle_crop_3806588545_0.png resize: (138, 141) 1359863361 -2.7205608269712034 treat image : temp/1747770627_4107064_1359852586_2323cf58b8ed443535b0b899306ec82b_rle_crop_3806588555_0.png resize: (319, 148) 1359863362 -2.645386361418224 treat image : temp/1747770627_4107064_1359852586_2323cf58b8ed443535b0b899306ec82b_rle_crop_3806588569_0.png resize: (94, 124) 1359863363 -0.017929392028556434 treat image : temp/1747770627_4107064_1359852586_2323cf58b8ed443535b0b899306ec82b_rle_crop_3806588552_0.png resize: (326, 99) 1359863364 -2.079610761209449 treat image : temp/1747770627_4107064_1359852586_2323cf58b8ed443535b0b899306ec82b_rle_crop_3806588553_0.png resize: (245, 215) 1359863365 -3.302291946115382 treat image : temp/1747770627_4107064_1359852586_2323cf58b8ed443535b0b899306ec82b_rle_crop_3806588576_0.png resize: (155, 111) 1359863366 -3.4994709178947696 treat image : temp/1747770627_4107064_1359852586_2323cf58b8ed443535b0b899306ec82b_rle_crop_3806588564_0.png resize: (136, 171) 1359863367 -1.0665869484465318 treat image : temp/1747770627_4107064_1359852586_2323cf58b8ed443535b0b899306ec82b_rle_crop_3806588561_0.png resize: (164, 148) 1359863368 -0.7033590702016784 treat image : temp/1747770627_4107064_1359852586_2323cf58b8ed443535b0b899306ec82b_rle_crop_3806588556_0.png resize: (392, 319) 1359863369 -1.5890531662909655 treat image : temp/1747770627_4107064_1359852586_2323cf58b8ed443535b0b899306ec82b_rle_crop_3806588574_0.png resize: (229, 326) 1359863370 -0.6421988900581552 treat image : temp/1747770627_4107064_1359852586_2323cf58b8ed443535b0b899306ec82b_rle_crop_3806588570_0.png resize: (335, 282) 1359863371 -0.8727062126047797 treat image : temp/1747770627_4107064_1359852586_2323cf58b8ed443535b0b899306ec82b_rle_crop_3806588567_0.png resize: (353, 521) 1359863372 0.36523713639431593 treat image : temp/1747770627_4107064_1359852586_2323cf58b8ed443535b0b899306ec82b_rle_crop_3806588566_0.png resize: (228, 239) 1359863373 -1.5135983496788816 treat image : temp/1747770627_4107064_1359852586_2323cf58b8ed443535b0b899306ec82b_rle_crop_3806588557_0.png resize: (179, 139) 1359863374 -0.08115932709907972 treat image : temp/1747770627_4107064_1359852586_2323cf58b8ed443535b0b899306ec82b_rle_crop_3806588565_0.png resize: (225, 302) 1359863375 -1.1655143288848462 treat image : temp/1747770627_4107064_1359852586_2323cf58b8ed443535b0b899306ec82b_rle_crop_3806588575_0.png resize: (139, 124) 1359863376 -0.6892932377363352 treat image : temp/1747770627_4107064_1359852586_2323cf58b8ed443535b0b899306ec82b_rle_crop_3806588572_0.png resize: (349, 151) 1359863377 -0.625418247213125 treat image : temp/1747770627_4107064_1359852586_2323cf58b8ed443535b0b899306ec82b_rle_crop_3806588579_0.png resize: (171, 124) 1359863378 -0.8906714524067009 treat image : temp/1747770627_4107064_1359852586_2323cf58b8ed443535b0b899306ec82b_rle_crop_3806588554_0.png resize: (360, 277) 1359863379 -0.7750094422228823 treat image : temp/1747770627_4107064_1359852586_2323cf58b8ed443535b0b899306ec82b_rle_crop_3806588558_0.png resize: (149, 160) 1359863380 -0.17737735125029766 treat image : temp/1747770627_4107064_1359852586_2323cf58b8ed443535b0b899306ec82b_rle_crop_3806588582_0.png resize: (945, 745) 1359863381 -2.2867794050713863 treat image : temp/1747770627_4107064_1359852586_2323cf58b8ed443535b0b899306ec82b_rle_crop_3806588581_0.png resize: (155, 159) 1359863382 -1.763010268747322 treat image : temp/1747770627_4107064_1359852586_2323cf58b8ed443535b0b899306ec82b_rle_crop_3806588580_0.png resize: (56, 122) 1359863383 -3.378678826041722 treat image : temp/1747770627_4107064_1359852586_2323cf58b8ed443535b0b899306ec82b_rle_crop_3806588560_0.png resize: (123, 151) 1359863384 0.8703838471234261 treat image : temp/1747770627_4107064_1359852586_2323cf58b8ed443535b0b899306ec82b_rle_crop_3806588559_0.png resize: (110, 112) 1359863385 2.5885789248881563 treat image : temp/1747770627_4107064_1359852586_2323cf58b8ed443535b0b899306ec82b_rle_crop_3806588578_0.png resize: (106, 97) 1359863386 -3.0023780847047474 treat image : temp/1747770627_4107064_1359852586_2323cf58b8ed443535b0b899306ec82b_rle_crop_3806588571_0.png resize: (160, 170) 1359863387 -0.10395440735008735 treat image : temp/1747770627_4107064_1359852690_590970015a5cb015904388913a0fc12a_rle_crop_3806588431_0.png resize: (217, 244) 1359863418 -1.4931586015879024 treat image : temp/1747770627_4107064_1359852678_417ddbee7ecfb6bc4a888466870b8102_rle_crop_3806588454_0.png resize: (90, 186) 1359863419 -1.0535509838736916 treat image : temp/1747770627_4107064_1359852678_417ddbee7ecfb6bc4a888466870b8102_rle_crop_3806588444_0.png resize: (220, 276) 1359863420 -2.1833184219365256 treat image : temp/1747770627_4107064_1359852678_417ddbee7ecfb6bc4a888466870b8102_rle_crop_3806588439_0.png resize: (232, 275) 1359863421 -1.648914709900473 treat image : temp/1747770627_4107064_1359852666_dcb4ffad0fd71d95081a378d8c9695fd_rle_crop_3806588461_0.png resize: (190, 222) 1359863422 -1.4800056929013297 treat image : temp/1747770627_4107064_1359852666_dcb4ffad0fd71d95081a378d8c9695fd_rle_crop_3806588473_0.png resize: (650, 543) 1359863423 -2.324741537868827 treat image : temp/1747770627_4107064_1359852666_dcb4ffad0fd71d95081a378d8c9695fd_rle_crop_3806588469_0.png resize: (148, 192) 1359863424 -0.008345143883070755 treat image : temp/1747770627_4107064_1359852666_dcb4ffad0fd71d95081a378d8c9695fd_rle_crop_3806588463_0.png resize: (89, 167) 1359863425 -1.844369349052229 treat image : temp/1747770627_4107064_1359852666_dcb4ffad0fd71d95081a378d8c9695fd_rle_crop_3806588467_0.png resize: (122, 219) 1359863426 -0.7151506348773308 treat image : temp/1747770627_4107064_1359852666_dcb4ffad0fd71d95081a378d8c9695fd_rle_crop_3806588468_0.png resize: (91, 110) 1359863427 -0.34546561290936356 treat image : temp/1747770627_4107064_1359852659_a74c6c3c32387fd98b518cefa6ada1d9_rle_crop_3806588479_0.png resize: (171, 421) 1359863428 -1.205507730482703 treat image : temp/1747770627_4107064_1359852659_a74c6c3c32387fd98b518cefa6ada1d9_rle_crop_3806588488_0.png resize: (320, 309) 1359863429 -1.2053613885071086 treat image : temp/1747770627_4107064_1359852656_647d50273da7604c0e522e9e3c9ba4a4_rle_crop_3806588506_0.png resize: (522, 239) 1359863430 -1.3850224845281516 treat image : temp/1747770627_4107064_1359852656_647d50273da7604c0e522e9e3c9ba4a4_rle_crop_3806588497_0.png resize: (131, 168) 1359863431 0.555734767663919 treat image : temp/1747770627_4107064_1359852656_647d50273da7604c0e522e9e3c9ba4a4_rle_crop_3806588504_0.png resize: (213, 288) 1359863432 -0.68995153935769 treat image : temp/1747770627_4107064_1359852656_647d50273da7604c0e522e9e3c9ba4a4_rle_crop_3806588499_0.png resize: (199, 129) 1359863433 -0.8713581643252262 treat image : temp/1747770627_4107064_1359852593_780c5709d9dcceee679b6f5a1e49d4df_rle_crop_3806588516_0.png resize: (241, 218) 1359863434 -1.8051943443635243 treat image : temp/1747770627_4107064_1359852593_780c5709d9dcceee679b6f5a1e49d4df_rle_crop_3806588520_0.png resize: (124, 87) 1359863435 -1.193048569593805 treat image : temp/1747770627_4107064_1359852593_780c5709d9dcceee679b6f5a1e49d4df_rle_crop_3806588510_0.png resize: (85, 183) 1359863436 -0.9285717316098824 treat image : temp/1747770627_4107064_1359852589_4d9fb7c1b2ae38dac7784ecbd076e186_rle_crop_3806588535_0.png resize: (154, 365) 1359863437 -2.6222997282866194 treat image : temp/1747770627_4107064_1359852589_4d9fb7c1b2ae38dac7784ecbd076e186_rle_crop_3806588547_0.png resize: (193, 328) 1359863438 -0.7767674989649438 treat image : temp/1747770627_4107064_1359852586_2323cf58b8ed443535b0b899306ec82b_rle_crop_3806588573_0.png resize: (193, 250) 1359863439 -1.1101751232453572 treat image : temp/1747770627_4107064_1359852690_590970015a5cb015904388913a0fc12a_rle_crop_3806588426_0.png resize: (211, 373) 1359863444 -1.7275452637073347 treat image : temp/1747770627_4107064_1359852690_590970015a5cb015904388913a0fc12a_rle_crop_3806588434_0.png resize: (166, 144) 1359863445 -0.12426617949217089 treat image : temp/1747770627_4107064_1359852690_590970015a5cb015904388913a0fc12a_rle_crop_3806588437_0.png resize: (159, 259) 1359863446 -0.8328365511901579 treat image : temp/1747770627_4107064_1359852678_417ddbee7ecfb6bc4a888466870b8102_rle_crop_3806588451_0.png resize: (266, 393) 1359863447 -1.5418555034725767 treat image : temp/1747770627_4107064_1359852678_417ddbee7ecfb6bc4a888466870b8102_rle_crop_3806588456_0.png resize: (399, 508) 1359863448 -3.4964198253982834 treat image : temp/1747770627_4107064_1359852678_417ddbee7ecfb6bc4a888466870b8102_rle_crop_3806588442_0.png resize: (436, 485) 1359863449 -2.3716971586682645 treat image : temp/1747770627_4107064_1359852666_dcb4ffad0fd71d95081a378d8c9695fd_rle_crop_3806588470_0.png resize: (186, 338) 1359863450 -1.7832644365284673 treat image : temp/1747770627_4107064_1359852666_dcb4ffad0fd71d95081a378d8c9695fd_rle_crop_3806588460_0.png resize: (224, 251) 1359863451 -3.5409814953842007 treat image : temp/1747770627_4107064_1359852666_dcb4ffad0fd71d95081a378d8c9695fd_rle_crop_3806588472_0.png resize: (315, 604) 1359863452 -1.5376461357202915 treat image : temp/1747770627_4107064_1359852666_dcb4ffad0fd71d95081a378d8c9695fd_rle_crop_3806588457_0.png resize: (350, 178) 1359863453 -2.811884655576096 treat image : temp/1747770627_4107064_1359852659_a74c6c3c32387fd98b518cefa6ada1d9_rle_crop_3806588492_0.png resize: (324, 316) 1359863454 -0.9015461548091072 treat image : temp/1747770627_4107064_1359852659_a74c6c3c32387fd98b518cefa6ada1d9_rle_crop_3806588477_0.png resize: (417, 633) 1359863455 0.13834084976034902 treat image : temp/1747770627_4107064_1359852659_a74c6c3c32387fd98b518cefa6ada1d9_rle_crop_3806588484_0.png resize: (147, 208) 1359863456 1.602815974104671 treat image : temp/1747770627_4107064_1359852656_647d50273da7604c0e522e9e3c9ba4a4_rle_crop_3806588508_0.png resize: (480, 410) 1359863457 -0.5523357704211939 treat image : temp/1747770627_4107064_1359852593_780c5709d9dcceee679b6f5a1e49d4df_rle_crop_3806588519_0.png resize: (145, 294) 1359863458 -2.550906043733657 treat image : temp/1747770627_4107064_1359852589_4d9fb7c1b2ae38dac7784ecbd076e186_rle_crop_3806588542_0.png resize: (131, 106) 1359863459 -1.7893853625434917 treat image : temp/1747770627_4107064_1359852589_4d9fb7c1b2ae38dac7784ecbd076e186_rle_crop_3806588549_0.png resize: (194, 158) 1359863460 -2.138468426008466 treat image : temp/1747770627_4107064_1359852589_4d9fb7c1b2ae38dac7784ecbd076e186_rle_crop_3806588532_0.png resize: (265, 417) 1359863461 -1.158034864150109 treat image : temp/1747770627_4107064_1359852586_2323cf58b8ed443535b0b899306ec82b_rle_crop_3806588563_0.png resize: (436, 321) 1359863462 -1.6520284760573702 treat image : temp/1747770627_4107064_1359852586_2323cf58b8ed443535b0b899306ec82b_rle_crop_3806588562_0.png resize: (352, 410) 1359863463 -1.2980204922931693 treat image : temp/1747770627_4107064_1359852586_2323cf58b8ed443535b0b899306ec82b_rle_crop_3806588568_0.png resize: (166, 261) 1359863464 -1.560308599150755 treat image : temp/1747770627_4107064_1359852586_2323cf58b8ed443535b0b899306ec82b_rle_crop_3806588577_0.png resize: (357, 245) 1359863465 -0.7544227683422526 treat image : temp/1747770627_4107064_1359852666_dcb4ffad0fd71d95081a378d8c9695fd_rle_crop_3806588465_0.png resize: (184, 145) 1359863467 -0.14594860653477298 treat image : temp/1747770627_4107064_1359852659_a74c6c3c32387fd98b518cefa6ada1d9_rle_crop_3806588487_0.png resize: (129, 98) 1359863468 0.3671232638088982 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 167 time used for this insertion : 0.02062535285949707 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 167 time used for this insertion : 0.03171229362487793 save missing photos in datou_result : time spend for datou_step_exec : 30.106934785842896 time spend to save output : 0.058363914489746094 total time spend for step 6 : 30.16529870033264 step7:brightness Tue May 20 21:55:16 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1747770627_4107064_1359852690_590970015a5cb015904388913a0fc12a.jpg treat image : temp/1747770627_4107064_1359852678_417ddbee7ecfb6bc4a888466870b8102.jpg treat image : temp/1747770627_4107064_1359852666_dcb4ffad0fd71d95081a378d8c9695fd.jpg treat image : temp/1747770627_4107064_1359852659_a74c6c3c32387fd98b518cefa6ada1d9.jpg treat image : temp/1747770627_4107064_1359852656_647d50273da7604c0e522e9e3c9ba4a4.jpg treat image : temp/1747770627_4107064_1359852593_780c5709d9dcceee679b6f5a1e49d4df.jpg treat image : temp/1747770627_4107064_1359852589_4d9fb7c1b2ae38dac7784ecbd076e186.jpg treat image : temp/1747770627_4107064_1359852586_2323cf58b8ed443535b0b899306ec82b.jpg treat image : temp/1747770627_4107064_1359852690_590970015a5cb015904388913a0fc12a_rle_crop_3806588432_0.png treat image : temp/1747770627_4107064_1359852690_590970015a5cb015904388913a0fc12a_rle_crop_3806588429_0.png treat image : temp/1747770627_4107064_1359852690_590970015a5cb015904388913a0fc12a_rle_crop_3806588428_0.png treat image : temp/1747770627_4107064_1359852690_590970015a5cb015904388913a0fc12a_rle_crop_3806588430_0.png treat image : temp/1747770627_4107064_1359852690_590970015a5cb015904388913a0fc12a_rle_crop_3806588436_0.png treat image : temp/1747770627_4107064_1359852690_590970015a5cb015904388913a0fc12a_rle_crop_3806588424_0.png treat image : temp/1747770627_4107064_1359852690_590970015a5cb015904388913a0fc12a_rle_crop_3806588425_0.png treat image : temp/1747770627_4107064_1359852690_590970015a5cb015904388913a0fc12a_rle_crop_3806588433_0.png treat image : temp/1747770627_4107064_1359852690_590970015a5cb015904388913a0fc12a_rle_crop_3806588435_0.png treat image : temp/1747770627_4107064_1359852690_590970015a5cb015904388913a0fc12a_rle_crop_3806588427_0.png treat image : temp/1747770627_4107064_1359852678_417ddbee7ecfb6bc4a888466870b8102_rle_crop_3806588447_0.png treat image : temp/1747770627_4107064_1359852678_417ddbee7ecfb6bc4a888466870b8102_rle_crop_3806588449_0.png treat image : temp/1747770627_4107064_1359852678_417ddbee7ecfb6bc4a888466870b8102_rle_crop_3806588450_0.png treat image : temp/1747770627_4107064_1359852678_417ddbee7ecfb6bc4a888466870b8102_rle_crop_3806588445_0.png treat image : temp/1747770627_4107064_1359852678_417ddbee7ecfb6bc4a888466870b8102_rle_crop_3806588438_0.png treat image : temp/1747770627_4107064_1359852678_417ddbee7ecfb6bc4a888466870b8102_rle_crop_3806588452_0.png treat image : temp/1747770627_4107064_1359852678_417ddbee7ecfb6bc4a888466870b8102_rle_crop_3806588446_0.png treat image : temp/1747770627_4107064_1359852678_417ddbee7ecfb6bc4a888466870b8102_rle_crop_3806588455_0.png treat image : temp/1747770627_4107064_1359852678_417ddbee7ecfb6bc4a888466870b8102_rle_crop_3806588448_0.png treat image : temp/1747770627_4107064_1359852678_417ddbee7ecfb6bc4a888466870b8102_rle_crop_3806588453_0.png treat image : temp/1747770627_4107064_1359852678_417ddbee7ecfb6bc4a888466870b8102_rle_crop_3806588443_0.png treat image : temp/1747770627_4107064_1359852678_417ddbee7ecfb6bc4a888466870b8102_rle_crop_3806588440_0.png treat image : temp/1747770627_4107064_1359852678_417ddbee7ecfb6bc4a888466870b8102_rle_crop_3806588441_0.png treat image : temp/1747770627_4107064_1359852666_dcb4ffad0fd71d95081a378d8c9695fd_rle_crop_3806588459_0.png treat image : temp/1747770627_4107064_1359852666_dcb4ffad0fd71d95081a378d8c9695fd_rle_crop_3806588466_0.png treat image : temp/1747770627_4107064_1359852666_dcb4ffad0fd71d95081a378d8c9695fd_rle_crop_3806588475_0.png treat image : temp/1747770627_4107064_1359852666_dcb4ffad0fd71d95081a378d8c9695fd_rle_crop_3806588474_0.png treat image : temp/1747770627_4107064_1359852666_dcb4ffad0fd71d95081a378d8c9695fd_rle_crop_3806588462_0.png treat image : temp/1747770627_4107064_1359852666_dcb4ffad0fd71d95081a378d8c9695fd_rle_crop_3806588471_0.png treat image : temp/1747770627_4107064_1359852666_dcb4ffad0fd71d95081a378d8c9695fd_rle_crop_3806588458_0.png treat image : temp/1747770627_4107064_1359852666_dcb4ffad0fd71d95081a378d8c9695fd_rle_crop_3806588464_0.png treat image : temp/1747770627_4107064_1359852659_a74c6c3c32387fd98b518cefa6ada1d9_rle_crop_3806588476_0.png treat image : temp/1747770627_4107064_1359852659_a74c6c3c32387fd98b518cefa6ada1d9_rle_crop_3806588494_0.png treat image : temp/1747770627_4107064_1359852659_a74c6c3c32387fd98b518cefa6ada1d9_rle_crop_3806588486_0.png treat image : temp/1747770627_4107064_1359852659_a74c6c3c32387fd98b518cefa6ada1d9_rle_crop_3806588493_0.png treat image : temp/1747770627_4107064_1359852659_a74c6c3c32387fd98b518cefa6ada1d9_rle_crop_3806588485_0.png treat image : temp/1747770627_4107064_1359852659_a74c6c3c32387fd98b518cefa6ada1d9_rle_crop_3806588480_0.png treat image : temp/1747770627_4107064_1359852659_a74c6c3c32387fd98b518cefa6ada1d9_rle_crop_3806588491_0.png treat image : temp/1747770627_4107064_1359852659_a74c6c3c32387fd98b518cefa6ada1d9_rle_crop_3806588478_0.png treat image : temp/1747770627_4107064_1359852659_a74c6c3c32387fd98b518cefa6ada1d9_rle_crop_3806588481_0.png treat image : temp/1747770627_4107064_1359852659_a74c6c3c32387fd98b518cefa6ada1d9_rle_crop_3806588490_0.png treat image : temp/1747770627_4107064_1359852659_a74c6c3c32387fd98b518cefa6ada1d9_rle_crop_3806588482_0.png treat image : temp/1747770627_4107064_1359852659_a74c6c3c32387fd98b518cefa6ada1d9_rle_crop_3806588483_0.png treat image : temp/1747770627_4107064_1359852659_a74c6c3c32387fd98b518cefa6ada1d9_rle_crop_3806588489_0.png treat image : temp/1747770627_4107064_1359852656_647d50273da7604c0e522e9e3c9ba4a4_rle_crop_3806588501_0.png treat image : temp/1747770627_4107064_1359852656_647d50273da7604c0e522e9e3c9ba4a4_rle_crop_3806588500_0.png treat image : temp/1747770627_4107064_1359852656_647d50273da7604c0e522e9e3c9ba4a4_rle_crop_3806588502_0.png treat image : temp/1747770627_4107064_1359852656_647d50273da7604c0e522e9e3c9ba4a4_rle_crop_3806588509_0.png treat image : temp/1747770627_4107064_1359852656_647d50273da7604c0e522e9e3c9ba4a4_rle_crop_3806588495_0.png treat image : temp/1747770627_4107064_1359852656_647d50273da7604c0e522e9e3c9ba4a4_rle_crop_3806588505_0.png treat image : temp/1747770627_4107064_1359852656_647d50273da7604c0e522e9e3c9ba4a4_rle_crop_3806588496_0.png treat image : temp/1747770627_4107064_1359852656_647d50273da7604c0e522e9e3c9ba4a4_rle_crop_3806588507_0.png treat image : temp/1747770627_4107064_1359852656_647d50273da7604c0e522e9e3c9ba4a4_rle_crop_3806588498_0.png treat image : temp/1747770627_4107064_1359852656_647d50273da7604c0e522e9e3c9ba4a4_rle_crop_3806588503_0.png treat image : temp/1747770627_4107064_1359852593_780c5709d9dcceee679b6f5a1e49d4df_rle_crop_3806588525_0.png treat image : temp/1747770627_4107064_1359852593_780c5709d9dcceee679b6f5a1e49d4df_rle_crop_3806588511_0.png treat image : temp/1747770627_4107064_1359852593_780c5709d9dcceee679b6f5a1e49d4df_rle_crop_3806588518_0.png treat image : temp/1747770627_4107064_1359852593_780c5709d9dcceee679b6f5a1e49d4df_rle_crop_3806588512_0.png treat image : temp/1747770627_4107064_1359852593_780c5709d9dcceee679b6f5a1e49d4df_rle_crop_3806588521_0.png treat image : temp/1747770627_4107064_1359852593_780c5709d9dcceee679b6f5a1e49d4df_rle_crop_3806588526_0.png treat image : temp/1747770627_4107064_1359852593_780c5709d9dcceee679b6f5a1e49d4df_rle_crop_3806588517_0.png treat image : temp/1747770627_4107064_1359852593_780c5709d9dcceee679b6f5a1e49d4df_rle_crop_3806588522_0.png treat image : temp/1747770627_4107064_1359852593_780c5709d9dcceee679b6f5a1e49d4df_rle_crop_3806588515_0.png treat image : temp/1747770627_4107064_1359852593_780c5709d9dcceee679b6f5a1e49d4df_rle_crop_3806588524_0.png treat image : temp/1747770627_4107064_1359852593_780c5709d9dcceee679b6f5a1e49d4df_rle_crop_3806588523_0.png treat image : temp/1747770627_4107064_1359852593_780c5709d9dcceee679b6f5a1e49d4df_rle_crop_3806588513_0.png treat image : temp/1747770627_4107064_1359852593_780c5709d9dcceee679b6f5a1e49d4df_rle_crop_3806588527_0.png treat image : temp/1747770627_4107064_1359852593_780c5709d9dcceee679b6f5a1e49d4df_rle_crop_3806588514_0.png treat image : temp/1747770627_4107064_1359852589_4d9fb7c1b2ae38dac7784ecbd076e186_rle_crop_3806588536_0.png treat image : temp/1747770627_4107064_1359852589_4d9fb7c1b2ae38dac7784ecbd076e186_rle_crop_3806588528_0.png treat image : temp/1747770627_4107064_1359852589_4d9fb7c1b2ae38dac7784ecbd076e186_rle_crop_3806588544_0.png treat image : temp/1747770627_4107064_1359852589_4d9fb7c1b2ae38dac7784ecbd076e186_rle_crop_3806588531_0.png treat image : temp/1747770627_4107064_1359852589_4d9fb7c1b2ae38dac7784ecbd076e186_rle_crop_3806588530_0.png treat image : temp/1747770627_4107064_1359852589_4d9fb7c1b2ae38dac7784ecbd076e186_rle_crop_3806588534_0.png treat image : temp/1747770627_4107064_1359852589_4d9fb7c1b2ae38dac7784ecbd076e186_rle_crop_3806588537_0.png treat image : temp/1747770627_4107064_1359852589_4d9fb7c1b2ae38dac7784ecbd076e186_rle_crop_3806588546_0.png treat image : temp/1747770627_4107064_1359852589_4d9fb7c1b2ae38dac7784ecbd076e186_rle_crop_3806588533_0.png treat image : temp/1747770627_4107064_1359852589_4d9fb7c1b2ae38dac7784ecbd076e186_rle_crop_3806588529_0.png treat image : temp/1747770627_4107064_1359852589_4d9fb7c1b2ae38dac7784ecbd076e186_rle_crop_3806588548_0.png treat image : temp/1747770627_4107064_1359852589_4d9fb7c1b2ae38dac7784ecbd076e186_rle_crop_3806588538_0.png treat image : temp/1747770627_4107064_1359852589_4d9fb7c1b2ae38dac7784ecbd076e186_rle_crop_3806588551_0.png treat image : temp/1747770627_4107064_1359852589_4d9fb7c1b2ae38dac7784ecbd076e186_rle_crop_3806588550_0.png treat image : temp/1747770627_4107064_1359852589_4d9fb7c1b2ae38dac7784ecbd076e186_rle_crop_3806588539_0.png treat image : temp/1747770627_4107064_1359852589_4d9fb7c1b2ae38dac7784ecbd076e186_rle_crop_3806588541_0.png treat image : temp/1747770627_4107064_1359852589_4d9fb7c1b2ae38dac7784ecbd076e186_rle_crop_3806588543_0.png treat image : temp/1747770627_4107064_1359852589_4d9fb7c1b2ae38dac7784ecbd076e186_rle_crop_3806588540_0.png treat image : temp/1747770627_4107064_1359852589_4d9fb7c1b2ae38dac7784ecbd076e186_rle_crop_3806588545_0.png treat image : temp/1747770627_4107064_1359852586_2323cf58b8ed443535b0b899306ec82b_rle_crop_3806588555_0.png treat image : temp/1747770627_4107064_1359852586_2323cf58b8ed443535b0b899306ec82b_rle_crop_3806588569_0.png treat image : temp/1747770627_4107064_1359852586_2323cf58b8ed443535b0b899306ec82b_rle_crop_3806588552_0.png treat image : temp/1747770627_4107064_1359852586_2323cf58b8ed443535b0b899306ec82b_rle_crop_3806588553_0.png treat image : temp/1747770627_4107064_1359852586_2323cf58b8ed443535b0b899306ec82b_rle_crop_3806588576_0.png treat image : temp/1747770627_4107064_1359852586_2323cf58b8ed443535b0b899306ec82b_rle_crop_3806588564_0.png treat image : temp/1747770627_4107064_1359852586_2323cf58b8ed443535b0b899306ec82b_rle_crop_3806588561_0.png treat image : temp/1747770627_4107064_1359852586_2323cf58b8ed443535b0b899306ec82b_rle_crop_3806588556_0.png treat image : temp/1747770627_4107064_1359852586_2323cf58b8ed443535b0b899306ec82b_rle_crop_3806588574_0.png treat image : temp/1747770627_4107064_1359852586_2323cf58b8ed443535b0b899306ec82b_rle_crop_3806588570_0.png treat image : temp/1747770627_4107064_1359852586_2323cf58b8ed443535b0b899306ec82b_rle_crop_3806588567_0.png treat image : temp/1747770627_4107064_1359852586_2323cf58b8ed443535b0b899306ec82b_rle_crop_3806588566_0.png treat image : temp/1747770627_4107064_1359852586_2323cf58b8ed443535b0b899306ec82b_rle_crop_3806588557_0.png treat image : temp/1747770627_4107064_1359852586_2323cf58b8ed443535b0b899306ec82b_rle_crop_3806588565_0.png treat image : temp/1747770627_4107064_1359852586_2323cf58b8ed443535b0b899306ec82b_rle_crop_3806588575_0.png treat image : temp/1747770627_4107064_1359852586_2323cf58b8ed443535b0b899306ec82b_rle_crop_3806588572_0.png treat image : temp/1747770627_4107064_1359852586_2323cf58b8ed443535b0b899306ec82b_rle_crop_3806588579_0.png treat image : temp/1747770627_4107064_1359852586_2323cf58b8ed443535b0b899306ec82b_rle_crop_3806588554_0.png treat image : temp/1747770627_4107064_1359852586_2323cf58b8ed443535b0b899306ec82b_rle_crop_3806588558_0.png treat image : temp/1747770627_4107064_1359852586_2323cf58b8ed443535b0b899306ec82b_rle_crop_3806588582_0.png treat image : temp/1747770627_4107064_1359852586_2323cf58b8ed443535b0b899306ec82b_rle_crop_3806588581_0.png treat image : temp/1747770627_4107064_1359852586_2323cf58b8ed443535b0b899306ec82b_rle_crop_3806588580_0.png treat image : temp/1747770627_4107064_1359852586_2323cf58b8ed443535b0b899306ec82b_rle_crop_3806588560_0.png treat image : temp/1747770627_4107064_1359852586_2323cf58b8ed443535b0b899306ec82b_rle_crop_3806588559_0.png treat image : temp/1747770627_4107064_1359852586_2323cf58b8ed443535b0b899306ec82b_rle_crop_3806588578_0.png treat image : temp/1747770627_4107064_1359852586_2323cf58b8ed443535b0b899306ec82b_rle_crop_3806588571_0.png treat image : temp/1747770627_4107064_1359852690_590970015a5cb015904388913a0fc12a_rle_crop_3806588431_0.png treat image : temp/1747770627_4107064_1359852678_417ddbee7ecfb6bc4a888466870b8102_rle_crop_3806588454_0.png treat image : temp/1747770627_4107064_1359852678_417ddbee7ecfb6bc4a888466870b8102_rle_crop_3806588444_0.png treat image : temp/1747770627_4107064_1359852678_417ddbee7ecfb6bc4a888466870b8102_rle_crop_3806588439_0.png treat image : temp/1747770627_4107064_1359852666_dcb4ffad0fd71d95081a378d8c9695fd_rle_crop_3806588461_0.png treat image : temp/1747770627_4107064_1359852666_dcb4ffad0fd71d95081a378d8c9695fd_rle_crop_3806588473_0.png treat image : temp/1747770627_4107064_1359852666_dcb4ffad0fd71d95081a378d8c9695fd_rle_crop_3806588469_0.png treat image : temp/1747770627_4107064_1359852666_dcb4ffad0fd71d95081a378d8c9695fd_rle_crop_3806588463_0.png treat image : temp/1747770627_4107064_1359852666_dcb4ffad0fd71d95081a378d8c9695fd_rle_crop_3806588467_0.png treat image : temp/1747770627_4107064_1359852666_dcb4ffad0fd71d95081a378d8c9695fd_rle_crop_3806588468_0.png treat image : temp/1747770627_4107064_1359852659_a74c6c3c32387fd98b518cefa6ada1d9_rle_crop_3806588479_0.png treat image : temp/1747770627_4107064_1359852659_a74c6c3c32387fd98b518cefa6ada1d9_rle_crop_3806588488_0.png treat image : temp/1747770627_4107064_1359852656_647d50273da7604c0e522e9e3c9ba4a4_rle_crop_3806588506_0.png treat image : temp/1747770627_4107064_1359852656_647d50273da7604c0e522e9e3c9ba4a4_rle_crop_3806588497_0.png treat image : temp/1747770627_4107064_1359852656_647d50273da7604c0e522e9e3c9ba4a4_rle_crop_3806588504_0.png treat image : temp/1747770627_4107064_1359852656_647d50273da7604c0e522e9e3c9ba4a4_rle_crop_3806588499_0.png treat image : temp/1747770627_4107064_1359852593_780c5709d9dcceee679b6f5a1e49d4df_rle_crop_3806588516_0.png treat image : temp/1747770627_4107064_1359852593_780c5709d9dcceee679b6f5a1e49d4df_rle_crop_3806588520_0.png treat image : temp/1747770627_4107064_1359852593_780c5709d9dcceee679b6f5a1e49d4df_rle_crop_3806588510_0.png treat image : temp/1747770627_4107064_1359852589_4d9fb7c1b2ae38dac7784ecbd076e186_rle_crop_3806588535_0.png treat image : temp/1747770627_4107064_1359852589_4d9fb7c1b2ae38dac7784ecbd076e186_rle_crop_3806588547_0.png treat image : temp/1747770627_4107064_1359852586_2323cf58b8ed443535b0b899306ec82b_rle_crop_3806588573_0.png treat image : temp/1747770627_4107064_1359852690_590970015a5cb015904388913a0fc12a_rle_crop_3806588426_0.png treat image : temp/1747770627_4107064_1359852690_590970015a5cb015904388913a0fc12a_rle_crop_3806588434_0.png treat image : temp/1747770627_4107064_1359852690_590970015a5cb015904388913a0fc12a_rle_crop_3806588437_0.png treat image : temp/1747770627_4107064_1359852678_417ddbee7ecfb6bc4a888466870b8102_rle_crop_3806588451_0.png treat image : temp/1747770627_4107064_1359852678_417ddbee7ecfb6bc4a888466870b8102_rle_crop_3806588456_0.png treat image : temp/1747770627_4107064_1359852678_417ddbee7ecfb6bc4a888466870b8102_rle_crop_3806588442_0.png treat image : temp/1747770627_4107064_1359852666_dcb4ffad0fd71d95081a378d8c9695fd_rle_crop_3806588470_0.png treat image : temp/1747770627_4107064_1359852666_dcb4ffad0fd71d95081a378d8c9695fd_rle_crop_3806588460_0.png treat image : temp/1747770627_4107064_1359852666_dcb4ffad0fd71d95081a378d8c9695fd_rle_crop_3806588472_0.png treat image : temp/1747770627_4107064_1359852666_dcb4ffad0fd71d95081a378d8c9695fd_rle_crop_3806588457_0.png treat image : temp/1747770627_4107064_1359852659_a74c6c3c32387fd98b518cefa6ada1d9_rle_crop_3806588492_0.png treat image : temp/1747770627_4107064_1359852659_a74c6c3c32387fd98b518cefa6ada1d9_rle_crop_3806588477_0.png treat image : temp/1747770627_4107064_1359852659_a74c6c3c32387fd98b518cefa6ada1d9_rle_crop_3806588484_0.png treat image : temp/1747770627_4107064_1359852656_647d50273da7604c0e522e9e3c9ba4a4_rle_crop_3806588508_0.png treat image : temp/1747770627_4107064_1359852593_780c5709d9dcceee679b6f5a1e49d4df_rle_crop_3806588519_0.png treat image : temp/1747770627_4107064_1359852589_4d9fb7c1b2ae38dac7784ecbd076e186_rle_crop_3806588542_0.png treat image : temp/1747770627_4107064_1359852589_4d9fb7c1b2ae38dac7784ecbd076e186_rle_crop_3806588549_0.png treat image : temp/1747770627_4107064_1359852589_4d9fb7c1b2ae38dac7784ecbd076e186_rle_crop_3806588532_0.png treat image : temp/1747770627_4107064_1359852586_2323cf58b8ed443535b0b899306ec82b_rle_crop_3806588563_0.png treat image : temp/1747770627_4107064_1359852586_2323cf58b8ed443535b0b899306ec82b_rle_crop_3806588562_0.png treat image : temp/1747770627_4107064_1359852586_2323cf58b8ed443535b0b899306ec82b_rle_crop_3806588568_0.png treat image : temp/1747770627_4107064_1359852586_2323cf58b8ed443535b0b899306ec82b_rle_crop_3806588577_0.png treat image : temp/1747770627_4107064_1359852666_dcb4ffad0fd71d95081a378d8c9695fd_rle_crop_3806588465_0.png treat image : temp/1747770627_4107064_1359852659_a74c6c3c32387fd98b518cefa6ada1d9_rle_crop_3806588487_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 167 time used for this insertion : 0.018079280853271484 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 167 time used for this insertion : 0.03165721893310547 save missing photos in datou_result : time spend for datou_step_exec : 7.7372963428497314 time spend to save output : 0.054514169692993164 total time spend for step 7 : 7.791810512542725 step8:velours_tree Tue May 20 21:55:24 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.14085817337036133 time spend to save output : 4.792213439941406e-05 total time spend for step 8 : 0.14090609550476074 step9:send_mail_cod Tue May 20 21:55:24 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P23181897_20-05-2025_21_55_24.pdf 23182086 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette231820861747770924 23182088 imagette231820881747770925 23182089 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette231820891747770925 23182090 imagette231820901747770926 23182091 imagette231820911747770927 23182092 imagette231820921747770927 23182093 change filename to text .change filename to text .imagette231820931747770927 23182094 imagette231820941747770927 23182095 imagette231820951747770927 23182096 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette231820961747770927 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=23181897 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/23182086,23182087,23182088,23182089,23182090,23182091,23182092,23182093,23182094,23182095,23182096?tags=carton,environnement,pet_fonce,pet_clair,mal_croppe,flou,metal,autre,background,pehd,papier args[1359852690] : ((1359852690, -2.7550842302461462, 492609224), (1359852690, 0.157420757398439, 2107752395), '0.1128588707618464') We are sending mail with results at report@fotonower.com args[1359852678] : ((1359852678, -2.841148051338666, 492609224), (1359852678, -0.08832740890988612, 496442774), '0.1128588707618464') We are sending mail with results at report@fotonower.com args[1359852666] : ((1359852666, -2.7259627740991346, 492609224), (1359852666, 0.15733018290922335, 2107752395), '0.1128588707618464') We are sending mail with results at report@fotonower.com args[1359852659] : ((1359852659, -0.6130143955883302, 492688767), (1359852659, -0.19454361231398437, 496442774), '0.1128588707618464') We are sending mail with results at report@fotonower.com args[1359852656] : ((1359852656, -1.4861560903618876, 492688767), (1359852656, -0.151842925294953, 496442774), '0.1128588707618464') We are sending mail with results at report@fotonower.com args[1359852593] : ((1359852593, -2.5317078494122462, 492609224), (1359852593, 0.3268368786079653, 2107752395), '0.1128588707618464') We are sending mail with results at report@fotonower.com args[1359852589] : ((1359852589, -4.036180061561887, 492609224), (1359852589, 0.24142393824978417, 2107752395), '0.1128588707618464') We are sending mail with results at report@fotonower.com args[1359852586] : ((1359852586, -2.141009053950533, 492609224), (1359852586, 0.05455754536765302, 2107752395), '0.1128588707618464') We are sending mail with results at report@fotonower.com refus_total : 0.1128588707618464 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=23181897 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23181897_20-05-2025_21_55_24.pdf results_Auto_P23181897_20-05-2025_21_55_24.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23181897_20-05-2025_21_55_24.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','23181897','results_Auto_P23181897_20-05-2025_21_55_24.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23181897_20-05-2025_21_55_24.pdf','pdf','','0.59','0.1128588707618464') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/23181897

https://www.fotonower.com/image?json=false&list_photos_id=1359852690
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359852678
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359852666
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359852659
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359852656
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359852593
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359852589
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359852586
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 11.29%
Veuillez trouver les photos des contaminants.

exemples de contaminants: carton: https://www.fotonower.com/view/23182086?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/23182089?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/23182093?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/23182096?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23181897_20-05-2025_21_55_24.pdf.

Lien vers velours :https://www.fotonower.com/velours/23182086,23182087,23182088,23182089,23182090,23182091,23182092,23182093,23182094,23182095,23182096?tags=carton,environnement,pet_fonce,pet_clair,mal_croppe,flou,metal,autre,background,pehd,papier.


L'équipe Fotonower 202 b'' Server: nginx Date: Tue, 20 May 2025 19:55:31 GMT Content-Length: 0 Connection: close X-Message-Id: Qm2H8artSmSgHFjRD_hlhQ Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1359852690, 1359852678, 1359852666, 1359852659, 1359852656, 1359852593, 1359852589, 1359852586] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2914173') ('3318', '23181897', '1359852690', None, None, None, None, None, '2914173') ('3318', None, None, None, None, None, None, None, '2914173') ('3318', '23181897', '1359852678', None, None, None, None, None, '2914173') ('3318', None, None, None, None, None, None, None, '2914173') ('3318', '23181897', '1359852666', None, None, None, None, None, '2914173') ('3318', None, None, None, None, None, None, None, '2914173') ('3318', '23181897', '1359852659', None, None, None, None, None, '2914173') ('3318', None, None, None, None, None, None, None, '2914173') ('3318', '23181897', '1359852656', None, None, None, None, None, '2914173') ('3318', None, None, None, None, None, None, None, '2914173') ('3318', '23181897', '1359852593', None, None, None, None, None, '2914173') ('3318', None, None, None, None, None, None, None, '2914173') ('3318', '23181897', '1359852589', None, None, None, None, None, '2914173') ('3318', None, None, None, None, None, None, None, '2914173') ('3318', '23181897', '1359852586', None, None, None, None, None, '2914173') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.014903545379638672 save_final save missing photos in datou_result : time spend for datou_step_exec : 7.059236526489258 time spend to save output : 0.015159845352172852 total time spend for step 9 : 7.074396371841431 step10:split_time_score Tue May 20 21:55:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('20', 8),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 20052025 23181897 Nombre de photos uploadées : 8 / 23040 (0%) 20052025 23181897 Nombre de photos taguées (types de déchets): 0 / 8 (0%) 20052025 23181897 Nombre de photos taguées (volume) : 0 / 8 (0%) elapsed_time : load_data_split_time_score 1.430511474609375e-06 elapsed_time : order_list_meta_photo_and_scores 5.245208740234375e-06 ???????? elapsed_time : fill_and_build_computed_from_old_data 0.00042438507080078125 elapsed_time : insert_dashboard_record_day_entry 0.024448156356811523 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.0462500658941438 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23159907_20-05-2025_09_13_51.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23159907 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23159907 AND mptpi.`type`=3726 To do Qualite : 0.12732645980846047 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23167061_20-05-2025_13_36_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23167061 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23167061 AND mptpi.`type`=3594 To do Qualite : 0.11592767054738566 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23172605_20-05-2025_16_44_38.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23172605 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23172605 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23181868 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23181869 order by id desc limit 1 Qualite : 0.14202566153776322 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23175554_20-05-2025_18_16_22.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23175554 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23175554 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23175556 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23177157 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23177158 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23177162 order by id desc limit 1 Qualite : 0.10680072987271037 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23177165_20-05-2025_19_25_12.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23177165 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23177165 AND mptpi.`type`=3594 To do Qualite : 0.10174944399055919 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23177171_20-05-2025_19_15_23.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23177171 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23177171 AND mptpi.`type`=3594 To do Qualite : 0.1128588707618464 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23181897_20-05-2025_21_55_24.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23181897 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23181897 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'20052025': {'nb_upload': 8, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1359852690, 1359852678, 1359852666, 1359852659, 1359852656, 1359852593, 1359852589, 1359852586] Looping around the photos to save general results len do output : 1 /23181897Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2914173') ('3318', '23181897', '1359852690', None, None, None, None, None, '2914173') ('3318', None, None, None, None, None, None, None, '2914173') ('3318', '23181897', '1359852678', None, None, None, None, None, '2914173') ('3318', None, None, None, None, None, None, None, '2914173') ('3318', '23181897', '1359852666', None, None, None, None, None, '2914173') ('3318', None, None, None, None, None, None, None, '2914173') ('3318', '23181897', '1359852659', None, None, None, None, None, '2914173') ('3318', None, None, None, None, None, None, None, '2914173') ('3318', '23181897', '1359852656', None, None, None, None, None, '2914173') ('3318', None, None, None, None, None, None, None, '2914173') ('3318', '23181897', '1359852593', None, None, None, None, None, '2914173') ('3318', None, None, None, None, None, None, None, '2914173') ('3318', '23181897', '1359852589', None, None, None, None, None, '2914173') ('3318', None, None, None, None, None, None, None, '2914173') ('3318', '23181897', '1359852586', None, None, None, None, None, '2914173') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.01425623893737793 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.874133586883545 time spend to save output : 0.014550209045410156 total time spend for step 10 : 5.888683795928955 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 8 set_done_treatment 125.22user 114.88system 5:12.40elapsed 76%CPU (0avgtext+0avgdata 5461144maxresident)k 588928inputs+75016outputs (7563major+13285205minor)pagefaults 0swaps