python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3639314 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2651253'] with mtr_portfolio_ids : ['21173139'] and first list_photo_ids : [] new path : /proc/3639314/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 5 ; length of list_pids : 5 ; length of list_args : 5 time to download the photos : 3.38303804397583 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Sat Mar 8 09:10:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 9930 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-03-08 09:10:35.867325: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-03-08 09:10:35.881410: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-03-08 09:10:35.883203: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fbce4000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-03-08 09:10:35.883254: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-03-08 09:10:35.887177: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-03-08 09:10:36.089423: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x2ff47ac0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-03-08 09:10:36.089495: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-03-08 09:10:36.091151: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-08 09:10:36.091598: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-08 09:10:36.094684: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-08 09:10:36.103757: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-08 09:10:36.104327: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-08 09:10:36.124418: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-08 09:10:36.129252: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-08 09:10:36.153910: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-08 09:10:36.156340: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-08 09:10:36.156947: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-08 09:10:36.157902: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-03-08 09:10:36.157922: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-03-08 09:10:36.157934: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-03-08 09:10:36.159638: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9192 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-03-08 09:10:36.575409: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-08 09:10:36.575717: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-08 09:10:36.575755: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-08 09:10:36.575788: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-08 09:10:36.575813: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-08 09:10:36.575836: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-08 09:10:36.575862: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-08 09:10:36.575891: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-08 09:10:36.578269: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-08 09:10:36.580643: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-08 09:10:36.580727: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-08 09:10:36.580757: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-08 09:10:36.580784: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-08 09:10:36.580811: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-08 09:10:36.580838: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-08 09:10:36.580864: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-08 09:10:36.580896: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-08 09:10:36.583109: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-08 09:10:36.583179: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-03-08 09:10:36.583197: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-03-08 09:10:36.583212: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-03-08 09:10:36.585247: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9192 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-03-08 09:10:50.513824: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-08 09:10:50.728916: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-08 09:10:52.494799: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 09:10:52.495493: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.60G (3865470464 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 09:10:52.496176: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 3.24G (3478923264 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 09:10:52.496863: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.92G (3131030784 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 09:10:52.497485: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.62G (2817927680 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 09:10:54.447689: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 09:10:54.458211: W tensorflow/core/common_runtime/bfc_allocator.cc:311] Garbage collection: deallocate free memory regions (i.e., allocations) so that we can re-allocate a larger region to avoid OOM due to memory fragmentation. If you see this message frequently, you are running near the threshold of the available device memory and re-allocation may incur great performance overhead. You may try smaller batch sizes to observe the performance impact. Set TF_ENABLE_GPU_GARBAGE_COLLECTION=false if you'd like to disable this feature. 2025-03-08 09:10:54.519019: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 09:10:54.519094: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.67GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-08 09:10:54.520311: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 09:10:54.520342: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.67GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-08 09:10:54.529904: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 09:10:54.529986: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 3.29GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-08 09:10:54.530639: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 09:10:54.530690: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 3.29GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-08 09:10:54.537025: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 09:10:54.537053: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 1.78GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-08 09:10:54.537698: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 09:10:54.537717: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 1.78GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-08 09:10:54.567937: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 09:10:54.568006: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 19.91MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-08 09:10:54.568024: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-03-08 09:10:54.569123: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 09:10:54.569154: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 16.00MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-08 09:10:54.570243: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 09:10:54.570272: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 16.00MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-08 09:10:54.577261: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 09:10:54.577289: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 63.85MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-03-08 09:10:54.577912: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 09:10:54.578555: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 09:10:54.579191: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 09:10:54.587931: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 09:10:54.588932: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 09:10:54.608656: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 09:10:54.609540: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 09:10:54.610423: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 09:10:54.611322: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 09:10:54.616115: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 09:10:54.616858: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 09:10:54.617553: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 09:10:54.618239: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 09:10:54.619702: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 09:10:54.630198: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 09:10:54.630972: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 09:10:54.640899: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 09:10:54.641635: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 09:10:54.642379: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 09:10:54.643124: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 09:10:54.643827: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-03-08 09:10:54.644507: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 4.00G (4294967296 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 5 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 144.85000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 47 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 147.85000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 57 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.35000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 41 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 36 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 147.35000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 37 Detection mask done ! Trying to reset tf kernel 3640119 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 7544 tf kernel not reseted sub process len(results) : 5 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 5 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 8737 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0006124973297119141 nb_pixel_total : 12827 time to create 1 rle with old method : 0.016289949417114258 length of segment : 155 time for calcul the mask position with numpy : 0.0010113716125488281 nb_pixel_total : 31350 time to create 1 rle with old method : 0.04085254669189453 length of segment : 213 time for calcul the mask position with numpy : 0.0006208419799804688 nb_pixel_total : 27050 time to create 1 rle with old method : 0.041793107986450195 length of segment : 229 time for calcul the mask position with numpy : 0.000766754150390625 nb_pixel_total : 34181 time to create 1 rle with old method : 0.04488348960876465 length of segment : 255 time for calcul the mask position with numpy : 0.00044655799865722656 nb_pixel_total : 15588 time to create 1 rle with old method : 0.018414020538330078 length of segment : 119 time for calcul the mask position with numpy : 0.0008966922760009766 nb_pixel_total : 20852 time to create 1 rle with old method : 0.024265289306640625 length of segment : 270 time for calcul the mask position with numpy : 0.000606536865234375 nb_pixel_total : 21270 time to create 1 rle with old method : 0.0251617431640625 length of segment : 201 time for calcul the mask position with numpy : 0.0009655952453613281 nb_pixel_total : 28179 time to create 1 rle with old method : 0.03275012969970703 length of segment : 217 time for calcul the mask position with numpy : 0.005426168441772461 nb_pixel_total : 153867 time to create 1 rle with new method : 0.013657331466674805 length of segment : 434 time for calcul the mask position with numpy : 0.0015478134155273438 nb_pixel_total : 60999 time to create 1 rle with old method : 0.07093191146850586 length of segment : 338 time for calcul the mask position with numpy : 0.031508445739746094 nb_pixel_total : 274384 time to create 1 rle with new method : 0.018298625946044922 length of segment : 779 time for calcul the mask position with numpy : 0.0003142356872558594 nb_pixel_total : 4230 time to create 1 rle with old method : 0.005346059799194336 length of segment : 172 time for calcul the mask position with numpy : 0.0004286766052246094 nb_pixel_total : 18348 time to create 1 rle with old method : 0.02220749855041504 length of segment : 153 time for calcul the mask position with numpy : 0.0016241073608398438 nb_pixel_total : 53792 time to create 1 rle with old method : 0.0649716854095459 length of segment : 271 time for calcul the mask position with numpy : 0.0001862049102783203 nb_pixel_total : 4566 time to create 1 rle with old method : 0.0055005550384521484 length of segment : 103 time for calcul the mask position with numpy : 0.0007870197296142578 nb_pixel_total : 28686 time to create 1 rle with old method : 0.03379511833190918 length of segment : 215 time for calcul the mask position with numpy : 0.0015878677368164062 nb_pixel_total : 68873 time to create 1 rle with old method : 0.08806300163269043 length of segment : 384 time for calcul the mask position with numpy : 0.023040056228637695 nb_pixel_total : 315273 time to create 1 rle with new method : 0.025905370712280273 length of segment : 504 time for calcul the mask position with numpy : 0.0011916160583496094 nb_pixel_total : 28887 time to create 1 rle with old method : 0.04842352867126465 length of segment : 236 time for calcul the mask position with numpy : 0.0007627010345458984 nb_pixel_total : 27057 time to create 1 rle with old method : 0.05071616172790527 length of segment : 179 time for calcul the mask position with numpy : 0.004270315170288086 nb_pixel_total : 171934 time to create 1 rle with new method : 0.012043952941894531 length of segment : 818 time for calcul the mask position with numpy : 0.0016546249389648438 nb_pixel_total : 47844 time to create 1 rle with old method : 0.06923222541809082 length of segment : 407 time for calcul the mask position with numpy : 0.0008809566497802734 nb_pixel_total : 28675 time to create 1 rle with old method : 0.03363776206970215 length of segment : 266 time for calcul the mask position with numpy : 0.000820159912109375 nb_pixel_total : 28811 time to create 1 rle with old method : 0.03677082061767578 length of segment : 227 time for calcul the mask position with numpy : 0.00034308433532714844 nb_pixel_total : 7126 time to create 1 rle with old method : 0.012008190155029297 length of segment : 83 time for calcul the mask position with numpy : 0.0006532669067382812 nb_pixel_total : 17246 time to create 1 rle with old method : 0.02931976318359375 length of segment : 188 time for calcul the mask position with numpy : 0.00526118278503418 nb_pixel_total : 116219 time to create 1 rle with old method : 0.14016222953796387 length of segment : 462 time for calcul the mask position with numpy : 0.007375478744506836 nb_pixel_total : 117193 time to create 1 rle with old method : 0.13814306259155273 length of segment : 482 time for calcul the mask position with numpy : 0.0008141994476318359 nb_pixel_total : 13489 time to create 1 rle with old method : 0.015577077865600586 length of segment : 147 time for calcul the mask position with numpy : 0.0017633438110351562 nb_pixel_total : 27238 time to create 1 rle with old method : 0.03188800811767578 length of segment : 246 time for calcul the mask position with numpy : 0.0008656978607177734 nb_pixel_total : 19037 time to create 1 rle with old method : 0.0257875919342041 length of segment : 231 time for calcul the mask position with numpy : 0.006026029586791992 nb_pixel_total : 126249 time to create 1 rle with old method : 0.1433415412902832 length of segment : 486 time for calcul the mask position with numpy : 0.003625631332397461 nb_pixel_total : 105676 time to create 1 rle with old method : 0.1565690040588379 length of segment : 357 time for calcul the mask position with numpy : 0.0018291473388671875 nb_pixel_total : 25053 time to create 1 rle with old method : 0.03947877883911133 length of segment : 278 time for calcul the mask position with numpy : 0.0031332969665527344 nb_pixel_total : 63129 time to create 1 rle with old method : 0.07432126998901367 length of segment : 276 time for calcul the mask position with numpy : 0.01446223258972168 nb_pixel_total : 281789 time to create 1 rle with new method : 0.02174997329711914 length of segment : 1008 time for calcul the mask position with numpy : 0.0008733272552490234 nb_pixel_total : 8887 time to create 1 rle with old method : 0.016521215438842773 length of segment : 100 time for calcul the mask position with numpy : 0.002331256866455078 nb_pixel_total : 24508 time to create 1 rle with old method : 0.046141862869262695 length of segment : 244 time for calcul the mask position with numpy : 0.0017993450164794922 nb_pixel_total : 18347 time to create 1 rle with old method : 0.034343719482421875 length of segment : 404 time for calcul the mask position with numpy : 0.0021414756774902344 nb_pixel_total : 49191 time to create 1 rle with old method : 0.05794239044189453 length of segment : 425 time for calcul the mask position with numpy : 0.001619577407836914 nb_pixel_total : 34666 time to create 1 rle with old method : 0.041214704513549805 length of segment : 231 time for calcul the mask position with numpy : 0.004037380218505859 nb_pixel_total : 81158 time to create 1 rle with old method : 0.1024923324584961 length of segment : 423 time for calcul the mask position with numpy : 0.002819061279296875 nb_pixel_total : 46242 time to create 1 rle with old method : 0.06198000907897949 length of segment : 286 time for calcul the mask position with numpy : 0.0013413429260253906 nb_pixel_total : 10274 time to create 1 rle with old method : 0.03435397148132324 length of segment : 125 time for calcul the mask position with numpy : 0.0021321773529052734 nb_pixel_total : 19213 time to create 1 rle with old method : 0.04035806655883789 length of segment : 188 time for calcul the mask position with numpy : 0.08631515502929688 nb_pixel_total : 404527 time to create 1 rle with new method : 0.04239702224731445 length of segment : 889 time for calcul the mask position with numpy : 0.0008890628814697266 nb_pixel_total : 12490 time to create 1 rle with old method : 0.015069007873535156 length of segment : 135 time for calcul the mask position with numpy : 0.002812623977661133 nb_pixel_total : 29383 time to create 1 rle with old method : 0.03419613838195801 length of segment : 407 time for calcul the mask position with numpy : 0.005789995193481445 nb_pixel_total : 127633 time to create 1 rle with old method : 0.14297270774841309 length of segment : 402 time for calcul the mask position with numpy : 0.003969907760620117 nb_pixel_total : 57110 time to create 1 rle with old method : 0.1183023452758789 length of segment : 268 time for calcul the mask position with numpy : 0.0018415451049804688 nb_pixel_total : 23782 time to create 1 rle with old method : 0.03288626670837402 length of segment : 208 time for calcul the mask position with numpy : 0.0029153823852539062 nb_pixel_total : 60250 time to create 1 rle with old method : 0.06828069686889648 length of segment : 534 time for calcul the mask position with numpy : 0.0011332035064697266 nb_pixel_total : 31776 time to create 1 rle with old method : 0.03557562828063965 length of segment : 186 time for calcul the mask position with numpy : 0.0015616416931152344 nb_pixel_total : 35152 time to create 1 rle with old method : 0.04146575927734375 length of segment : 205 time for calcul the mask position with numpy : 0.005376100540161133 nb_pixel_total : 141546 time to create 1 rle with old method : 0.1597912311553955 length of segment : 588 time for calcul the mask position with numpy : 0.0017840862274169922 nb_pixel_total : 28716 time to create 1 rle with old method : 0.03210186958312988 length of segment : 396 time for calcul the mask position with numpy : 0.0003571510314941406 nb_pixel_total : 5948 time to create 1 rle with old method : 0.008034944534301758 length of segment : 67 time for calcul the mask position with numpy : 0.0017576217651367188 nb_pixel_total : 66911 time to create 1 rle with old method : 0.0774240493774414 length of segment : 211 time for calcul the mask position with numpy : 0.006407260894775391 nb_pixel_total : 130083 time to create 1 rle with old method : 0.14715147018432617 length of segment : 737 time for calcul the mask position with numpy : 0.0007119178771972656 nb_pixel_total : 14415 time to create 1 rle with old method : 0.016836166381835938 length of segment : 130 time for calcul the mask position with numpy : 0.002631664276123047 nb_pixel_total : 67080 time to create 1 rle with old method : 0.07728338241577148 length of segment : 335 time for calcul the mask position with numpy : 0.0005576610565185547 nb_pixel_total : 14244 time to create 1 rle with old method : 0.01754927635192871 length of segment : 102 time for calcul the mask position with numpy : 0.008910179138183594 nb_pixel_total : 225333 time to create 1 rle with new method : 0.018060922622680664 length of segment : 918 time for calcul the mask position with numpy : 0.004485368728637695 nb_pixel_total : 150343 time to create 1 rle with new method : 0.011987924575805664 length of segment : 506 time for calcul the mask position with numpy : 0.0013358592987060547 nb_pixel_total : 26003 time to create 1 rle with old method : 0.03836226463317871 length of segment : 170 time for calcul the mask position with numpy : 0.002752542495727539 nb_pixel_total : 76743 time to create 1 rle with old method : 0.09073901176452637 length of segment : 285 time for calcul the mask position with numpy : 0.002220630645751953 nb_pixel_total : 49113 time to create 1 rle with old method : 0.05970621109008789 length of segment : 328 time for calcul the mask position with numpy : 0.0007305145263671875 nb_pixel_total : 12094 time to create 1 rle with old method : 0.01423335075378418 length of segment : 194 time for calcul the mask position with numpy : 0.027541160583496094 nb_pixel_total : 406570 time to create 1 rle with new method : 0.06025409698486328 length of segment : 969 time for calcul the mask position with numpy : 0.0009126663208007812 nb_pixel_total : 33768 time to create 1 rle with old method : 0.03843545913696289 length of segment : 256 time for calcul the mask position with numpy : 0.0011334419250488281 nb_pixel_total : 22916 time to create 1 rle with old method : 0.028738975524902344 length of segment : 217 time for calcul the mask position with numpy : 0.0017123222351074219 nb_pixel_total : 28934 time to create 1 rle with old method : 0.034970760345458984 length of segment : 270 time for calcul the mask position with numpy : 0.0050241947174072266 nb_pixel_total : 113052 time to create 1 rle with old method : 0.12710905075073242 length of segment : 467 time for calcul the mask position with numpy : 0.0020074844360351562 nb_pixel_total : 34637 time to create 1 rle with old method : 0.04021930694580078 length of segment : 229 time for calcul the mask position with numpy : 0.0025784969329833984 nb_pixel_total : 108238 time to create 1 rle with old method : 0.12348031997680664 length of segment : 467 time for calcul the mask position with numpy : 0.0005362033843994141 nb_pixel_total : 10250 time to create 1 rle with old method : 0.01238560676574707 length of segment : 72 time for calcul the mask position with numpy : 0.0004131793975830078 nb_pixel_total : 8480 time to create 1 rle with old method : 0.010032176971435547 length of segment : 126 time for calcul the mask position with numpy : 0.0008594989776611328 nb_pixel_total : 31371 time to create 1 rle with old method : 0.03634476661682129 length of segment : 159 time for calcul the mask position with numpy : 0.004187822341918945 nb_pixel_total : 143015 time to create 1 rle with old method : 0.16158437728881836 length of segment : 306 time for calcul the mask position with numpy : 0.003252744674682617 nb_pixel_total : 101265 time to create 1 rle with old method : 0.121673583984375 length of segment : 498 time for calcul the mask position with numpy : 0.0018908977508544922 nb_pixel_total : 53018 time to create 1 rle with old method : 0.06051468849182129 length of segment : 345 time for calcul the mask position with numpy : 0.0010344982147216797 nb_pixel_total : 20954 time to create 1 rle with old method : 0.02507305145263672 length of segment : 99 time for calcul the mask position with numpy : 0.0006258487701416016 nb_pixel_total : 31417 time to create 1 rle with old method : 0.03696322441101074 length of segment : 191 time for calcul the mask position with numpy : 0.003917694091796875 nb_pixel_total : 125521 time to create 1 rle with old method : 0.1475369930267334 length of segment : 431 time for calcul the mask position with numpy : 0.0008513927459716797 nb_pixel_total : 17592 time to create 1 rle with old method : 0.020467281341552734 length of segment : 259 time for calcul the mask position with numpy : 0.005383014678955078 nb_pixel_total : 168789 time to create 1 rle with new method : 0.006756782531738281 length of segment : 675 time for calcul the mask position with numpy : 0.00037741661071777344 nb_pixel_total : 5724 time to create 1 rle with old method : 0.006572723388671875 length of segment : 97 time for calcul the mask position with numpy : 0.0018775463104248047 nb_pixel_total : 55872 time to create 1 rle with old method : 0.06159019470214844 length of segment : 269 time for calcul the mask position with numpy : 0.005891561508178711 nb_pixel_total : 157299 time to create 1 rle with new method : 0.006948232650756836 length of segment : 544 time for calcul the mask position with numpy : 0.0014276504516601562 nb_pixel_total : 27042 time to create 1 rle with old method : 0.031720876693725586 length of segment : 303 time for calcul the mask position with numpy : 0.0015740394592285156 nb_pixel_total : 34176 time to create 1 rle with old method : 0.03977608680725098 length of segment : 224 time for calcul the mask position with numpy : 0.00595855712890625 nb_pixel_total : 206659 time to create 1 rle with new method : 0.007602691650390625 length of segment : 712 time for calcul the mask position with numpy : 0.0005514621734619141 nb_pixel_total : 16453 time to create 1 rle with old method : 0.01922607421875 length of segment : 192 time for calcul the mask position with numpy : 0.00316619873046875 nb_pixel_total : 76779 time to create 1 rle with old method : 0.09102773666381836 length of segment : 464 time spent for convertir_results : 10.737671375274658 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 94 chid ids of type : 3594 Number RLEs to save : 30857 save missing photos in datou_result : time spend for datou_step_exec : 79.41210532188416 time spend to save output : 4.644381523132324 total time spend for step 1 : 84.05648684501648 step2:crop_condition Sat Mar 8 09:11:55 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 5 ! batch 1 Loaded 94 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 49 About to insert : list_path_to_insert length 49 new photo from crops ! About to upload 49 photos upload in portfolio : 3736932 init cache_photo without model_param we have 49 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741421532_3639314 we have uploaded 49 photos in the portfolio 3736932 time of upload the photos Elapsed time : 13.4373779296875 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 13 About to insert : list_path_to_insert length 13 new photo from crops ! About to upload 13 photos upload in portfolio : 3736932 init cache_photo without model_param we have 13 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741421551_3639314 we have uploaded 13 photos in the portfolio 3736932 time of upload the photos Elapsed time : 3.917462110519409 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 7 About to insert : list_path_to_insert length 7 new photo from crops ! About to upload 7 photos upload in portfolio : 3736932 init cache_photo without model_param we have 7 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741421557_3639314 we have uploaded 7 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.3345274925231934 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 23 About to insert : list_path_to_insert length 23 new photo from crops ! About to upload 23 photos upload in portfolio : 3736932 init cache_photo without model_param we have 23 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741421571_3639314 we have uploaded 23 photos in the portfolio 3736932 time of upload the photos Elapsed time : 8.920700788497925 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741421582_3639314 we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.7184944152832031 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1329190350, 1329190340, 1329190335, 1329190331, 1329190285] Looping around the photos to save general results len do output : 94 /1341787757Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787758Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787759Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787760Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787761Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787762Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787763Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787764Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787765Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787767Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787768Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787769Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787770Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787771Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787772Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787773Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787774Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787775Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787776Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787777Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787778Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787779Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787780Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787781Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787782Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787783Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787784Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787785Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787786Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787787Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787788Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787789Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787790Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787791Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787792Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787793Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787794Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787795Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787796Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787797Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787798Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787799Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787800Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787801Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787802Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787803Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787804Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787805Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787806Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787819Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787820Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787821Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787822Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787823Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787824Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787825Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787826Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787827Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787828Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787829Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787830Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787831Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787866Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787867Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787868Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787870Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787876Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787878Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787880Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787901Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787902Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787903Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787904Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787905Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787906Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787907Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787908Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787909Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787910Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787911Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787912Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787913Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787914Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787915Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787917Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787918Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787919Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787920Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787921Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787922Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787923Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787924Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787927Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341787928Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2651253') ('3318', '21173139', '1329190350', None, None, None, None, None, '2651253') ('3318', None, None, None, None, None, None, None, '2651253') ('3318', '21173139', '1329190340', None, None, None, None, None, '2651253') ('3318', None, None, None, None, None, None, None, '2651253') ('3318', '21173139', '1329190335', None, None, None, None, None, '2651253') ('3318', None, None, None, None, None, None, None, '2651253') ('3318', '21173139', '1329190331', None, None, None, None, None, '2651253') ('3318', None, None, None, None, None, None, None, '2651253') ('3318', '21173139', '1329190285', None, None, None, None, None, '2651253') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 287 time used for this insertion : 0.8761947154998779 save_final save missing photos in datou_result : time spend for datou_step_exec : 67.49943137168884 time spend to save output : 0.8963193893432617 total time spend for step 2 : 68.3957507610321 step3:rle_unique_nms_with_priority Sat Mar 8 09:13:04 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 94 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 25 nb_hashtags : 4 time to prepare the origin masks : 16.76095199584961 time for calcul the mask position with numpy : 0.7828707695007324 nb_pixel_total : 6819588 time to create 1 rle with new method : 1.4128096103668213 time for calcul the mask position with numpy : 0.037062644958496094 nb_pixel_total : 7126 time to create 1 rle with old method : 0.008023262023925781 time for calcul the mask position with numpy : 0.029340028762817383 nb_pixel_total : 28811 time to create 1 rle with old method : 0.03272533416748047 time for calcul the mask position with numpy : 0.02654099464416504 nb_pixel_total : 2219 time to create 1 rle with old method : 0.0026924610137939453 time for calcul the mask position with numpy : 0.02918219566345215 nb_pixel_total : 47844 time to create 1 rle with old method : 0.054686546325683594 time for calcul the mask position with numpy : 0.0387575626373291 nb_pixel_total : 171934 time to create 1 rle with new method : 2.22694730758667 time for calcul the mask position with numpy : 0.03133726119995117 nb_pixel_total : 27057 time to create 1 rle with old method : 0.04823470115661621 time for calcul the mask position with numpy : 0.03468060493469238 nb_pixel_total : 28682 time to create 1 rle with old method : 0.04175138473510742 time for calcul the mask position with numpy : 0.03092360496520996 nb_pixel_total : 302101 time to create 1 rle with new method : 0.9319624900817871 time for calcul the mask position with numpy : 0.033464670181274414 nb_pixel_total : 68873 time to create 1 rle with old method : 0.07926440238952637 time for calcul the mask position with numpy : 0.029240846633911133 nb_pixel_total : 28686 time to create 1 rle with old method : 0.03259396553039551 time for calcul the mask position with numpy : 0.03169441223144531 nb_pixel_total : 4562 time to create 1 rle with old method : 0.00803828239440918 time for calcul the mask position with numpy : 0.03518319129943848 nb_pixel_total : 53792 time to create 1 rle with old method : 0.06332015991210938 time for calcul the mask position with numpy : 0.026813745498657227 nb_pixel_total : 18348 time to create 1 rle with old method : 0.021464824676513672 time for calcul the mask position with numpy : 0.03914356231689453 nb_pixel_total : 4230 time to create 1 rle with old method : 0.00496983528137207 time for calcul the mask position with numpy : 0.03410053253173828 nb_pixel_total : 274384 time to create 1 rle with new method : 0.8513932228088379 time for calcul the mask position with numpy : 0.031426191329956055 nb_pixel_total : 60999 time to create 1 rle with old method : 0.06841421127319336 time for calcul the mask position with numpy : 0.0344541072845459 nb_pixel_total : 153867 time to create 1 rle with new method : 0.5737566947937012 time for calcul the mask position with numpy : 0.03419351577758789 nb_pixel_total : 28179 time to create 1 rle with old method : 0.03325223922729492 time for calcul the mask position with numpy : 0.03677725791931152 nb_pixel_total : 21270 time to create 1 rle with old method : 0.025045394897460938 time for calcul the mask position with numpy : 0.02652430534362793 nb_pixel_total : 20852 time to create 1 rle with old method : 0.02335047721862793 time for calcul the mask position with numpy : 0.027022838592529297 nb_pixel_total : 15588 time to create 1 rle with old method : 0.018177509307861328 time for calcul the mask position with numpy : 0.032559871673583984 nb_pixel_total : 34181 time to create 1 rle with old method : 0.0544126033782959 time for calcul the mask position with numpy : 0.029215574264526367 nb_pixel_total : 27050 time to create 1 rle with old method : 0.03041672706604004 time for calcul the mask position with numpy : 0.027953624725341797 nb_pixel_total : 31350 time to create 1 rle with old method : 0.034888267517089844 time for calcul the mask position with numpy : 0.030843019485473633 nb_pixel_total : 12827 time to create 1 rle with old method : 0.014326095581054688 create new chi : 8.451112270355225 time to delete rle : 0.023877859115600586 batch 1 Loaded 51 chid ids of type : 3594 ++++++++++++++++++++++++++++++Number RLEs to save : 16206 TO DO : save crop sub photo not yet done ! save time : 2.349714756011963 nb_obj : 20 nb_hashtags : 5 time to prepare the origin masks : 11.805396795272827 time for calcul the mask position with numpy : 0.3191192150115967 nb_pixel_total : 7089596 time to create 1 rle with new method : 1.96659255027771 time for calcul the mask position with numpy : 0.045371055603027344 nb_pixel_total : 19213 time to create 1 rle with old method : 0.029564619064331055 time for calcul the mask position with numpy : 0.04410696029663086 nb_pixel_total : 10274 time to create 1 rle with old method : 0.011736631393432617 time for calcul the mask position with numpy : 0.04461932182312012 nb_pixel_total : 46242 time to create 1 rle with old method : 0.05173349380493164 time for calcul the mask position with numpy : 0.04474282264709473 nb_pixel_total : 81158 time to create 1 rle with old method : 0.09028100967407227 time for calcul the mask position with numpy : 0.04279518127441406 nb_pixel_total : 34666 time to create 1 rle with old method : 0.04226803779602051 time for calcul the mask position with numpy : 0.041573524475097656 nb_pixel_total : 49191 time to create 1 rle with old method : 0.05507469177246094 time for calcul the mask position with numpy : 0.04568982124328613 nb_pixel_total : 18347 time to create 1 rle with old method : 0.022591829299926758 time for calcul the mask position with numpy : 0.04388165473937988 nb_pixel_total : 24508 time to create 1 rle with old method : 0.02735114097595215 time for calcul the mask position with numpy : 0.041785240173339844 nb_pixel_total : 8887 time to create 1 rle with old method : 0.010085344314575195 time for calcul the mask position with numpy : 0.043459415435791016 nb_pixel_total : 281789 time to create 1 rle with new method : 1.002643346786499 time for calcul the mask position with numpy : 0.044708251953125 nb_pixel_total : 63129 time to create 1 rle with old method : 0.06970000267028809 time for calcul the mask position with numpy : 0.04430079460144043 nb_pixel_total : 25053 time to create 1 rle with old method : 0.027901649475097656 time for calcul the mask position with numpy : 0.04454207420349121 nb_pixel_total : 105676 time to create 1 rle with old method : 0.12947988510131836 time for calcul the mask position with numpy : 0.05426812171936035 nb_pixel_total : 126249 time to create 1 rle with old method : 0.15956711769104004 time for calcul the mask position with numpy : 0.045592308044433594 nb_pixel_total : 19037 time to create 1 rle with old method : 0.023455142974853516 time for calcul the mask position with numpy : 0.043289899826049805 nb_pixel_total : 27238 time to create 1 rle with old method : 0.030595779418945312 time for calcul the mask position with numpy : 0.04455733299255371 nb_pixel_total : 13489 time to create 1 rle with old method : 0.01595473289489746 time for calcul the mask position with numpy : 0.04123210906982422 nb_pixel_total : 117193 time to create 1 rle with old method : 0.1313190460205078 time for calcul the mask position with numpy : 0.038146257400512695 nb_pixel_total : 116219 time to create 1 rle with old method : 0.13123488426208496 time for calcul the mask position with numpy : 0.04065871238708496 nb_pixel_total : 17246 time to create 1 rle with old method : 0.020218849182128906 create new chi : 5.554139852523804 time to delete rle : 0.0031824111938476562 batch 1 Loaded 41 chid ids of type : 3594 +++++++++++++++++++++++++++++++Number RLEs to save : 15334 TO DO : save crop sub photo not yet done ! save time : 11.309422016143799 nb_obj : 17 nb_hashtags : 3 time to prepare the origin masks : 13.155481100082397 time for calcul the mask position with numpy : 1.261899709701538 nb_pixel_total : 7043354 time to create 1 rle with new method : 0.6887681484222412 time for calcul the mask position with numpy : 0.04009437561035156 nb_pixel_total : 14244 time to create 1 rle with old method : 0.015838623046875 time for calcul the mask position with numpy : 0.04357624053955078 nb_pixel_total : 67080 time to create 1 rle with old method : 0.07549476623535156 time for calcul the mask position with numpy : 0.04399585723876953 nb_pixel_total : 14415 time to create 1 rle with old method : 0.016634225845336914 time for calcul the mask position with numpy : 0.044213294982910156 nb_pixel_total : 130083 time to create 1 rle with old method : 0.17043662071228027 time for calcul the mask position with numpy : 0.04172158241271973 nb_pixel_total : 66911 time to create 1 rle with old method : 0.07628655433654785 time for calcul the mask position with numpy : 0.043166160583496094 nb_pixel_total : 5948 time to create 1 rle with old method : 0.007185935974121094 time for calcul the mask position with numpy : 0.05111098289489746 nb_pixel_total : 28716 time to create 1 rle with old method : 0.03407168388366699 time for calcul the mask position with numpy : 0.045828819274902344 nb_pixel_total : 141546 time to create 1 rle with old method : 0.15845441818237305 time for calcul the mask position with numpy : 0.041884660720825195 nb_pixel_total : 35152 time to create 1 rle with old method : 0.03912830352783203 time for calcul the mask position with numpy : 0.04235243797302246 nb_pixel_total : 31776 time to create 1 rle with old method : 0.03618741035461426 time for calcul the mask position with numpy : 0.03056478500366211 nb_pixel_total : 60250 time to create 1 rle with old method : 0.07166218757629395 time for calcul the mask position with numpy : 0.03212571144104004 nb_pixel_total : 23782 time to create 1 rle with old method : 0.03268289566040039 time for calcul the mask position with numpy : 0.03349733352661133 nb_pixel_total : 57110 time to create 1 rle with old method : 0.07302284240722656 time for calcul the mask position with numpy : 0.02824854850769043 nb_pixel_total : 127633 time to create 1 rle with old method : 0.14586687088012695 time for calcul the mask position with numpy : 0.02881598472595215 nb_pixel_total : 29383 time to create 1 rle with old method : 0.032598257064819336 time for calcul the mask position with numpy : 0.025826215744018555 nb_pixel_total : 12490 time to create 1 rle with old method : 0.01381540298461914 time for calcul the mask position with numpy : 0.03050518035888672 nb_pixel_total : 404527 time to create 1 rle with new method : 0.9307045936584473 create new chi : 4.604971170425415 time to delete rle : 0.002872943878173828 batch 1 Loaded 35 chid ids of type : 3594 ++++++++++++++++++++++++++Number RLEs to save : 13760 TO DO : save crop sub photo not yet done ! save time : 5.104482889175415 nb_obj : 14 nb_hashtags : 4 time to prepare the origin masks : 8.46300458908081 time for calcul the mask position with numpy : 0.6603384017944336 nb_pixel_total : 7119780 time to create 1 rle with new method : 1.271432876586914 time for calcul the mask position with numpy : 0.03612470626831055 nb_pixel_total : 10250 time to create 1 rle with old method : 0.011635780334472656 time for calcul the mask position with numpy : 0.04450845718383789 nb_pixel_total : 4234 time to create 1 rle with old method : 0.005298614501953125 time for calcul the mask position with numpy : 0.04801011085510254 nb_pixel_total : 34637 time to create 1 rle with old method : 0.03860902786254883 time for calcul the mask position with numpy : 0.049916982650756836 nb_pixel_total : 113052 time to create 1 rle with old method : 0.12842798233032227 time for calcul the mask position with numpy : 0.04151129722595215 nb_pixel_total : 28934 time to create 1 rle with old method : 0.03403353691101074 time for calcul the mask position with numpy : 0.04637956619262695 nb_pixel_total : 22916 time to create 1 rle with old method : 0.02582859992980957 time for calcul the mask position with numpy : 0.041640520095825195 nb_pixel_total : 33768 time to create 1 rle with old method : 0.03882575035095215 time for calcul the mask position with numpy : 0.04596281051635742 nb_pixel_total : 406570 time to create 1 rle with new method : 1.0881624221801758 time for calcul the mask position with numpy : 0.044954776763916016 nb_pixel_total : 12094 time to create 1 rle with old method : 0.014469623565673828 time for calcul the mask position with numpy : 0.04716348648071289 nb_pixel_total : 49113 time to create 1 rle with old method : 0.05538034439086914 time for calcul the mask position with numpy : 0.04664754867553711 nb_pixel_total : 76743 time to create 1 rle with old method : 0.08610224723815918 time for calcul the mask position with numpy : 0.04174351692199707 nb_pixel_total : 26003 time to create 1 rle with old method : 0.030375957489013672 time for calcul the mask position with numpy : 0.03279614448547363 nb_pixel_total : 130973 time to create 1 rle with old method : 0.1457829475402832 time for calcul the mask position with numpy : 0.027669668197631836 nb_pixel_total : 225333 time to create 1 rle with new method : 0.9187366962432861 create new chi : 5.260962724685669 time to delete rle : 0.0026826858520507812 batch 1 Loaded 29 chid ids of type : 3594 ++++++++++++++++++Number RLEs to save : 12039 TO DO : save crop sub photo not yet done ! save time : 5.317103147506714 nb_obj : 18 nb_hashtags : 3 time to prepare the origin masks : 11.593586921691895 time for calcul the mask position with numpy : 1.2482845783233643 nb_pixel_total : 7025185 time to create 1 rle with new method : 0.7363326549530029 time for calcul the mask position with numpy : 0.04182791709899902 nb_pixel_total : 76779 time to create 1 rle with old method : 0.08697152137756348 time for calcul the mask position with numpy : 0.04152035713195801 nb_pixel_total : 16453 time to create 1 rle with old method : 0.019152402877807617 time for calcul the mask position with numpy : 0.05015397071838379 nb_pixel_total : 206659 time to create 1 rle with new method : 0.47367072105407715 time for calcul the mask position with numpy : 0.04734182357788086 nb_pixel_total : 34176 time to create 1 rle with old method : 0.04327034950256348 time for calcul the mask position with numpy : 0.04486370086669922 nb_pixel_total : 17197 time to create 1 rle with old method : 0.019527196884155273 time for calcul the mask position with numpy : 0.042786359786987305 nb_pixel_total : 157299 time to create 1 rle with new method : 0.5425972938537598 time for calcul the mask position with numpy : 0.0411069393157959 nb_pixel_total : 55872 time to create 1 rle with old method : 0.06305360794067383 time for calcul the mask position with numpy : 0.04357337951660156 nb_pixel_total : 5724 time to create 1 rle with old method : 0.006399631500244141 time for calcul the mask position with numpy : 0.04253721237182617 nb_pixel_total : 168789 time to create 1 rle with new method : 0.9640140533447266 time for calcul the mask position with numpy : 0.04108023643493652 nb_pixel_total : 17592 time to create 1 rle with old method : 0.019838333129882812 time for calcul the mask position with numpy : 0.04465961456298828 nb_pixel_total : 125521 time to create 1 rle with old method : 0.1507885456085205 time for calcul the mask position with numpy : 0.05986976623535156 nb_pixel_total : 29051 time to create 1 rle with old method : 0.037252187728881836 time for calcul the mask position with numpy : 0.0626530647277832 nb_pixel_total : 20954 time to create 1 rle with old method : 0.032558441162109375 time for calcul the mask position with numpy : 0.051954030990600586 nb_pixel_total : 53018 time to create 1 rle with old method : 0.07844805717468262 time for calcul the mask position with numpy : 0.04134702682495117 nb_pixel_total : 101265 time to create 1 rle with old method : 0.11484527587890625 time for calcul the mask position with numpy : 0.04221773147583008 nb_pixel_total : 143015 time to create 1 rle with old method : 0.15785956382751465 time for calcul the mask position with numpy : 0.04099750518798828 nb_pixel_total : 31371 time to create 1 rle with old method : 0.03415989875793457 time for calcul the mask position with numpy : 0.040373802185058594 nb_pixel_total : 8480 time to create 1 rle with old method : 0.010622501373291016 create new chi : 5.842418432235718 time to delete rle : 0.005120754241943359 batch 1 Loaded 37 chid ids of type : 3594 +++++++++++++++++++++Number RLEs to save : 13549 TO DO : save crop sub photo not yet done ! save time : 5.769140720367432 map_output_result : {1329190350: (0.0, 'Should be the crop_list due to order', 0), 1329190340: (0.0, 'Should be the crop_list due to order', 0), 1329190335: (0.0, 'Should be the crop_list due to order', 0), 1329190331: (0.0, 'Should be the crop_list due to order', 0), 1329190285: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1329190350, 1329190340, 1329190335, 1329190331, 1329190285] Looping around the photos to save general results len do output : 5 /1329190350.Didn't retrieve data . /1329190340.Didn't retrieve data . /1329190335.Didn't retrieve data . /1329190331.Didn't retrieve data . /1329190285.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2651253') ('3318', '21173139', '1329190350', None, None, None, None, None, '2651253') ('3318', None, None, None, None, None, None, None, '2651253') ('3318', '21173139', '1329190340', None, None, None, None, None, '2651253') ('3318', None, None, None, None, None, None, None, '2651253') ('3318', '21173139', '1329190335', None, None, None, None, None, '2651253') ('3318', None, None, None, None, None, None, None, '2651253') ('3318', '21173139', '1329190331', None, None, None, None, None, '2651253') ('3318', None, None, None, None, None, None, None, '2651253') ('3318', '21173139', '1329190285', None, None, None, None, None, '2651253') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 15 time used for this insertion : 0.012292623519897461 save_final save missing photos in datou_result : time spend for datou_step_exec : 123.07804536819458 time spend to save output : 0.013117790222167969 total time spend for step 3 : 123.09116315841675 step4:ventilate_hashtags_in_portfolio Sat Mar 8 09:15:07 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 21173139 get user id for portfolio 21173139 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21173139 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','mal_croppe','pehd','metal','autre','pet_fonce','carton','flou','background','papier','pet_clair')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21173139 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','mal_croppe','pehd','metal','autre','pet_fonce','carton','flou','background','papier','pet_clair')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21173139 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','mal_croppe','pehd','metal','autre','pet_fonce','carton','flou','background','papier','pet_clair')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/21173751,21173752,21173753,21173754,21173755,21173756,21173757,21173758,21173759,21173760,21173761?tags=environnement,mal_croppe,pehd,metal,autre,pet_fonce,carton,flou,background,papier,pet_clair Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1329190350, 1329190340, 1329190335, 1329190331, 1329190285] Looping around the photos to save general results len do output : 1 /21173139. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2651253') ('3318', '21173139', '1329190350', None, None, None, None, None, '2651253') ('3318', None, None, None, None, None, None, None, '2651253') ('3318', '21173139', '1329190340', None, None, None, None, None, '2651253') ('3318', None, None, None, None, None, None, None, '2651253') ('3318', '21173139', '1329190335', None, None, None, None, None, '2651253') ('3318', None, None, None, None, None, None, None, '2651253') ('3318', '21173139', '1329190331', None, None, None, None, None, '2651253') ('3318', None, None, None, None, None, None, None, '2651253') ('3318', '21173139', '1329190285', None, None, None, None, None, '2651253') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.013382196426391602 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.431934356689453 time spend to save output : 0.01397085189819336 total time spend for step 4 : 2.4459052085876465 step5:final Sat Mar 8 09:15:09 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1329190350: ('0.15370604263117282',), 1329190340: ('0.15370604263117282',), 1329190335: ('0.15370604263117282',), 1329190331: ('0.15370604263117282',), 1329190285: ('0.15370604263117282',)} new output for save of step final : {1329190350: ('0.15370604263117282',), 1329190340: ('0.15370604263117282',), 1329190335: ('0.15370604263117282',), 1329190331: ('0.15370604263117282',), 1329190285: ('0.15370604263117282',)} [1329190350, 1329190340, 1329190335, 1329190331, 1329190285] Looping around the photos to save general results len do output : 5 /1329190350.Didn't retrieve data . /1329190340.Didn't retrieve data . /1329190335.Didn't retrieve data . /1329190331.Didn't retrieve data . /1329190285.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2651253') ('3318', '21173139', '1329190350', None, None, None, None, None, '2651253') ('3318', None, None, None, None, None, None, None, '2651253') ('3318', '21173139', '1329190340', None, None, None, None, None, '2651253') ('3318', None, None, None, None, None, None, None, '2651253') ('3318', '21173139', '1329190335', None, None, None, None, None, '2651253') ('3318', None, None, None, None, None, None, None, '2651253') ('3318', '21173139', '1329190331', None, None, None, None, None, '2651253') ('3318', None, None, None, None, None, None, None, '2651253') ('3318', '21173139', '1329190285', None, None, None, None, None, '2651253') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 15 time used for this insertion : 0.011835336685180664 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.4256875514984131 time spend to save output : 0.012342214584350586 total time spend for step 5 : 0.43802976608276367 step6:blur_detection Sat Mar 8 09:15:10 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1741421430_3639314_1329190350_fee6618746d35ba65bd20f90209c79e3.jpg resize: (2160, 3840) 1329190350 -5.150611309457475 treat image : temp/1741421430_3639314_1329190340_bb74e5c838a5d9c7f029d257b31873f8.jpg resize: (2160, 3840) 1329190340 -5.568501114413636 treat image : temp/1741421430_3639314_1329190335_8a8f6a9cf7fb9bc51077ba9bb7b7e27a.jpg resize: (2160, 3840) 1329190335 -6.023054719786022 treat image : temp/1741421430_3639314_1329190331_bacc9a38f22de0a8f0ff23c308ca6df3.jpg resize: (2160, 3840) 1329190331 -5.941215476425226 treat image : temp/1741421430_3639314_1329190285_0c1b063f07f3246b02442a0877ef7bb2.jpg resize: (2160, 3840) 1329190285 -5.270089537768302 treat image : temp/1741421430_3639314_1329190350_fee6618746d35ba65bd20f90209c79e3_rle_crop_3699254100_0.png resize: (223, 160) 1341787757 -2.6412226457047807 treat image : temp/1741421430_3639314_1329190350_fee6618746d35ba65bd20f90209c79e3_rle_crop_3699254113_0.png resize: (212, 229) 1341787758 -3.221538300689778 treat image : temp/1741421430_3639314_1329190350_fee6618746d35ba65bd20f90209c79e3_rle_crop_3699254114_0.png resize: (270, 430) 1341787759 -4.271823534495471 treat image : temp/1741421430_3639314_1329190350_fee6618746d35ba65bd20f90209c79e3_rle_crop_3699254121_0.png resize: (213, 182) 1341787760 -3.4404067209872453 treat image : temp/1741421430_3639314_1329190350_fee6618746d35ba65bd20f90209c79e3_rle_crop_3699254116_0.png resize: (236, 254) 1341787761 -3.9045344536893785 treat image : temp/1741421430_3639314_1329190350_fee6618746d35ba65bd20f90209c79e3_rle_crop_3699254106_0.png resize: (427, 506) 1341787762 -3.933019965914033 treat image : temp/1741421430_3639314_1329190350_fee6618746d35ba65bd20f90209c79e3_rle_crop_3699254107_0.png resize: (321, 257) 1341787763 -1.878602478689632 treat image : temp/1741421430_3639314_1329190350_fee6618746d35ba65bd20f90209c79e3_rle_crop_3699254118_0.png resize: (759, 318) 1341787764 -3.8499166840144436 treat image : temp/1741421430_3639314_1329190350_fee6618746d35ba65bd20f90209c79e3_rle_crop_3699254122_0.png resize: (83, 123) 1341787765 -3.936420332945187 treat image : temp/1741421430_3639314_1329190350_fee6618746d35ba65bd20f90209c79e3_rle_crop_3699254105_0.png resize: (216, 269) 1341787767 -2.6551226862752504 treat image : temp/1741421430_3639314_1329190350_fee6618746d35ba65bd20f90209c79e3_rle_crop_3699254102_0.png resize: (115, 159) 1341787768 -2.9350495711860374 treat image : temp/1741421430_3639314_1329190350_fee6618746d35ba65bd20f90209c79e3_rle_crop_3699254119_0.png resize: (355, 281) 1341787769 -3.012535373525981 treat image : temp/1741421430_3639314_1329190350_fee6618746d35ba65bd20f90209c79e3_rle_crop_3699254109_0.png resize: (132, 77) 1341787770 -4.178670438008878 treat image : temp/1741421430_3639314_1329190340_bb74e5c838a5d9c7f029d257b31873f8_rle_crop_3699254136_0.png resize: (265, 136) 1341787771 -4.490935903412182 treat image : temp/1741421430_3639314_1329190340_bb74e5c838a5d9c7f029d257b31873f8_rle_crop_3699254124_0.png resize: (425, 397) 1341787772 -3.561137968008608 treat image : temp/1741421430_3639314_1329190340_bb74e5c838a5d9c7f029d257b31873f8_rle_crop_3699254131_0.png resize: (250, 146) 1341787773 -2.7752317985795583 treat image : temp/1741421430_3639314_1329190340_bb74e5c838a5d9c7f029d257b31873f8_rle_crop_3699254123_0.png resize: (188, 164) 1341787774 -3.247549085036546 treat image : temp/1741421430_3639314_1329190340_bb74e5c838a5d9c7f029d257b31873f8_rle_crop_3699254133_0.png resize: (721, 604) 1341787775 -4.595028433772238 treat image : temp/1741421430_3639314_1329190340_bb74e5c838a5d9c7f029d257b31873f8_rle_crop_3699254127_0.png resize: (241, 213) 1341787776 -2.52222454690983 treat image : temp/1741421430_3639314_1329190340_bb74e5c838a5d9c7f029d257b31873f8_rle_crop_3699254126_0.png resize: (145, 160) 1341787777 -3.724052525663152 treat image : temp/1741421430_3639314_1329190335_8a8f6a9cf7fb9bc51077ba9bb7b7e27a_rle_crop_3699254151_0.png resize: (200, 253) 1341787778 -3.1729844192476273 treat image : temp/1741421430_3639314_1329190335_8a8f6a9cf7fb9bc51077ba9bb7b7e27a_rle_crop_3699254159_0.png resize: (101, 187) 1341787779 -3.780316158522987 treat image : temp/1741421430_3639314_1329190335_8a8f6a9cf7fb9bc51077ba9bb7b7e27a_rle_crop_3699254144_0.png resize: (126, 164) 1341787780 -2.510848450393531 treat image : temp/1741421430_3639314_1329190335_8a8f6a9cf7fb9bc51077ba9bb7b7e27a_rle_crop_3699254145_0.png resize: (407, 195) 1341787781 -3.157512060688896 treat image : temp/1741421430_3639314_1329190335_8a8f6a9cf7fb9bc51077ba9bb7b7e27a_rle_crop_3699254149_0.png resize: (445, 245) 1341787782 -3.139860959528836 treat image : temp/1741421430_3639314_1329190335_8a8f6a9cf7fb9bc51077ba9bb7b7e27a_rle_crop_3699254156_0.png resize: (501, 511) 1341787783 -4.130410463375032 treat image : temp/1741421430_3639314_1329190335_8a8f6a9cf7fb9bc51077ba9bb7b7e27a_rle_crop_3699254147_0.png resize: (268, 318) 1341787784 -4.200522689058282 treat image : temp/1741421430_3639314_1329190335_8a8f6a9cf7fb9bc51077ba9bb7b7e27a_rle_crop_3699254155_0.png resize: (200, 486) 1341787785 -3.301814666938697 treat image : temp/1741421430_3639314_1329190335_8a8f6a9cf7fb9bc51077ba9bb7b7e27a_rle_crop_3699254146_0.png resize: (401, 452) 1341787786 -3.8288623706926597 treat image : temp/1741421430_3639314_1329190335_8a8f6a9cf7fb9bc51077ba9bb7b7e27a_rle_crop_3699254148_0.png resize: (201, 183) 1341787787 -2.7781270830949465 treat image : temp/1741421430_3639314_1329190335_8a8f6a9cf7fb9bc51077ba9bb7b7e27a_rle_crop_3699254143_0.png resize: (872, 656) 1341787788 -4.56812703241339 treat image : temp/1741421430_3639314_1329190335_8a8f6a9cf7fb9bc51077ba9bb7b7e27a_rle_crop_3699254157_0.png resize: (130, 166) 1341787789 -3.7104343487831106 treat image : temp/1741421430_3639314_1329190335_8a8f6a9cf7fb9bc51077ba9bb7b7e27a_rle_crop_3699254153_0.png resize: (315, 176) 1341787790 -3.8078104751944357 treat image : temp/1741421430_3639314_1329190331_bacc9a38f22de0a8f0ff23c308ca6df3_rle_crop_3699254160_0.png resize: (738, 554) 1341787791 -4.134041200678088 treat image : temp/1741421430_3639314_1329190331_bacc9a38f22de0a8f0ff23c308ca6df3_rle_crop_3699254161_0.png resize: (458, 504) 1341787792 -3.923478081615142 treat image : temp/1741421430_3639314_1329190331_bacc9a38f22de0a8f0ff23c308ca6df3_rle_crop_3699254170_0.png resize: (467, 418) 1341787793 -3.7874723702722966 treat image : temp/1741421430_3639314_1329190331_bacc9a38f22de0a8f0ff23c308ca6df3_rle_crop_3699254162_0.png resize: (170, 208) 1341787794 -4.0120408736399655 treat image : temp/1741421430_3639314_1329190331_bacc9a38f22de0a8f0ff23c308ca6df3_rle_crop_3699254164_0.png resize: (328, 270) 1341787795 -1.7037167647783429 treat image : temp/1741421430_3639314_1329190331_bacc9a38f22de0a8f0ff23c308ca6df3_rle_crop_3699254173_0.png resize: (72, 210) 1341787796 -3.8762118334176523 treat image : temp/1741421430_3639314_1329190331_bacc9a38f22de0a8f0ff23c308ca6df3_rle_crop_3699254168_0.png resize: (191, 179) 1341787797 -2.79968238117718 treat image : temp/1741421430_3639314_1329190285_0c1b063f07f3246b02442a0877ef7bb2_rle_crop_3699254181_0.png resize: (428, 409) 1341787798 -3.461253318562815 treat image : temp/1741421430_3639314_1329190285_0c1b063f07f3246b02442a0877ef7bb2_rle_crop_3699254180_0.png resize: (190, 220) 1341787799 -4.651196775063659 treat image : temp/1741421430_3639314_1329190285_0c1b063f07f3246b02442a0877ef7bb2_rle_crop_3699254174_0.png resize: (125, 93) 1341787800 -3.485943119763218 treat image : temp/1741421430_3639314_1329190285_0c1b063f07f3246b02442a0877ef7bb2_rle_crop_3699254175_0.png resize: (155, 248) 1341787801 -3.6549603785378304 treat image : temp/1741421430_3639314_1329190285_0c1b063f07f3246b02442a0877ef7bb2_rle_crop_3699254187_0.png resize: (231, 215) 1341787802 -3.553122500715841 treat image : temp/1741421430_3639314_1329190285_0c1b063f07f3246b02442a0877ef7bb2_rle_crop_3699254184_0.png resize: (97, 80) 1341787803 -3.5452447181758897 treat image : temp/1741421430_3639314_1329190285_0c1b063f07f3246b02442a0877ef7bb2_rle_crop_3699254190_0.png resize: (153, 142) 1341787804 -3.635552888691858 treat image : temp/1741421430_3639314_1329190285_0c1b063f07f3246b02442a0877ef7bb2_rle_crop_3699254185_0.png resize: (253, 283) 1341787805 -3.7707912085207993 treat image : temp/1741421430_3639314_1329190285_0c1b063f07f3246b02442a0877ef7bb2_rle_crop_3699254182_0.png resize: (259, 90) 1341787806 -3.318805734730453 treat image : temp/1741421430_3639314_1329190350_fee6618746d35ba65bd20f90209c79e3_rle_crop_3699254098_0.png resize: (155, 107) 1341787819 -1.7487291925418644 treat image : temp/1741421430_3639314_1329190350_fee6618746d35ba65bd20f90209c79e3_rle_crop_3699254120_0.png resize: (243, 181) 1341787820 -2.8535929686705392 treat image : temp/1741421430_3639314_1329190350_fee6618746d35ba65bd20f90209c79e3_rle_crop_3699254112_0.png resize: (99, 65) 1341787821 -2.8330586818877475 treat image : temp/1741421430_3639314_1329190350_fee6618746d35ba65bd20f90209c79e3_rle_crop_3699254110_0.png resize: (106, 217) 1341787822 -3.7405357560826875 treat image : temp/1741421430_3639314_1329190350_fee6618746d35ba65bd20f90209c79e3_rle_crop_3699254099_0.png resize: (211, 235) 1341787823 -3.3022795275899357 treat image : temp/1741421430_3639314_1329190340_bb74e5c838a5d9c7f029d257b31873f8_rle_crop_3699254128_0.png resize: (230, 126) 1341787824 -3.255995332131146 treat image : temp/1741421430_3639314_1329190340_bb74e5c838a5d9c7f029d257b31873f8_rle_crop_3699254135_0.png resize: (218, 184) 1341787825 -3.5777070827081023 treat image : temp/1741421430_3639314_1329190331_bacc9a38f22de0a8f0ff23c308ca6df3_rle_crop_3699254165_0.png resize: (161, 118) 1341787826 -4.01742366649832 treat image : temp/1741421430_3639314_1329190331_bacc9a38f22de0a8f0ff23c308ca6df3_rle_crop_3699254172_0.png resize: (457, 412) 1341787827 -3.759718017030421 treat image : temp/1741421430_3639314_1329190331_bacc9a38f22de0a8f0ff23c308ca6df3_rle_crop_3699254166_0.png resize: (969, 903) 1341787828 -4.431373731131888 treat image : temp/1741421430_3639314_1329190285_0c1b063f07f3246b02442a0877ef7bb2_rle_crop_3699254176_0.png resize: (302, 582) 1341787829 -4.006888788828609 treat image : temp/1741421430_3639314_1329190285_0c1b063f07f3246b02442a0877ef7bb2_rle_crop_3699254188_0.png resize: (222, 225) 1341787830 -3.0969247845077916 treat image : temp/1741421430_3639314_1329190285_0c1b063f07f3246b02442a0877ef7bb2_rle_crop_3699254191_0.png resize: (397, 340) 1341787831 -3.561702051221027 treat image : temp/1741421430_3639314_1329190350_fee6618746d35ba65bd20f90209c79e3_rle_crop_3699254111_0.png resize: (269, 244) 1341787866 -3.5733521656540566 treat image : temp/1741421430_3639314_1329190350_fee6618746d35ba65bd20f90209c79e3_rle_crop_3699254101_0.png resize: (253, 167) 1341787867 -4.026396979614301 treat image : temp/1741421430_3639314_1329190340_bb74e5c838a5d9c7f029d257b31873f8_rle_crop_3699254141_0.png resize: (125, 105) 1341787868 -3.5279876816081046 treat image : temp/1741421430_3639314_1329190340_bb74e5c838a5d9c7f029d257b31873f8_rle_crop_3699254134_0.png resize: (100, 114) 1341787870 -3.769530670800426 treat image : temp/1741421430_3639314_1329190340_bb74e5c838a5d9c7f029d257b31873f8_rle_crop_3699254142_0.png resize: (188, 136) 1341787876 -3.7634079898331203 treat image : temp/1741421430_3639314_1329190335_8a8f6a9cf7fb9bc51077ba9bb7b7e27a_rle_crop_3699254150_0.png resize: (185, 200) 1341787878 -4.247745098965901 treat image : temp/1741421430_3639314_1329190331_bacc9a38f22de0a8f0ff23c308ca6df3_rle_crop_3699254169_0.png resize: (269, 165) 1341787880 -3.724173338714389 treat image : temp/1741421430_3639314_1329190350_fee6618746d35ba65bd20f90209c79e3_rle_crop_3699254117_0.png resize: (177, 217) 1341787901 -3.6153720854614426 treat image : temp/1741421430_3639314_1329190350_fee6618746d35ba65bd20f90209c79e3_rle_crop_3699254103_0.png resize: (168, 185) 1341787902 -4.449644419079266 treat image : temp/1741421430_3639314_1329190350_fee6618746d35ba65bd20f90209c79e3_rle_crop_3699254115_0.png resize: (502, 831) 1341787903 -3.5687927552334866 treat image : temp/1741421430_3639314_1329190350_fee6618746d35ba65bd20f90209c79e3_rle_crop_3699254108_0.png resize: (777, 454) 1341787904 -4.026070446061365 treat image : temp/1741421430_3639314_1329190350_fee6618746d35ba65bd20f90209c79e3_rle_crop_3699254104_0.png resize: (201, 129) 1341787905 -3.4995204664271116 treat image : temp/1741421430_3639314_1329190340_bb74e5c838a5d9c7f029d257b31873f8_rle_crop_3699254129_0.png resize: (481, 325) 1341787906 -1.7969571736452967 treat image : temp/1741421430_3639314_1329190340_bb74e5c838a5d9c7f029d257b31873f8_rle_crop_3699254137_0.png resize: (354, 206) 1341787907 -4.523438815342522 treat image : temp/1741421430_3639314_1329190340_bb74e5c838a5d9c7f029d257b31873f8_rle_crop_3699254139_0.png resize: (402, 281) 1341787908 -4.2698968851813275 treat image : temp/1741421430_3639314_1329190340_bb74e5c838a5d9c7f029d257b31873f8_rle_crop_3699254138_0.png resize: (229, 199) 1341787909 -3.5562568688243226 treat image : temp/1741421430_3639314_1329190340_bb74e5c838a5d9c7f029d257b31873f8_rle_crop_3699254125_0.png resize: (530, 376) 1341787910 -4.1772250458128575 treat image : temp/1741421430_3639314_1329190340_bb74e5c838a5d9c7f029d257b31873f8_rle_crop_3699254132_0.png resize: (267, 328) 1341787911 -3.814914142233174 treat image : temp/1741421430_3639314_1329190335_8a8f6a9cf7fb9bc51077ba9bb7b7e27a_rle_crop_3699254152_0.png resize: (585, 308) 1341787912 -4.175458505482025 treat image : temp/1741421430_3639314_1329190335_8a8f6a9cf7fb9bc51077ba9bb7b7e27a_rle_crop_3699254154_0.png resize: (67, 121) 1341787913 -3.102715073281735 treat image : temp/1741421430_3639314_1329190335_8a8f6a9cf7fb9bc51077ba9bb7b7e27a_rle_crop_3699254158_0.png resize: (323, 346) 1341787914 -3.132319791116885 treat image : temp/1741421430_3639314_1329190331_bacc9a38f22de0a8f0ff23c308ca6df3_rle_crop_3699254167_0.png resize: (224, 183) 1341787915 -3.6872050552088447 treat image : temp/1741421430_3639314_1329190331_bacc9a38f22de0a8f0ff23c308ca6df3_rle_crop_3699254163_0.png resize: (280, 420) 1341787917 -4.2791219580469715 treat image : temp/1741421430_3639314_1329190331_bacc9a38f22de0a8f0ff23c308ca6df3_rle_crop_3699254171_0.png resize: (192, 294) 1341787918 -3.993196959099319 treat image : temp/1741421430_3639314_1329190285_0c1b063f07f3246b02442a0877ef7bb2_rle_crop_3699254179_0.png resize: (99, 344) 1341787919 -3.2220694981556224 treat image : temp/1741421430_3639314_1329190285_0c1b063f07f3246b02442a0877ef7bb2_rle_crop_3699254177_0.png resize: (494, 272) 1341787920 -4.305890469441505 treat image : temp/1741421430_3639314_1329190285_0c1b063f07f3246b02442a0877ef7bb2_rle_crop_3699254183_0.png resize: (674, 337) 1341787921 -4.239528338893778 treat image : temp/1741421430_3639314_1329190285_0c1b063f07f3246b02442a0877ef7bb2_rle_crop_3699254189_0.png resize: (684, 386) 1341787922 -3.8588428737268563 treat image : temp/1741421430_3639314_1329190285_0c1b063f07f3246b02442a0877ef7bb2_rle_crop_3699254186_0.png resize: (544, 423) 1341787923 -4.241429522423533 treat image : temp/1741421430_3639314_1329190285_0c1b063f07f3246b02442a0877ef7bb2_rle_crop_3699254178_0.png resize: (345, 206) 1341787924 -3.056792932208112 treat image : temp/1741421430_3639314_1329190340_bb74e5c838a5d9c7f029d257b31873f8_rle_crop_3699254140_0.png resize: (286, 238) 1341787927 -3.289228778447852 treat image : temp/1741421430_3639314_1329190340_bb74e5c838a5d9c7f029d257b31873f8_rle_crop_3699254130_0.png resize: (323, 434) 1341787928 -1.6667885930017814 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 99 time used for this insertion : 0.018148422241210938 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 99 time used for this insertion : 0.28844189643859863 save missing photos in datou_result : time spend for datou_step_exec : 26.754857778549194 time spend to save output : 0.31200098991394043 total time spend for step 6 : 27.066858768463135 step7:brightness Sat Mar 8 09:15:37 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1741421430_3639314_1329190350_fee6618746d35ba65bd20f90209c79e3.jpg treat image : temp/1741421430_3639314_1329190340_bb74e5c838a5d9c7f029d257b31873f8.jpg treat image : temp/1741421430_3639314_1329190335_8a8f6a9cf7fb9bc51077ba9bb7b7e27a.jpg treat image : temp/1741421430_3639314_1329190331_bacc9a38f22de0a8f0ff23c308ca6df3.jpg treat image : temp/1741421430_3639314_1329190285_0c1b063f07f3246b02442a0877ef7bb2.jpg treat image : temp/1741421430_3639314_1329190350_fee6618746d35ba65bd20f90209c79e3_rle_crop_3699254100_0.png treat image : temp/1741421430_3639314_1329190350_fee6618746d35ba65bd20f90209c79e3_rle_crop_3699254113_0.png treat image : temp/1741421430_3639314_1329190350_fee6618746d35ba65bd20f90209c79e3_rle_crop_3699254114_0.png treat image : temp/1741421430_3639314_1329190350_fee6618746d35ba65bd20f90209c79e3_rle_crop_3699254121_0.png treat image : temp/1741421430_3639314_1329190350_fee6618746d35ba65bd20f90209c79e3_rle_crop_3699254116_0.png treat image : temp/1741421430_3639314_1329190350_fee6618746d35ba65bd20f90209c79e3_rle_crop_3699254106_0.png treat image : temp/1741421430_3639314_1329190350_fee6618746d35ba65bd20f90209c79e3_rle_crop_3699254107_0.png treat image : temp/1741421430_3639314_1329190350_fee6618746d35ba65bd20f90209c79e3_rle_crop_3699254118_0.png treat image : temp/1741421430_3639314_1329190350_fee6618746d35ba65bd20f90209c79e3_rle_crop_3699254122_0.png treat image : temp/1741421430_3639314_1329190350_fee6618746d35ba65bd20f90209c79e3_rle_crop_3699254105_0.png treat image : temp/1741421430_3639314_1329190350_fee6618746d35ba65bd20f90209c79e3_rle_crop_3699254102_0.png treat image : temp/1741421430_3639314_1329190350_fee6618746d35ba65bd20f90209c79e3_rle_crop_3699254119_0.png treat image : temp/1741421430_3639314_1329190350_fee6618746d35ba65bd20f90209c79e3_rle_crop_3699254109_0.png treat image : temp/1741421430_3639314_1329190340_bb74e5c838a5d9c7f029d257b31873f8_rle_crop_3699254136_0.png treat image : temp/1741421430_3639314_1329190340_bb74e5c838a5d9c7f029d257b31873f8_rle_crop_3699254124_0.png treat image : temp/1741421430_3639314_1329190340_bb74e5c838a5d9c7f029d257b31873f8_rle_crop_3699254131_0.png treat image : temp/1741421430_3639314_1329190340_bb74e5c838a5d9c7f029d257b31873f8_rle_crop_3699254123_0.png treat image : temp/1741421430_3639314_1329190340_bb74e5c838a5d9c7f029d257b31873f8_rle_crop_3699254133_0.png treat image : temp/1741421430_3639314_1329190340_bb74e5c838a5d9c7f029d257b31873f8_rle_crop_3699254127_0.png treat image : temp/1741421430_3639314_1329190340_bb74e5c838a5d9c7f029d257b31873f8_rle_crop_3699254126_0.png treat image : temp/1741421430_3639314_1329190335_8a8f6a9cf7fb9bc51077ba9bb7b7e27a_rle_crop_3699254151_0.png treat image : temp/1741421430_3639314_1329190335_8a8f6a9cf7fb9bc51077ba9bb7b7e27a_rle_crop_3699254159_0.png treat image : temp/1741421430_3639314_1329190335_8a8f6a9cf7fb9bc51077ba9bb7b7e27a_rle_crop_3699254144_0.png treat image : temp/1741421430_3639314_1329190335_8a8f6a9cf7fb9bc51077ba9bb7b7e27a_rle_crop_3699254145_0.png treat image : temp/1741421430_3639314_1329190335_8a8f6a9cf7fb9bc51077ba9bb7b7e27a_rle_crop_3699254149_0.png treat image : temp/1741421430_3639314_1329190335_8a8f6a9cf7fb9bc51077ba9bb7b7e27a_rle_crop_3699254156_0.png treat image : temp/1741421430_3639314_1329190335_8a8f6a9cf7fb9bc51077ba9bb7b7e27a_rle_crop_3699254147_0.png treat image : temp/1741421430_3639314_1329190335_8a8f6a9cf7fb9bc51077ba9bb7b7e27a_rle_crop_3699254155_0.png treat image : temp/1741421430_3639314_1329190335_8a8f6a9cf7fb9bc51077ba9bb7b7e27a_rle_crop_3699254146_0.png treat image : temp/1741421430_3639314_1329190335_8a8f6a9cf7fb9bc51077ba9bb7b7e27a_rle_crop_3699254148_0.png treat image : temp/1741421430_3639314_1329190335_8a8f6a9cf7fb9bc51077ba9bb7b7e27a_rle_crop_3699254143_0.png treat image : temp/1741421430_3639314_1329190335_8a8f6a9cf7fb9bc51077ba9bb7b7e27a_rle_crop_3699254157_0.png treat image : temp/1741421430_3639314_1329190335_8a8f6a9cf7fb9bc51077ba9bb7b7e27a_rle_crop_3699254153_0.png treat image : temp/1741421430_3639314_1329190331_bacc9a38f22de0a8f0ff23c308ca6df3_rle_crop_3699254160_0.png treat image : temp/1741421430_3639314_1329190331_bacc9a38f22de0a8f0ff23c308ca6df3_rle_crop_3699254161_0.png treat image : temp/1741421430_3639314_1329190331_bacc9a38f22de0a8f0ff23c308ca6df3_rle_crop_3699254170_0.png treat image : temp/1741421430_3639314_1329190331_bacc9a38f22de0a8f0ff23c308ca6df3_rle_crop_3699254162_0.png treat image : temp/1741421430_3639314_1329190331_bacc9a38f22de0a8f0ff23c308ca6df3_rle_crop_3699254164_0.png treat image : temp/1741421430_3639314_1329190331_bacc9a38f22de0a8f0ff23c308ca6df3_rle_crop_3699254173_0.png treat image : temp/1741421430_3639314_1329190331_bacc9a38f22de0a8f0ff23c308ca6df3_rle_crop_3699254168_0.png treat image : temp/1741421430_3639314_1329190285_0c1b063f07f3246b02442a0877ef7bb2_rle_crop_3699254181_0.png treat image : temp/1741421430_3639314_1329190285_0c1b063f07f3246b02442a0877ef7bb2_rle_crop_3699254180_0.png treat image : temp/1741421430_3639314_1329190285_0c1b063f07f3246b02442a0877ef7bb2_rle_crop_3699254174_0.png treat image : temp/1741421430_3639314_1329190285_0c1b063f07f3246b02442a0877ef7bb2_rle_crop_3699254175_0.png treat image : temp/1741421430_3639314_1329190285_0c1b063f07f3246b02442a0877ef7bb2_rle_crop_3699254187_0.png treat image : temp/1741421430_3639314_1329190285_0c1b063f07f3246b02442a0877ef7bb2_rle_crop_3699254184_0.png treat image : temp/1741421430_3639314_1329190285_0c1b063f07f3246b02442a0877ef7bb2_rle_crop_3699254190_0.png treat image : temp/1741421430_3639314_1329190285_0c1b063f07f3246b02442a0877ef7bb2_rle_crop_3699254185_0.png treat image : temp/1741421430_3639314_1329190285_0c1b063f07f3246b02442a0877ef7bb2_rle_crop_3699254182_0.png treat image : temp/1741421430_3639314_1329190350_fee6618746d35ba65bd20f90209c79e3_rle_crop_3699254098_0.png treat image : temp/1741421430_3639314_1329190350_fee6618746d35ba65bd20f90209c79e3_rle_crop_3699254120_0.png treat image : temp/1741421430_3639314_1329190350_fee6618746d35ba65bd20f90209c79e3_rle_crop_3699254112_0.png treat image : temp/1741421430_3639314_1329190350_fee6618746d35ba65bd20f90209c79e3_rle_crop_3699254110_0.png treat image : temp/1741421430_3639314_1329190350_fee6618746d35ba65bd20f90209c79e3_rle_crop_3699254099_0.png treat image : temp/1741421430_3639314_1329190340_bb74e5c838a5d9c7f029d257b31873f8_rle_crop_3699254128_0.png treat image : temp/1741421430_3639314_1329190340_bb74e5c838a5d9c7f029d257b31873f8_rle_crop_3699254135_0.png treat image : temp/1741421430_3639314_1329190331_bacc9a38f22de0a8f0ff23c308ca6df3_rle_crop_3699254165_0.png treat image : temp/1741421430_3639314_1329190331_bacc9a38f22de0a8f0ff23c308ca6df3_rle_crop_3699254172_0.png treat image : temp/1741421430_3639314_1329190331_bacc9a38f22de0a8f0ff23c308ca6df3_rle_crop_3699254166_0.png treat image : temp/1741421430_3639314_1329190285_0c1b063f07f3246b02442a0877ef7bb2_rle_crop_3699254176_0.png treat image : temp/1741421430_3639314_1329190285_0c1b063f07f3246b02442a0877ef7bb2_rle_crop_3699254188_0.png treat image : temp/1741421430_3639314_1329190285_0c1b063f07f3246b02442a0877ef7bb2_rle_crop_3699254191_0.png treat image : temp/1741421430_3639314_1329190350_fee6618746d35ba65bd20f90209c79e3_rle_crop_3699254111_0.png treat image : temp/1741421430_3639314_1329190350_fee6618746d35ba65bd20f90209c79e3_rle_crop_3699254101_0.png treat image : temp/1741421430_3639314_1329190340_bb74e5c838a5d9c7f029d257b31873f8_rle_crop_3699254141_0.png treat image : temp/1741421430_3639314_1329190340_bb74e5c838a5d9c7f029d257b31873f8_rle_crop_3699254134_0.png treat image : temp/1741421430_3639314_1329190340_bb74e5c838a5d9c7f029d257b31873f8_rle_crop_3699254142_0.png treat image : temp/1741421430_3639314_1329190335_8a8f6a9cf7fb9bc51077ba9bb7b7e27a_rle_crop_3699254150_0.png treat image : temp/1741421430_3639314_1329190331_bacc9a38f22de0a8f0ff23c308ca6df3_rle_crop_3699254169_0.png treat image : temp/1741421430_3639314_1329190350_fee6618746d35ba65bd20f90209c79e3_rle_crop_3699254117_0.png treat image : temp/1741421430_3639314_1329190350_fee6618746d35ba65bd20f90209c79e3_rle_crop_3699254103_0.png treat image : temp/1741421430_3639314_1329190350_fee6618746d35ba65bd20f90209c79e3_rle_crop_3699254115_0.png treat image : temp/1741421430_3639314_1329190350_fee6618746d35ba65bd20f90209c79e3_rle_crop_3699254108_0.png treat image : temp/1741421430_3639314_1329190350_fee6618746d35ba65bd20f90209c79e3_rle_crop_3699254104_0.png treat image : temp/1741421430_3639314_1329190340_bb74e5c838a5d9c7f029d257b31873f8_rle_crop_3699254129_0.png treat image : temp/1741421430_3639314_1329190340_bb74e5c838a5d9c7f029d257b31873f8_rle_crop_3699254137_0.png treat image : temp/1741421430_3639314_1329190340_bb74e5c838a5d9c7f029d257b31873f8_rle_crop_3699254139_0.png treat image : temp/1741421430_3639314_1329190340_bb74e5c838a5d9c7f029d257b31873f8_rle_crop_3699254138_0.png treat image : temp/1741421430_3639314_1329190340_bb74e5c838a5d9c7f029d257b31873f8_rle_crop_3699254125_0.png treat image : temp/1741421430_3639314_1329190340_bb74e5c838a5d9c7f029d257b31873f8_rle_crop_3699254132_0.png treat image : temp/1741421430_3639314_1329190335_8a8f6a9cf7fb9bc51077ba9bb7b7e27a_rle_crop_3699254152_0.png treat image : temp/1741421430_3639314_1329190335_8a8f6a9cf7fb9bc51077ba9bb7b7e27a_rle_crop_3699254154_0.png treat image : temp/1741421430_3639314_1329190335_8a8f6a9cf7fb9bc51077ba9bb7b7e27a_rle_crop_3699254158_0.png treat image : temp/1741421430_3639314_1329190331_bacc9a38f22de0a8f0ff23c308ca6df3_rle_crop_3699254167_0.png treat image : temp/1741421430_3639314_1329190331_bacc9a38f22de0a8f0ff23c308ca6df3_rle_crop_3699254163_0.png treat image : temp/1741421430_3639314_1329190331_bacc9a38f22de0a8f0ff23c308ca6df3_rle_crop_3699254171_0.png treat image : temp/1741421430_3639314_1329190285_0c1b063f07f3246b02442a0877ef7bb2_rle_crop_3699254179_0.png treat image : temp/1741421430_3639314_1329190285_0c1b063f07f3246b02442a0877ef7bb2_rle_crop_3699254177_0.png treat image : temp/1741421430_3639314_1329190285_0c1b063f07f3246b02442a0877ef7bb2_rle_crop_3699254183_0.png treat image : temp/1741421430_3639314_1329190285_0c1b063f07f3246b02442a0877ef7bb2_rle_crop_3699254189_0.png treat image : temp/1741421430_3639314_1329190285_0c1b063f07f3246b02442a0877ef7bb2_rle_crop_3699254186_0.png treat image : temp/1741421430_3639314_1329190285_0c1b063f07f3246b02442a0877ef7bb2_rle_crop_3699254178_0.png treat image : temp/1741421430_3639314_1329190340_bb74e5c838a5d9c7f029d257b31873f8_rle_crop_3699254140_0.png treat image : temp/1741421430_3639314_1329190340_bb74e5c838a5d9c7f029d257b31873f8_rle_crop_3699254130_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 99 time used for this insertion : 0.016340017318725586 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 99 time used for this insertion : 0.021195411682128906 save missing photos in datou_result : time spend for datou_step_exec : 7.12070894241333 time spend to save output : 0.04276895523071289 total time spend for step 7 : 7.163477897644043 step8:velours_tree Sat Mar 8 09:15:44 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.30610108375549316 time spend to save output : 4.935264587402344e-05 total time spend for step 8 : 0.3061504364013672 step9:send_mail_cod Sat Mar 8 09:15:44 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P21173139_08-03-2025_09_15_44.pdf 21173752 imagette211737521741421744 21173753 imagette211737531741421744 21173754 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette211737541741421744 21173755 change filename to text .change filename to text .imagette211737551741421745 21173756 imagette211737561741421745 21173757 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette211737571741421745 21173758 imagette211737581741421746 21173759 imagette211737591741421746 21173760 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette211737601741421746 21173761 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette211737611741421747 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=21173139 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/21173751,21173752,21173753,21173754,21173755,21173756,21173757,21173758,21173759,21173760,21173761?tags=environnement,mal_croppe,pehd,metal,autre,pet_fonce,carton,flou,background,papier,pet_clair args[1329190350] : ((1329190350, -5.150611309457475, 492609224), (1329190350, -0.5007775535289618, 501862349), '0.15370604263117282') We are sending mail with results at report@fotonower.com args[1329190340] : ((1329190340, -5.568501114413636, 492609224), (1329190340, -0.34422573432820286, 496442774), '0.15370604263117282') We are sending mail with results at report@fotonower.com args[1329190335] : ((1329190335, -6.023054719786022, 492609224), (1329190335, -0.17116565667827327, 496442774), '0.15370604263117282') We are sending mail with results at report@fotonower.com args[1329190331] : ((1329190331, -5.941215476425226, 492609224), (1329190331, -0.18184642474710563, 496442774), '0.15370604263117282') We are sending mail with results at report@fotonower.com args[1329190285] : ((1329190285, -5.270089537768302, 492609224), (1329190285, -0.20933872314411864, 496442774), '0.15370604263117282') We are sending mail with results at report@fotonower.com refus_total : 0.15370604263117282 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21173139 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21173139_08-03-2025_09_15_44.pdf results_Auto_P21173139_08-03-2025_09_15_44.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21173139_08-03-2025_09_15_44.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','21173139','results_Auto_P21173139_08-03-2025_09_15_44.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21173139_08-03-2025_09_15_44.pdf','pdf','','0.85','0.15370604263117282') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/21173139

https://www.fotonower.com/image?json=false&list_photos_id=1329190350
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1329190340
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1329190335
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1329190331
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1329190285
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 15.37%
Veuillez trouver les photos des contaminants.

exemples de contaminants: metal: https://www.fotonower.com/view/21173754?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/21173755?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/21173757?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/21173760?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/21173761?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21173139_08-03-2025_09_15_44.pdf.

Lien vers velours :https://www.fotonower.com/velours/21173751,21173752,21173753,21173754,21173755,21173756,21173757,21173758,21173759,21173760,21173761?tags=environnement,mal_croppe,pehd,metal,autre,pet_fonce,carton,flou,background,papier,pet_clair.


L'équipe Fotonower 202 b'' Server: nginx Date: Sat, 08 Mar 2025 08:15:51 GMT Content-Length: 0 Connection: close X-Message-Id: AVVUC7OyS1uiyM9MsqPxZw Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1329190350, 1329190340, 1329190335, 1329190331, 1329190285] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2651253') ('3318', '21173139', '1329190350', None, None, None, None, None, '2651253') ('3318', None, None, None, None, None, None, None, '2651253') ('3318', '21173139', '1329190340', None, None, None, None, None, '2651253') ('3318', None, None, None, None, None, None, None, '2651253') ('3318', '21173139', '1329190335', None, None, None, None, None, '2651253') ('3318', None, None, None, None, None, None, None, '2651253') ('3318', '21173139', '1329190331', None, None, None, None, None, '2651253') ('3318', None, None, None, None, None, None, None, '2651253') ('3318', '21173139', '1329190285', None, None, None, None, None, '2651253') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 5 time used for this insertion : 0.0787050724029541 save_final save missing photos in datou_result : time spend for datou_step_exec : 7.024252653121948 time spend to save output : 0.07890748977661133 total time spend for step 9 : 7.10316014289856 step10:split_time_score Sat Mar 8 09:15:51 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('18', 5),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 15012025 21173139 Nombre de photos uploadées : 5 / 23040 (0%) 15012025 21173139 Nombre de photos taguées (types de déchets): 0 / 5 (0%) 15012025 21173139 Nombre de photos taguées (volume) : 0 / 5 (0%) elapsed_time : load_data_split_time_score 3.5762786865234375e-06 elapsed_time : order_list_meta_photo_and_scores 1.9788742065429688e-05 ????? elapsed_time : fill_and_build_computed_from_old_data 0.00029730796813964844 elapsed_time : insert_dashboard_record_day_entry 0.025867462158203125 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21172998 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21173017 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21173086 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21173096 order by id desc limit 1 Qualite : 0.15370604263117282 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P21173139_08-03-2025_09_15_44.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21173139 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21173139 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'15012025': {'nb_upload': 5, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1329190350, 1329190340, 1329190335, 1329190331, 1329190285] Looping around the photos to save general results len do output : 1 /21173139Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2651253') ('3318', '21173139', '1329190350', None, None, None, None, None, '2651253') ('3318', None, None, None, None, None, None, None, '2651253') ('3318', '21173139', '1329190340', None, None, None, None, None, '2651253') ('3318', None, None, None, None, None, None, None, '2651253') ('3318', '21173139', '1329190335', None, None, None, None, None, '2651253') ('3318', None, None, None, None, None, None, None, '2651253') ('3318', '21173139', '1329190331', None, None, None, None, None, '2651253') ('3318', None, None, None, None, None, None, None, '2651253') ('3318', '21173139', '1329190285', None, None, None, None, None, '2651253') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.014108896255493164 save_final save missing photos in datou_result : time spend for datou_step_exec : 3.493905544281006 time spend to save output : 0.014378786087036133 total time spend for step 10 : 3.508284330368042 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 5 set_done_treatment 119.29user 133.28system 5:30.39elapsed 76%CPU (0avgtext+0avgdata 4559208maxresident)k 1227064inputs+124576outputs (16738major+12409244minor)pagefaults 0swaps