python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1492295 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3555589'] with mtr_portfolio_ids : ['26072152'] and first list_photo_ids : [] new path : /proc/1492295/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 26 ; length of list_pids : 26 ; length of list_args : 26 time to download the photos : 3.272392511367798 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Wed Aug 20 10:00:32 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10617 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-08-20 10:00:34.866640: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-08-20 10:00:34.892585: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3492910000 Hz 2025-08-20 10:00:34.894806: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f9db0000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-08-20 10:00:34.894861: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-08-20 10:00:34.898829: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-08-20 10:00:35.035336: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x3d558000 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-08-20 10:00:35.035393: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-08-20 10:00:35.036716: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-20 10:00:35.037158: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-20 10:00:35.040227: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-20 10:00:35.043153: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-20 10:00:35.043657: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-20 10:00:35.046252: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-20 10:00:35.047276: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-20 10:00:35.051549: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-20 10:00:35.053141: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-20 10:00:35.053232: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-20 10:00:35.054032: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-20 10:00:35.054048: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-20 10:00:35.054058: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-20 10:00:35.055357: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9691 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-08-20 10:00:35.310645: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-20 10:00:35.310778: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-20 10:00:35.310807: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-20 10:00:35.310833: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-20 10:00:35.310858: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-20 10:00:35.310882: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-20 10:00:35.310906: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-20 10:00:35.310931: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-20 10:00:35.313024: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-20 10:00:35.314339: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-20 10:00:35.314376: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-20 10:00:35.314393: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-20 10:00:35.314413: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-20 10:00:35.314430: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-20 10:00:35.314446: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-20 10:00:35.314461: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-20 10:00:35.314477: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-20 10:00:35.315638: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-20 10:00:35.315671: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-20 10:00:35.315679: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-20 10:00:35.315687: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-20 10:00:35.316910: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9691 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-08-20 10:00:44.453535: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-20 10:00:44.664131: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 26 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 21.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 22.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 19.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 12.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 20.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 13.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 32.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 22.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 1 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 19.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 21.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 23.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 Detection mask done ! Trying to reset tf kernel 1492912 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 355 tf kernel not reseted sub process len(results) : 26 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 26 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5644 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.015046834945678711 nb_pixel_total : 737997 time to create 1 rle with new method : 0.04910993576049805 length of segment : 955 time for calcul the mask position with numpy : 0.0004870891571044922 nb_pixel_total : 31034 time to create 1 rle with old method : 0.03538990020751953 length of segment : 170 time for calcul the mask position with numpy : 0.001577138900756836 nb_pixel_total : 108814 time to create 1 rle with old method : 0.1138002872467041 length of segment : 552 time for calcul the mask position with numpy : 0.00014901161193847656 nb_pixel_total : 5174 time to create 1 rle with old method : 0.005707502365112305 length of segment : 89 time for calcul the mask position with numpy : 0.00013971328735351562 nb_pixel_total : 5555 time to create 1 rle with old method : 0.006375312805175781 length of segment : 100 time for calcul the mask position with numpy : 0.01345515251159668 nb_pixel_total : 760118 time to create 1 rle with new method : 0.02954888343811035 length of segment : 987 time for calcul the mask position with numpy : 0.00017881393432617188 nb_pixel_total : 7942 time to create 1 rle with old method : 0.008806705474853516 length of segment : 116 time for calcul the mask position with numpy : 0.0015363693237304688 nb_pixel_total : 110195 time to create 1 rle with old method : 0.11738467216491699 length of segment : 518 time for calcul the mask position with numpy : 0.0001361370086669922 nb_pixel_total : 4472 time to create 1 rle with old method : 0.005306243896484375 length of segment : 72 time for calcul the mask position with numpy : 0.0003108978271484375 nb_pixel_total : 11252 time to create 1 rle with old method : 0.013198614120483398 length of segment : 185 time for calcul the mask position with numpy : 0.0017917156219482422 nb_pixel_total : 104223 time to create 1 rle with old method : 0.11567258834838867 length of segment : 688 time for calcul the mask position with numpy : 0.000186920166015625 nb_pixel_total : 6487 time to create 1 rle with old method : 0.0075304508209228516 length of segment : 110 time for calcul the mask position with numpy : 0.025894880294799805 nb_pixel_total : 1494782 time to create 1 rle with new method : 0.35248279571533203 length of segment : 1071 time for calcul the mask position with numpy : 0.0002949237823486328 nb_pixel_total : 10119 time to create 1 rle with old method : 0.012834787368774414 length of segment : 175 time for calcul the mask position with numpy : 0.001949310302734375 nb_pixel_total : 102905 time to create 1 rle with old method : 0.12981677055358887 length of segment : 516 time for calcul the mask position with numpy : 0.003004789352416992 nb_pixel_total : 106306 time to create 1 rle with old method : 0.11714792251586914 length of segment : 511 time for calcul the mask position with numpy : 0.00032591819763183594 nb_pixel_total : 6574 time to create 1 rle with old method : 0.007822036743164062 length of segment : 111 time for calcul the mask position with numpy : 0.00019812583923339844 nb_pixel_total : 3422 time to create 1 rle with old method : 0.003968477249145508 length of segment : 70 time for calcul the mask position with numpy : 0.00019621849060058594 nb_pixel_total : 3406 time to create 1 rle with old method : 0.00402522087097168 length of segment : 87 time for calcul the mask position with numpy : 0.00033164024353027344 nb_pixel_total : 6220 time to create 1 rle with old method : 0.00763702392578125 length of segment : 108 time for calcul the mask position with numpy : 0.00033855438232421875 nb_pixel_total : 8672 time to create 1 rle with old method : 0.016081809997558594 length of segment : 136 time for calcul the mask position with numpy : 0.023878097534179688 nb_pixel_total : 712619 time to create 1 rle with new method : 0.04949617385864258 length of segment : 911 time for calcul the mask position with numpy : 0.0004401206970214844 nb_pixel_total : 11098 time to create 1 rle with old method : 0.01222991943359375 length of segment : 181 time for calcul the mask position with numpy : 0.0007102489471435547 nb_pixel_total : 42022 time to create 1 rle with old method : 0.04774808883666992 length of segment : 238 time for calcul the mask position with numpy : 0.0002837181091308594 nb_pixel_total : 4142 time to create 1 rle with old method : 0.007647275924682617 length of segment : 110 time for calcul the mask position with numpy : 0.01015782356262207 nb_pixel_total : 672569 time to create 1 rle with new method : 0.014582395553588867 length of segment : 887 time for calcul the mask position with numpy : 0.0024726390838623047 nb_pixel_total : 114978 time to create 1 rle with old method : 0.13861083984375 length of segment : 563 time for calcul the mask position with numpy : 0.0005879402160644531 nb_pixel_total : 21402 time to create 1 rle with old method : 0.026660442352294922 length of segment : 120 time for calcul the mask position with numpy : 0.00030517578125 nb_pixel_total : 6842 time to create 1 rle with old method : 0.007827043533325195 length of segment : 128 time for calcul the mask position with numpy : 0.00016427040100097656 nb_pixel_total : 3173 time to create 1 rle with old method : 0.0039386749267578125 length of segment : 70 time for calcul the mask position with numpy : 0.0023000240325927734 nb_pixel_total : 91398 time to create 1 rle with old method : 0.1036686897277832 length of segment : 701 time for calcul the mask position with numpy : 0.0004553794860839844 nb_pixel_total : 11247 time to create 1 rle with old method : 0.012503385543823242 length of segment : 131 time for calcul the mask position with numpy : 0.0006399154663085938 nb_pixel_total : 27202 time to create 1 rle with old method : 0.0305173397064209 length of segment : 178 time for calcul the mask position with numpy : 0.00019931793212890625 nb_pixel_total : 3280 time to create 1 rle with old method : 0.004011631011962891 length of segment : 60 time for calcul the mask position with numpy : 0.0003657341003417969 nb_pixel_total : 13991 time to create 1 rle with old method : 0.01584768295288086 length of segment : 116 time for calcul the mask position with numpy : 0.013826370239257812 nb_pixel_total : 734576 time to create 1 rle with new method : 0.03103470802307129 length of segment : 917 time for calcul the mask position with numpy : 0.0003361701965332031 nb_pixel_total : 9551 time to create 1 rle with old method : 0.010464191436767578 length of segment : 105 time for calcul the mask position with numpy : 0.002686738967895508 nb_pixel_total : 108772 time to create 1 rle with old method : 0.11760950088500977 length of segment : 783 time for calcul the mask position with numpy : 0.00039267539978027344 nb_pixel_total : 8524 time to create 1 rle with old method : 0.00948190689086914 length of segment : 135 time for calcul the mask position with numpy : 0.0025980472564697266 nb_pixel_total : 110273 time to create 1 rle with old method : 0.1189737319946289 length of segment : 541 time for calcul the mask position with numpy : 0.01746082305908203 nb_pixel_total : 885759 time to create 1 rle with new method : 0.038744449615478516 length of segment : 1508 time for calcul the mask position with numpy : 0.0018110275268554688 nb_pixel_total : 106533 time to create 1 rle with old method : 0.11890482902526855 length of segment : 516 time for calcul the mask position with numpy : 0.01491856575012207 nb_pixel_total : 741326 time to create 1 rle with new method : 0.04671502113342285 length of segment : 930 time for calcul the mask position with numpy : 0.0001552104949951172 nb_pixel_total : 3630 time to create 1 rle with old method : 0.004508495330810547 length of segment : 51 time for calcul the mask position with numpy : 0.00057220458984375 nb_pixel_total : 32412 time to create 1 rle with old method : 0.03664207458496094 length of segment : 138 time for calcul the mask position with numpy : 0.001943826675415039 nb_pixel_total : 93514 time to create 1 rle with old method : 0.11025118827819824 length of segment : 681 time for calcul the mask position with numpy : 0.00023508071899414062 nb_pixel_total : 3098 time to create 1 rle with old method : 0.0038864612579345703 length of segment : 62 time for calcul the mask position with numpy : 0.00030303001403808594 nb_pixel_total : 5090 time to create 1 rle with old method : 0.0058879852294921875 length of segment : 116 time for calcul the mask position with numpy : 0.016366004943847656 nb_pixel_total : 768764 time to create 1 rle with new method : 0.020800113677978516 length of segment : 991 time for calcul the mask position with numpy : 0.00039196014404296875 nb_pixel_total : 11061 time to create 1 rle with old method : 0.012593984603881836 length of segment : 184 time for calcul the mask position with numpy : 0.0003757476806640625 nb_pixel_total : 12375 time to create 1 rle with old method : 0.015134811401367188 length of segment : 242 time for calcul the mask position with numpy : 0.014060497283935547 nb_pixel_total : 822427 time to create 1 rle with new method : 0.03618168830871582 length of segment : 1056 time for calcul the mask position with numpy : 0.0037314891815185547 nb_pixel_total : 143767 time to create 1 rle with old method : 0.17782092094421387 length of segment : 390 time for calcul the mask position with numpy : 0.00922393798828125 nb_pixel_total : 659504 time to create 1 rle with new method : 0.43596410751342773 length of segment : 878 time spent for convertir_results : 6.160243511199951 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 54 chid ids of type : 3594 Number RLEs to save : 21945 save missing photos in datou_result : time spend for datou_step_exec : 35.35080432891846 time spend to save output : 1.7702746391296387 total time spend for step 1 : 37.121078968048096 step2:crop_condition Wed Aug 20 10:01:09 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 26 ! batch 1 Loaded 54 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 15 About to insert : list_path_to_insert length 15 new photo from crops ! About to upload 15 photos upload in portfolio : 3736932 init cache_photo without model_param we have 15 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1755676870_1492295 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 15 photos in the portfolio 3736932 time of upload the photos Elapsed time : 4.3073461055755615 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 39 About to insert : list_path_to_insert length 39 new photo from crops ! About to upload 39 photos upload in portfolio : 3736932 init cache_photo without model_param we have 39 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1755676916_1492295 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 39 photos in the portfolio 3736932 time of upload the photos Elapsed time : 10.6509690284729 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1377890267, 1377890245, 1377890244, 1377890243, 1377890239, 1377890222, 1377890220, 1377890218, 1377890215, 1377890212, 1377890210, 1377890165, 1377890161, 1377890149, 1377890135, 1377890132, 1377890127, 1377890019, 1377890017, 1377890015, 1377890009, 1377889991, 1377889989, 1377889976, 1377889975, 1377889974] Looping around the photos to save general results len do output : 54 /1377995808Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377995809Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377995810Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377995811Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377995812Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377995813Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377995814Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377995815Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377995816Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377995817Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377995818Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377995819Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377995820Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377995821Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377995822Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377995853Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377995854Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377995855Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377995856Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377995857Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377995858Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377995859Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377995860Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377995861Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377995862Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377995863Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377995865Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377995866Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377995867Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377995868Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377995869Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377995870Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377995871Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377995872Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377995873Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377995874Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377995875Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377995876Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377995877Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377995878Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377995879Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377995880Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377995881Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377995882Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377995883Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377995884Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377995885Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377995886Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377995887Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377995888Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377995889Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377995890Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377995891Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377995892Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890267', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890245', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890244', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890243', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890239', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890222', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890220', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890218', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890215', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890212', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890210', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890165', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890161', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890149', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890135', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890132', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890127', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890019', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890017', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890015', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890009', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377889991', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377889989', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377889976', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377889975', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377889974', None, None, None, None, None, '3555589') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 188 time used for this insertion : 0.5475819110870361 save_final save missing photos in datou_result : time spend for datou_step_exec : 57.55805540084839 time spend to save output : 0.5493311882019043 total time spend for step 2 : 58.10738658905029 step3:rle_unique_nms_with_priority Wed Aug 20 10:02:07 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 54 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 3 nb_hashtags : 1 time to prepare the origin masks : 0.32471609115600586 time for calcul the mask position with numpy : 0.8882195949554443 nb_pixel_total : 1195755 time to create 1 rle with new method : 0.07965207099914551 time for calcul the mask position with numpy : 0.0072667598724365234 nb_pixel_total : 108814 time to create 1 rle with old method : 0.11911439895629883 time for calcul the mask position with numpy : 0.0066013336181640625 nb_pixel_total : 31034 time to create 1 rle with old method : 0.033904314041137695 time for calcul the mask position with numpy : 0.010954618453979492 nb_pixel_total : 737997 time to create 1 rle with new method : 0.11843991279602051 create new chi : 1.2809133529663086 time to delete rle : 0.03390240669250488 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 4434 TO DO : save crop sub photo not yet done ! save time : 0.3520042896270752 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.06270790100097656 time for calcul the mask position with numpy : 0.02702641487121582 nb_pixel_total : 2068426 time to create 1 rle with new method : 0.19230961799621582 time for calcul the mask position with numpy : 0.006114959716796875 nb_pixel_total : 5174 time to create 1 rle with old method : 0.005722761154174805 create new chi : 0.23764538764953613 time to delete rle : 0.00025582313537597656 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1258 TO DO : save crop sub photo not yet done ! save time : 0.1900191307067871 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.04637026786804199 time for calcul the mask position with numpy : 0.04524421691894531 nb_pixel_total : 1307927 time to create 1 rle with new method : 0.16495895385742188 time for calcul the mask position with numpy : 0.013828039169311523 nb_pixel_total : 760118 time to create 1 rle with new method : 0.06923317909240723 time for calcul the mask position with numpy : 0.006002902984619141 nb_pixel_total : 5555 time to create 1 rle with old method : 0.005930900573730469 create new chi : 0.31912970542907715 time to delete rle : 0.0004494190216064453 batch 1 Loaded 5 chid ids of type : 3594 +++Number RLEs to save : 3254 TO DO : save crop sub photo not yet done ! save time : 0.23825979232788086 nb_obj : 3 nb_hashtags : 1 time to prepare the origin masks : 0.1567089557647705 time for calcul the mask position with numpy : 0.1196446418762207 nb_pixel_total : 1950991 time to create 1 rle with new method : 0.20754718780517578 time for calcul the mask position with numpy : 0.006005048751831055 nb_pixel_total : 4472 time to create 1 rle with old method : 0.004658937454223633 time for calcul the mask position with numpy : 0.006539344787597656 nb_pixel_total : 110195 time to create 1 rle with old method : 0.11749815940856934 time for calcul the mask position with numpy : 0.00599217414855957 nb_pixel_total : 7942 time to create 1 rle with old method : 0.008614778518676758 create new chi : 0.4856133460998535 time to delete rle : 0.0003819465637207031 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2492 TO DO : save crop sub photo not yet done ! save time : 0.32088637351989746 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.046684980392456055 time for calcul the mask position with numpy : 0.0507204532623291 nb_pixel_total : 1958125 time to create 1 rle with new method : 0.18410181999206543 time for calcul the mask position with numpy : 0.0063359737396240234 nb_pixel_total : 104223 time to create 1 rle with old method : 0.10825824737548828 time for calcul the mask position with numpy : 0.005815029144287109 nb_pixel_total : 11252 time to create 1 rle with old method : 0.011784791946411133 create new chi : 0.37603116035461426 time to delete rle : 0.0002624988555908203 batch 1 Loaded 5 chid ids of type : 3594 +++Number RLEs to save : 2826 TO DO : save crop sub photo not yet done ! save time : 0.2651989459991455 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.09783506393432617 time for calcul the mask position with numpy : 0.008523225784301758 nb_pixel_total : 465970 time to create 1 rle with new method : 0.17138433456420898 time for calcul the mask position with numpy : 0.0068285465240478516 nb_pixel_total : 102905 time to create 1 rle with old method : 0.11014294624328613 time for calcul the mask position with numpy : 0.005923271179199219 nb_pixel_total : 9943 time to create 1 rle with old method : 0.010492801666259766 time for calcul the mask position with numpy : 0.10779857635498047 nb_pixel_total : 1488295 time to create 1 rle with new method : 0.06590795516967773 time for calcul the mask position with numpy : 0.005903720855712891 nb_pixel_total : 6487 time to create 1 rle with old method : 0.006804466247558594 create new chi : 0.5136165618896484 time to delete rle : 0.0006940364837646484 batch 1 Loaded 9 chid ids of type : 3594 ++++++Number RLEs to save : 4788 TO DO : save crop sub photo not yet done ! save time : 0.40456247329711914 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.05765581130981445 time for calcul the mask position with numpy : 0.09801268577575684 nb_pixel_total : 1953892 time to create 1 rle with new method : 0.07306838035583496 time for calcul the mask position with numpy : 0.00609278678894043 nb_pixel_total : 3406 time to create 1 rle with old method : 0.0038330554962158203 time for calcul the mask position with numpy : 0.005944728851318359 nb_pixel_total : 3422 time to create 1 rle with old method : 0.003896951675415039 time for calcul the mask position with numpy : 0.0059473514556884766 nb_pixel_total : 6574 time to create 1 rle with old method : 0.00745701789855957 time for calcul the mask position with numpy : 0.006555080413818359 nb_pixel_total : 106306 time to create 1 rle with old method : 0.11733555793762207 create new chi : 0.3387277126312256 time to delete rle : 0.0003991127014160156 batch 1 Loaded 9 chid ids of type : 3594 ++++++Number RLEs to save : 2638 TO DO : save crop sub photo not yet done ! save time : 0.5510268211364746 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.03967547416687012 time for calcul the mask position with numpy : 0.01897263526916504 nb_pixel_total : 2058708 time to create 1 rle with new method : 0.13269519805908203 time for calcul the mask position with numpy : 0.0061604976654052734 nb_pixel_total : 8672 time to create 1 rle with old method : 0.00922536849975586 time for calcul the mask position with numpy : 0.005835771560668945 nb_pixel_total : 6220 time to create 1 rle with old method : 0.0068285465240478516 create new chi : 0.18651676177978516 time to delete rle : 0.0002865791320800781 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1568 TO DO : save crop sub photo not yet done ! save time : 0.6905131340026855 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.20078587532043457 time for calcul the mask position with numpy : 0.0988156795501709 nb_pixel_total : 1303869 time to create 1 rle with new method : 0.07301211357116699 time for calcul the mask position with numpy : 0.006191253662109375 nb_pixel_total : 4142 time to create 1 rle with old method : 0.004556894302368164 time for calcul the mask position with numpy : 0.006221771240234375 nb_pixel_total : 42022 time to create 1 rle with old method : 0.04498457908630371 time for calcul the mask position with numpy : 0.006139278411865234 nb_pixel_total : 10948 time to create 1 rle with old method : 0.011569023132324219 time for calcul the mask position with numpy : 0.010156869888305664 nb_pixel_total : 712619 time to create 1 rle with new method : 0.1369495391845703 create new chi : 0.4084508419036865 time to delete rle : 0.0005326271057128906 batch 1 Loaded 9 chid ids of type : 3594 ++++++Number RLEs to save : 3933 TO DO : save crop sub photo not yet done ! save time : 0.620671272277832 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03438067436218262 time for calcul the mask position with numpy : 0.014927387237548828 nb_pixel_total : 1401031 time to create 1 rle with new method : 0.028886795043945312 time for calcul the mask position with numpy : 0.010200023651123047 nb_pixel_total : 672569 time to create 1 rle with new method : 0.02735447883605957 create new chi : 0.08830571174621582 time to delete rle : 0.0003972053527832031 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 2854 TO DO : save crop sub photo not yet done ! save time : 0.7676153182983398 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.043282508850097656 time for calcul the mask position with numpy : 0.019429445266723633 nb_pixel_total : 1937220 time to create 1 rle with new method : 0.1384894847869873 time for calcul the mask position with numpy : 0.006209611892700195 nb_pixel_total : 21402 time to create 1 rle with old method : 0.023421049118041992 time for calcul the mask position with numpy : 0.006777763366699219 nb_pixel_total : 114978 time to create 1 rle with old method : 0.12397360801696777 create new chi : 0.32845449447631836 time to delete rle : 0.00046324729919433594 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2446 TO DO : save crop sub photo not yet done ! save time : 0.4212782382965088 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03398704528808594 time for calcul the mask position with numpy : 0.0579683780670166 nb_pixel_total : 2066758 time to create 1 rle with new method : 0.12537646293640137 time for calcul the mask position with numpy : 0.006186246871948242 nb_pixel_total : 6842 time to create 1 rle with old method : 0.007783412933349609 create new chi : 0.20786571502685547 time to delete rle : 0.000270843505859375 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1336 TO DO : save crop sub photo not yet done ! save time : 0.11310219764709473 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.13550877571105957 time for calcul the mask position with numpy : 0.05332827568054199 nb_pixel_total : 1979029 time to create 1 rle with new method : 0.15174603462219238 time for calcul the mask position with numpy : 0.006539106369018555 nb_pixel_total : 91398 time to create 1 rle with old method : 0.10033512115478516 time for calcul the mask position with numpy : 0.00623011589050293 nb_pixel_total : 3173 time to create 1 rle with old method : 0.003526449203491211 create new chi : 0.33222103118896484 time to delete rle : 0.0004417896270751953 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2622 TO DO : save crop sub photo not yet done ! save time : 0.4757561683654785 No data in photo_id : 1377890149 nb_obj : 5 nb_hashtags : 2 time to prepare the origin masks : 0.22942161560058594 time for calcul the mask position with numpy : 0.04693031311035156 nb_pixel_total : 1283304 time to create 1 rle with new method : 0.19629454612731934 time for calcul the mask position with numpy : 0.010937213897705078 nb_pixel_total : 734576 time to create 1 rle with new method : 0.06956982612609863 time for calcul the mask position with numpy : 0.006028652191162109 nb_pixel_total : 13991 time to create 1 rle with old method : 0.01557016372680664 time for calcul the mask position with numpy : 0.006209611892700195 nb_pixel_total : 3280 time to create 1 rle with old method : 0.0036363601684570312 time for calcul the mask position with numpy : 0.006199836730957031 nb_pixel_total : 27202 time to create 1 rle with old method : 0.029619455337524414 time for calcul the mask position with numpy : 0.006608247756958008 nb_pixel_total : 11247 time to create 1 rle with old method : 0.01231527328491211 create new chi : 0.4189624786376953 time to delete rle : 0.0006222724914550781 batch 1 Loaded 11 chid ids of type : 3594 ++++++Number RLEs to save : 3884 TO DO : save crop sub photo not yet done ! save time : 0.6766703128814697 No data in photo_id : 1377890132 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03418159484863281 time for calcul the mask position with numpy : 0.019324541091918945 nb_pixel_total : 2064049 time to create 1 rle with new method : 0.030667781829833984 time for calcul the mask position with numpy : 0.0069768428802490234 nb_pixel_total : 9551 time to create 1 rle with old method : 0.011882543563842773 create new chi : 0.07619929313659668 time to delete rle : 0.00029206275939941406 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1290 TO DO : save crop sub photo not yet done ! save time : 0.251788854598999 No data in photo_id : 1377890019 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03314614295959473 time for calcul the mask position with numpy : 0.01863241195678711 nb_pixel_total : 1964828 time to create 1 rle with new method : 0.06615638732910156 time for calcul the mask position with numpy : 0.0063304901123046875 nb_pixel_total : 108772 time to create 1 rle with old method : 0.11756491661071777 create new chi : 0.21593070030212402 time to delete rle : 0.00037932395935058594 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 2646 TO DO : save crop sub photo not yet done ! save time : 0.26746463775634766 nb_obj : 3 nb_hashtags : 1 time to prepare the origin masks : 0.06129193305969238 time for calcul the mask position with numpy : 0.03439736366271973 nb_pixel_total : 1076409 time to create 1 rle with new method : 0.11826443672180176 time for calcul the mask position with numpy : 0.012961864471435547 nb_pixel_total : 878394 time to create 1 rle with new method : 0.13409113883972168 time for calcul the mask position with numpy : 0.006566762924194336 nb_pixel_total : 110273 time to create 1 rle with old method : 0.12228178977966309 time for calcul the mask position with numpy : 0.006530046463012695 nb_pixel_total : 8524 time to create 1 rle with old method : 0.009526968002319336 create new chi : 0.4543790817260742 time to delete rle : 0.0009229183197021484 batch 1 Loaded 7 chid ids of type : 3594 ++++++Number RLEs to save : 5446 TO DO : save crop sub photo not yet done ! save time : 0.589381217956543 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.049588918685913086 time for calcul the mask position with numpy : 0.01537013053894043 nb_pixel_total : 1225741 time to create 1 rle with new method : 0.054108381271362305 time for calcul the mask position with numpy : 0.011177301406860352 nb_pixel_total : 741326 time to create 1 rle with new method : 0.1721820831298828 time for calcul the mask position with numpy : 0.0066051483154296875 nb_pixel_total : 106533 time to create 1 rle with old method : 0.11906814575195312 create new chi : 0.38647890090942383 time to delete rle : 0.0008394718170166016 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 3972 TO DO : save crop sub photo not yet done ! save time : 0.5768740177154541 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.21683549880981445 time for calcul the mask position with numpy : 0.24650263786315918 nb_pixel_total : 1944044 time to create 1 rle with new method : 0.12070250511169434 time for calcul the mask position with numpy : 0.00896453857421875 nb_pixel_total : 93514 time to create 1 rle with old method : 0.15587592124938965 time for calcul the mask position with numpy : 0.0074613094329833984 nb_pixel_total : 32412 time to create 1 rle with old method : 0.036499977111816406 time for calcul the mask position with numpy : 0.008074760437011719 nb_pixel_total : 3630 time to create 1 rle with old method : 0.0040798187255859375 create new chi : 0.6040456295013428 time to delete rle : 0.00057220458984375 batch 1 Loaded 7 chid ids of type : 3594 +++++++Number RLEs to save : 2820 TO DO : save crop sub photo not yet done ! save time : 0.48496198654174805 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.07688093185424805 time for calcul the mask position with numpy : 0.44466590881347656 nb_pixel_total : 1296648 time to create 1 rle with new method : 0.07444620132446289 time for calcul the mask position with numpy : 0.01091623306274414 nb_pixel_total : 768764 time to create 1 rle with new method : 0.5765841007232666 time for calcul the mask position with numpy : 0.005986690521240234 nb_pixel_total : 5090 time to create 1 rle with old method : 0.005722761154174805 time for calcul the mask position with numpy : 0.006086826324462891 nb_pixel_total : 3098 time to create 1 rle with old method : 0.0034635066986083984 create new chi : 1.137397289276123 time to delete rle : 0.0004971027374267578 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 3418 TO DO : save crop sub photo not yet done ! save time : 0.462383508682251 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.040406227111816406 time for calcul the mask position with numpy : 0.019780397415161133 nb_pixel_total : 2062539 time to create 1 rle with new method : 0.2582395076751709 time for calcul the mask position with numpy : 0.006261587142944336 nb_pixel_total : 11061 time to create 1 rle with old method : 0.012465715408325195 create new chi : 0.3040761947631836 time to delete rle : 0.0002410411834716797 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1448 TO DO : save crop sub photo not yet done ! save time : 0.22655797004699707 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.047867774963378906 time for calcul the mask position with numpy : 0.018492937088012695 nb_pixel_total : 1239259 time to create 1 rle with new method : 0.07659196853637695 time for calcul the mask position with numpy : 0.011681556701660156 nb_pixel_total : 821966 time to create 1 rle with new method : 0.275557279586792 time for calcul the mask position with numpy : 0.006289482116699219 nb_pixel_total : 12375 time to create 1 rle with old method : 0.013940572738647461 create new chi : 0.41217827796936035 time to delete rle : 0.0005548000335693359 batch 1 Loaded 5 chid ids of type : 3594 ++++++Number RLEs to save : 3604 TO DO : save crop sub photo not yet done ! save time : 0.41339993476867676 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.052843570709228516 time for calcul the mask position with numpy : 0.017004966735839844 nb_pixel_total : 1270329 time to create 1 rle with new method : 0.16128063201904297 time for calcul the mask position with numpy : 0.011262178421020508 nb_pixel_total : 659504 time to create 1 rle with new method : 0.1047210693359375 time for calcul the mask position with numpy : 0.008264541625976562 nb_pixel_total : 143767 time to create 1 rle with old method : 0.16188979148864746 create new chi : 0.48313045501708984 time to delete rle : 0.0005695819854736328 batch 1 Loaded 5 chid ids of type : 3594 +++Number RLEs to save : 3616 TO DO : save crop sub photo not yet done ! save time : 0.41497087478637695 map_output_result : {1377890267: (0.0, 'Should be the crop_list due to order', 0), 1377890245: (0.0, 'Should be the crop_list due to order', 0), 1377890244: (0.0, 'Should be the crop_list due to order', 0), 1377890243: (0.0, 'Should be the crop_list due to order', 0), 1377890239: (0.0, 'Should be the crop_list due to order', 0), 1377890222: (0.0, 'Should be the crop_list due to order', 0), 1377890220: (0.0, 'Should be the crop_list due to order', 0), 1377890218: (0.0, 'Should be the crop_list due to order', 0), 1377890215: (0.0, 'Should be the crop_list due to order', 0), 1377890212: (0.0, 'Should be the crop_list due to order', 0), 1377890210: (0.0, 'Should be the crop_list due to order', 0), 1377890165: (0.0, 'Should be the crop_list due to order', 0), 1377890161: (0.0, 'Should be the crop_list due to order', 0), 1377890149: (0.0, 'Should be the crop_list due to order', 0.0), 1377890135: (0.0, 'Should be the crop_list due to order', 0), 1377890132: (0.0, 'Should be the crop_list due to order', 0.0), 1377890127: (0.0, 'Should be the crop_list due to order', 0), 1377890019: (0.0, 'Should be the crop_list due to order', 0.0), 1377890017: (0.0, 'Should be the crop_list due to order', 0), 1377890015: (0.0, 'Should be the crop_list due to order', 0), 1377890009: (0.0, 'Should be the crop_list due to order', 0), 1377889991: (0.0, 'Should be the crop_list due to order', 0), 1377889989: (0.0, 'Should be the crop_list due to order', 0), 1377889976: (0.0, 'Should be the crop_list due to order', 0), 1377889975: (0.0, 'Should be the crop_list due to order', 0), 1377889974: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1377890267, 1377890245, 1377890244, 1377890243, 1377890239, 1377890222, 1377890220, 1377890218, 1377890215, 1377890212, 1377890210, 1377890165, 1377890161, 1377890149, 1377890135, 1377890132, 1377890127, 1377890019, 1377890017, 1377890015, 1377890009, 1377889991, 1377889989, 1377889976, 1377889975, 1377889974] Looping around the photos to save general results len do output : 26 /1377890267.Didn't retrieve data . /1377890245.Didn't retrieve data . /1377890244.Didn't retrieve data . /1377890243.Didn't retrieve data . /1377890239.Didn't retrieve data . /1377890222.Didn't retrieve data . /1377890220.Didn't retrieve data . /1377890218.Didn't retrieve data . /1377890215.Didn't retrieve data . /1377890212.Didn't retrieve data . /1377890210.Didn't retrieve data . /1377890165.Didn't retrieve data . /1377890161.Didn't retrieve data . /1377890149.Didn't retrieve data . /1377890135.Didn't retrieve data . /1377890132.Didn't retrieve data . /1377890127.Didn't retrieve data . /1377890019.Didn't retrieve data . /1377890017.Didn't retrieve data . /1377890015.Didn't retrieve data . /1377890009.Didn't retrieve data . /1377889991.Didn't retrieve data . /1377889989.Didn't retrieve data . /1377889976.Didn't retrieve data . /1377889975.Didn't retrieve data . /1377889974.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890267', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890245', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890244', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890243', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890239', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890222', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890220', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890218', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890215', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890212', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890210', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890165', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890161', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890149', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890135', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890132', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890127', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890019', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890017', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890015', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890009', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377889991', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377889989', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377889976', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377889975', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377889974', None, None, None, None, None, '3555589') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 78 time used for this insertion : 0.022150039672851562 save_final save missing photos in datou_result : time spend for datou_step_exec : 22.781311988830566 time spend to save output : 0.022878170013427734 total time spend for step 3 : 22.804190158843994 step4:ventilate_hashtags_in_portfolio Wed Aug 20 10:02:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 26072152 get user id for portfolio 26072152 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26072152 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre','background','metal','mal_croppe','pehd','pet_clair','environnement','flou','papier','carton','pet_fonce')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26072152 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre','background','metal','mal_croppe','pehd','pet_clair','environnement','flou','papier','carton','pet_fonce')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26072152 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre','background','metal','mal_croppe','pehd','pet_clair','environnement','flou','papier','carton','pet_fonce')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/26073062,26073063,26073064,26073065,26073066,26073067,26073068,26073069,26073070,26073071,26073072?tags=autre,background,metal,mal_croppe,pehd,pet_clair,environnement,flou,papier,carton,pet_fonce Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1377890267, 1377890245, 1377890244, 1377890243, 1377890239, 1377890222, 1377890220, 1377890218, 1377890215, 1377890212, 1377890210, 1377890165, 1377890161, 1377890149, 1377890135, 1377890132, 1377890127, 1377890019, 1377890017, 1377890015, 1377890009, 1377889991, 1377889989, 1377889976, 1377889975, 1377889974] Looping around the photos to save general results len do output : 1 /26072152. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890267', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890245', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890244', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890243', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890239', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890222', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890220', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890218', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890215', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890212', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890210', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890165', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890161', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890149', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890135', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890132', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890127', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890019', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890017', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890015', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890009', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377889991', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377889989', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377889976', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377889975', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377889974', None, None, None, None, None, '3555589') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 27 time used for this insertion : 0.02440619468688965 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.0330119132995605 time spend to save output : 0.02469778060913086 total time spend for step 4 : 2.0577096939086914 step5:final Wed Aug 20 10:02:32 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1377890267: ('0.19694379525759734',), 1377890245: ('0.19694379525759734',), 1377890244: ('0.19694379525759734',), 1377890243: ('0.19694379525759734',), 1377890239: ('0.19694379525759734',), 1377890222: ('0.19694379525759734',), 1377890220: ('0.19694379525759734',), 1377890218: ('0.19694379525759734',), 1377890215: ('0.19694379525759734',), 1377890212: ('0.19694379525759734',), 1377890210: ('0.19694379525759734',), 1377890165: ('0.19694379525759734',), 1377890161: ('0.19694379525759734',), 1377890149: ('0.19694379525759734',), 1377890135: ('0.19694379525759734',), 1377890132: ('0.19694379525759734',), 1377890127: ('0.19694379525759734',), 1377890019: ('0.19694379525759734',), 1377890017: ('0.19694379525759734',), 1377890015: ('0.19694379525759734',), 1377890009: ('0.19694379525759734',), 1377889991: ('0.19694379525759734',), 1377889989: ('0.19694379525759734',), 1377889976: ('0.19694379525759734',), 1377889975: ('0.19694379525759734',), 1377889974: ('0.19694379525759734',)} new output for save of step final : {1377890267: ('0.19694379525759734',), 1377890245: ('0.19694379525759734',), 1377890244: ('0.19694379525759734',), 1377890243: ('0.19694379525759734',), 1377890239: ('0.19694379525759734',), 1377890222: ('0.19694379525759734',), 1377890220: ('0.19694379525759734',), 1377890218: ('0.19694379525759734',), 1377890215: ('0.19694379525759734',), 1377890212: ('0.19694379525759734',), 1377890210: ('0.19694379525759734',), 1377890165: ('0.19694379525759734',), 1377890161: ('0.19694379525759734',), 1377890149: ('0.19694379525759734',), 1377890135: ('0.19694379525759734',), 1377890132: ('0.19694379525759734',), 1377890127: ('0.19694379525759734',), 1377890019: ('0.19694379525759734',), 1377890017: ('0.19694379525759734',), 1377890015: ('0.19694379525759734',), 1377890009: ('0.19694379525759734',), 1377889991: ('0.19694379525759734',), 1377889989: ('0.19694379525759734',), 1377889976: ('0.19694379525759734',), 1377889975: ('0.19694379525759734',), 1377889974: ('0.19694379525759734',)} [1377890267, 1377890245, 1377890244, 1377890243, 1377890239, 1377890222, 1377890220, 1377890218, 1377890215, 1377890212, 1377890210, 1377890165, 1377890161, 1377890149, 1377890135, 1377890132, 1377890127, 1377890019, 1377890017, 1377890015, 1377890009, 1377889991, 1377889989, 1377889976, 1377889975, 1377889974] Looping around the photos to save general results len do output : 26 /1377890267.Didn't retrieve data . /1377890245.Didn't retrieve data . /1377890244.Didn't retrieve data . /1377890243.Didn't retrieve data . /1377890239.Didn't retrieve data . /1377890222.Didn't retrieve data . /1377890220.Didn't retrieve data . /1377890218.Didn't retrieve data . /1377890215.Didn't retrieve data . /1377890212.Didn't retrieve data . /1377890210.Didn't retrieve data . /1377890165.Didn't retrieve data . /1377890161.Didn't retrieve data . /1377890149.Didn't retrieve data . /1377890135.Didn't retrieve data . /1377890132.Didn't retrieve data . /1377890127.Didn't retrieve data . /1377890019.Didn't retrieve data . /1377890017.Didn't retrieve data . /1377890015.Didn't retrieve data . /1377890009.Didn't retrieve data . /1377889991.Didn't retrieve data . /1377889989.Didn't retrieve data . /1377889976.Didn't retrieve data . /1377889975.Didn't retrieve data . /1377889974.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890267', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890245', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890244', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890243', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890239', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890222', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890220', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890218', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890215', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890212', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890210', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890165', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890161', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890149', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890135', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890132', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890127', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890019', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890017', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890015', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890009', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377889991', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377889989', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377889976', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377889975', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377889974', None, None, None, None, None, '3555589') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 78 time used for this insertion : 0.1683485507965088 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.13671398162841797 time spend to save output : 0.16944575309753418 total time spend for step 5 : 0.30615973472595215 step6:blur_detection Wed Aug 20 10:02:32 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1755676828_1492295_1377890267_cd454084ab209e7d407d6d343fed0606.jpg resize: (1080, 1920) 1377890267 -2.233707863521869 treat image : temp/1755676828_1492295_1377890245_725ed2d9c4f7b4980a03b442ed987669.jpg resize: (1080, 1920) 1377890245 -2.879554435342563 treat image : temp/1755676828_1492295_1377890244_b4557c8a2af45cf01c902d61ae9ec5cf.jpg resize: (1080, 1920) 1377890244 -1.9510944142909497 treat image : temp/1755676828_1492295_1377890243_7803657656a654fc67dd2a141f887c7c.jpg resize: (1080, 1920) 1377890243 -1.9123909929615737 treat image : temp/1755676828_1492295_1377890239_cf4036e73a927802ca666123a430b320.jpg resize: (1080, 1920) 1377890239 -2.537646782924348 treat image : temp/1755676828_1492295_1377890222_ad875baf068b0ed48e638f4aadd21e39.jpg resize: (1080, 1920) 1377890222 -1.5841332575249307 treat image : temp/1755676828_1492295_1377890220_a2a902eeccc3195e2984fa23c959c351.jpg resize: (1080, 1920) 1377890220 -2.6575877432586217 treat image : temp/1755676828_1492295_1377890218_95b344700cc8bfc25fa0a88b4422c4a9.jpg resize: (1080, 1920) 1377890218 -1.6855143546866638 treat image : temp/1755676828_1492295_1377890215_fa63ecbf1d58177bab8652ac90e1b7d5.jpg resize: (1080, 1920) 1377890215 -2.2354848499302284 treat image : temp/1755676828_1492295_1377890212_9599b2f36c6af4150db08045c7743622.jpg resize: (1080, 1920) 1377890212 -1.771577482782747 treat image : temp/1755676828_1492295_1377890210_ca7c057a03a39f87b237ac965df54144.jpg resize: (1080, 1920) 1377890210 -2.695490871443852 treat image : temp/1755676828_1492295_1377890165_156778cf97770272ce2660e2ecb6d63c.jpg resize: (1080, 1920) 1377890165 -1.9049384054402447 treat image : temp/1755676828_1492295_1377890161_895d28ddb381ab970709dd40743f3106.jpg resize: (1080, 1920) 1377890161 -1.6405913437959034 treat image : temp/1755676828_1492295_1377890149_ec0cba9e2411d1ec6604ca9f6fa38703.jpg resize: (1080, 1920) 1377890149 -2.4365307868535164 treat image : temp/1755676828_1492295_1377890135_6bdd541678967509b63303c39c7fc911.jpg resize: (1080, 1920) 1377890135 -1.97751524997492 treat image : temp/1755676828_1492295_1377890132_ba6cb97dde2f978726d38dc3cf1a4d9e.jpg resize: (1080, 1920) 1377890132 2.608037656805899 treat image : temp/1755676828_1492295_1377890127_487221c28a911fa4eacc10ac13ff7b84.jpg resize: (1080, 1920) 1377890127 -3.0497647084114377 treat image : temp/1755676828_1492295_1377890019_dc339cb9ba84f1438464dcd83841cb1e.jpg resize: (1080, 1920) 1377890019 0.28312859468764234 treat image : temp/1755676828_1492295_1377890017_2b1d1e4e42efd41a124cbe54e0289286.jpg resize: (1080, 1920) 1377890017 -2.322536790066243 treat image : temp/1755676828_1492295_1377890015_a59b2a7b30875fd43eaddc297575eef3.jpg resize: (1080, 1920) 1377890015 -2.541920834680989 treat image : temp/1755676828_1492295_1377890009_ecc12efec175390520156369a53f5cbc.jpg resize: (1080, 1920) 1377890009 -1.820604179623908 treat image : temp/1755676828_1492295_1377889991_847522788e7a1fd848eb44fbd99e79da.jpg resize: (1080, 1920) 1377889991 -2.3620762849561396 treat image : temp/1755676828_1492295_1377889989_f330839aae65e51fdf8fc68926c78ce1.jpg resize: (1080, 1920) 1377889989 -2.1055352844646085 treat image : temp/1755676828_1492295_1377889976_137b73cdc8ff539f0fc9e27334205ca9.jpg resize: (1080, 1920) 1377889976 -2.9283975048922297 treat image : temp/1755676828_1492295_1377889975_53078b22921a45b4f803fa0d9750e9b4.jpg resize: (1080, 1920) 1377889975 -2.011784378765275 treat image : temp/1755676828_1492295_1377889974_4a88898441c08dfeb46bf6b5513c5497.jpg resize: (1080, 1920) 1377889974 -1.6566836730848797 treat image : temp/1755676828_1492295_1377890245_725ed2d9c4f7b4980a03b442ed987669_rle_crop_3921345499_0.png resize: (89, 96) 1377995808 -1.9836498866678156 treat image : temp/1755676828_1492295_1377890239_cf4036e73a927802ca666123a430b320_rle_crop_3921345505_0.png resize: (184, 110) 1377995809 -0.5797414371177028 treat image : temp/1755676828_1492295_1377890222_ad875baf068b0ed48e638f4aadd21e39_rle_crop_3921345507_0.png resize: (110, 101) 1377995810 -1.9553894895834236 treat image : temp/1755676828_1492295_1377890222_ad875baf068b0ed48e638f4aadd21e39_rle_crop_3921345509_0.png resize: (175, 113) 1377995811 -0.8291296173729013 treat image : temp/1755676828_1492295_1377890220_a2a902eeccc3195e2984fa23c959c351_rle_crop_3921345512_0.png resize: (111, 95) 1377995812 -1.661949926848945 treat image : temp/1755676828_1492295_1377890220_a2a902eeccc3195e2984fa23c959c351_rle_crop_3921345513_0.png resize: (70, 66) 1377995813 -1.5178493392533385 treat image : temp/1755676828_1492295_1377890220_a2a902eeccc3195e2984fa23c959c351_rle_crop_3921345514_0.png resize: (96, 51) 1377995814 0.5423668528075112 treat image : temp/1755676828_1492295_1377890218_95b344700cc8bfc25fa0a88b4422c4a9_rle_crop_3921345515_0.png resize: (107, 93) 1377995815 -1.4638982694075122 treat image : temp/1755676828_1492295_1377890215_fa63ecbf1d58177bab8652ac90e1b7d5_rle_crop_3921345518_0.png resize: (181, 108) 1377995816 -0.6655266316445541 treat image : temp/1755676828_1492295_1377890215_fa63ecbf1d58177bab8652ac90e1b7d5_rle_crop_3921345520_0.png resize: (110, 80) 1377995817 -2.3277214686098233 treat image : temp/1755676828_1492295_1377890161_895d28ddb381ab970709dd40743f3106_rle_crop_3921345525_0.png resize: (69, 75) 1377995818 -1.3326191304104864 treat image : temp/1755676828_1492295_1377890135_6bdd541678967509b63303c39c7fc911_rle_crop_3921345529_0.png resize: (60, 82) 1377995819 -1.5728532001603501 treat image : temp/1755676828_1492295_1377889991_847522788e7a1fd848eb44fbd99e79da_rle_crop_3921345539_0.png resize: (47, 91) 1377995820 1.3783188507412627 treat image : temp/1755676828_1492295_1377889989_f330839aae65e51fdf8fc68926c78ce1_rle_crop_3921345542_0.png resize: (62, 65) 1377995821 0.6929857244142622 treat image : temp/1755676828_1492295_1377889976_137b73cdc8ff539f0fc9e27334205ca9_rle_crop_3921345545_0.png resize: (184, 112) 1377995822 -0.48386257567665486 treat image : temp/1755676828_1492295_1377890267_cd454084ab209e7d407d6d343fed0606_rle_crop_3921345496_0.png resize: (950, 995) 1377995853 0.07994047899392488 treat image : temp/1755676828_1492295_1377890267_cd454084ab209e7d407d6d343fed0606_rle_crop_3921345497_0.png resize: (170, 259) 1377995854 -3.6083719868207798 treat image : temp/1755676828_1492295_1377890267_cd454084ab209e7d407d6d343fed0606_rle_crop_3921345498_0.png resize: (542, 337) 1377995855 -0.32438921951139493 treat image : temp/1755676828_1492295_1377890244_b4557c8a2af45cf01c902d61ae9ec5cf_rle_crop_3921345500_0.png resize: (99, 78) 1377995856 -2.118433092043421 treat image : temp/1755676828_1492295_1377890244_b4557c8a2af45cf01c902d61ae9ec5cf_rle_crop_3921345501_0.png resize: (977, 1045) 1377995857 0.16567807918939442 treat image : temp/1755676828_1492295_1377890243_7803657656a654fc67dd2a141f887c7c_rle_crop_3921345502_0.png resize: (116, 85) 1377995858 -2.6835104259818454 treat image : temp/1755676828_1492295_1377890243_7803657656a654fc67dd2a141f887c7c_rle_crop_3921345503_0.png resize: (514, 341) 1377995859 0.07527674172417545 treat image : temp/1755676828_1492295_1377890243_7803657656a654fc67dd2a141f887c7c_rle_crop_3921345504_0.png resize: (72, 80) 1377995860 -2.3002266581549553 treat image : temp/1755676828_1492295_1377890239_cf4036e73a927802ca666123a430b320_rle_crop_3921345506_0.png resize: (610, 341) 1377995861 -1.0420365011879158 treat image : temp/1755676828_1492295_1377890222_ad875baf068b0ed48e638f4aadd21e39_rle_crop_3921345508_0.png resize: (944, 1646) 1377995862 -1.7392782314847346 treat image : temp/1755676828_1492295_1377890222_ad875baf068b0ed48e638f4aadd21e39_rle_crop_3921345510_0.png resize: (496, 317) 1377995863 -0.35837028906172647 treat image : temp/1755676828_1492295_1377890220_a2a902eeccc3195e2984fa23c959c351_rle_crop_3921345511_0.png resize: (509, 338) 1377995865 -0.07662929134464744 treat image : temp/1755676828_1492295_1377890218_95b344700cc8bfc25fa0a88b4422c4a9_rle_crop_3921345516_0.png resize: (132, 81) 1377995866 -1.7845769599327967 treat image : temp/1755676828_1492295_1377890215_fa63ecbf1d58177bab8652ac90e1b7d5_rle_crop_3921345517_0.png resize: (910, 965) 1377995867 0.6547245632093186 treat image : temp/1755676828_1492295_1377890215_fa63ecbf1d58177bab8652ac90e1b7d5_rle_crop_3921345519_0.png resize: (202, 309) 1377995868 -3.948744275112445 treat image : temp/1755676828_1492295_1377890212_9599b2f36c6af4150db08045c7743622_rle_crop_3921345521_0.png resize: (883, 915) 1377995869 0.6002635360383286 treat image : temp/1755676828_1492295_1377890210_ca7c057a03a39f87b237ac965df54144_rle_crop_3921345522_0.png resize: (555, 347) 1377995870 0.2083842431673189 treat image : temp/1755676828_1492295_1377890210_ca7c057a03a39f87b237ac965df54144_rle_crop_3921345523_0.png resize: (120, 209) 1377995871 -3.0420393070099427 treat image : temp/1755676828_1492295_1377890165_156778cf97770272ce2660e2ecb6d63c_rle_crop_3921345524_0.png resize: (127, 72) 1377995872 -1.5331478883672824 treat image : temp/1755676828_1492295_1377890161_895d28ddb381ab970709dd40743f3106_rle_crop_3921345526_0.png resize: (535, 350) 1377995873 -1.3166058328868369 treat image : temp/1755676828_1492295_1377890135_6bdd541678967509b63303c39c7fc911_rle_crop_3921345527_0.png resize: (129, 188) 1377995874 -2.6877929150131346 treat image : temp/1755676828_1492295_1377890135_6bdd541678967509b63303c39c7fc911_rle_crop_3921345528_0.png resize: (169, 214) 1377995875 -4.090479949595075 treat image : temp/1755676828_1492295_1377890135_6bdd541678967509b63303c39c7fc911_rle_crop_3921345530_0.png resize: (113, 155) 1377995876 -2.408874207133985 treat image : temp/1755676828_1492295_1377890135_6bdd541678967509b63303c39c7fc911_rle_crop_3921345531_0.png resize: (915, 1005) 1377995877 0.5132915419780112 treat image : temp/1755676828_1492295_1377890127_487221c28a911fa4eacc10ac13ff7b84_rle_crop_3921345532_0.png resize: (105, 129) 1377995878 -1.861543416855099 treat image : temp/1755676828_1492295_1377890017_2b1d1e4e42efd41a124cbe54e0289286_rle_crop_3921345533_0.png resize: (530, 350) 1377995879 -1.136315796767644 treat image : temp/1755676828_1492295_1377890015_a59b2a7b30875fd43eaddc297575eef3_rle_crop_3921345534_0.png resize: (134, 80) 1377995880 -2.45560301957111 treat image : temp/1755676828_1492295_1377890015_a59b2a7b30875fd43eaddc297575eef3_rle_crop_3921345535_0.png resize: (541, 326) 1377995881 0.06913603621194422 treat image : temp/1755676828_1492295_1377890015_a59b2a7b30875fd43eaddc297575eef3_rle_crop_3921345536_0.png resize: (968, 1237) 1377995882 -1.3151452416476344 treat image : temp/1755676828_1492295_1377890009_ecc12efec175390520156369a53f5cbc_rle_crop_3921345537_0.png resize: (504, 350) 1377995883 0.1984415430564825 treat image : temp/1755676828_1492295_1377890009_ecc12efec175390520156369a53f5cbc_rle_crop_3921345538_0.png resize: (929, 1027) 1377995884 0.39637450336433516 treat image : temp/1755676828_1492295_1377889991_847522788e7a1fd848eb44fbd99e79da_rle_crop_3921345540_0.png resize: (137, 304) 1377995885 -2.671441880885001 treat image : temp/1755676828_1492295_1377889991_847522788e7a1fd848eb44fbd99e79da_rle_crop_3921345541_0.png resize: (548, 352) 1377995886 -1.0763080625576404 treat image : temp/1755676828_1492295_1377889989_f330839aae65e51fdf8fc68926c78ce1_rle_crop_3921345543_0.png resize: (116, 52) 1377995887 0.8279868941218725 treat image : temp/1755676828_1492295_1377889989_f330839aae65e51fdf8fc68926c78ce1_rle_crop_3921345544_0.png resize: (989, 1028) 1377995888 0.24963933243895053 treat image : temp/1755676828_1492295_1377889975_53078b22921a45b4f803fa0d9750e9b4_rle_crop_3921345546_0.png resize: (136, 140) 1377995889 -2.5945161898265656 treat image : temp/1755676828_1492295_1377889975_53078b22921a45b4f803fa0d9750e9b4_rle_crop_3921345547_0.png resize: (982, 1191) 1377995890 -0.2623285121956417 treat image : temp/1755676828_1492295_1377889974_4a88898441c08dfeb46bf6b5513c5497_rle_crop_3921345548_0.png resize: (381, 703) 1377995891 -3.0205417987796945 treat image : temp/1755676828_1492295_1377889974_4a88898441c08dfeb46bf6b5513c5497_rle_crop_3921345549_0.png resize: (874, 897) 1377995892 0.22912158036049834 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 80 time used for this insertion : 0.01540684700012207 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 80 time used for this insertion : 0.6132533550262451 save missing photos in datou_result : time spend for datou_step_exec : 24.509161949157715 time spend to save output : 0.6338381767272949 total time spend for step 6 : 25.14300012588501 step7:brightness Wed Aug 20 10:02:57 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1755676828_1492295_1377890267_cd454084ab209e7d407d6d343fed0606.jpg treat image : temp/1755676828_1492295_1377890245_725ed2d9c4f7b4980a03b442ed987669.jpg treat image : temp/1755676828_1492295_1377890244_b4557c8a2af45cf01c902d61ae9ec5cf.jpg treat image : temp/1755676828_1492295_1377890243_7803657656a654fc67dd2a141f887c7c.jpg treat image : temp/1755676828_1492295_1377890239_cf4036e73a927802ca666123a430b320.jpg treat image : temp/1755676828_1492295_1377890222_ad875baf068b0ed48e638f4aadd21e39.jpg treat image : temp/1755676828_1492295_1377890220_a2a902eeccc3195e2984fa23c959c351.jpg treat image : temp/1755676828_1492295_1377890218_95b344700cc8bfc25fa0a88b4422c4a9.jpg treat image : temp/1755676828_1492295_1377890215_fa63ecbf1d58177bab8652ac90e1b7d5.jpg treat image : temp/1755676828_1492295_1377890212_9599b2f36c6af4150db08045c7743622.jpg treat image : temp/1755676828_1492295_1377890210_ca7c057a03a39f87b237ac965df54144.jpg treat image : temp/1755676828_1492295_1377890165_156778cf97770272ce2660e2ecb6d63c.jpg treat image : temp/1755676828_1492295_1377890161_895d28ddb381ab970709dd40743f3106.jpg treat image : temp/1755676828_1492295_1377890149_ec0cba9e2411d1ec6604ca9f6fa38703.jpg treat image : temp/1755676828_1492295_1377890135_6bdd541678967509b63303c39c7fc911.jpg treat image : temp/1755676828_1492295_1377890132_ba6cb97dde2f978726d38dc3cf1a4d9e.jpg treat image : temp/1755676828_1492295_1377890127_487221c28a911fa4eacc10ac13ff7b84.jpg treat image : temp/1755676828_1492295_1377890019_dc339cb9ba84f1438464dcd83841cb1e.jpg treat image : temp/1755676828_1492295_1377890017_2b1d1e4e42efd41a124cbe54e0289286.jpg treat image : temp/1755676828_1492295_1377890015_a59b2a7b30875fd43eaddc297575eef3.jpg treat image : temp/1755676828_1492295_1377890009_ecc12efec175390520156369a53f5cbc.jpg treat image : temp/1755676828_1492295_1377889991_847522788e7a1fd848eb44fbd99e79da.jpg treat image : temp/1755676828_1492295_1377889989_f330839aae65e51fdf8fc68926c78ce1.jpg treat image : temp/1755676828_1492295_1377889976_137b73cdc8ff539f0fc9e27334205ca9.jpg treat image : temp/1755676828_1492295_1377889975_53078b22921a45b4f803fa0d9750e9b4.jpg treat image : temp/1755676828_1492295_1377889974_4a88898441c08dfeb46bf6b5513c5497.jpg treat image : temp/1755676828_1492295_1377890245_725ed2d9c4f7b4980a03b442ed987669_rle_crop_3921345499_0.png treat image : temp/1755676828_1492295_1377890239_cf4036e73a927802ca666123a430b320_rle_crop_3921345505_0.png treat image : temp/1755676828_1492295_1377890222_ad875baf068b0ed48e638f4aadd21e39_rle_crop_3921345507_0.png treat image : temp/1755676828_1492295_1377890222_ad875baf068b0ed48e638f4aadd21e39_rle_crop_3921345509_0.png treat image : temp/1755676828_1492295_1377890220_a2a902eeccc3195e2984fa23c959c351_rle_crop_3921345512_0.png treat image : temp/1755676828_1492295_1377890220_a2a902eeccc3195e2984fa23c959c351_rle_crop_3921345513_0.png treat image : temp/1755676828_1492295_1377890220_a2a902eeccc3195e2984fa23c959c351_rle_crop_3921345514_0.png treat image : temp/1755676828_1492295_1377890218_95b344700cc8bfc25fa0a88b4422c4a9_rle_crop_3921345515_0.png treat image : temp/1755676828_1492295_1377890215_fa63ecbf1d58177bab8652ac90e1b7d5_rle_crop_3921345518_0.png treat image : temp/1755676828_1492295_1377890215_fa63ecbf1d58177bab8652ac90e1b7d5_rle_crop_3921345520_0.png treat image : temp/1755676828_1492295_1377890161_895d28ddb381ab970709dd40743f3106_rle_crop_3921345525_0.png treat image : temp/1755676828_1492295_1377890135_6bdd541678967509b63303c39c7fc911_rle_crop_3921345529_0.png treat image : temp/1755676828_1492295_1377889991_847522788e7a1fd848eb44fbd99e79da_rle_crop_3921345539_0.png treat image : temp/1755676828_1492295_1377889989_f330839aae65e51fdf8fc68926c78ce1_rle_crop_3921345542_0.png treat image : temp/1755676828_1492295_1377889976_137b73cdc8ff539f0fc9e27334205ca9_rle_crop_3921345545_0.png treat image : temp/1755676828_1492295_1377890267_cd454084ab209e7d407d6d343fed0606_rle_crop_3921345496_0.png treat image : temp/1755676828_1492295_1377890267_cd454084ab209e7d407d6d343fed0606_rle_crop_3921345497_0.png treat image : temp/1755676828_1492295_1377890267_cd454084ab209e7d407d6d343fed0606_rle_crop_3921345498_0.png treat image : temp/1755676828_1492295_1377890244_b4557c8a2af45cf01c902d61ae9ec5cf_rle_crop_3921345500_0.png treat image : temp/1755676828_1492295_1377890244_b4557c8a2af45cf01c902d61ae9ec5cf_rle_crop_3921345501_0.png treat image : temp/1755676828_1492295_1377890243_7803657656a654fc67dd2a141f887c7c_rle_crop_3921345502_0.png treat image : temp/1755676828_1492295_1377890243_7803657656a654fc67dd2a141f887c7c_rle_crop_3921345503_0.png treat image : temp/1755676828_1492295_1377890243_7803657656a654fc67dd2a141f887c7c_rle_crop_3921345504_0.png treat image : temp/1755676828_1492295_1377890239_cf4036e73a927802ca666123a430b320_rle_crop_3921345506_0.png treat image : temp/1755676828_1492295_1377890222_ad875baf068b0ed48e638f4aadd21e39_rle_crop_3921345508_0.png treat image : temp/1755676828_1492295_1377890222_ad875baf068b0ed48e638f4aadd21e39_rle_crop_3921345510_0.png treat image : temp/1755676828_1492295_1377890220_a2a902eeccc3195e2984fa23c959c351_rle_crop_3921345511_0.png treat image : temp/1755676828_1492295_1377890218_95b344700cc8bfc25fa0a88b4422c4a9_rle_crop_3921345516_0.png treat image : temp/1755676828_1492295_1377890215_fa63ecbf1d58177bab8652ac90e1b7d5_rle_crop_3921345517_0.png treat image : temp/1755676828_1492295_1377890215_fa63ecbf1d58177bab8652ac90e1b7d5_rle_crop_3921345519_0.png treat image : temp/1755676828_1492295_1377890212_9599b2f36c6af4150db08045c7743622_rle_crop_3921345521_0.png treat image : temp/1755676828_1492295_1377890210_ca7c057a03a39f87b237ac965df54144_rle_crop_3921345522_0.png treat image : temp/1755676828_1492295_1377890210_ca7c057a03a39f87b237ac965df54144_rle_crop_3921345523_0.png treat image : temp/1755676828_1492295_1377890165_156778cf97770272ce2660e2ecb6d63c_rle_crop_3921345524_0.png treat image : temp/1755676828_1492295_1377890161_895d28ddb381ab970709dd40743f3106_rle_crop_3921345526_0.png treat image : temp/1755676828_1492295_1377890135_6bdd541678967509b63303c39c7fc911_rle_crop_3921345527_0.png treat image : temp/1755676828_1492295_1377890135_6bdd541678967509b63303c39c7fc911_rle_crop_3921345528_0.png treat image : temp/1755676828_1492295_1377890135_6bdd541678967509b63303c39c7fc911_rle_crop_3921345530_0.png treat image : temp/1755676828_1492295_1377890135_6bdd541678967509b63303c39c7fc911_rle_crop_3921345531_0.png treat image : temp/1755676828_1492295_1377890127_487221c28a911fa4eacc10ac13ff7b84_rle_crop_3921345532_0.png treat image : temp/1755676828_1492295_1377890017_2b1d1e4e42efd41a124cbe54e0289286_rle_crop_3921345533_0.png treat image : temp/1755676828_1492295_1377890015_a59b2a7b30875fd43eaddc297575eef3_rle_crop_3921345534_0.png treat image : temp/1755676828_1492295_1377890015_a59b2a7b30875fd43eaddc297575eef3_rle_crop_3921345535_0.png treat image : temp/1755676828_1492295_1377890015_a59b2a7b30875fd43eaddc297575eef3_rle_crop_3921345536_0.png treat image : temp/1755676828_1492295_1377890009_ecc12efec175390520156369a53f5cbc_rle_crop_3921345537_0.png treat image : temp/1755676828_1492295_1377890009_ecc12efec175390520156369a53f5cbc_rle_crop_3921345538_0.png treat image : temp/1755676828_1492295_1377889991_847522788e7a1fd848eb44fbd99e79da_rle_crop_3921345540_0.png treat image : temp/1755676828_1492295_1377889991_847522788e7a1fd848eb44fbd99e79da_rle_crop_3921345541_0.png treat image : temp/1755676828_1492295_1377889989_f330839aae65e51fdf8fc68926c78ce1_rle_crop_3921345543_0.png treat image : temp/1755676828_1492295_1377889989_f330839aae65e51fdf8fc68926c78ce1_rle_crop_3921345544_0.png treat image : temp/1755676828_1492295_1377889975_53078b22921a45b4f803fa0d9750e9b4_rle_crop_3921345546_0.png treat image : temp/1755676828_1492295_1377889975_53078b22921a45b4f803fa0d9750e9b4_rle_crop_3921345547_0.png treat image : temp/1755676828_1492295_1377889974_4a88898441c08dfeb46bf6b5513c5497_rle_crop_3921345548_0.png treat image : temp/1755676828_1492295_1377889974_4a88898441c08dfeb46bf6b5513c5497_rle_crop_3921345549_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 80 time used for this insertion : 0.013288736343383789 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 80 time used for this insertion : 0.29730987548828125 save missing photos in datou_result : time spend for datou_step_exec : 6.944921493530273 time spend to save output : 0.31549906730651855 total time spend for step 7 : 7.260420560836792 step8:velours_tree Wed Aug 20 10:03:04 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.11661291122436523 time spend to save output : 4.839897155761719e-05 total time spend for step 8 : 0.11666131019592285 step9:send_mail_cod Wed Aug 20 10:03:05 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P26072152_20-08-2025_10_03_05.pdf 26073062 imagette260730621755676985 26073063 imagette260730631755676985 26073064 imagette260730641755676985 26073065 imagette260730651755676985 26073066 imagette260730661755676985 26073067 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette260730671755676985 26073069 imagette260730691755676986 26073070 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette260730701755676986 26073071 imagette260730711755676987 26073072 imagette260730721755676987 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=26072152 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/26073062,26073063,26073064,26073065,26073066,26073067,26073068,26073069,26073070,26073071,26073072?tags=autre,background,metal,mal_croppe,pehd,pet_clair,environnement,flou,papier,carton,pet_fonce args[1377890267] : ((1377890267, -2.233707863521869, 492609224), (1377890267, 0.4762002583873212, 2107752395), '0.19694379525759734') We are sending mail with results at report@fotonower.com args[1377890245] : ((1377890245, -2.879554435342563, 492609224), (1377890245, 0.4848671706860595, 2107752395), '0.19694379525759734') We are sending mail with results at report@fotonower.com args[1377890244] : ((1377890244, -1.9510944142909497, 492688767), (1377890244, 0.49520028552861345, 2107752395), '0.19694379525759734') We are sending mail with results at report@fotonower.com args[1377890243] : ((1377890243, -1.9123909929615737, 492688767), (1377890243, 0.578570023437596, 2107752395), '0.19694379525759734') We are sending mail with results at report@fotonower.com args[1377890239] : ((1377890239, -2.537646782924348, 492609224), (1377890239, 0.489097810934699, 2107752395), '0.19694379525759734') We are sending mail with results at report@fotonower.com args[1377890222] : ((1377890222, -1.5841332575249307, 492688767), (1377890222, 0.4328290142529643, 2107752395), '0.19694379525759734') We are sending mail with results at report@fotonower.com args[1377890220] : ((1377890220, -2.6575877432586217, 492609224), (1377890220, 0.29518114909086685, 2107752395), '0.19694379525759734') We are sending mail with results at report@fotonower.com args[1377890218] : ((1377890218, -1.6855143546866638, 492688767), (1377890218, 0.49625710340353124, 2107752395), '0.19694379525759734') We are sending mail with results at report@fotonower.com args[1377890215] : ((1377890215, -2.2354848499302284, 492609224), (1377890215, 0.3557638867565003, 2107752395), '0.19694379525759734') We are sending mail with results at report@fotonower.com args[1377890212] : ((1377890212, -1.771577482782747, 492688767), (1377890212, 0.5013175880688295, 2107752395), '0.19694379525759734') We are sending mail with results at report@fotonower.com args[1377890210] : ((1377890210, -2.695490871443852, 492609224), (1377890210, 0.5598982574942191, 2107752395), '0.19694379525759734') We are sending mail with results at report@fotonower.com args[1377890165] : ((1377890165, -1.9049384054402447, 492688767), (1377890165, 0.558280116006206, 2107752395), '0.19694379525759734') We are sending mail with results at report@fotonower.com args[1377890161] : ((1377890161, -1.6405913437959034, 492688767), (1377890161, 0.552288417044043, 2107752395), '0.19694379525759734') We are sending mail with results at report@fotonower.com args[1377890149] : ((1377890149, -2.4365307868535164, 492609224), (1377890149, 0.4796267274328358, 2107752395), '0.19694379525759734') We are sending mail with results at report@fotonower.com args[1377890135] : ((1377890135, -1.97751524997492, 492688767), (1377890135, 0.4354089885242179, 2107752395), '0.19694379525759734') We are sending mail with results at report@fotonower.com args[1377890132] : ((1377890132, 2.608037656805899, 492688767), (1377890132, 0.4885697222316149, 2107752395), '0.19694379525759734') We are sending mail with results at report@fotonower.com args[1377890127] : ((1377890127, -3.0497647084114377, 492609224), (1377890127, 0.46494778257723585, 2107752395), '0.19694379525759734') We are sending mail with results at report@fotonower.com args[1377890019] : ((1377890019, 0.28312859468764234, 492688767), (1377890019, 0.5663496346281868, 2107752395), '0.19694379525759734') We are sending mail with results at report@fotonower.com args[1377890017] : ((1377890017, -2.322536790066243, 492609224), (1377890017, 0.4303798171255005, 2107752395), '0.19694379525759734') We are sending mail with results at report@fotonower.com args[1377890015] : ((1377890015, -2.541920834680989, 492609224), (1377890015, 0.45037912935512464, 2107752395), '0.19694379525759734') We are sending mail with results at report@fotonower.com args[1377890009] : ((1377890009, -1.820604179623908, 492688767), (1377890009, 0.576695436385774, 2107752395), '0.19694379525759734') We are sending mail with results at report@fotonower.com args[1377889991] : ((1377889991, -2.3620762849561396, 492609224), (1377889991, 0.5742006000186267, 2107752395), '0.19694379525759734') We are sending mail with results at report@fotonower.com args[1377889989] : ((1377889989, -2.1055352844646085, 492609224), (1377889989, 0.4721514787471393, 2107752395), '0.19694379525759734') We are sending mail with results at report@fotonower.com args[1377889976] : ((1377889976, -2.9283975048922297, 492609224), (1377889976, 0.6651593077751685, 2107752395), '0.19694379525759734') We are sending mail with results at report@fotonower.com args[1377889975] : ((1377889975, -2.011784378765275, 492609224), (1377889975, 0.5503911826277001, 2107752395), '0.19694379525759734') We are sending mail with results at report@fotonower.com args[1377889974] : ((1377889974, -1.6566836730848797, 492688767), (1377889974, 0.5005461894992163, 2107752395), '0.19694379525759734') We are sending mail with results at report@fotonower.com refus_total : 0.19694379525759734 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=26072152 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26072152_20-08-2025_10_03_05.pdf results_Auto_P26072152_20-08-2025_10_03_05.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26072152_20-08-2025_10_03_05.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','26072152','results_Auto_P26072152_20-08-2025_10_03_05.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26072152_20-08-2025_10_03_05.pdf','pdf','','0.69','0.19694379525759734') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/26072152

https://www.fotonower.com/image?json=false&list_photos_id=1377890267
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377890245
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377890244
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377890243
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377890239
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377890222
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377890220
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377890218
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377890215
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377890212
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377890210
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377890165
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377890161
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377890149
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377890135
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377890132
La photo est trop floue, merci de reprendre une photo.(avec le score = 2.608037656805899)
https://www.fotonower.com/image?json=false&list_photos_id=1377890127
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377890019
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377890017
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377890015
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377890009
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377889991
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377889989
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377889976
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377889975
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377889974
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 19.69%
Veuillez trouver les photos des contaminants.

exemples de contaminants: pet_clair: https://www.fotonower.com/view/26073067?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/26073070?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26072152_20-08-2025_10_03_05.pdf.

Lien vers velours :https://www.fotonower.com/velours/26073062,26073063,26073064,26073065,26073066,26073067,26073068,26073069,26073070,26073071,26073072?tags=autre,background,metal,mal_croppe,pehd,pet_clair,environnement,flou,papier,carton,pet_fonce.


L'équipe Fotonower 202 b'' Server: nginx Date: Wed, 20 Aug 2025 08:03:10 GMT Content-Length: 0 Connection: close X-Message-Id: 36suzonsR7iPezHY49PDGA Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1377890267, 1377890245, 1377890244, 1377890243, 1377890239, 1377890222, 1377890220, 1377890218, 1377890215, 1377890212, 1377890210, 1377890165, 1377890161, 1377890149, 1377890135, 1377890132, 1377890127, 1377890019, 1377890017, 1377890015, 1377890009, 1377889991, 1377889989, 1377889976, 1377889975, 1377889974] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890267', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890245', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890244', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890243', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890239', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890222', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890220', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890218', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890215', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890212', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890210', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890165', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890161', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890149', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890135', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890132', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890127', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890019', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890017', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890015', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890009', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377889991', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377889989', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377889976', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377889975', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377889974', None, None, None, None, None, '3555589') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 26 time used for this insertion : 0.14304256439208984 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.979313611984253 time spend to save output : 0.14338183403015137 total time spend for step 9 : 5.122695446014404 step10:split_time_score Wed Aug 20 10:03:10 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('15', 26),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 19082025 26072152 Nombre de photos uploadées : 26 / 23040 (0%) 19082025 26072152 Nombre de photos taguées (types de déchets): 0 / 26 (0%) 19082025 26072152 Nombre de photos taguées (volume) : 0 / 26 (0%) elapsed_time : load_data_split_time_score 1.6689300537109375e-06 elapsed_time : order_list_meta_photo_and_scores 5.245208740234375e-06 ?????????????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0012536048889160156 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.20650792121887207 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.1721447172619048 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26072114_20-08-2025_09_52_17.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26072114 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26072114 AND mptpi.`type`=3594 To do Qualite : 0.03661185056584362 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26072115_20-08-2025_09_56_48.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26072115 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26072115 AND mptpi.`type`=3594 To do Qualite : 0.03857088316615225 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26072116_20-08-2025_10_01_43.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26072116 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26072116 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26072119 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26072121 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26072123 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26072142 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26072146 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26072150 order by id desc limit 1 Qualite : 0.19694379525759734 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26072152_20-08-2025_10_03_05.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26072152 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26072152 AND mptpi.`type`=3594 To do Qualite : 0.09926064573688273 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26072154_20-08-2025_09_51_28.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26072154 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26072154 AND mptpi.`type`=3594 To do Qualite : 0.1528929157021605 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26072156_20-08-2025_09_41_51.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26072156 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26072156 AND mptpi.`type`=3594 To do Qualite : 0.14430815972222225 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26072158_20-08-2025_09_31_42.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26072158 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26072158 AND mptpi.`type`=3594 To do Qualite : 0.09642829585537918 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26072161_20-08-2025_09_22_01.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26072161 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26072161 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'19082025': {'nb_upload': 26, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1377890267, 1377890245, 1377890244, 1377890243, 1377890239, 1377890222, 1377890220, 1377890218, 1377890215, 1377890212, 1377890210, 1377890165, 1377890161, 1377890149, 1377890135, 1377890132, 1377890127, 1377890019, 1377890017, 1377890015, 1377890009, 1377889991, 1377889989, 1377889976, 1377889975, 1377889974] Looping around the photos to save general results len do output : 1 /26072152Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890267', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890245', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890244', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890243', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890239', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890222', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890220', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890218', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890215', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890212', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890210', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890165', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890161', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890149', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890135', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890132', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890127', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890019', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890017', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890015', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377890009', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377889991', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377889989', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377889976', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377889975', None, None, None, None, None, '3555589') ('3318', None, None, None, None, None, None, None, '3555589') ('3318', '26072152', '1377889974', None, None, None, None, None, '3555589') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 27 time used for this insertion : 0.02305459976196289 save_final save missing photos in datou_result : time spend for datou_step_exec : 6.826643228530884 time spend to save output : 0.02329874038696289 total time spend for step 10 : 6.849941968917847 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 26 set_done_treatment 104.99user 31.71system 2:51.50elapsed 79%CPU (0avgtext+0avgdata 3039932maxresident)k 2080inputs+64808outputs (27major+2363606minor)pagefaults 0swaps