python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2327780 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['4305111'] with mtr_portfolio_ids : ['29904813'] and first list_photo_ids : [] new path : /proc/2327780/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 13 ; length of list_pids : 13 ; length of list_args : 13 time to download the photos : 2.4353690147399902 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Fri Jan 2 20:10:29 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10605 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2026-01-02 20:10:32.892023: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2026-01-02 20:10:32.918572: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493010000 Hz 2026-01-02 20:10:32.920663: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f3c18000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2026-01-02 20:10:32.920715: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2026-01-02 20:10:32.924489: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2026-01-02 20:10:33.155980: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x380d7630 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2026-01-02 20:10:33.156014: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2026-01-02 20:10:33.156922: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2026-01-02 20:10:33.157208: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2026-01-02 20:10:33.159332: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2026-01-02 20:10:33.203841: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2026-01-02 20:10:33.204323: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2026-01-02 20:10:33.211710: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2026-01-02 20:10:33.212944: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2026-01-02 20:10:33.226771: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2026-01-02 20:10:33.228515: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2026-01-02 20:10:33.228584: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2026-01-02 20:10:33.229497: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2026-01-02 20:10:33.229515: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2026-01-02 20:10:33.229525: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2026-01-02 20:10:33.231201: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9826 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2026-01-02 20:10:33.503709: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2026-01-02 20:10:33.503788: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2026-01-02 20:10:33.503808: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2026-01-02 20:10:33.503827: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2026-01-02 20:10:33.503844: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2026-01-02 20:10:33.503861: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2026-01-02 20:10:33.503878: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2026-01-02 20:10:33.503895: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2026-01-02 20:10:33.505444: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2026-01-02 20:10:33.506738: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2026-01-02 20:10:33.506773: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2026-01-02 20:10:33.506791: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2026-01-02 20:10:33.506808: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2026-01-02 20:10:33.506825: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2026-01-02 20:10:33.506841: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2026-01-02 20:10:33.506857: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2026-01-02 20:10:33.506874: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2026-01-02 20:10:33.508421: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2026-01-02 20:10:33.508451: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2026-01-02 20:10:33.508461: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2026-01-02 20:10:33.508471: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2026-01-02 20:10:33.510065: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9826 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2026-01-02 20:10:45.237654: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2026-01-02 20:10:45.469089: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 13 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 24 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 18 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 15 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 16 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 16 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 20 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 14 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 19 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 9 Detection mask done ! Trying to reset tf kernel 2328319 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5537 tf kernel not reseted sub process len(results) : 13 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 13 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10826 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] DEBUG bbox = [1836, 1818, 2148, 2346] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002341032028198242 nb_pixel_total : 102429 time to create 1 rle with old method : 0.13559508323669434 length of segment : 301 DEBUG bbox = [1638, 1314, 1866, 1476] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003676414489746094 nb_pixel_total : 16665 time to create 1 rle with old method : 0.01768040657043457 length of segment : 162 DEBUG bbox = [648, 3150, 942, 3402] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005984306335449219 nb_pixel_total : 34654 time to create 1 rle with old method : 0.0363774299621582 length of segment : 264 DEBUG bbox = [1506, 1392, 1692, 1638] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.000408172607421875 nb_pixel_total : 25418 time to create 1 rle with old method : 0.027216672897338867 length of segment : 141 DEBUG bbox = [264, 3102, 732, 3306] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007092952728271484 nb_pixel_total : 44749 time to create 1 rle with old method : 0.04714322090148926 length of segment : 519 DEBUG bbox = [1206, 1692, 1524, 2130] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0010271072387695312 nb_pixel_total : 71059 time to create 1 rle with old method : 0.07546424865722656 length of segment : 296 DEBUG bbox = [996, 1164, 1170, 1494] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004429817199707031 nb_pixel_total : 33123 time to create 1 rle with old method : 0.03694295883178711 length of segment : 193 DEBUG bbox = [1056, 2550, 1278, 2718] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003018379211425781 nb_pixel_total : 18848 time to create 1 rle with old method : 0.0201723575592041 length of segment : 185 DEBUG bbox = [24, 420, 210, 582] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0002713203430175781 nb_pixel_total : 18164 time to create 1 rle with old method : 0.019626379013061523 length of segment : 182 DEBUG bbox = [1176, 1722, 1512, 2148] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0010144710540771484 nb_pixel_total : 72583 time to create 1 rle with old method : 0.07676100730895996 length of segment : 315 DEBUG bbox = [24, 1404, 276, 1566] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004172325134277344 nb_pixel_total : 30366 time to create 1 rle with old method : 0.03158164024353027 length of segment : 235 DEBUG bbox = [1326, 918, 1842, 1260] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0012247562408447266 nb_pixel_total : 92456 time to create 1 rle with old method : 0.09687519073486328 length of segment : 466 DEBUG bbox = [1254, 1716, 1560, 2106] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001020193099975586 nb_pixel_total : 69465 time to create 1 rle with old method : 0.08050870895385742 length of segment : 297 DEBUG bbox = [180, 3168, 462, 3276] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00026869773864746094 nb_pixel_total : 12705 time to create 1 rle with old method : 0.013222455978393555 length of segment : 246 DEBUG bbox = [12, 1164, 144, 1428] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003185272216796875 nb_pixel_total : 27103 time to create 1 rle with old method : 0.02850174903869629 length of segment : 130 DEBUG bbox = [186, 732, 468, 990] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006561279296875 nb_pixel_total : 50309 time to create 1 rle with old method : 0.055736541748046875 length of segment : 256 DEBUG bbox = [1062, 1134, 1224, 1356] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00029277801513671875 nb_pixel_total : 16526 time to create 1 rle with old method : 0.01745772361755371 length of segment : 133 DEBUG bbox = [1422, 984, 1860, 1272] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0010488033294677734 nb_pixel_total : 66489 time to create 1 rle with old method : 0.07417869567871094 length of segment : 464 DEBUG bbox = [18, 2154, 186, 2388] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006520748138427734 nb_pixel_total : 21887 time to create 1 rle with old method : 0.023617029190063477 length of segment : 154 DEBUG bbox = [1608, 2916, 1812, 3198] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.000949859619140625 nb_pixel_total : 36007 time to create 1 rle with old method : 0.03940153121948242 length of segment : 208 DEBUG bbox = [174, 1740, 402, 1980] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004584789276123047 nb_pixel_total : 27481 time to create 1 rle with old method : 0.03030228614807129 length of segment : 185 DEBUG bbox = [870, 1806, 1326, 2202] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001392364501953125 nb_pixel_total : 102637 time to create 1 rle with old method : 0.10972952842712402 length of segment : 405 DEBUG bbox = [1764, 1860, 1986, 2040] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00033736228942871094 nb_pixel_total : 20024 time to create 1 rle with old method : 0.021595478057861328 length of segment : 216 DEBUG bbox = [1320, 1968, 1530, 2448] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008175373077392578 nb_pixel_total : 63972 time to create 1 rle with old method : 0.07206106185913086 length of segment : 188 DEBUG bbox = [18, 2148, 234, 2358] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00042247772216796875 nb_pixel_total : 27295 time to create 1 rle with old method : 0.030692338943481445 length of segment : 216 DEBUG bbox = [0, 672, 342, 1338] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0042760372161865234 nb_pixel_total : 135238 time to create 1 rle with old method : 0.17566537857055664 length of segment : 356 DEBUG bbox = [684, 2274, 966, 2592] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001390695571899414 nb_pixel_total : 45211 time to create 1 rle with old method : 0.04929852485656738 length of segment : 264 DEBUG bbox = [24, 1398, 228, 1518] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004229545593261719 nb_pixel_total : 18317 time to create 1 rle with old method : 0.019559621810913086 length of segment : 199 DEBUG bbox = [30, 126, 384, 414] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0014111995697021484 nb_pixel_total : 64040 time to create 1 rle with old method : 0.06810426712036133 length of segment : 309 DEBUG bbox = [450, 1050, 690, 1320] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0010178089141845703 nb_pixel_total : 40493 time to create 1 rle with old method : 0.04540300369262695 length of segment : 254 DEBUG bbox = [1524, 1980, 1824, 2196] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00103759765625 nb_pixel_total : 36129 time to create 1 rle with old method : 0.03843092918395996 length of segment : 257 DEBUG bbox = [252, 2154, 534, 2490] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0013124942779541016 nb_pixel_total : 48746 time to create 1 rle with old method : 0.052489280700683594 length of segment : 284 DEBUG bbox = [84, 1374, 432, 1770] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0021779537200927734 nb_pixel_total : 77792 time to create 1 rle with old method : 0.08616924285888672 length of segment : 303 DEBUG bbox = [1068, 1146, 1536, 1596] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0030601024627685547 nb_pixel_total : 119836 time to create 1 rle with old method : 0.12491679191589355 length of segment : 418 DEBUG bbox = [546, 2094, 750, 2262] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006849765777587891 nb_pixel_total : 21333 time to create 1 rle with old method : 0.02393651008605957 length of segment : 197 DEBUG bbox = [1086, 2502, 1368, 2736] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0010614395141601562 nb_pixel_total : 36782 time to create 1 rle with old method : 0.038985490798950195 length of segment : 259 DEBUG bbox = [24, 1452, 198, 1644] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003933906555175781 nb_pixel_total : 16253 time to create 1 rle with old method : 0.017045974731445312 length of segment : 155 DEBUG bbox = [12, 1368, 198, 1524] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00028514862060546875 nb_pixel_total : 16603 time to create 1 rle with old method : 0.017693042755126953 length of segment : 196 DEBUG bbox = [438, 1398, 858, 1890] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00399017333984375 nb_pixel_total : 150342 time to create 1 rle with new method : 0.005398750305175781 length of segment : 408 DEBUG bbox = [144, 2778, 732, 3228] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.005263090133666992 nb_pixel_total : 183404 time to create 1 rle with new method : 0.007842302322387695 length of segment : 887 DEBUG bbox = [168, 726, 480, 954] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0011627674102783203 nb_pixel_total : 36860 time to create 1 rle with old method : 0.03954815864562988 length of segment : 302 DEBUG bbox = [516, 2964, 858, 3318] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0013768672943115234 nb_pixel_total : 69350 time to create 1 rle with old method : 0.07523632049560547 length of segment : 319 DEBUG bbox = [258, 1092, 444, 1302] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005838871002197266 nb_pixel_total : 23512 time to create 1 rle with old method : 0.02537059783935547 length of segment : 164 DEBUG bbox = [558, 2436, 1626, 3096] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.011803150177001953 nb_pixel_total : 306169 time to create 1 rle with new method : 0.031050443649291992 length of segment : 1288 DEBUG bbox = [708, 792, 1032, 1260] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0012781620025634766 nb_pixel_total : 65540 time to create 1 rle with old method : 0.0713202953338623 length of segment : 306 DEBUG bbox = [24, 504, 498, 972] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002321958541870117 nb_pixel_total : 117966 time to create 1 rle with old method : 0.12608885765075684 length of segment : 601 DEBUG bbox = [1944, 1488, 2160, 1884] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001035451889038086 nb_pixel_total : 50889 time to create 1 rle with old method : 0.055982112884521484 length of segment : 192 DEBUG bbox = [12, 1572, 204, 1764] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007016658782958984 nb_pixel_total : 29753 time to create 1 rle with old method : 0.04590487480163574 length of segment : 190 DEBUG bbox = [1110, 774, 1266, 1050] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005812644958496094 nb_pixel_total : 27164 time to create 1 rle with old method : 0.029132843017578125 length of segment : 130 DEBUG bbox = [330, 444, 552, 732] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001016855239868164 nb_pixel_total : 47266 time to create 1 rle with old method : 0.05548548698425293 length of segment : 210 DEBUG bbox = [1080, 258, 1434, 660] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0016090869903564453 nb_pixel_total : 63182 time to create 1 rle with old method : 0.06871628761291504 length of segment : 351 DEBUG bbox = [192, 162, 630, 456] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0015368461608886719 nb_pixel_total : 59182 time to create 1 rle with old method : 0.06316518783569336 length of segment : 397 DEBUG bbox = [582, 294, 1308, 714] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0037696361541748047 nb_pixel_total : 151889 time to create 1 rle with new method : 0.0072519779205322266 length of segment : 630 DEBUG bbox = [888, 984, 1158, 1218] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0010306835174560547 nb_pixel_total : 35267 time to create 1 rle with old method : 0.03911113739013672 length of segment : 250 DEBUG bbox = [180, 1422, 474, 1788] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0016937255859375 nb_pixel_total : 63696 time to create 1 rle with old method : 0.0707547664642334 length of segment : 276 DEBUG bbox = [84, 120, 312, 342] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008916854858398438 nb_pixel_total : 27889 time to create 1 rle with old method : 0.030810117721557617 length of segment : 189 DEBUG bbox = [1224, 954, 1626, 1140] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0012118816375732422 nb_pixel_total : 37709 time to create 1 rle with old method : 0.04036116600036621 length of segment : 336 DEBUG bbox = [234, 1014, 690, 1392] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0023086071014404297 nb_pixel_total : 125003 time to create 1 rle with old method : 0.13439679145812988 length of segment : 466 DEBUG bbox = [1026, 288, 1716, 768] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.004549503326416016 nb_pixel_total : 191511 time to create 1 rle with new method : 0.01004791259765625 length of segment : 587 DEBUG bbox = [0, 522, 120, 738] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007891654968261719 nb_pixel_total : 13542 time to create 1 rle with old method : 0.020236492156982422 length of segment : 110 DEBUG bbox = [150, 2124, 420, 2412] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0010800361633300781 nb_pixel_total : 41924 time to create 1 rle with old method : 0.04689192771911621 length of segment : 249 DEBUG bbox = [660, 246, 1086, 684] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002221822738647461 nb_pixel_total : 96411 time to create 1 rle with old method : 0.10479974746704102 length of segment : 407 DEBUG bbox = [1062, 2556, 1326, 2880] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009794235229492188 nb_pixel_total : 36956 time to create 1 rle with old method : 0.040442705154418945 length of segment : 231 DEBUG bbox = [30, 12, 294, 336] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0011022090911865234 nb_pixel_total : 64400 time to create 1 rle with old method : 0.07174420356750488 length of segment : 279 DEBUG bbox = [1716, 1620, 1896, 1788] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005509853363037109 nb_pixel_total : 18548 time to create 1 rle with old method : 0.020543575286865234 length of segment : 162 DEBUG bbox = [972, 624, 1446, 1404] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.003957509994506836 nb_pixel_total : 212060 time to create 1 rle with new method : 0.010514259338378906 length of segment : 511 DEBUG bbox = [1314, 594, 1572, 852] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007786750793457031 nb_pixel_total : 36917 time to create 1 rle with old method : 0.04020571708679199 length of segment : 252 DEBUG bbox = [246, 2604, 420, 2892] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006201267242431641 nb_pixel_total : 20158 time to create 1 rle with old method : 0.022411108016967773 length of segment : 168 DEBUG bbox = [774, 324, 1260, 594] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0014274120330810547 nb_pixel_total : 62078 time to create 1 rle with old method : 0.09508419036865234 length of segment : 555 DEBUG bbox = [804, 1476, 972, 1836] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007300376892089844 nb_pixel_total : 31641 time to create 1 rle with old method : 0.03513836860656738 length of segment : 253 time spent for convertir_results : 7.033456563949585 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 70 chid ids of type : 3594 Number RLEs to save : 21464 save missing photos in datou_result : time spend for datou_step_exec : 69.7101354598999 time spend to save output : 1.342076063156128 total time spend for step 1 : 71.05221152305603 step2:crop_condition Fri Jan 2 20:11:40 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 13 ! batch 1 Loaded 70 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 20 About to insert : list_path_to_insert length 20 new photo from crops ! About to upload 20 photos upload in portfolio : 3736932 init cache_photo without model_param we have 20 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1767381109_2327780 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767381113), 0.0, 0.0, 14, '', 0, 0, '1767381027_2327780_1402186372_aafc3c5748834ac2183bd35c1e98eb5b_rle_crop_4088823814_0.png', 0, 144, 157, 0, 1767381113,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767381113), 0.0, 0.0, 14, '', 0, 0, '1767381027_2327780_1402186362_b2b5d82d72865acfc4203c7b6c3df5a0_rle_crop_4088823822_0.png', 0, 374, 315, 0, 1767381113,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767381113), 0.0, 0.0, 14, '', 0, 0, '1767381027_2327780_1402186354_b863a268d96510e9fd1115c3e8671071_rle_crop_4088823835_0.png', 0, 173, 207, 0, 1767381113,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767381113), 0.0, 0.0, 14, '', 0, 0, '1767381027_2327780_1402186351_53f4c5e9a6676296f2223560c60d6dc3_rle_crop_4088823838_0.png', 0, 590, 293, 0, 1767381113,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767381113), 0.0, 0.0, 14, '', 0, 0, '1767381027_2327780_1402186350_a0dc7ca4e9c336bb420e96e5c0e8002c_rle_crop_4088823842_0.png', 0, 266, 236, 0, 1767381113,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767381113), 0.0, 0.0, 14, '', 0, 0, '1767381027_2327780_1402186349_b63fef8ec6a552ae51695a6af6a33882_rle_crop_4088823846_0.png', 0, 385, 400, 0, 1767381113,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767381113), 0.0, 0.0, 14, '', 0, 0, '1767381027_2327780_1402186349_b63fef8ec6a552ae51695a6af6a33882_rle_crop_4088823847_0.png', 0, 161, 196, 0, 1767381113,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767381113), 0.0, 0.0, 14, '', 0, 0, '1767381027_2327780_1402186349_b63fef8ec6a552ae51695a6af6a33882_rle_crop_4088823848_0.png', 0, 200, 252, 0, 1767381113,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767381113), 0.0, 0.0, 14, '', 0, 0, '1767381027_2327780_1402186349_b63fef8ec6a552ae51695a6af6a33882_rle_crop_4088823853_0.png', 0, 211, 302, 0, 1767381113,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767381113), 0.0, 0.0, 14, '', 0, 0, '1767381027_2327780_1402186339_f8a1ede21eea0fa1462aebfd811850d1_rle_crop_4088823854_0.png', 0, 337, 307, 0, 1767381113,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767381113), 0.0, 0.0, 14, '', 0, 0, '1767381027_2327780_1402186339_f8a1ede21eea0fa1462aebfd811850d1_rle_crop_4088823856_0.png', 0, 602, 1010, 0, 1767381113,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767381113), 0.0, 0.0, 14, '', 0, 0, '1767381027_2327780_1402186339_f8a1ede21eea0fa1462aebfd811850d1_rle_crop_4088823857_0.png', 0, 396, 306, 0, 1767381113,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767381113), 0.0, 0.0, 14, '', 0, 0, '1767381027_2327780_1402186337_ead5c6b053e2a145c40f696e678d21fe_rle_crop_4088823859_0.png', 0, 362, 191, 0, 1767381113,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767381113), 0.0, 0.0, 14, '', 0, 0, '1767381027_2327780_1402186336_0356c31a79ea14a0ee66b651b9c3c704_rle_crop_4088823861_0.png', 0, 256, 125, 0, 1767381113,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767381113), 0.0, 0.0, 14, '', 0, 0, '1767381027_2327780_1402186336_0356c31a79ea14a0ee66b651b9c3c704_rle_crop_4088823863_0.png', 0, 339, 267, 0, 1767381113,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767381113), 0.0, 0.0, 14, '', 0, 0, '1767381027_2327780_1402186335_55a8ea897d5726678c03e3694097db47_rle_crop_4088823867_0.png', 0, 360, 275, 0, 1767381113,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767381113), 0.0, 0.0, 14, '', 0, 0, '1767381027_2327780_1402186335_55a8ea897d5726678c03e3694097db47_rle_crop_4088823869_0.png', 0, 179, 336, 0, 1767381113,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767381113), 0.0, 0.0, 14, '', 0, 0, '1767381027_2327780_1402186333_4cf977942bc5967ec51a92208c927b42_rle_crop_4088823877_0.png', 0, 153, 162, 0, 1767381113,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767381113), 0.0, 0.0, 14, '', 0, 0, '1767381027_2327780_1402186331_b965eb1374930402e04776e34e39d517_rle_crop_4088823878_0.png', 0, 774, 378, 0, 1767381113,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767381113), 0.0, 0.0, 14, '', 0, 0, '1767381027_2327780_1402186331_b965eb1374930402e04776e34e39d517_rle_crop_4088823881_0.png', 0, 225, 462, 0, 1767381113,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 20 photos in the portfolio 3736932 time of upload the photos Elapsed time : 4.809010744094849 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 21 About to insert : list_path_to_insert length 21 new photo from crops ! About to upload 21 photos upload in portfolio : 3736932 init cache_photo without model_param we have 21 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1767381120_2327780 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767381124), 0.0, 0.0, 14, '', 0, 0, '1767381027_2327780_1402186362_b2b5d82d72865acfc4203c7b6c3df5a0_rle_crop_4088823817_0.png', 0, 193, 451, 0, 1767381124,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767381124), 0.0, 0.0, 14, '', 0, 0, '1767381027_2327780_1402186362_b2b5d82d72865acfc4203c7b6c3df5a0_rle_crop_4088823818_0.png', 0, 375, 296, 0, 1767381124,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767381124), 0.0, 0.0, 14, '', 0, 0, '1767381027_2327780_1402186362_b2b5d82d72865acfc4203c7b6c3df5a0_rle_crop_4088823819_0.png', 0, 310, 152, 0, 1767381124,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767381124), 0.0, 0.0, 14, '', 0, 0, '1767381027_2327780_1402186362_b2b5d82d72865acfc4203c7b6c3df5a0_rle_crop_4088823820_0.png', 0, 141, 185, 0, 1767381124,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767381124), 0.0, 0.0, 14, '', 0, 0, '1767381027_2327780_1402186362_b2b5d82d72865acfc4203c7b6c3df5a0_rle_crop_4088823821_0.png', 0, 156, 182, 0, 1767381124,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767381124), 0.0, 0.0, 14, '', 0, 0, '1767381027_2327780_1402186362_b2b5d82d72865acfc4203c7b6c3df5a0_rle_crop_4088823823_0.png', 0, 160, 229, 0, 1767381124,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767381124), 0.0, 0.0, 14, '', 0, 0, '1767381027_2327780_1402186356_0d0f051f8fc72e15175988cbdb4ce54a_rle_crop_4088823825_0.png', 0, 361, 297, 0, 1767381124,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767381124), 0.0, 0.0, 14, '', 0, 0, '1767381027_2327780_1402186356_0d0f051f8fc72e15175988cbdb4ce54a_rle_crop_4088823826_0.png', 0, 87, 245, 0, 1767381124,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767381124), 0.0, 0.0, 14, '', 0, 0, '1767381027_2327780_1402186356_0d0f051f8fc72e15175988cbdb4ce54a_rle_crop_4088823829_0.png', 0, 170, 133, 0, 1767381124,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767381124), 0.0, 0.0, 14, '', 0, 0, '1767381027_2327780_1402186356_0d0f051f8fc72e15175988cbdb4ce54a_rle_crop_4088823831_0.png', 0, 195, 154, 0, 1767381124,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767381124), 0.0, 0.0, 14, '', 0, 0, '1767381027_2327780_1402186351_53f4c5e9a6676296f2223560c60d6dc3_rle_crop_4088823839_0.png', 0, 276, 256, 0, 1767381124,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767381124), 0.0, 0.0, 14, '', 0, 0, '1767381027_2327780_1402186350_a0dc7ca4e9c336bb420e96e5c0e8002c_rle_crop_4088823840_0.png', 0, 116, 199, 0, 1767381124,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767381124), 0.0, 0.0, 14, '', 0, 0, '1767381027_2327780_1402186349_b63fef8ec6a552ae51695a6af6a33882_rle_crop_4088823851_0.png', 0, 466, 405, 0, 1767381124,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767381124), 0.0, 0.0, 14, '', 0, 0, '1767381027_2327780_1402186337_ead5c6b053e2a145c40f696e678d21fe_rle_crop_4088823858_0.png', 0, 441, 457, 0, 1767381124,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767381124), 0.0, 0.0, 14, '', 0, 0, '1767381027_2327780_1402186335_55a8ea897d5726678c03e3694097db47_rle_crop_4088823866_0.png', 0, 217, 249, 0, 1767381124,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767381124), 0.0, 0.0, 14, '', 0, 0, '1767381027_2327780_1402186333_4cf977942bc5967ec51a92208c927b42_rle_crop_4088823873_0.png', 0, 279, 249, 0, 1767381124,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767381124), 0.0, 0.0, 14, '', 0, 0, '1767381027_2327780_1402186333_4cf977942bc5967ec51a92208c927b42_rle_crop_4088823875_0.png', 0, 285, 199, 0, 1767381124,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767381124), 0.0, 0.0, 14, '', 0, 0, '1767381027_2327780_1402186333_4cf977942bc5967ec51a92208c927b42_rle_crop_4088823876_0.png', 0, 318, 255, 0, 1767381124,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767381124), 0.0, 0.0, 14, '', 0, 0, '1767381027_2327780_1402186331_b965eb1374930402e04776e34e39d517_rle_crop_4088823879_0.png', 0, 223, 252, 0, 1767381124,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767381124), 0.0, 0.0, 14, '', 0, 0, '1767381027_2327780_1402186331_b965eb1374930402e04776e34e39d517_rle_crop_4088823880_0.png', 0, 284, 134, 0, 1767381124,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767381124), 0.0, 0.0, 14, '', 0, 0, '1767381027_2327780_1402186331_b965eb1374930402e04776e34e39d517_rle_crop_4088823882_0.png', 0, 358, 165, 0, 1767381124,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 21 photos in the portfolio 3736932 time of upload the photos Elapsed time : 4.777086019515991 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1767381127_2327780 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767381127), 0.0, 0.0, 14, '', 0, 0, '1767381027_2327780_1402186372_aafc3c5748834ac2183bd35c1e98eb5b_rle_crop_4088823816_0.png', 0, 228, 141, 0, 1767381127,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.8636324405670166 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 23 About to insert : list_path_to_insert length 23 new photo from crops ! About to upload 23 photos upload in portfolio : 3736932 init cache_photo without model_param we have 23 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1767381135_2327780 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767381140), 0.0, 0.0, 14, '', 0, 0, '1767381027_2327780_1402186372_aafc3c5748834ac2183bd35c1e98eb5b_rle_crop_4088823813_0.png', 0, 478, 301, 0, 1767381140,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767381140), 0.0, 0.0, 14, '', 0, 0, '1767381027_2327780_1402186372_aafc3c5748834ac2183bd35c1e98eb5b_rle_crop_4088823815_0.png', 0, 242, 264, 0, 1767381140,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767381140), 0.0, 0.0, 14, '', 0, 0, '1767381027_2327780_1402186362_b2b5d82d72865acfc4203c7b6c3df5a0_rle_crop_4088823824_0.png', 0, 288, 423, 0, 1767381140,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767381140), 0.0, 0.0, 14, '', 0, 0, '1767381027_2327780_1402186356_0d0f051f8fc72e15175988cbdb4ce54a_rle_crop_4088823827_0.png', 0, 262, 130, 0, 1767381140,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767381140), 0.0, 0.0, 14, '', 0, 0, '1767381027_2327780_1402186356_0d0f051f8fc72e15175988cbdb4ce54a_rle_crop_4088823828_0.png', 0, 234, 256, 0, 1767381140,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767381140), 0.0, 0.0, 14, '', 0, 0, '1767381027_2327780_1402186356_0d0f051f8fc72e15175988cbdb4ce54a_rle_crop_4088823830_0.png', 0, 217, 373, 0, 1767381140,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767381140), 0.0, 0.0, 14, '', 0, 0, '1767381027_2327780_1402186354_b863a268d96510e9fd1115c3e8671071_rle_crop_4088823833_0.png', 0, 199, 184, 0, 1767381140,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767381140), 0.0, 0.0, 14, '', 0, 0, '1767381027_2327780_1402186354_b863a268d96510e9fd1115c3e8671071_rle_crop_4088823834_0.png', 0, 378, 402, 0, 1767381140,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767381140), 0.0, 0.0, 14, '', 0, 0, '1767381027_2327780_1402186354_b863a268d96510e9fd1115c3e8671071_rle_crop_4088823837_0.png', 0, 175, 213, 0, 1767381140,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767381140), 0.0, 0.0, 14, '', 0, 0, '1767381027_2327780_1402186350_a0dc7ca4e9c336bb420e96e5c0e8002c_rle_crop_4088823841_0.png', 0, 285, 291, 0, 1767381140,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767381140), 0.0, 0.0, 14, '', 0, 0, '1767381027_2327780_1402186349_b63fef8ec6a552ae51695a6af6a33882_rle_crop_4088823844_0.png', 0, 282, 274, 0, 1767381140,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767381140), 0.0, 0.0, 14, '', 0, 0, '1767381027_2327780_1402186349_b63fef8ec6a552ae51695a6af6a33882_rle_crop_4088823845_0.png', 0, 351, 303, 0, 1767381140,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767381140), 0.0, 0.0, 14, '', 0, 0, '1767381027_2327780_1402186349_b63fef8ec6a552ae51695a6af6a33882_rle_crop_4088823849_0.png', 0, 179, 141, 0, 1767381140,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767381140), 0.0, 0.0, 14, '', 0, 0, '1767381027_2327780_1402186349_b63fef8ec6a552ae51695a6af6a33882_rle_crop_4088823850_0.png', 0, 131, 176, 0, 1767381140,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767381140), 0.0, 0.0, 14, '', 0, 0, '1767381027_2327780_1402186339_f8a1ede21eea0fa1462aebfd811850d1_rle_crop_4088823855_0.png', 0, 198, 161, 0, 1767381140,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767381140), 0.0, 0.0, 14, '', 0, 0, '1767381027_2327780_1402186337_ead5c6b053e2a145c40f696e678d21fe_rle_crop_4088823860_0.png', 0, 186, 188, 0, 1767381140,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767381140), 0.0, 0.0, 14, '', 0, 0, '1767381027_2327780_1402186336_0356c31a79ea14a0ee66b651b9c3c704_rle_crop_4088823862_0.png', 0, 280, 204, 0, 1767381140,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767381140), 0.0, 0.0, 14, '', 0, 0, '1767381027_2327780_1402186336_0356c31a79ea14a0ee66b651b9c3c704_rle_crop_4088823864_0.png', 0, 265, 363, 0, 1767381140,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767381140), 0.0, 0.0, 14, '', 0, 0, '1767381027_2327780_1402186335_55a8ea897d5726678c03e3694097db47_rle_crop_4088823868_0.png', 0, 210, 177, 0, 1767381140,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767381140), 0.0, 0.0, 14, '', 0, 0, '1767381027_2327780_1402186335_55a8ea897d5726678c03e3694097db47_rle_crop_4088823870_0.png', 0, 370, 445, 0, 1767381140,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767381140), 0.0, 0.0, 14, '', 0, 0, '1767381027_2327780_1402186335_55a8ea897d5726678c03e3694097db47_rle_crop_4088823871_0.png', 0, 459, 587, 0, 1767381140,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767381140), 0.0, 0.0, 14, '', 0, 0, '1767381027_2327780_1402186335_55a8ea897d5726678c03e3694097db47_rle_crop_4088823872_0.png', 0, 182, 110, 0, 1767381140,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767381140), 0.0, 0.0, 14, '', 0, 0, '1767381027_2327780_1402186333_4cf977942bc5967ec51a92208c927b42_rle_crop_4088823874_0.png', 0, 355, 407, 0, 1767381140,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 23 photos in the portfolio 3736932 time of upload the photos Elapsed time : 5.9479005336761475 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1767381144_2327780 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767381145), 0.0, 0.0, 14, '', 0, 0, '1767381027_2327780_1402186354_b863a268d96510e9fd1115c3e8671071_rle_crop_4088823836_0.png', 0, 479, 181, 0, 1767381145,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767381145), 0.0, 0.0, 14, '', 0, 0, '1767381027_2327780_1402186350_a0dc7ca4e9c336bb420e96e5c0e8002c_rle_crop_4088823843_0.png', 0, 184, 257, 0, 1767381145,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767381145), 0.0, 0.0, 14, '', 0, 0, '1767381027_2327780_1402186349_b63fef8ec6a552ae51695a6af6a33882_rle_crop_4088823852_0.png', 0, 443, 578, 0, 1767381145,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.9149472713470459 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1767381148_2327780 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767381149), 0.0, 0.0, 14, '', 0, 0, '1767381027_2327780_1402186356_0d0f051f8fc72e15175988cbdb4ce54a_rle_crop_4088823832_0.png', 0, 255, 201, 0, 1767381149,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767381149), 0.0, 0.0, 14, '', 0, 0, '1767381027_2327780_1402186336_0356c31a79ea14a0ee66b651b9c3c704_rle_crop_4088823865_0.png', 0, 372, 582, 0, 1767381149,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.0381476879119873 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1402186372, 1402186362, 1402186356, 1402186354, 1402186351, 1402186350, 1402186349, 1402186339, 1402186337, 1402186336, 1402186335, 1402186333, 1402186331] Looping around the photos to save general results len do output : 70 /1402192367Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402192368Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402192369Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402192371Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402192372Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402192373Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402192375Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402192376Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402192377Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402192379Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402192380Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402192381Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402192383Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402192384Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402192385Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402192387Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402192388Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402192389Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402192391Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402192392Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402192442Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402192443Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402192444Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402192445Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402192446Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402192447Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402192448Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402192449Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402192450Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402192451Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402192452Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402192453Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402192454Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402192455Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402192456Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402192457Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402192458Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402192459Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402192460Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402192461Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402192462Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402192464Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402192471Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402192472Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402192473Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402192474Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402192475Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402192476Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402192477Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402192478Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402192479Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402192480Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402192481Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402192482Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402192483Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402192484Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402192485Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402192486Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402192487Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402192488Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402192489Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402192490Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402192491Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402192492Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402192493Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402192497Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402192498Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402192499Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402192502Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1402192503Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186372', None, None, None, None, None, '4305111') ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186362', None, None, None, None, None, '4305111') ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186356', None, None, None, None, None, '4305111') ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186354', None, None, None, None, None, '4305111') ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186351', None, None, None, None, None, '4305111') ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186350', None, None, None, None, None, '4305111') ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186349', None, None, None, None, None, '4305111') ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186339', None, None, None, None, None, '4305111') ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186337', None, None, None, None, None, '4305111') ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186336', None, None, None, None, None, '4305111') ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186335', None, None, None, None, None, '4305111') ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186333', None, None, None, None, None, '4305111') ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186331', None, None, None, None, None, '4305111') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 223 time used for this insertion : 0.04159998893737793 save_final save missing photos in datou_result : time spend for datou_step_exec : 48.48551368713379 time spend to save output : 0.04463338851928711 total time spend for step 2 : 48.530147075653076 step3:rle_unique_nms_with_priority Fri Jan 2 20:12:29 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 70 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 3.08467173576355 time for calcul the mask position with numpy : 0.6776635646820068 nb_pixel_total : 8115234 time to create 1 rle with new method : 0.9413506984710693 time for calcul the mask position with numpy : 0.023456096649169922 nb_pixel_total : 25418 time to create 1 rle with old method : 0.027556896209716797 time for calcul the mask position with numpy : 0.02323746681213379 nb_pixel_total : 34654 time to create 1 rle with old method : 0.03625035285949707 time for calcul the mask position with numpy : 0.02351689338684082 nb_pixel_total : 16665 time to create 1 rle with old method : 0.017935991287231445 time for calcul the mask position with numpy : 0.024674654006958008 nb_pixel_total : 102429 time to create 1 rle with old method : 0.1066427230834961 create new chi : 1.9368038177490234 time to delete rle : 0.02181839942932129 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 3896 TO DO : save crop sub photo not yet done ! save time : 0.2799065113067627 nb_obj : 8 nb_hashtags : 3 time to prepare the origin masks : 4.060750246047974 time for calcul the mask position with numpy : 0.853273868560791 nb_pixel_total : 7983543 time to create 1 rle with new method : 0.8533563613891602 time for calcul the mask position with numpy : 0.023983240127563477 nb_pixel_total : 92456 time to create 1 rle with old method : 0.09589290618896484 time for calcul the mask position with numpy : 0.023189544677734375 nb_pixel_total : 30366 time to create 1 rle with old method : 0.03155851364135742 time for calcul the mask position with numpy : 0.0226290225982666 nb_pixel_total : 2092 time to create 1 rle with old method : 0.0025424957275390625 time for calcul the mask position with numpy : 0.02427530288696289 nb_pixel_total : 18164 time to create 1 rle with old method : 0.019002437591552734 time for calcul the mask position with numpy : 0.024449825286865234 nb_pixel_total : 18848 time to create 1 rle with old method : 0.01952648162841797 time for calcul the mask position with numpy : 0.024581432342529297 nb_pixel_total : 33123 time to create 1 rle with old method : 0.035349369049072266 time for calcul the mask position with numpy : 0.027739524841308594 nb_pixel_total : 71059 time to create 1 rle with old method : 0.07538986206054688 time for calcul the mask position with numpy : 0.024706125259399414 nb_pixel_total : 44749 time to create 1 rle with old method : 0.046639442443847656 create new chi : 2.268383264541626 time to delete rle : 0.0008924007415771484 batch 1 Loaded 17 chid ids of type : 3594 ++++++++++Number RLEs to save : 6635 TO DO : save crop sub photo not yet done ! save time : 0.4599168300628662 nb_obj : 8 nb_hashtags : 3 time to prepare the origin masks : 3.9460771083831787 time for calcul the mask position with numpy : 0.4327869415283203 nb_pixel_total : 7993909 time to create 1 rle with new method : 1.005737066268921 time for calcul the mask position with numpy : 0.022758960723876953 nb_pixel_total : 36007 time to create 1 rle with old method : 0.038254737854003906 time for calcul the mask position with numpy : 0.031210660934448242 nb_pixel_total : 21887 time to create 1 rle with old method : 0.023662090301513672 time for calcul the mask position with numpy : 0.03869819641113281 nb_pixel_total : 66489 time to create 1 rle with old method : 0.07050871849060059 time for calcul the mask position with numpy : 0.030990123748779297 nb_pixel_total : 16526 time to create 1 rle with old method : 0.017384052276611328 time for calcul the mask position with numpy : 0.024207115173339844 nb_pixel_total : 50309 time to create 1 rle with old method : 0.053023576736450195 time for calcul the mask position with numpy : 0.024072885513305664 nb_pixel_total : 27103 time to create 1 rle with old method : 0.02841329574584961 time for calcul the mask position with numpy : 0.023796558380126953 nb_pixel_total : 12705 time to create 1 rle with old method : 0.013237476348876953 time for calcul the mask position with numpy : 0.02570343017578125 nb_pixel_total : 69465 time to create 1 rle with old method : 0.07444977760314941 create new chi : 2.0204899311065674 time to delete rle : 0.0008776187896728516 batch 1 Loaded 17 chid ids of type : 3594 +++++++++Number RLEs to save : 5936 TO DO : save crop sub photo not yet done ! save time : 0.4101274013519287 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 2.925189733505249 time for calcul the mask position with numpy : 0.9216275215148926 nb_pixel_total : 8052991 time to create 1 rle with new method : 0.9432106018066406 time for calcul the mask position with numpy : 0.022539377212524414 nb_pixel_total : 27295 time to create 1 rle with old method : 0.02861785888671875 time for calcul the mask position with numpy : 0.023630142211914062 nb_pixel_total : 63972 time to create 1 rle with old method : 0.0669705867767334 time for calcul the mask position with numpy : 0.022899389266967773 nb_pixel_total : 20024 time to create 1 rle with old method : 0.020999908447265625 time for calcul the mask position with numpy : 0.024608373641967773 nb_pixel_total : 102637 time to create 1 rle with old method : 0.11504721641540527 time for calcul the mask position with numpy : 0.028553485870361328 nb_pixel_total : 27481 time to create 1 rle with old method : 0.040682315826416016 create new chi : 2.298539161682129 time to delete rle : 0.0006611347198486328 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 4580 TO DO : save crop sub photo not yet done ! save time : 0.3202402591705322 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 1.386209487915039 time for calcul the mask position with numpy : 0.5816044807434082 nb_pixel_total : 8113951 time to create 1 rle with new method : 0.99582839012146 time for calcul the mask position with numpy : 0.04010653495788574 nb_pixel_total : 45211 time to create 1 rle with old method : 0.04854178428649902 time for calcul the mask position with numpy : 0.026237964630126953 nb_pixel_total : 135238 time to create 1 rle with old method : 0.14342617988586426 create new chi : 1.8777527809143066 time to delete rle : 0.0004436969757080078 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 3400 TO DO : save crop sub photo not yet done ! save time : 0.23895716667175293 nb_obj : 4 nb_hashtags : 4 time to prepare the origin masks : 2.6259968280792236 time for calcul the mask position with numpy : 0.6517508029937744 nb_pixel_total : 8135421 time to create 1 rle with new method : 1.410229206085205 time for calcul the mask position with numpy : 0.023772239685058594 nb_pixel_total : 36129 time to create 1 rle with old method : 0.039162635803222656 time for calcul the mask position with numpy : 0.02466893196105957 nb_pixel_total : 40493 time to create 1 rle with old method : 0.04252314567565918 time for calcul the mask position with numpy : 0.024559736251831055 nb_pixel_total : 64040 time to create 1 rle with old method : 0.06849503517150879 time for calcul the mask position with numpy : 0.024466276168823242 nb_pixel_total : 18317 time to create 1 rle with old method : 0.019545793533325195 create new chi : 2.3710193634033203 time to delete rle : 0.0006086826324462891 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 4198 TO DO : save crop sub photo not yet done ! save time : 0.2988114356994629 nb_obj : 10 nb_hashtags : 4 time to prepare the origin masks : 5.825894117355347 time for calcul the mask position with numpy : 0.5988748073577881 nb_pixel_total : 7587433 time to create 1 rle with new method : 0.8924338817596436 time for calcul the mask position with numpy : 0.028095245361328125 nb_pixel_total : 36860 time to create 1 rle with old method : 0.04074883460998535 time for calcul the mask position with numpy : 0.025241613388061523 nb_pixel_total : 183404 time to create 1 rle with new method : 0.9120118618011475 time for calcul the mask position with numpy : 0.025736570358276367 nb_pixel_total : 150342 time to create 1 rle with new method : 0.9801070690155029 time for calcul the mask position with numpy : 0.023761987686157227 nb_pixel_total : 16178 time to create 1 rle with old method : 0.01711440086364746 time for calcul the mask position with numpy : 0.02373504638671875 nb_pixel_total : 15694 time to create 1 rle with old method : 0.016709327697753906 time for calcul the mask position with numpy : 0.024805784225463867 nb_pixel_total : 36782 time to create 1 rle with old method : 0.03865337371826172 time for calcul the mask position with numpy : 0.02392435073852539 nb_pixel_total : 21333 time to create 1 rle with old method : 0.022641897201538086 time for calcul the mask position with numpy : 0.023578405380249023 nb_pixel_total : 119836 time to create 1 rle with old method : 0.12650156021118164 time for calcul the mask position with numpy : 0.024393796920776367 nb_pixel_total : 77792 time to create 1 rle with old method : 0.08025193214416504 time for calcul the mask position with numpy : 0.023703575134277344 nb_pixel_total : 48746 time to create 1 rle with old method : 0.0507962703704834 create new chi : 4.121819496154785 time to delete rle : 0.0011796951293945312 batch 1 Loaded 21 chid ids of type : 3594 +++++++++++++++++++Number RLEs to save : 8923 TO DO : save crop sub photo not yet done ! save time : 0.5890231132507324 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 1.996049404144287 time for calcul the mask position with numpy : 0.7441439628601074 nb_pixel_total : 7829829 time to create 1 rle with new method : 1.0534179210662842 time for calcul the mask position with numpy : 0.023821592330932617 nb_pixel_total : 65540 time to create 1 rle with old method : 0.07024717330932617 time for calcul the mask position with numpy : 0.024269580841064453 nb_pixel_total : 306169 time to create 1 rle with new method : 0.9146087169647217 time for calcul the mask position with numpy : 0.02364659309387207 nb_pixel_total : 23512 time to create 1 rle with old method : 0.025621414184570312 time for calcul the mask position with numpy : 0.02385425567626953 nb_pixel_total : 69350 time to create 1 rle with old method : 0.07238483428955078 create new chi : 3.0397489070892334 time to delete rle : 0.0009148120880126953 batch 1 Loaded 9 chid ids of type : 3594 +++++++Number RLEs to save : 6314 TO DO : save crop sub photo not yet done ! save time : 0.41107749938964844 nb_obj : 3 nb_hashtags : 3 time to prepare the origin masks : 1.9166338443756104 time for calcul the mask position with numpy : 0.8423290252685547 nb_pixel_total : 8095792 time to create 1 rle with new method : 0.9519681930541992 time for calcul the mask position with numpy : 0.023850440979003906 nb_pixel_total : 29753 time to create 1 rle with old method : 0.035387516021728516 time for calcul the mask position with numpy : 0.024125337600708008 nb_pixel_total : 50889 time to create 1 rle with old method : 0.055789947509765625 time for calcul the mask position with numpy : 0.025328636169433594 nb_pixel_total : 117966 time to create 1 rle with old method : 0.1261141300201416 create new chi : 2.125781297683716 time to delete rle : 0.0006797313690185547 batch 1 Loaded 7 chid ids of type : 3594 ++++Number RLEs to save : 4126 TO DO : save crop sub photo not yet done ! save time : 0.2991302013397217 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 2.9918010234832764 time for calcul the mask position with numpy : 0.9881367683410645 nb_pixel_total : 7945717 time to create 1 rle with new method : 0.8697404861450195 time for calcul the mask position with numpy : 0.02480173110961914 nb_pixel_total : 151889 time to create 1 rle with new method : 0.8722469806671143 time for calcul the mask position with numpy : 0.024846553802490234 nb_pixel_total : 59182 time to create 1 rle with old method : 0.06516790390014648 time for calcul the mask position with numpy : 0.026699542999267578 nb_pixel_total : 63182 time to create 1 rle with old method : 0.06918835639953613 time for calcul the mask position with numpy : 0.025071382522583008 nb_pixel_total : 47266 time to create 1 rle with old method : 0.05068635940551758 time for calcul the mask position with numpy : 0.025322914123535156 nb_pixel_total : 27164 time to create 1 rle with old method : 0.030246257781982422 create new chi : 3.143490791320801 time to delete rle : 0.0009467601776123047 batch 1 Loaded 11 chid ids of type : 3594 ++++++++++Number RLEs to save : 5595 TO DO : save crop sub photo not yet done ! save time : 0.4075663089752197 nb_obj : 7 nb_hashtags : 3 time to prepare the origin masks : 3.5410194396972656 time for calcul the mask position with numpy : 0.6389584541320801 nb_pixel_total : 7799783 time to create 1 rle with new method : 0.9713983535766602 time for calcul the mask position with numpy : 0.022341012954711914 nb_pixel_total : 13542 time to create 1 rle with old method : 0.013997554779052734 time for calcul the mask position with numpy : 0.02312469482421875 nb_pixel_total : 191511 time to create 1 rle with new method : 0.928645133972168 time for calcul the mask position with numpy : 0.02815413475036621 nb_pixel_total : 125003 time to create 1 rle with old method : 0.14292287826538086 time for calcul the mask position with numpy : 0.02467179298400879 nb_pixel_total : 37709 time to create 1 rle with old method : 0.04073023796081543 time for calcul the mask position with numpy : 0.024943113327026367 nb_pixel_total : 27889 time to create 1 rle with old method : 0.030889511108398438 time for calcul the mask position with numpy : 0.02671217918395996 nb_pixel_total : 63696 time to create 1 rle with old method : 0.06829619407653809 time for calcul the mask position with numpy : 0.025114774703979492 nb_pixel_total : 35267 time to create 1 rle with old method : 0.03689408302307129 create new chi : 3.113754987716675 time to delete rle : 0.0009334087371826172 batch 1 Loaded 15 chid ids of type : 3594 +++++++Number RLEs to save : 6588 TO DO : save crop sub photo not yet done ! save time : 0.43416690826416016 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 2.821824312210083 time for calcul the mask position with numpy : 0.7248399257659912 nb_pixel_total : 8036161 time to create 1 rle with new method : 0.9802744388580322 time for calcul the mask position with numpy : 0.02339005470275879 nb_pixel_total : 18548 time to create 1 rle with old method : 0.019522428512573242 time for calcul the mask position with numpy : 0.025151729583740234 nb_pixel_total : 64400 time to create 1 rle with old method : 0.0932164192199707 time for calcul the mask position with numpy : 0.0245358943939209 nb_pixel_total : 36956 time to create 1 rle with old method : 0.038926124572753906 time for calcul the mask position with numpy : 0.024546146392822266 nb_pixel_total : 96411 time to create 1 rle with old method : 0.10298562049865723 time for calcul the mask position with numpy : 0.024066925048828125 nb_pixel_total : 41924 time to create 1 rle with old method : 0.044980525970458984 create new chi : 2.167071580886841 time to delete rle : 0.0007061958312988281 batch 1 Loaded 11 chid ids of type : 3594 ++++++Number RLEs to save : 4816 TO DO : save crop sub photo not yet done ! save time : 0.33327460289001465 nb_obj : 5 nb_hashtags : 2 time to prepare the origin masks : 2.48793888092041 time for calcul the mask position with numpy : 0.7933101654052734 nb_pixel_total : 7931546 time to create 1 rle with new method : 0.9533696174621582 time for calcul the mask position with numpy : 0.025266647338867188 nb_pixel_total : 31641 time to create 1 rle with old method : 0.03449845314025879 time for calcul the mask position with numpy : 0.0256805419921875 nb_pixel_total : 62078 time to create 1 rle with old method : 0.06657791137695312 time for calcul the mask position with numpy : 0.023993492126464844 nb_pixel_total : 20158 time to create 1 rle with old method : 0.02377462387084961 time for calcul the mask position with numpy : 0.025154829025268555 nb_pixel_total : 36917 time to create 1 rle with old method : 0.03998422622680664 time for calcul the mask position with numpy : 0.02572464942932129 nb_pixel_total : 212060 time to create 1 rle with new method : 0.7539162635803223 create new chi : 2.8597259521484375 time to delete rle : 0.0008234977722167969 batch 1 Loaded 11 chid ids of type : 3594 +++++++Number RLEs to save : 5638 TO DO : save crop sub photo not yet done ! save time : 0.38088250160217285 map_output_result : {1402186372: (0.0, 'Should be the crop_list due to order', 0), 1402186362: (0.0, 'Should be the crop_list due to order', 0), 1402186356: (0.0, 'Should be the crop_list due to order', 0), 1402186354: (0.0, 'Should be the crop_list due to order', 0), 1402186351: (0.0, 'Should be the crop_list due to order', 0), 1402186350: (0.0, 'Should be the crop_list due to order', 0), 1402186349: (0.0, 'Should be the crop_list due to order', 0), 1402186339: (0.0, 'Should be the crop_list due to order', 0), 1402186337: (0.0, 'Should be the crop_list due to order', 0), 1402186336: (0.0, 'Should be the crop_list due to order', 0), 1402186335: (0.0, 'Should be the crop_list due to order', 0), 1402186333: (0.0, 'Should be the crop_list due to order', 0), 1402186331: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1402186372, 1402186362, 1402186356, 1402186354, 1402186351, 1402186350, 1402186349, 1402186339, 1402186337, 1402186336, 1402186335, 1402186333, 1402186331] Looping around the photos to save general results len do output : 13 /1402186372.Didn't retrieve data . /1402186362.Didn't retrieve data . /1402186356.Didn't retrieve data . /1402186354.Didn't retrieve data . /1402186351.Didn't retrieve data . /1402186350.Didn't retrieve data . /1402186349.Didn't retrieve data . /1402186339.Didn't retrieve data . /1402186337.Didn't retrieve data . /1402186336.Didn't retrieve data . /1402186335.Didn't retrieve data . /1402186333.Didn't retrieve data . /1402186331.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186372', None, None, None, None, None, '4305111') ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186362', None, None, None, None, None, '4305111') ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186356', None, None, None, None, None, '4305111') ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186354', None, None, None, None, None, '4305111') ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186351', None, None, None, None, None, '4305111') ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186350', None, None, None, None, None, '4305111') ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186349', None, None, None, None, None, '4305111') ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186339', None, None, None, None, None, '4305111') ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186337', None, None, None, None, None, '4305111') ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186336', None, None, None, None, None, '4305111') ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186335', None, None, None, None, None, '4305111') ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186333', None, None, None, None, None, '4305111') ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186331', None, None, None, None, None, '4305111') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 39 time used for this insertion : 0.01604485511779785 save_final save missing photos in datou_result : time spend for datou_step_exec : 79.28834819793701 time spend to save output : 0.017143726348876953 total time spend for step 3 : 79.30549192428589 step4:ventilate_hashtags_in_portfolio Fri Jan 2 20:13:48 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 29904813 get user id for portfolio 29904813 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29904813 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','flou','papier','pet_clair','carton','autre','mal_croppe','background','pehd','environnement','metal')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29904813 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','flou','papier','pet_clair','carton','autre','mal_croppe','background','pehd','environnement','metal')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29904813 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','flou','papier','pet_clair','carton','autre','mal_croppe','background','pehd','environnement','metal')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/29905311,29905312,29905313,29905314,29905315,29905316,29905317,29905318,29905319,29905320,29905321?tags=pet_fonce,flou,papier,pet_clair,carton,autre,mal_croppe,background,pehd,environnement,metal Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1402186372, 1402186362, 1402186356, 1402186354, 1402186351, 1402186350, 1402186349, 1402186339, 1402186337, 1402186336, 1402186335, 1402186333, 1402186331] Looping around the photos to save general results len do output : 1 /29904813. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186372', None, None, None, None, None, '4305111') ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186362', None, None, None, None, None, '4305111') ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186356', None, None, None, None, None, '4305111') ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186354', None, None, None, None, None, '4305111') ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186351', None, None, None, None, None, '4305111') ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186350', None, None, None, None, None, '4305111') ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186349', None, None, None, None, None, '4305111') ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186339', None, None, None, None, None, '4305111') ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186337', None, None, None, None, None, '4305111') ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186336', None, None, None, None, None, '4305111') ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186335', None, None, None, None, None, '4305111') ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186333', None, None, None, None, None, '4305111') ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186331', None, None, None, None, None, '4305111') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 14 time used for this insertion : 0.018468618392944336 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.040628433227539 time spend to save output : 0.018716096878051758 total time spend for step 4 : 2.059344530105591 step5:final Fri Jan 2 20:13:50 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1402186372: ('0.03900583526234568',), 1402186362: ('0.03900583526234568',), 1402186356: ('0.03900583526234568',), 1402186354: ('0.03900583526234568',), 1402186351: ('0.03900583526234568',), 1402186350: ('0.03900583526234568',), 1402186349: ('0.03900583526234568',), 1402186339: ('0.03900583526234568',), 1402186337: ('0.03900583526234568',), 1402186336: ('0.03900583526234568',), 1402186335: ('0.03900583526234568',), 1402186333: ('0.03900583526234568',), 1402186331: ('0.03900583526234568',)} new output for save of step final : {1402186372: ('0.03900583526234568',), 1402186362: ('0.03900583526234568',), 1402186356: ('0.03900583526234568',), 1402186354: ('0.03900583526234568',), 1402186351: ('0.03900583526234568',), 1402186350: ('0.03900583526234568',), 1402186349: ('0.03900583526234568',), 1402186339: ('0.03900583526234568',), 1402186337: ('0.03900583526234568',), 1402186336: ('0.03900583526234568',), 1402186335: ('0.03900583526234568',), 1402186333: ('0.03900583526234568',), 1402186331: ('0.03900583526234568',)} [1402186372, 1402186362, 1402186356, 1402186354, 1402186351, 1402186350, 1402186349, 1402186339, 1402186337, 1402186336, 1402186335, 1402186333, 1402186331] Looping around the photos to save general results len do output : 13 /1402186372.Didn't retrieve data . /1402186362.Didn't retrieve data . /1402186356.Didn't retrieve data . /1402186354.Didn't retrieve data . /1402186351.Didn't retrieve data . /1402186350.Didn't retrieve data . /1402186349.Didn't retrieve data . /1402186339.Didn't retrieve data . /1402186337.Didn't retrieve data . /1402186336.Didn't retrieve data . /1402186335.Didn't retrieve data . /1402186333.Didn't retrieve data . /1402186331.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186372', None, None, None, None, None, '4305111') ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186362', None, None, None, None, None, '4305111') ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186356', None, None, None, None, None, '4305111') ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186354', None, None, None, None, None, '4305111') ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186351', None, None, None, None, None, '4305111') ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186350', None, None, None, None, None, '4305111') ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186349', None, None, None, None, None, '4305111') ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186339', None, None, None, None, None, '4305111') ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186337', None, None, None, None, None, '4305111') ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186336', None, None, None, None, None, '4305111') ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186335', None, None, None, None, None, '4305111') ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186333', None, None, None, None, None, '4305111') ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186331', None, None, None, None, None, '4305111') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 39 time used for this insertion : 0.018954753875732422 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.1398451328277588 time spend to save output : 0.019550323486328125 total time spend for step 5 : 0.15939545631408691 step6:blur_detection Fri Jan 2 20:13:51 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1767381027_2327780_1402186372_aafc3c5748834ac2183bd35c1e98eb5b.jpg resize: (2160, 3840) 1402186372 -6.289162579291545 treat image : temp/1767381027_2327780_1402186362_b2b5d82d72865acfc4203c7b6c3df5a0.jpg resize: (2160, 3840) 1402186362 -7.077562110114963 treat image : temp/1767381027_2327780_1402186356_0d0f051f8fc72e15175988cbdb4ce54a.jpg resize: (2160, 3840) 1402186356 -7.034919021205624 treat image : temp/1767381027_2327780_1402186354_b863a268d96510e9fd1115c3e8671071.jpg resize: (2160, 3840) 1402186354 -7.078398566971845 treat image : temp/1767381027_2327780_1402186351_53f4c5e9a6676296f2223560c60d6dc3.jpg resize: (2160, 3840) 1402186351 -7.017860627981287 treat image : temp/1767381027_2327780_1402186350_a0dc7ca4e9c336bb420e96e5c0e8002c.jpg resize: (2160, 3840) 1402186350 -7.04530093969516 treat image : temp/1767381027_2327780_1402186349_b63fef8ec6a552ae51695a6af6a33882.jpg resize: (2160, 3840) 1402186349 -6.926785589157974 treat image : temp/1767381027_2327780_1402186339_f8a1ede21eea0fa1462aebfd811850d1.jpg resize: (2160, 3840) 1402186339 -6.942881181784024 treat image : temp/1767381027_2327780_1402186337_ead5c6b053e2a145c40f696e678d21fe.jpg resize: (2160, 3840) 1402186337 -6.981170679289628 treat image : temp/1767381027_2327780_1402186336_0356c31a79ea14a0ee66b651b9c3c704.jpg resize: (2160, 3840) 1402186336 -6.930403250540173 treat image : temp/1767381027_2327780_1402186335_55a8ea897d5726678c03e3694097db47.jpg resize: (2160, 3840) 1402186335 -6.921981067742746 treat image : temp/1767381027_2327780_1402186333_4cf977942bc5967ec51a92208c927b42.jpg resize: (2160, 3840) 1402186333 -7.003187353645286 treat image : temp/1767381027_2327780_1402186331_b965eb1374930402e04776e34e39d517.jpg resize: (2160, 3840) 1402186331 -6.837498261783665 treat image : temp/1767381027_2327780_1402186372_aafc3c5748834ac2183bd35c1e98eb5b_rle_crop_4088823814_0.png resize: (157, 144) 1402192367 -3.882782165826109 treat image : temp/1767381027_2327780_1402186362_b2b5d82d72865acfc4203c7b6c3df5a0_rle_crop_4088823822_0.png resize: (315, 374) 1402192368 -4.8656461129615804 treat image : temp/1767381027_2327780_1402186354_b863a268d96510e9fd1115c3e8671071_rle_crop_4088823835_0.png resize: (207, 173) 1402192369 -3.5803739355654227 treat image : temp/1767381027_2327780_1402186351_53f4c5e9a6676296f2223560c60d6dc3_rle_crop_4088823838_0.png resize: (293, 590) 1402192371 -4.100321701908242 treat image : temp/1767381027_2327780_1402186350_a0dc7ca4e9c336bb420e96e5c0e8002c_rle_crop_4088823842_0.png resize: (236, 266) 1402192372 -5.0177440744300315 treat image : temp/1767381027_2327780_1402186349_b63fef8ec6a552ae51695a6af6a33882_rle_crop_4088823846_0.png resize: (400, 385) 1402192373 -5.036606645327283 treat image : temp/1767381027_2327780_1402186349_b63fef8ec6a552ae51695a6af6a33882_rle_crop_4088823847_0.png resize: (196, 161) 1402192375 -4.308737302786147 treat image : temp/1767381027_2327780_1402186349_b63fef8ec6a552ae51695a6af6a33882_rle_crop_4088823848_0.png resize: (252, 200) 1402192376 -4.799733037436132 treat image : temp/1767381027_2327780_1402186349_b63fef8ec6a552ae51695a6af6a33882_rle_crop_4088823853_0.png resize: (302, 211) 1402192377 -3.701837418927523 treat image : temp/1767381027_2327780_1402186339_f8a1ede21eea0fa1462aebfd811850d1_rle_crop_4088823854_0.png resize: (307, 337) 1402192379 -4.598335231317477 treat image : temp/1767381027_2327780_1402186339_f8a1ede21eea0fa1462aebfd811850d1_rle_crop_4088823856_0.png resize: (1010, 602) 1402192380 -4.7312441672798355 treat image : temp/1767381027_2327780_1402186339_f8a1ede21eea0fa1462aebfd811850d1_rle_crop_4088823857_0.png resize: (306, 396) 1402192381 -4.7700584265517625 treat image : temp/1767381027_2327780_1402186337_ead5c6b053e2a145c40f696e678d21fe_rle_crop_4088823859_0.png resize: (191, 362) 1402192383 -5.034917890308421 treat image : temp/1767381027_2327780_1402186336_0356c31a79ea14a0ee66b651b9c3c704_rle_crop_4088823861_0.png resize: (125, 256) 1402192384 -4.147240371715422 treat image : temp/1767381027_2327780_1402186336_0356c31a79ea14a0ee66b651b9c3c704_rle_crop_4088823863_0.png resize: (267, 339) 1402192385 -3.9789745393761216 treat image : temp/1767381027_2327780_1402186335_55a8ea897d5726678c03e3694097db47_rle_crop_4088823867_0.png resize: (275, 360) 1402192387 -4.1837459642078905 treat image : temp/1767381027_2327780_1402186335_55a8ea897d5726678c03e3694097db47_rle_crop_4088823869_0.png resize: (336, 179) 1402192388 -4.856919212870202 treat image : temp/1767381027_2327780_1402186333_4cf977942bc5967ec51a92208c927b42_rle_crop_4088823877_0.png resize: (162, 153) 1402192389 -4.1892809330007745 treat image : temp/1767381027_2327780_1402186331_b965eb1374930402e04776e34e39d517_rle_crop_4088823878_0.png resize: (378, 774) 1402192391 -5.364175657731036 treat image : temp/1767381027_2327780_1402186331_b965eb1374930402e04776e34e39d517_rle_crop_4088823881_0.png resize: (462, 225) 1402192392 -4.29791658118828 treat image : temp/1767381027_2327780_1402186362_b2b5d82d72865acfc4203c7b6c3df5a0_rle_crop_4088823817_0.png resize: (451, 193) 1402192442 -4.183399304218058 treat image : temp/1767381027_2327780_1402186362_b2b5d82d72865acfc4203c7b6c3df5a0_rle_crop_4088823818_0.png resize: (296, 375) 1402192443 -4.800679871031712 treat image : temp/1767381027_2327780_1402186362_b2b5d82d72865acfc4203c7b6c3df5a0_rle_crop_4088823819_0.png resize: (152, 310) 1402192444 -4.192275192511306 treat image : temp/1767381027_2327780_1402186362_b2b5d82d72865acfc4203c7b6c3df5a0_rle_crop_4088823820_0.png resize: (185, 141) 1402192445 -4.149762311118238 treat image : temp/1767381027_2327780_1402186362_b2b5d82d72865acfc4203c7b6c3df5a0_rle_crop_4088823821_0.png resize: (182, 156) 1402192446 -4.038108300857091 treat image : temp/1767381027_2327780_1402186362_b2b5d82d72865acfc4203c7b6c3df5a0_rle_crop_4088823823_0.png resize: (229, 160) 1402192447 -3.288525879215352 treat image : temp/1767381027_2327780_1402186356_0d0f051f8fc72e15175988cbdb4ce54a_rle_crop_4088823825_0.png resize: (297, 361) 1402192448 -5.0409820317161325 treat image : temp/1767381027_2327780_1402186356_0d0f051f8fc72e15175988cbdb4ce54a_rle_crop_4088823826_0.png resize: (245, 87) 1402192449 -4.023572254057829 treat image : temp/1767381027_2327780_1402186356_0d0f051f8fc72e15175988cbdb4ce54a_rle_crop_4088823829_0.png resize: (133, 170) 1402192450 -4.629996787844534 treat image : temp/1767381027_2327780_1402186356_0d0f051f8fc72e15175988cbdb4ce54a_rle_crop_4088823831_0.png resize: (154, 195) 1402192451 -1.3002526222489388 treat image : temp/1767381027_2327780_1402186351_53f4c5e9a6676296f2223560c60d6dc3_rle_crop_4088823839_0.png resize: (256, 276) 1402192452 -3.9733202727480132 treat image : temp/1767381027_2327780_1402186350_a0dc7ca4e9c336bb420e96e5c0e8002c_rle_crop_4088823840_0.png resize: (199, 116) 1402192453 -2.38223406926531 treat image : temp/1767381027_2327780_1402186349_b63fef8ec6a552ae51695a6af6a33882_rle_crop_4088823851_0.png resize: (405, 466) 1402192454 -2.788865461749181 treat image : temp/1767381027_2327780_1402186337_ead5c6b053e2a145c40f696e678d21fe_rle_crop_4088823858_0.png resize: (457, 441) 1402192455 -3.5699679840815444 treat image : temp/1767381027_2327780_1402186335_55a8ea897d5726678c03e3694097db47_rle_crop_4088823866_0.png resize: (249, 217) 1402192456 -3.3452438255650385 treat image : temp/1767381027_2327780_1402186333_4cf977942bc5967ec51a92208c927b42_rle_crop_4088823873_0.png resize: (249, 279) 1402192457 -3.479001106559221 treat image : temp/1767381027_2327780_1402186333_4cf977942bc5967ec51a92208c927b42_rle_crop_4088823875_0.png resize: (199, 285) 1402192458 -3.823072021506013 treat image : temp/1767381027_2327780_1402186333_4cf977942bc5967ec51a92208c927b42_rle_crop_4088823876_0.png resize: (255, 318) 1402192459 -4.712976265849556 treat image : temp/1767381027_2327780_1402186331_b965eb1374930402e04776e34e39d517_rle_crop_4088823879_0.png resize: (252, 223) 1402192460 -3.1778443660691704 treat image : temp/1767381027_2327780_1402186331_b965eb1374930402e04776e34e39d517_rle_crop_4088823880_0.png resize: (134, 284) 1402192461 -3.0104400244022487 treat image : temp/1767381027_2327780_1402186331_b965eb1374930402e04776e34e39d517_rle_crop_4088823882_0.png resize: (165, 358) 1402192462 -4.6318952862536165 treat image : temp/1767381027_2327780_1402186372_aafc3c5748834ac2183bd35c1e98eb5b_rle_crop_4088823816_0.png resize: (141, 228) 1402192464 -4.900517617446293 treat image : temp/1767381027_2327780_1402186372_aafc3c5748834ac2183bd35c1e98eb5b_rle_crop_4088823813_0.png resize: (301, 478) 1402192471 -5.309167184276782 treat image : temp/1767381027_2327780_1402186372_aafc3c5748834ac2183bd35c1e98eb5b_rle_crop_4088823815_0.png resize: (264, 242) 1402192472 -3.6115528599413014 treat image : temp/1767381027_2327780_1402186362_b2b5d82d72865acfc4203c7b6c3df5a0_rle_crop_4088823824_0.png resize: (423, 288) 1402192473 -6.302215533483188 treat image : temp/1767381027_2327780_1402186356_0d0f051f8fc72e15175988cbdb4ce54a_rle_crop_4088823827_0.png resize: (130, 262) 1402192474 -3.937007049176276 treat image : temp/1767381027_2327780_1402186356_0d0f051f8fc72e15175988cbdb4ce54a_rle_crop_4088823828_0.png resize: (256, 234) 1402192475 -4.683013389686956 treat image : temp/1767381027_2327780_1402186356_0d0f051f8fc72e15175988cbdb4ce54a_rle_crop_4088823830_0.png resize: (373, 217) 1402192476 -6.235552784186245 treat image : temp/1767381027_2327780_1402186354_b863a268d96510e9fd1115c3e8671071_rle_crop_4088823833_0.png resize: (184, 199) 1402192477 -3.5733929736152534 treat image : temp/1767381027_2327780_1402186354_b863a268d96510e9fd1115c3e8671071_rle_crop_4088823834_0.png resize: (402, 378) 1402192478 -5.275454706722921 treat image : temp/1767381027_2327780_1402186354_b863a268d96510e9fd1115c3e8671071_rle_crop_4088823837_0.png resize: (213, 175) 1402192479 -3.775305028516872 treat image : temp/1767381027_2327780_1402186350_a0dc7ca4e9c336bb420e96e5c0e8002c_rle_crop_4088823841_0.png resize: (291, 285) 1402192480 -4.928062946108742 treat image : temp/1767381027_2327780_1402186349_b63fef8ec6a552ae51695a6af6a33882_rle_crop_4088823844_0.png resize: (274, 282) 1402192481 -3.9387653631690434 treat image : temp/1767381027_2327780_1402186349_b63fef8ec6a552ae51695a6af6a33882_rle_crop_4088823845_0.png resize: (303, 351) 1402192482 -4.5299205929712745 treat image : temp/1767381027_2327780_1402186349_b63fef8ec6a552ae51695a6af6a33882_rle_crop_4088823849_0.png resize: (141, 179) 1402192483 -3.636849194471626 treat image : temp/1767381027_2327780_1402186349_b63fef8ec6a552ae51695a6af6a33882_rle_crop_4088823850_0.png resize: (176, 131) 1402192484 -3.9646312167999813 treat image : temp/1767381027_2327780_1402186339_f8a1ede21eea0fa1462aebfd811850d1_rle_crop_4088823855_0.png resize: (161, 198) 1402192485 -4.918423239075308 treat image : temp/1767381027_2327780_1402186337_ead5c6b053e2a145c40f696e678d21fe_rle_crop_4088823860_0.png resize: (188, 186) 1402192486 -4.1547055111931614 treat image : temp/1767381027_2327780_1402186336_0356c31a79ea14a0ee66b651b9c3c704_rle_crop_4088823862_0.png resize: (204, 280) 1402192487 -4.932356546652842 treat image : temp/1767381027_2327780_1402186336_0356c31a79ea14a0ee66b651b9c3c704_rle_crop_4088823864_0.png resize: (363, 265) 1402192488 -5.0697594171643585 treat image : temp/1767381027_2327780_1402186335_55a8ea897d5726678c03e3694097db47_rle_crop_4088823868_0.png resize: (177, 210) 1402192489 -4.9052756275803295 treat image : temp/1767381027_2327780_1402186335_55a8ea897d5726678c03e3694097db47_rle_crop_4088823870_0.png resize: (445, 370) 1402192490 -5.2489015812958755 treat image : temp/1767381027_2327780_1402186335_55a8ea897d5726678c03e3694097db47_rle_crop_4088823871_0.png resize: (587, 459) 1402192491 -5.029289108946466 treat image : temp/1767381027_2327780_1402186335_55a8ea897d5726678c03e3694097db47_rle_crop_4088823872_0.png resize: (110, 182) 1402192492 -4.424683188756941 treat image : temp/1767381027_2327780_1402186333_4cf977942bc5967ec51a92208c927b42_rle_crop_4088823874_0.png resize: (407, 355) 1402192493 -5.293572125622855 treat image : temp/1767381027_2327780_1402186354_b863a268d96510e9fd1115c3e8671071_rle_crop_4088823836_0.png resize: (181, 479) 1402192497 -3.6726044183471966 treat image : temp/1767381027_2327780_1402186350_a0dc7ca4e9c336bb420e96e5c0e8002c_rle_crop_4088823843_0.png resize: (257, 184) 1402192498 -6.154981955601563 treat image : temp/1767381027_2327780_1402186349_b63fef8ec6a552ae51695a6af6a33882_rle_crop_4088823852_0.png resize: (578, 443) 1402192499 -5.394886230694703 treat image : temp/1767381027_2327780_1402186356_0d0f051f8fc72e15175988cbdb4ce54a_rle_crop_4088823832_0.png resize: (201, 255) 1402192502 -4.699291628098532 treat image : temp/1767381027_2327780_1402186336_0356c31a79ea14a0ee66b651b9c3c704_rle_crop_4088823865_0.png resize: (582, 372) 1402192503 -6.054266948607146 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 83 time used for this insertion : 0.015364408493041992 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 83 time used for this insertion : 0.02085709571838379 save missing photos in datou_result : time spend for datou_step_exec : 53.43865728378296 time spend to save output : 0.042638540267944336 total time spend for step 6 : 53.4812958240509 step7:brightness Fri Jan 2 20:14:44 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1767381027_2327780_1402186372_aafc3c5748834ac2183bd35c1e98eb5b.jpg treat image : temp/1767381027_2327780_1402186362_b2b5d82d72865acfc4203c7b6c3df5a0.jpg treat image : temp/1767381027_2327780_1402186356_0d0f051f8fc72e15175988cbdb4ce54a.jpg treat image : temp/1767381027_2327780_1402186354_b863a268d96510e9fd1115c3e8671071.jpg treat image : temp/1767381027_2327780_1402186351_53f4c5e9a6676296f2223560c60d6dc3.jpg treat image : temp/1767381027_2327780_1402186350_a0dc7ca4e9c336bb420e96e5c0e8002c.jpg treat image : temp/1767381027_2327780_1402186349_b63fef8ec6a552ae51695a6af6a33882.jpg treat image : temp/1767381027_2327780_1402186339_f8a1ede21eea0fa1462aebfd811850d1.jpg treat image : temp/1767381027_2327780_1402186337_ead5c6b053e2a145c40f696e678d21fe.jpg treat image : temp/1767381027_2327780_1402186336_0356c31a79ea14a0ee66b651b9c3c704.jpg treat image : temp/1767381027_2327780_1402186335_55a8ea897d5726678c03e3694097db47.jpg treat image : temp/1767381027_2327780_1402186333_4cf977942bc5967ec51a92208c927b42.jpg treat image : temp/1767381027_2327780_1402186331_b965eb1374930402e04776e34e39d517.jpg treat image : temp/1767381027_2327780_1402186372_aafc3c5748834ac2183bd35c1e98eb5b_rle_crop_4088823814_0.png treat image : temp/1767381027_2327780_1402186362_b2b5d82d72865acfc4203c7b6c3df5a0_rle_crop_4088823822_0.png treat image : temp/1767381027_2327780_1402186354_b863a268d96510e9fd1115c3e8671071_rle_crop_4088823835_0.png treat image : temp/1767381027_2327780_1402186351_53f4c5e9a6676296f2223560c60d6dc3_rle_crop_4088823838_0.png treat image : temp/1767381027_2327780_1402186350_a0dc7ca4e9c336bb420e96e5c0e8002c_rle_crop_4088823842_0.png treat image : temp/1767381027_2327780_1402186349_b63fef8ec6a552ae51695a6af6a33882_rle_crop_4088823846_0.png treat image : temp/1767381027_2327780_1402186349_b63fef8ec6a552ae51695a6af6a33882_rle_crop_4088823847_0.png treat image : temp/1767381027_2327780_1402186349_b63fef8ec6a552ae51695a6af6a33882_rle_crop_4088823848_0.png treat image : temp/1767381027_2327780_1402186349_b63fef8ec6a552ae51695a6af6a33882_rle_crop_4088823853_0.png treat image : temp/1767381027_2327780_1402186339_f8a1ede21eea0fa1462aebfd811850d1_rle_crop_4088823854_0.png treat image : temp/1767381027_2327780_1402186339_f8a1ede21eea0fa1462aebfd811850d1_rle_crop_4088823856_0.png treat image : temp/1767381027_2327780_1402186339_f8a1ede21eea0fa1462aebfd811850d1_rle_crop_4088823857_0.png treat image : temp/1767381027_2327780_1402186337_ead5c6b053e2a145c40f696e678d21fe_rle_crop_4088823859_0.png treat image : temp/1767381027_2327780_1402186336_0356c31a79ea14a0ee66b651b9c3c704_rle_crop_4088823861_0.png treat image : temp/1767381027_2327780_1402186336_0356c31a79ea14a0ee66b651b9c3c704_rle_crop_4088823863_0.png treat image : temp/1767381027_2327780_1402186335_55a8ea897d5726678c03e3694097db47_rle_crop_4088823867_0.png treat image : temp/1767381027_2327780_1402186335_55a8ea897d5726678c03e3694097db47_rle_crop_4088823869_0.png treat image : temp/1767381027_2327780_1402186333_4cf977942bc5967ec51a92208c927b42_rle_crop_4088823877_0.png treat image : temp/1767381027_2327780_1402186331_b965eb1374930402e04776e34e39d517_rle_crop_4088823878_0.png treat image : temp/1767381027_2327780_1402186331_b965eb1374930402e04776e34e39d517_rle_crop_4088823881_0.png treat image : temp/1767381027_2327780_1402186362_b2b5d82d72865acfc4203c7b6c3df5a0_rle_crop_4088823817_0.png treat image : temp/1767381027_2327780_1402186362_b2b5d82d72865acfc4203c7b6c3df5a0_rle_crop_4088823818_0.png treat image : temp/1767381027_2327780_1402186362_b2b5d82d72865acfc4203c7b6c3df5a0_rle_crop_4088823819_0.png treat image : temp/1767381027_2327780_1402186362_b2b5d82d72865acfc4203c7b6c3df5a0_rle_crop_4088823820_0.png treat image : temp/1767381027_2327780_1402186362_b2b5d82d72865acfc4203c7b6c3df5a0_rle_crop_4088823821_0.png treat image : temp/1767381027_2327780_1402186362_b2b5d82d72865acfc4203c7b6c3df5a0_rle_crop_4088823823_0.png treat image : temp/1767381027_2327780_1402186356_0d0f051f8fc72e15175988cbdb4ce54a_rle_crop_4088823825_0.png treat image : temp/1767381027_2327780_1402186356_0d0f051f8fc72e15175988cbdb4ce54a_rle_crop_4088823826_0.png treat image : temp/1767381027_2327780_1402186356_0d0f051f8fc72e15175988cbdb4ce54a_rle_crop_4088823829_0.png treat image : temp/1767381027_2327780_1402186356_0d0f051f8fc72e15175988cbdb4ce54a_rle_crop_4088823831_0.png treat image : temp/1767381027_2327780_1402186351_53f4c5e9a6676296f2223560c60d6dc3_rle_crop_4088823839_0.png treat image : temp/1767381027_2327780_1402186350_a0dc7ca4e9c336bb420e96e5c0e8002c_rle_crop_4088823840_0.png treat image : temp/1767381027_2327780_1402186349_b63fef8ec6a552ae51695a6af6a33882_rle_crop_4088823851_0.png treat image : temp/1767381027_2327780_1402186337_ead5c6b053e2a145c40f696e678d21fe_rle_crop_4088823858_0.png treat image : temp/1767381027_2327780_1402186335_55a8ea897d5726678c03e3694097db47_rle_crop_4088823866_0.png treat image : temp/1767381027_2327780_1402186333_4cf977942bc5967ec51a92208c927b42_rle_crop_4088823873_0.png treat image : temp/1767381027_2327780_1402186333_4cf977942bc5967ec51a92208c927b42_rle_crop_4088823875_0.png treat image : temp/1767381027_2327780_1402186333_4cf977942bc5967ec51a92208c927b42_rle_crop_4088823876_0.png treat image : temp/1767381027_2327780_1402186331_b965eb1374930402e04776e34e39d517_rle_crop_4088823879_0.png treat image : temp/1767381027_2327780_1402186331_b965eb1374930402e04776e34e39d517_rle_crop_4088823880_0.png treat image : temp/1767381027_2327780_1402186331_b965eb1374930402e04776e34e39d517_rle_crop_4088823882_0.png treat image : temp/1767381027_2327780_1402186372_aafc3c5748834ac2183bd35c1e98eb5b_rle_crop_4088823816_0.png treat image : temp/1767381027_2327780_1402186372_aafc3c5748834ac2183bd35c1e98eb5b_rle_crop_4088823813_0.png treat image : temp/1767381027_2327780_1402186372_aafc3c5748834ac2183bd35c1e98eb5b_rle_crop_4088823815_0.png treat image : temp/1767381027_2327780_1402186362_b2b5d82d72865acfc4203c7b6c3df5a0_rle_crop_4088823824_0.png treat image : temp/1767381027_2327780_1402186356_0d0f051f8fc72e15175988cbdb4ce54a_rle_crop_4088823827_0.png treat image : temp/1767381027_2327780_1402186356_0d0f051f8fc72e15175988cbdb4ce54a_rle_crop_4088823828_0.png treat image : temp/1767381027_2327780_1402186356_0d0f051f8fc72e15175988cbdb4ce54a_rle_crop_4088823830_0.png treat image : temp/1767381027_2327780_1402186354_b863a268d96510e9fd1115c3e8671071_rle_crop_4088823833_0.png treat image : temp/1767381027_2327780_1402186354_b863a268d96510e9fd1115c3e8671071_rle_crop_4088823834_0.png treat image : temp/1767381027_2327780_1402186354_b863a268d96510e9fd1115c3e8671071_rle_crop_4088823837_0.png treat image : temp/1767381027_2327780_1402186350_a0dc7ca4e9c336bb420e96e5c0e8002c_rle_crop_4088823841_0.png treat image : temp/1767381027_2327780_1402186349_b63fef8ec6a552ae51695a6af6a33882_rle_crop_4088823844_0.png treat image : temp/1767381027_2327780_1402186349_b63fef8ec6a552ae51695a6af6a33882_rle_crop_4088823845_0.png treat image : temp/1767381027_2327780_1402186349_b63fef8ec6a552ae51695a6af6a33882_rle_crop_4088823849_0.png treat image : temp/1767381027_2327780_1402186349_b63fef8ec6a552ae51695a6af6a33882_rle_crop_4088823850_0.png treat image : temp/1767381027_2327780_1402186339_f8a1ede21eea0fa1462aebfd811850d1_rle_crop_4088823855_0.png treat image : temp/1767381027_2327780_1402186337_ead5c6b053e2a145c40f696e678d21fe_rle_crop_4088823860_0.png treat image : temp/1767381027_2327780_1402186336_0356c31a79ea14a0ee66b651b9c3c704_rle_crop_4088823862_0.png treat image : temp/1767381027_2327780_1402186336_0356c31a79ea14a0ee66b651b9c3c704_rle_crop_4088823864_0.png treat image : temp/1767381027_2327780_1402186335_55a8ea897d5726678c03e3694097db47_rle_crop_4088823868_0.png treat image : temp/1767381027_2327780_1402186335_55a8ea897d5726678c03e3694097db47_rle_crop_4088823870_0.png treat image : temp/1767381027_2327780_1402186335_55a8ea897d5726678c03e3694097db47_rle_crop_4088823871_0.png treat image : temp/1767381027_2327780_1402186335_55a8ea897d5726678c03e3694097db47_rle_crop_4088823872_0.png treat image : temp/1767381027_2327780_1402186333_4cf977942bc5967ec51a92208c927b42_rle_crop_4088823874_0.png treat image : temp/1767381027_2327780_1402186354_b863a268d96510e9fd1115c3e8671071_rle_crop_4088823836_0.png treat image : temp/1767381027_2327780_1402186350_a0dc7ca4e9c336bb420e96e5c0e8002c_rle_crop_4088823843_0.png treat image : temp/1767381027_2327780_1402186349_b63fef8ec6a552ae51695a6af6a33882_rle_crop_4088823852_0.png treat image : temp/1767381027_2327780_1402186356_0d0f051f8fc72e15175988cbdb4ce54a_rle_crop_4088823832_0.png treat image : temp/1767381027_2327780_1402186336_0356c31a79ea14a0ee66b651b9c3c704_rle_crop_4088823865_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 83 time used for this insertion : 0.018212080001831055 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 83 time used for this insertion : 0.017715930938720703 save missing photos in datou_result : time spend for datou_step_exec : 12.664226293563843 time spend to save output : 0.04177975654602051 total time spend for step 7 : 12.706006050109863 step8:velours_tree Fri Jan 2 20:14:57 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.15626811981201172 time spend to save output : 4.100799560546875e-05 total time spend for step 8 : 0.1563091278076172 step9:send_mail_cod Fri Jan 2 20:14:57 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P29904813_02-01-2026_20_14_57.pdf 29905311 change filename to text .change filename to text .imagette299053111767381297 29905312 imagette299053121767381297 29905313 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette299053131767381297 29905314 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette299053141767381299 29905315 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette299053151767381301 29905316 change filename to text .change filename to text .change filename to text .imagette299053161767381303 29905317 imagette299053171767381303 29905318 imagette299053181767381303 29905319 imagette299053191767381303 29905321 change filename to text .imagette299053211767381303 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=29904813 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/29905311,29905312,29905313,29905314,29905315,29905316,29905317,29905318,29905319,29905320,29905321?tags=pet_fonce,flou,papier,pet_clair,carton,autre,mal_croppe,background,pehd,environnement,metal your option no_mail is active, we will not send the real mail to your client args[1402186372] : ((1402186372, -6.289162579291545, 492609224), (1402186372, -0.57322436055235, 501862349), '0.03900583526234568') We are sending mail with results at report@fotonower.com args[1402186362] : ((1402186362, -7.077562110114963, 492609224), (1402186362, -0.42533573570389754, 496442774), '0.03900583526234568') We are sending mail with results at report@fotonower.com args[1402186356] : ((1402186356, -7.034919021205624, 492609224), (1402186356, -0.4016797546583775, 496442774), '0.03900583526234568') We are sending mail with results at report@fotonower.com args[1402186354] : ((1402186354, -7.078398566971845, 492609224), (1402186354, -0.3405088035767261, 496442774), '0.03900583526234568') We are sending mail with results at report@fotonower.com args[1402186351] : ((1402186351, -7.017860627981287, 492609224), (1402186351, -0.15938808393974616, 496442774), '0.03900583526234568') We are sending mail with results at report@fotonower.com args[1402186350] : ((1402186350, -7.04530093969516, 492609224), (1402186350, -0.3283584177234962, 496442774), '0.03900583526234568') We are sending mail with results at report@fotonower.com args[1402186349] : ((1402186349, -6.926785589157974, 492609224), (1402186349, -0.2653509582161395, 496442774), '0.03900583526234568') We are sending mail with results at report@fotonower.com args[1402186339] : ((1402186339, -6.942881181784024, 492609224), (1402186339, -0.3028434662874712, 496442774), '0.03900583526234568') We are sending mail with results at report@fotonower.com args[1402186337] : ((1402186337, -6.981170679289628, 492609224), (1402186337, -0.35591257192142256, 496442774), '0.03900583526234568') We are sending mail with results at report@fotonower.com args[1402186336] : ((1402186336, -6.930403250540173, 492609224), (1402186336, -0.3659863654466463, 496442774), '0.03900583526234568') We are sending mail with results at report@fotonower.com args[1402186335] : ((1402186335, -6.921981067742746, 492609224), (1402186335, -0.2682536787685404, 496442774), '0.03900583526234568') We are sending mail with results at report@fotonower.com args[1402186333] : ((1402186333, -7.003187353645286, 492609224), (1402186333, -0.18864988199550345, 496442774), '0.03900583526234568') We are sending mail with results at report@fotonower.com args[1402186331] : ((1402186331, -6.837498261783665, 492609224), (1402186331, -0.35057342977481964, 496442774), '0.03900583526234568') We are sending mail with results at report@fotonower.com refus_total : 0.03900583526234568 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos_view ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=29904813 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29904813_02-01-2026_20_14_57.pdf results_Auto_P29904813_02-01-2026_20_14_57.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29904813_02-01-2026_20_14_57.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','29904813','results_Auto_P29904813_02-01-2026_20_14_57.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29904813_02-01-2026_20_14_57.pdf','pdf','','0.96','0.03900583526234568') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1402186372, 1402186362, 1402186356, 1402186354, 1402186351, 1402186350, 1402186349, 1402186339, 1402186337, 1402186336, 1402186335, 1402186333, 1402186331] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186372', None, None, None, None, None, '4305111') ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186362', None, None, None, None, None, '4305111') ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186356', None, None, None, None, None, '4305111') ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186354', None, None, None, None, None, '4305111') ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186351', None, None, None, None, None, '4305111') ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186350', None, None, None, None, None, '4305111') ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186349', None, None, None, None, None, '4305111') ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186339', None, None, None, None, None, '4305111') ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186337', None, None, None, None, None, '4305111') ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186336', None, None, None, None, None, '4305111') ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186335', None, None, None, None, None, '4305111') ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186333', None, None, None, None, None, '4305111') ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186331', None, None, None, None, None, '4305111') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 13 time used for this insertion : 0.014984846115112305 save_final save missing photos in datou_result : time spend for datou_step_exec : 11.423144340515137 time spend to save output : 0.015276193618774414 total time spend for step 9 : 11.438420534133911 step10:split_time_score Fri Jan 2 20:15:08 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('19', 13),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 02012026 29904813 Nombre de photos uploadées : 13 / 23040 (0%) 02012026 29904813 Nombre de photos taguées (types de déchets): 0 / 13 (0%) 02012026 29904813 Nombre de photos taguées (volume) : 0 / 13 (0%) elapsed_time : load_data_split_time_score 1.9073486328125e-06 elapsed_time : order_list_meta_photo_and_scores 5.245208740234375e-06 ????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0006728172302246094 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.25099897384643555 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.028380829739964537 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29886568_02-01-2026_11_53_07.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 29886568 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29886568 AND mptpi.`type`=3726 To do Qualite : 0.03069943950566814 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29895099_02-01-2026_15_50_15.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 29895099 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29895099 AND mptpi.`type`=3726 To do Qualite : 0.016865578859953427 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29889697_02-01-2026_13_05_05.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 29889697 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29889697 AND mptpi.`type`=3726 To do Qualite : 0.019441080170854007 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29892672_02-01-2026_14_47_42.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 29892672 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29892672 AND mptpi.`type`=3726 To do Qualite : 0.1360823314219149 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29900363_02-01-2026_18_08_30.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 29900363 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29900363 AND mptpi.`type`=3726 To do Qualite : 0.028642311581048387 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29901777_02-01-2026_18_52_52.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 29901777 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29901777 AND mptpi.`type`=3726 To do Qualite : 0.03900583526234568 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P29904813_02-01-2026_20_14_57.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 29904813 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29904813 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'02012026': {'nb_upload': 13, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1402186372, 1402186362, 1402186356, 1402186354, 1402186351, 1402186350, 1402186349, 1402186339, 1402186337, 1402186336, 1402186335, 1402186333, 1402186331] Looping around the photos to save general results len do output : 1 /29904813Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186372', None, None, None, None, None, '4305111') ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186362', None, None, None, None, None, '4305111') ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186356', None, None, None, None, None, '4305111') ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186354', None, None, None, None, None, '4305111') ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186351', None, None, None, None, None, '4305111') ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186350', None, None, None, None, None, '4305111') ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186349', None, None, None, None, None, '4305111') ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186339', None, None, None, None, None, '4305111') ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186337', None, None, None, None, None, '4305111') ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186336', None, None, None, None, None, '4305111') ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186335', None, None, None, None, None, '4305111') ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186333', None, None, None, None, None, '4305111') ('3318', None, None, None, None, None, None, None, '4305111') ('3318', '29904813', '1402186331', None, None, None, None, None, '4305111') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 14 time used for this insertion : 0.016980409622192383 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.9887027740478516 time spend to save output : 0.017215251922607422 total time spend for step 10 : 1.005918025970459 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 13 set_done_treatment 120.82user 132.04system 4:44.88elapsed 88%CPU (0avgtext+0avgdata 4812440maxresident)k 677784inputs+126048outputs (6297major+11344583minor)pagefaults 0swaps