python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3092298 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['4328919'] with mtr_portfolio_ids : ['30090237'] and first list_photo_ids : [] new path : /proc/3092298/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 10 ; length of list_pids : 10 ; length of list_args : 10 time to download the photos : 1.7220427989959717 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Mon Jan 12 10:10:31 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10826 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2026-01-12 10:10:34.708896: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2026-01-12 10:10:34.734456: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493010000 Hz 2026-01-12 10:10:34.736071: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7efbd0000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2026-01-12 10:10:34.736089: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2026-01-12 10:10:34.739164: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2026-01-12 10:10:34.967737: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x1d2120a0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2026-01-12 10:10:34.967784: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2026-01-12 10:10:34.968763: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2026-01-12 10:10:34.969049: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2026-01-12 10:10:34.971282: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2026-01-12 10:10:34.974058: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2026-01-12 10:10:34.974426: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2026-01-12 10:10:34.977918: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2026-01-12 10:10:34.979352: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2026-01-12 10:10:34.985699: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2026-01-12 10:10:34.987170: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2026-01-12 10:10:34.987248: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2026-01-12 10:10:34.988016: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2026-01-12 10:10:34.988031: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2026-01-12 10:10:34.988040: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2026-01-12 10:10:34.989665: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10034 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2026-01-12 10:10:35.270658: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2026-01-12 10:10:35.270767: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2026-01-12 10:10:35.270783: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2026-01-12 10:10:35.270797: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2026-01-12 10:10:35.270811: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2026-01-12 10:10:35.270823: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2026-01-12 10:10:35.270836: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2026-01-12 10:10:35.270850: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2026-01-12 10:10:35.272015: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2026-01-12 10:10:35.273095: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2026-01-12 10:10:35.273122: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2026-01-12 10:10:35.273136: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2026-01-12 10:10:35.273148: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2026-01-12 10:10:35.273160: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2026-01-12 10:10:35.273172: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2026-01-12 10:10:35.273184: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2026-01-12 10:10:35.273196: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2026-01-12 10:10:35.274372: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2026-01-12 10:10:35.274406: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2026-01-12 10:10:35.274414: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2026-01-12 10:10:35.274421: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2026-01-12 10:10:35.275619: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10034 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2026-01-12 10:10:46.252735: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2026-01-12 10:10:46.406531: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 10 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 25 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 33 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 27 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 21 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 17 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 24 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 20 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 16 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 27 Detection mask done ! Trying to reset tf kernel 3092834 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5537 tf kernel not reseted sub process len(results) : 10 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 10 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10826 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] DEBUG bbox = [1746, 2544, 2022, 2724] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0010097026824951172 nb_pixel_total : 24534 time to create 1 rle with old method : 0.026006221771240234 length of segment : 255 DEBUG bbox = [246, 1992, 402, 2220] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003261566162109375 nb_pixel_total : 13735 time to create 1 rle with old method : 0.015568256378173828 length of segment : 128 DEBUG bbox = [1230, 1350, 1650, 1662] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001859903335571289 nb_pixel_total : 88383 time to create 1 rle with old method : 0.09294605255126953 length of segment : 383 DEBUG bbox = [804, 1320, 1626, 2208] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.01727008819580078 nb_pixel_total : 348960 time to create 1 rle with new method : 0.03396749496459961 length of segment : 1163 DEBUG bbox = [1512, 2010, 1890, 2286] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0011086463928222656 nb_pixel_total : 55863 time to create 1 rle with old method : 0.0618290901184082 length of segment : 324 DEBUG bbox = [594, 2328, 714, 2514] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00024580955505371094 nb_pixel_total : 13600 time to create 1 rle with old method : 0.015032768249511719 length of segment : 101 DEBUG bbox = [18, 1182, 144, 1410] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00028824806213378906 nb_pixel_total : 22429 time to create 1 rle with old method : 0.02485513687133789 length of segment : 126 DEBUG bbox = [888, 1626, 1314, 1950] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0011625289916992188 nb_pixel_total : 55910 time to create 1 rle with old method : 0.060536861419677734 length of segment : 457 DEBUG bbox = [1728, 576, 2142, 918] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001321554183959961 nb_pixel_total : 76676 time to create 1 rle with old method : 0.08359050750732422 length of segment : 387 DEBUG bbox = [558, 1938, 864, 2304] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009083747863769531 nb_pixel_total : 46942 time to create 1 rle with old method : 0.0519559383392334 length of segment : 266 DEBUG bbox = [342, 2304, 600, 2652] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006973743438720703 nb_pixel_total : 44127 time to create 1 rle with old method : 0.04727625846862793 length of segment : 229 DEBUG bbox = [0, 174, 186, 300] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0002491474151611328 nb_pixel_total : 14652 time to create 1 rle with old method : 0.0160369873046875 length of segment : 201 DEBUG bbox = [204, 1362, 828, 2082] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0035741329193115234 nb_pixel_total : 263467 time to create 1 rle with new method : 0.013437032699584961 length of segment : 609 DEBUG bbox = [1422, 1380, 2028, 2202] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.005719184875488281 nb_pixel_total : 203715 time to create 1 rle with new method : 0.019264698028564453 length of segment : 576 DEBUG bbox = [1344, 432, 1536, 558] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003020763397216797 nb_pixel_total : 17790 time to create 1 rle with old method : 0.01900172233581543 length of segment : 175 DEBUG bbox = [1776, 576, 2160, 936] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0016627311706542969 nb_pixel_total : 90493 time to create 1 rle with old method : 0.09410643577575684 length of segment : 368 DEBUG bbox = [966, 2922, 1170, 3072] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003407001495361328 nb_pixel_total : 14833 time to create 1 rle with old method : 0.015998125076293945 length of segment : 178 DEBUG bbox = [936, 450, 1152, 570] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0002880096435546875 nb_pixel_total : 11895 time to create 1 rle with old method : 0.012937307357788086 length of segment : 179 DEBUG bbox = [1410, 636, 2136, 1374] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0041103363037109375 nb_pixel_total : 273312 time to create 1 rle with new method : 0.44499778747558594 length of segment : 998 DEBUG bbox = [12, 1764, 168, 2022] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004305839538574219 nb_pixel_total : 21399 time to create 1 rle with old method : 0.023427724838256836 length of segment : 156 DEBUG bbox = [1944, 1818, 2148, 2292] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009021759033203125 nb_pixel_total : 58756 time to create 1 rle with old method : 0.062285423278808594 length of segment : 200 DEBUG bbox = [798, 342, 1002, 480] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00030159950256347656 nb_pixel_total : 14618 time to create 1 rle with old method : 0.01579451560974121 length of segment : 175 DEBUG bbox = [132, 288, 486, 480] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006976127624511719 nb_pixel_total : 34997 time to create 1 rle with old method : 0.037030935287475586 length of segment : 299 DEBUG bbox = [1884, 1176, 2160, 1416] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005624294281005859 nb_pixel_total : 31155 time to create 1 rle with old method : 0.0336306095123291 length of segment : 256 DEBUG bbox = [1782, 546, 1992, 744] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004031658172607422 nb_pixel_total : 25641 time to create 1 rle with old method : 0.028681278228759766 length of segment : 186 DEBUG bbox = [1590, 1518, 2046, 2088] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0019876956939697266 nb_pixel_total : 126959 time to create 1 rle with old method : 0.13851642608642578 length of segment : 405 DEBUG bbox = [2004, 570, 2142, 720] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003161430358886719 nb_pixel_total : 11351 time to create 1 rle with old method : 0.01270294189453125 length of segment : 126 DEBUG bbox = [1614, 1566, 2016, 2088] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001825571060180664 nb_pixel_total : 118912 time to create 1 rle with old method : 0.1261730194091797 length of segment : 373 DEBUG bbox = [444, 2550, 594, 2634] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00016736984252929688 nb_pixel_total : 7412 time to create 1 rle with old method : 0.008336067199707031 length of segment : 115 DEBUG bbox = [18, 390, 300, 510] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003631114959716797 nb_pixel_total : 21270 time to create 1 rle with old method : 0.02254962921142578 length of segment : 311 DEBUG bbox = [1542, 2754, 1866, 2958] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007355213165283203 nb_pixel_total : 51732 time to create 1 rle with old method : 0.05472230911254883 length of segment : 324 DEBUG bbox = [498, 2022, 870, 2328] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009822845458984375 nb_pixel_total : 78265 time to create 1 rle with old method : 0.08727693557739258 length of segment : 350 DEBUG bbox = [1008, 2982, 1134, 3066] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0001347064971923828 nb_pixel_total : 8092 time to create 1 rle with old method : 0.009072065353393555 length of segment : 117 DEBUG bbox = [738, 2976, 1338, 3294] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0014204978942871094 nb_pixel_total : 116717 time to create 1 rle with old method : 0.12270236015319824 length of segment : 531 DEBUG bbox = [1794, 870, 2148, 1446] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0015053749084472656 nb_pixel_total : 123980 time to create 1 rle with old method : 0.12972164154052734 length of segment : 348 DEBUG bbox = [204, 78, 750, 414] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001501321792602539 nb_pixel_total : 123731 time to create 1 rle with old method : 0.13270878791809082 length of segment : 562 DEBUG bbox = [2022, 1938, 2148, 2106] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00019693374633789062 nb_pixel_total : 10607 time to create 1 rle with old method : 0.011293649673461914 length of segment : 142 DEBUG bbox = [90, 228, 390, 426] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0010149478912353516 nb_pixel_total : 29012 time to create 1 rle with old method : 0.03127312660217285 length of segment : 313 DEBUG bbox = [18, 198, 162, 348] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003561973571777344 nb_pixel_total : 16830 time to create 1 rle with old method : 0.01865553855895996 length of segment : 131 DEBUG bbox = [1518, 606, 1752, 858] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005130767822265625 nb_pixel_total : 31692 time to create 1 rle with old method : 0.03447294235229492 length of segment : 228 DEBUG bbox = [1776, 690, 2124, 918] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006453990936279297 nb_pixel_total : 46118 time to create 1 rle with old method : 0.049726009368896484 length of segment : 367 DEBUG bbox = [1560, 2010, 2022, 2316] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0012235641479492188 nb_pixel_total : 95025 time to create 1 rle with old method : 0.0986471176147461 length of segment : 425 DEBUG bbox = [432, 996, 738, 1302] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0014221668243408203 nb_pixel_total : 59587 time to create 1 rle with old method : 0.06491827964782715 length of segment : 281 DEBUG bbox = [228, 2664, 732, 2940] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002000570297241211 nb_pixel_total : 53334 time to create 1 rle with old method : 0.059362173080444336 length of segment : 485 DEBUG bbox = [1866, 1560, 2052, 1746] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006763935089111328 nb_pixel_total : 21771 time to create 1 rle with old method : 0.024481773376464844 length of segment : 151 DEBUG bbox = [60, 2244, 348, 2526] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001215219497680664 nb_pixel_total : 57419 time to create 1 rle with old method : 0.06335163116455078 length of segment : 284 DEBUG bbox = [1914, 798, 2142, 1050] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0010399818420410156 nb_pixel_total : 46332 time to create 1 rle with old method : 0.051621198654174805 length of segment : 227 DEBUG bbox = [918, 558, 1386, 1122] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.003232240676879883 nb_pixel_total : 145071 time to create 1 rle with old method : 0.15715551376342773 length of segment : 534 DEBUG bbox = [0, 1932, 126, 2340] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006866455078125 nb_pixel_total : 26610 time to create 1 rle with old method : 0.03044605255126953 length of segment : 103 DEBUG bbox = [1848, 582, 2124, 1062] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0022187232971191406 nb_pixel_total : 78324 time to create 1 rle with old method : 0.08577823638916016 length of segment : 256 DEBUG bbox = [606, 1830, 1086, 2520] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.004926919937133789 nb_pixel_total : 189284 time to create 1 rle with new method : 0.009621620178222656 length of segment : 610 DEBUG bbox = [1188, 2244, 2106, 2970] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.021951913833618164 nb_pixel_total : 458223 time to create 1 rle with new method : 0.035166263580322266 length of segment : 908 DEBUG bbox = [414, 2982, 864, 3084] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001344919204711914 nb_pixel_total : 30105 time to create 1 rle with old method : 0.03167986869812012 length of segment : 411 DEBUG bbox = [318, 222, 726, 738] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.003336191177368164 nb_pixel_total : 158096 time to create 1 rle with new method : 0.004322528839111328 length of segment : 468 DEBUG bbox = [1200, 1926, 1530, 2400] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0018503665924072266 nb_pixel_total : 82158 time to create 1 rle with old method : 0.08927607536315918 length of segment : 322 DEBUG bbox = [1740, 1236, 1950, 1464] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001125335693359375 nb_pixel_total : 23217 time to create 1 rle with old method : 0.03108668327331543 length of segment : 188 DEBUG bbox = [192, 2922, 450, 3048] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006566047668457031 nb_pixel_total : 16553 time to create 1 rle with old method : 0.018173933029174805 length of segment : 245 DEBUG bbox = [2028, 1704, 2154, 2016] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00069427490234375 nb_pixel_total : 24648 time to create 1 rle with old method : 0.027136564254760742 length of segment : 133 DEBUG bbox = [1836, 1488, 2112, 1890] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0013990402221679688 nb_pixel_total : 51366 time to create 1 rle with old method : 0.0555574893951416 length of segment : 285 DEBUG bbox = [288, 1446, 552, 1884] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0018494129180908203 nb_pixel_total : 58294 time to create 1 rle with old method : 0.06392407417297363 length of segment : 232 DEBUG bbox = [1986, 2184, 2154, 2418] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005612373352050781 nb_pixel_total : 25946 time to create 1 rle with old method : 0.029027223587036133 length of segment : 168 DEBUG bbox = [198, 876, 648, 1842] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00400996208190918 nb_pixel_total : 31096 time to create 1 rle with old method : 0.03409600257873535 length of segment : 242 DEBUG bbox = [270, 1722, 618, 1992] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0015168190002441406 nb_pixel_total : 56974 time to create 1 rle with old method : 0.06113314628601074 length of segment : 310 DEBUG bbox = [6, 432, 174, 960] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0014312267303466797 nb_pixel_total : 76589 time to create 1 rle with old method : 0.08422207832336426 length of segment : 171 DEBUG bbox = [24, 1452, 186, 1632] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005245208740234375 nb_pixel_total : 16975 time to create 1 rle with old method : 0.018463611602783203 length of segment : 159 DEBUG bbox = [0, 1830, 276, 2364] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0021991729736328125 nb_pixel_total : 97468 time to create 1 rle with old method : 0.10440492630004883 length of segment : 245 DEBUG bbox = [1170, 456, 1392, 570] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005929470062255859 nb_pixel_total : 14313 time to create 1 rle with old method : 0.015569925308227539 length of segment : 209 DEBUG bbox = [1848, 2580, 2034, 2808] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006875991821289062 nb_pixel_total : 24584 time to create 1 rle with old method : 0.0269775390625 length of segment : 165 DEBUG bbox = [1710, 1980, 2130, 2304] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0019333362579345703 nb_pixel_total : 50903 time to create 1 rle with old method : 0.05466651916503906 length of segment : 386 DEBUG bbox = [102, 216, 504, 966] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0036363601684570312 nb_pixel_total : 123869 time to create 1 rle with old method : 0.14195489883422852 length of segment : 415 DEBUG bbox = [1950, 798, 2160, 1236] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0016407966613769531 nb_pixel_total : 60727 time to create 1 rle with old method : 0.06637811660766602 length of segment : 198 DEBUG bbox = [1704, 582, 2046, 792] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0010874271392822266 nb_pixel_total : 41549 time to create 1 rle with old method : 0.04418325424194336 length of segment : 335 DEBUG bbox = [228, 2820, 540, 2964] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006368160247802734 nb_pixel_total : 21108 time to create 1 rle with old method : 0.022081375122070312 length of segment : 280 DEBUG bbox = [18, 408, 450, 1050] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0037267208099365234 nb_pixel_total : 194734 time to create 1 rle with new method : 0.006806612014770508 length of segment : 457 DEBUG bbox = [1584, 1452, 2076, 1800] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0025069713592529297 nb_pixel_total : 72291 time to create 1 rle with old method : 0.07776379585266113 length of segment : 473 DEBUG bbox = [738, 1110, 954, 1518] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0011932849884033203 nb_pixel_total : 58960 time to create 1 rle with old method : 0.06289219856262207 length of segment : 212 DEBUG bbox = [1824, 2754, 1914, 2826] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0002562999725341797 nb_pixel_total : 3305 time to create 1 rle with old method : 0.003717660903930664 length of segment : 75 DEBUG bbox = [1374, 2094, 1752, 2508] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002560853958129883 nb_pixel_total : 98641 time to create 1 rle with old method : 0.10845232009887695 length of segment : 352 DEBUG bbox = [396, 252, 888, 942] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.005279541015625 nb_pixel_total : 206204 time to create 1 rle with new method : 0.008543252944946289 length of segment : 439 DEBUG bbox = [1230, 1872, 1608, 2244] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002084016799926758 nb_pixel_total : 64976 time to create 1 rle with old method : 0.07354855537414551 length of segment : 325 DEBUG bbox = [984, 528, 1650, 1056] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.005860090255737305 nb_pixel_total : 210756 time to create 1 rle with new method : 0.008100748062133789 length of segment : 611 DEBUG bbox = [516, 1074, 1062, 1800] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.007014036178588867 nb_pixel_total : 281299 time to create 1 rle with new method : 0.013097047805786133 length of segment : 582 DEBUG bbox = [1734, 1794, 1998, 2424] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0024428367614746094 nb_pixel_total : 71695 time to create 1 rle with old method : 0.0788736343383789 length of segment : 295 DEBUG bbox = [6, 1206, 90, 1308] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00025916099548339844 nb_pixel_total : 6162 time to create 1 rle with old method : 0.007128477096557617 length of segment : 79 DEBUG bbox = [24, 204, 420, 426] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0018000602722167969 nb_pixel_total : 64281 time to create 1 rle with old method : 0.07003116607666016 length of segment : 395 DEBUG bbox = [342, 630, 738, 1086] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0017604827880859375 nb_pixel_total : 59073 time to create 1 rle with old method : 0.06539130210876465 length of segment : 554 DEBUG bbox = [984, 1002, 1512, 1392] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0026786327362060547 nb_pixel_total : 100805 time to create 1 rle with old method : 0.10707879066467285 length of segment : 487 DEBUG bbox = [1818, 618, 2100, 1122] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0023374557495117188 nb_pixel_total : 70904 time to create 1 rle with old method : 0.07878255844116211 length of segment : 286 DEBUG bbox = [912, 2274, 1392, 2598] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0025129318237304688 nb_pixel_total : 101754 time to create 1 rle with old method : 0.10545206069946289 length of segment : 478 time spent for convertir_results : 9.656108856201172 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 89 chid ids of type : 3594 Number RLEs to save : 29049 save missing photos in datou_result : time spend for datou_step_exec : 68.24954915046692 time spend to save output : 1.7115232944488525 total time spend for step 1 : 69.96107244491577 step2:crop_condition Mon Jan 12 10:11:41 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 10 ! batch 1 Loaded 89 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 37 About to insert : list_path_to_insert length 37 new photo from crops ! About to upload 37 photos upload in portfolio : 3736932 init cache_photo without model_param we have 37 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1768209113_3092298 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209120), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489671_12fe5518928c8b57e4d3cd91a2660f60_rle_crop_4097600678_0.png', 0, 170, 253, 0, 1768209120,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209120), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489671_12fe5518928c8b57e4d3cd91a2660f60_rle_crop_4097600679_0.png', 0, 201, 121, 0, 1768209120,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209120), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489671_12fe5518928c8b57e4d3cd91a2660f60_rle_crop_4097600680_0.png', 0, 303, 363, 0, 1768209120,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209120), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489671_12fe5518928c8b57e4d3cd91a2660f60_rle_crop_4097600681_0.png', 0, 821, 721, 0, 1768209120,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209120), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489671_12fe5518928c8b57e4d3cd91a2660f60_rle_crop_4097600682_0.png', 0, 259, 324, 0, 1768209120,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209120), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489671_12fe5518928c8b57e4d3cd91a2660f60_rle_crop_4097600683_0.png', 0, 172, 101, 0, 1768209120,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209120), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489671_12fe5518928c8b57e4d3cd91a2660f60_rle_crop_4097600685_0.png', 0, 262, 413, 0, 1768209120,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209120), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489671_12fe5518928c8b57e4d3cd91a2660f60_rle_crop_4097600687_0.png', 0, 346, 266, 0, 1768209120,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209120), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489671_12fe5518928c8b57e4d3cd91a2660f60_rle_crop_4097600689_0.png', 0, 121, 176, 0, 1768209120,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209120), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489669_234b57c0778ebb1557126a680b2fc925_rle_crop_4097600692_0.png', 0, 117, 172, 0, 1768209120,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209120), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489666_ab7440b4d86e6c12adcc58818a5f2a9c_rle_crop_4097600700_0.png', 0, 190, 281, 0, 1768209120,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209120), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489666_ab7440b4d86e6c12adcc58818a5f2a9c_rle_crop_4097600701_0.png', 0, 226, 256, 0, 1768209120,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209120), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489666_ab7440b4d86e6c12adcc58818a5f2a9c_rle_crop_4097600705_0.png', 0, 492, 373, 0, 1768209120,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209120), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489666_ab7440b4d86e6c12adcc58818a5f2a9c_rle_crop_4097600706_0.png', 0, 76, 113, 0, 1768209120,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209120), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489666_ab7440b4d86e6c12adcc58818a5f2a9c_rle_crop_4097600707_0.png', 0, 111, 264, 0, 1768209120,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209120), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489664_5041fd2674714b51e5b7f68fc76f2594_rle_crop_4097600710_0.png', 0, 81, 116, 0, 1768209120,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209120), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489664_5041fd2674714b51e5b7f68fc76f2594_rle_crop_4097600711_0.png', 0, 315, 529, 0, 1768209120,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209120), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489664_5041fd2674714b51e5b7f68fc76f2594_rle_crop_4097600714_0.png', 0, 120, 117, 0, 1768209120,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209120), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489663_509934a6189a4b4d78cae7712ddbe083_rle_crop_4097600717_0.png', 0, 250, 221, 0, 1768209120,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209120), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489662_56505ed5591c8ae0727d0123bebf9776_rle_crop_4097600720_0.png', 0, 304, 281, 0, 1768209120,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209120), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489662_56505ed5591c8ae0727d0123bebf9776_rle_crop_4097600721_0.png', 0, 190, 456, 0, 1768209120,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209120), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489662_56505ed5591c8ae0727d0123bebf9776_rle_crop_4097600722_0.png', 0, 183, 151, 0, 1768209120,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209120), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489662_56505ed5591c8ae0727d0123bebf9776_rle_crop_4097600725_0.png', 0, 530, 445, 0, 1768209120,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209120), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489661_354f6038865a98fce57c21f7a69afecb_rle_crop_4097600730_0.png', 0, 92, 411, 0, 1768209120,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209120), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489661_354f6038865a98fce57c21f7a69afecb_rle_crop_4097600733_0.png', 0, 197, 185, 0, 1768209120,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209120), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489661_354f6038865a98fce57c21f7a69afecb_rle_crop_4097600734_0.png', 0, 95, 245, 0, 1768209120,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209120), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489661_354f6038865a98fce57c21f7a69afecb_rle_crop_4097600735_0.png', 0, 305, 115, 0, 1768209120,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209120), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489661_354f6038865a98fce57c21f7a69afecb_rle_crop_4097600738_0.png', 0, 218, 166, 0, 1768209120,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209120), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489658_974bf3b12e953c5026bec407ca7cf5f1_rle_crop_4097600744_0.png', 0, 104, 208, 0, 1768209120,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209120), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489658_974bf3b12e953c5026bec407ca7cf5f1_rle_crop_4097600745_0.png', 0, 226, 163, 0, 1768209120,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209120), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489646_6729ac64e986c265a35fc838d1886135_rle_crop_4097600749_0.png', 0, 184, 334, 0, 1768209120,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209120), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489646_6729ac64e986c265a35fc838d1886135_rle_crop_4097600750_0.png', 0, 127, 279, 0, 1768209120,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209120), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489646_6729ac64e986c265a35fc838d1886135_rle_crop_4097600751_0.png', 0, 617, 396, 0, 1768209120,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209120), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489644_1707e202ec63465f3a846a356310f36d_rle_crop_4097600755_0.png', 0, 410, 345, 0, 1768209120,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209120), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489644_1707e202ec63465f3a846a356310f36d_rle_crop_4097600757_0.png', 0, 356, 325, 0, 1768209120,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209120), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489644_1707e202ec63465f3a846a356310f36d_rle_crop_4097600761_0.png', 0, 98, 78, 0, 1768209120,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209120), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489644_1707e202ec63465f3a846a356310f36d_rle_crop_4097600766_0.png', 0, 290, 477, 0, 1768209120,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 37 photos in the portfolio 3736932 time of upload the photos Elapsed time : 9.302899599075317 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 5 About to insert : list_path_to_insert length 5 new photo from crops ! About to upload 5 photos upload in portfolio : 3736932 init cache_photo without model_param we have 5 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1768209125_3092298 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209125), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489669_234b57c0778ebb1557126a680b2fc925_rle_crop_4097600695_0.png', 0, 108, 179, 0, 1768209125,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209125), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489669_234b57c0778ebb1557126a680b2fc925_rle_crop_4097600699_0.png', 0, 122, 175, 0, 1768209125,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209125), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489663_509934a6189a4b4d78cae7712ddbe083_rle_crop_4097600715_0.png', 0, 167, 292, 0, 1768209125,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209125), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489663_509934a6189a4b4d78cae7712ddbe083_rle_crop_4097600716_0.png', 0, 149, 131, 0, 1768209125,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209125), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489661_354f6038865a98fce57c21f7a69afecb_rle_crop_4097600728_0.png', 0, 679, 350, 0, 1768209125,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 5 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.422654151916504 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1768209127_3092298 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209128), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489669_234b57c0778ebb1557126a680b2fc925_rle_crop_4097600694_0.png', 0, 126, 168, 0, 1768209128,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209128), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489646_6729ac64e986c265a35fc838d1886135_rle_crop_4097600754_0.png', 0, 62, 69, 0, 1768209128,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.7027781009674072 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 42 About to insert : list_path_to_insert length 42 new photo from crops ! About to upload 42 photos upload in portfolio : 3736932 init cache_photo without model_param we have 42 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1768209148_3092298 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209157), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489671_12fe5518928c8b57e4d3cd91a2660f60_rle_crop_4097600684_0.png', 0, 224, 123, 0, 1768209157,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209157), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489671_12fe5518928c8b57e4d3cd91a2660f60_rle_crop_4097600686_0.png', 0, 302, 355, 0, 1768209157,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209157), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489671_12fe5518928c8b57e4d3cd91a2660f60_rle_crop_4097600690_0.png', 0, 660, 605, 0, 1768209157,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209157), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489669_234b57c0778ebb1557126a680b2fc925_rle_crop_4097600691_0.png', 0, 760, 546, 0, 1768209157,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209157), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489669_234b57c0778ebb1557126a680b2fc925_rle_crop_4097600693_0.png', 0, 321, 366, 0, 1768209157,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209157), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489669_234b57c0778ebb1557126a680b2fc925_rle_crop_4097600696_0.png', 0, 676, 621, 0, 1768209157,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209157), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489669_234b57c0778ebb1557126a680b2fc925_rle_crop_4097600698_0.png', 0, 353, 190, 0, 1768209157,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209157), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489666_ab7440b4d86e6c12adcc58818a5f2a9c_rle_crop_4097600702_0.png', 0, 186, 186, 0, 1768209157,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209157), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489666_ab7440b4d86e6c12adcc58818a5f2a9c_rle_crop_4097600703_0.png', 0, 491, 405, 0, 1768209157,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209157), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489666_ab7440b4d86e6c12adcc58818a5f2a9c_rle_crop_4097600704_0.png', 0, 116, 125, 0, 1768209157,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209157), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489664_5041fd2674714b51e5b7f68fc76f2594_rle_crop_4097600709_0.png', 0, 274, 341, 0, 1768209157,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209157), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489664_5041fd2674714b51e5b7f68fc76f2594_rle_crop_4097600712_0.png', 0, 527, 341, 0, 1768209157,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209157), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489664_5041fd2674714b51e5b7f68fc76f2594_rle_crop_4097600713_0.png', 0, 324, 461, 0, 1768209157,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209157), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489663_509934a6189a4b4d78cae7712ddbe083_rle_crop_4097600718_0.png', 0, 217, 340, 0, 1768209157,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209157), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489663_509934a6189a4b4d78cae7712ddbe083_rle_crop_4097600719_0.png', 0, 279, 425, 0, 1768209157,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209157), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489662_56505ed5591c8ae0727d0123bebf9776_rle_crop_4097600723_0.png', 0, 259, 282, 0, 1768209157,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209157), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489662_56505ed5591c8ae0727d0123bebf9776_rle_crop_4097600724_0.png', 0, 246, 226, 0, 1768209157,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209157), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489662_56505ed5591c8ae0727d0123bebf9776_rle_crop_4097600726_0.png', 0, 384, 102, 0, 1768209157,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209157), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489661_354f6038865a98fce57c21f7a69afecb_rle_crop_4097600727_0.png', 0, 402, 256, 0, 1768209157,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209157), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489661_354f6038865a98fce57c21f7a69afecb_rle_crop_4097600729_0.png', 0, 692, 906, 0, 1768209157,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209157), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489661_354f6038865a98fce57c21f7a69afecb_rle_crop_4097600731_0.png', 0, 513, 399, 0, 1768209157,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209157), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489661_354f6038865a98fce57c21f7a69afecb_rle_crop_4097600732_0.png', 0, 464, 320, 0, 1768209157,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209157), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489661_354f6038865a98fce57c21f7a69afecb_rle_crop_4097600736_0.png', 0, 358, 233, 0, 1768209157,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209157), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489661_354f6038865a98fce57c21f7a69afecb_rle_crop_4097600737_0.png', 0, 391, 216, 0, 1768209157,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209157), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489661_354f6038865a98fce57c21f7a69afecb_rle_crop_4097600739_0.png', 0, 439, 154, 0, 1768209157,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209157), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489658_974bf3b12e953c5026bec407ca7cf5f1_rle_crop_4097600740_0.png', 0, 240, 310, 0, 1768209157,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209157), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489658_974bf3b12e953c5026bec407ca7cf5f1_rle_crop_4097600741_0.png', 0, 527, 165, 0, 1768209157,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209157), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489658_974bf3b12e953c5026bec407ca7cf5f1_rle_crop_4097600742_0.png', 0, 151, 159, 0, 1768209157,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209157), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489658_974bf3b12e953c5026bec407ca7cf5f1_rle_crop_4097600743_0.png', 0, 498, 242, 0, 1768209157,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209157), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489658_974bf3b12e953c5026bec407ca7cf5f1_rle_crop_4097600746_0.png', 0, 306, 386, 0, 1768209157,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209157), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489658_974bf3b12e953c5026bec407ca7cf5f1_rle_crop_4097600747_0.png', 0, 543, 350, 0, 1768209157,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209157), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489646_6729ac64e986c265a35fc838d1886135_rle_crop_4097600748_0.png', 0, 396, 193, 0, 1768209157,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209157), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489646_6729ac64e986c265a35fc838d1886135_rle_crop_4097600752_0.png', 0, 269, 390, 0, 1768209157,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209157), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489646_6729ac64e986c265a35fc838d1886135_rle_crop_4097600753_0.png', 0, 389, 189, 0, 1768209157,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209157), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489644_1707e202ec63465f3a846a356310f36d_rle_crop_4097600756_0.png', 0, 561, 439, 0, 1768209157,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209157), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489644_1707e202ec63465f3a846a356310f36d_rle_crop_4097600758_0.png', 0, 464, 592, 0, 1768209157,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209157), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489644_1707e202ec63465f3a846a356310f36d_rle_crop_4097600759_0.png', 0, 713, 511, 0, 1768209157,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209157), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489644_1707e202ec63465f3a846a356310f36d_rle_crop_4097600760_0.png', 0, 562, 242, 0, 1768209157,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209157), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489644_1707e202ec63465f3a846a356310f36d_rle_crop_4097600762_0.png', 0, 192, 389, 0, 1768209157,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209157), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489644_1707e202ec63465f3a846a356310f36d_rle_crop_4097600763_0.png', 0, 309, 391, 0, 1768209157,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209157), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489644_1707e202ec63465f3a846a356310f36d_rle_crop_4097600764_0.png', 0, 389, 487, 0, 1768209157,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209157), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489644_1707e202ec63465f3a846a356310f36d_rle_crop_4097600765_0.png', 0, 486, 210, 0, 1768209157,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 42 photos in the portfolio 3736932 time of upload the photos Elapsed time : 11.115094900131226 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1768209160_3092298 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209161), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489669_234b57c0778ebb1557126a680b2fc925_rle_crop_4097600697_0.png', 0, 255, 155, 0, 1768209161,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209161), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489666_ab7440b4d86e6c12adcc58818a5f2a9c_rle_crop_4097600708_0.png', 0, 193, 324, 0, 1768209161,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.708341121673584 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1768209162_3092298 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768209163), 0.0, 0.0, 14, '', 0, 0, '1768209030_3092298_1403489671_12fe5518928c8b57e4d3cd91a2660f60_rle_crop_4097600688_0.png', 0, 289, 229, 0, 1768209163,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.5514438152313232 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1403489671, 1403489669, 1403489666, 1403489664, 1403489663, 1403489662, 1403489661, 1403489658, 1403489646, 1403489644] Looping around the photos to save general results len do output : 89 /1403494595Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494596Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494597Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494598Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494599Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494600Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494601Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494602Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494603Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494604Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494605Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494606Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494607Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494608Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494609Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494610Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494611Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494612Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494613Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494614Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494615Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494616Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494617Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494618Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494619Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494620Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494621Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494622Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494623Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494624Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494625Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494626Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494627Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494628Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494629Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494630Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494631Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494632Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494633Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494634Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494635Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494636Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494644Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494645Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494714Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494715Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494716Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494717Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494718Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494719Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494720Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494721Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494722Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494723Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494724Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494725Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494726Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494727Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494728Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494729Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494730Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494731Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494732Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494733Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494734Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494735Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494736Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494737Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494738Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494739Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494740Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494741Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494742Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494743Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494744Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494745Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494746Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494747Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494748Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494749Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494750Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494751Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494752Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494753Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494754Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494755Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494758Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494759Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403494762Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4328919') ('3318', '30090237', '1403489671', None, None, None, None, None, '4328919') ('3318', None, None, None, None, None, None, None, '4328919') ('3318', '30090237', '1403489669', None, None, None, None, None, '4328919') ('3318', None, None, None, None, None, None, None, '4328919') ('3318', '30090237', '1403489666', None, None, None, None, None, '4328919') ('3318', None, None, None, None, None, None, None, '4328919') ('3318', '30090237', '1403489664', None, None, None, None, None, '4328919') ('3318', None, None, None, None, None, None, None, '4328919') ('3318', '30090237', '1403489663', None, None, None, None, None, '4328919') ('3318', None, None, None, None, None, None, None, '4328919') ('3318', '30090237', '1403489662', None, None, None, None, None, '4328919') ('3318', None, None, None, None, None, None, None, '4328919') ('3318', '30090237', '1403489661', None, None, None, None, None, '4328919') ('3318', None, None, None, None, None, None, None, '4328919') ('3318', '30090237', '1403489658', None, None, None, None, None, '4328919') ('3318', None, None, None, None, None, None, None, '4328919') ('3318', '30090237', '1403489646', None, None, None, None, None, '4328919') ('3318', None, None, None, None, None, None, None, '4328919') ('3318', '30090237', '1403489644', None, None, None, None, None, '4328919') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 277 time used for this insertion : 0.05933427810668945 save_final save missing photos in datou_result : time spend for datou_step_exec : 61.42810416221619 time spend to save output : 0.06273555755615234 total time spend for step 2 : 61.49083971977234 step3:rle_unique_nms_with_priority Mon Jan 12 10:12:43 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 89 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 13 nb_hashtags : 3 time to prepare the origin masks : 5.415163040161133 time for calcul the mask position with numpy : 0.530081033706665 nb_pixel_total : 7360826 time to create 1 rle with new method : 0.9108028411865234 time for calcul the mask position with numpy : 0.02713918685913086 nb_pixel_total : 257695 time to create 1 rle with new method : 0.747673749923706 time for calcul the mask position with numpy : 0.03906393051147461 nb_pixel_total : 14652 time to create 1 rle with old method : 0.01611471176147461 time for calcul the mask position with numpy : 0.03944754600524902 nb_pixel_total : 44127 time to create 1 rle with old method : 0.046222686767578125 time for calcul the mask position with numpy : 0.028865814208984375 nb_pixel_total : 46942 time to create 1 rle with old method : 0.04836845397949219 time for calcul the mask position with numpy : 0.023328304290771484 nb_pixel_total : 76676 time to create 1 rle with old method : 0.07728838920593262 time for calcul the mask position with numpy : 0.023807048797607422 nb_pixel_total : 1412 time to create 1 rle with old method : 0.0015392303466796875 time for calcul the mask position with numpy : 0.022865772247314453 nb_pixel_total : 22429 time to create 1 rle with old method : 0.022864341735839844 time for calcul the mask position with numpy : 0.02295398712158203 nb_pixel_total : 13600 time to create 1 rle with old method : 0.013715267181396484 time for calcul the mask position with numpy : 0.023285627365112305 nb_pixel_total : 55863 time to create 1 rle with old method : 0.056729793548583984 time for calcul the mask position with numpy : 0.025018930435180664 nb_pixel_total : 273526 time to create 1 rle with new method : 0.6816897392272949 time for calcul the mask position with numpy : 0.024271249771118164 nb_pixel_total : 88383 time to create 1 rle with old method : 0.09023022651672363 time for calcul the mask position with numpy : 0.023463964462280273 nb_pixel_total : 13735 time to create 1 rle with old method : 0.01404118537902832 time for calcul the mask position with numpy : 0.02361893653869629 nb_pixel_total : 24534 time to create 1 rle with old method : 0.02489328384399414 create new chi : 3.7178549766540527 time to delete rle : 0.023122310638427734 batch 1 Loaded 27 chid ids of type : 3594 ++++++++++++++++++++Number RLEs to save : 10061 TO DO : save crop sub photo not yet done ! save time : 0.6115226745605469 nb_obj : 9 nb_hashtags : 5 time to prepare the origin masks : 4.50459885597229 time for calcul the mask position with numpy : 0.6496074199676514 nb_pixel_total : 7602609 time to create 1 rle with new method : 0.6170902252197266 time for calcul the mask position with numpy : 0.03759026527404785 nb_pixel_total : 14618 time to create 1 rle with old method : 0.015159368515014648 time for calcul the mask position with numpy : 0.023422956466674805 nb_pixel_total : 55876 time to create 1 rle with old method : 0.05774855613708496 time for calcul the mask position with numpy : 0.023449420928955078 nb_pixel_total : 21399 time to create 1 rle with old method : 0.021761178970336914 time for calcul the mask position with numpy : 0.02464437484741211 nb_pixel_total : 261172 time to create 1 rle with new method : 0.7083134651184082 time for calcul the mask position with numpy : 0.02565455436706543 nb_pixel_total : 11895 time to create 1 rle with old method : 0.013320446014404297 time for calcul the mask position with numpy : 0.027120113372802734 nb_pixel_total : 14833 time to create 1 rle with old method : 0.016680479049682617 time for calcul the mask position with numpy : 0.03099656105041504 nb_pixel_total : 90493 time to create 1 rle with old method : 0.10141539573669434 time for calcul the mask position with numpy : 0.028282880783081055 nb_pixel_total : 17790 time to create 1 rle with old method : 0.02082681655883789 time for calcul the mask position with numpy : 0.026669979095458984 nb_pixel_total : 203715 time to create 1 rle with new method : 0.7382245063781738 create new chi : 3.297187328338623 time to delete rle : 0.001065969467163086 batch 1 Loaded 19 chid ids of type : 3594 ++++++++++++Number RLEs to save : 7791 TO DO : save crop sub photo not yet done ! save time : 0.501253604888916 nb_obj : 9 nb_hashtags : 3 time to prepare the origin masks : 3.505841016769409 time for calcul the mask position with numpy : 0.6347253322601318 nb_pixel_total : 7983254 time to create 1 rle with new method : 0.6910116672515869 time for calcul the mask position with numpy : 0.02351212501525879 nb_pixel_total : 51732 time to create 1 rle with old method : 0.05336475372314453 time for calcul the mask position with numpy : 0.023801088333129883 nb_pixel_total : 21270 time to create 1 rle with old method : 0.022540807723999023 time for calcul the mask position with numpy : 0.024505615234375 nb_pixel_total : 7412 time to create 1 rle with old method : 0.008211374282836914 time for calcul the mask position with numpy : 0.024359464645385742 nb_pixel_total : 629 time to create 1 rle with old method : 0.0010857582092285156 time for calcul the mask position with numpy : 0.023871898651123047 nb_pixel_total : 11351 time to create 1 rle with old method : 0.011789560317993164 time for calcul the mask position with numpy : 0.024527549743652344 nb_pixel_total : 126959 time to create 1 rle with old method : 0.1310117244720459 time for calcul the mask position with numpy : 0.024219751358032227 nb_pixel_total : 25641 time to create 1 rle with old method : 0.026454925537109375 time for calcul the mask position with numpy : 0.023456811904907227 nb_pixel_total : 31155 time to create 1 rle with old method : 0.03172016143798828 time for calcul the mask position with numpy : 0.023590803146362305 nb_pixel_total : 34997 time to create 1 rle with old method : 0.036267995834350586 create new chi : 1.904883861541748 time to delete rle : 0.0009253025054931641 batch 1 Loaded 19 chid ids of type : 3594 ++++++++++Number RLEs to save : 6353 TO DO : save crop sub photo not yet done ! save time : 0.4171562194824219 nb_obj : 6 nb_hashtags : 2 time to prepare the origin masks : 2.4170708656311035 time for calcul the mask position with numpy : 0.6412675380706787 nb_pixel_total : 7840699 time to create 1 rle with new method : 0.7677803039550781 time for calcul the mask position with numpy : 0.02257537841796875 nb_pixel_total : 10607 time to create 1 rle with old method : 0.011294126510620117 time for calcul the mask position with numpy : 0.02365279197692871 nb_pixel_total : 123731 time to create 1 rle with old method : 0.13114261627197266 time for calcul the mask position with numpy : 0.024209260940551758 nb_pixel_total : 123980 time to create 1 rle with old method : 0.13075566291809082 time for calcul the mask position with numpy : 0.025087833404541016 nb_pixel_total : 109026 time to create 1 rle with old method : 0.11286425590515137 time for calcul the mask position with numpy : 0.02347707748413086 nb_pixel_total : 8092 time to create 1 rle with old method : 0.00852060317993164 time for calcul the mask position with numpy : 0.024058103561401367 nb_pixel_total : 78265 time to create 1 rle with old method : 0.08141255378723145 create new chi : 2.0680840015411377 time to delete rle : 0.0009365081787109375 batch 1 Loaded 13 chid ids of type : 3594 ++++++Number RLEs to save : 6173 TO DO : save crop sub photo not yet done ! save time : 0.40845584869384766 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 2.2600743770599365 time for calcul the mask position with numpy : 0.6751575469970703 nb_pixel_total : 8077363 time to create 1 rle with new method : 0.7567644119262695 time for calcul the mask position with numpy : 0.02374744415283203 nb_pixel_total : 95025 time to create 1 rle with old method : 0.09916114807128906 time for calcul the mask position with numpy : 0.023884296417236328 nb_pixel_total : 46118 time to create 1 rle with old method : 0.046684980392456055 time for calcul the mask position with numpy : 0.0233001708984375 nb_pixel_total : 31692 time to create 1 rle with old method : 0.03270244598388672 time for calcul the mask position with numpy : 0.022923707962036133 nb_pixel_total : 15190 time to create 1 rle with old method : 0.01575183868408203 time for calcul the mask position with numpy : 0.023704051971435547 nb_pixel_total : 29012 time to create 1 rle with old method : 0.030703067779541016 create new chi : 1.8148415088653564 time to delete rle : 0.0008285045623779297 batch 1 Loaded 11 chid ids of type : 3594 ++++++Number RLEs to save : 5077 TO DO : save crop sub photo not yet done ! save time : 0.35297465324401855 nb_obj : 7 nb_hashtags : 2 time to prepare the origin masks : 2.630939483642578 time for calcul the mask position with numpy : 0.4956939220428467 nb_pixel_total : 7884276 time to create 1 rle with new method : 0.7463321685791016 time for calcul the mask position with numpy : 0.022501468658447266 nb_pixel_total : 26610 time to create 1 rle with old method : 0.02798151969909668 time for calcul the mask position with numpy : 0.023235082626342773 nb_pixel_total : 145071 time to create 1 rle with old method : 0.1503129005432129 time for calcul the mask position with numpy : 0.023772478103637695 nb_pixel_total : 46332 time to create 1 rle with old method : 0.047855377197265625 time for calcul the mask position with numpy : 0.024319171905517578 nb_pixel_total : 57419 time to create 1 rle with old method : 0.05912160873413086 time for calcul the mask position with numpy : 0.023185014724731445 nb_pixel_total : 21771 time to create 1 rle with old method : 0.022831201553344727 time for calcul the mask position with numpy : 0.024260759353637695 nb_pixel_total : 53334 time to create 1 rle with old method : 0.056241750717163086 time for calcul the mask position with numpy : 0.023164033889770508 nb_pixel_total : 59587 time to create 1 rle with old method : 0.06413888931274414 create new chi : 1.8750622272491455 time to delete rle : 0.000896453857421875 batch 1 Loaded 15 chid ids of type : 3594 ++++++++Number RLEs to save : 6290 TO DO : save crop sub photo not yet done ! save time : 0.422652006149292 nb_obj : 13 nb_hashtags : 3 time to prepare the origin masks : 5.47203254699707 time for calcul the mask position with numpy : 0.49560976028442383 nb_pixel_total : 7067090 time to create 1 rle with new method : 0.921494722366333 time for calcul the mask position with numpy : 0.022830963134765625 nb_pixel_total : 31096 time to create 1 rle with old method : 0.03250527381896973 time for calcul the mask position with numpy : 0.02347421646118164 nb_pixel_total : 25946 time to create 1 rle with old method : 0.02707195281982422 time for calcul the mask position with numpy : 0.02413630485534668 nb_pixel_total : 58294 time to create 1 rle with old method : 0.06231117248535156 time for calcul the mask position with numpy : 0.02354574203491211 nb_pixel_total : 51366 time to create 1 rle with old method : 0.05358314514160156 time for calcul the mask position with numpy : 0.025527000427246094 nb_pixel_total : 24648 time to create 1 rle with old method : 0.026163339614868164 time for calcul the mask position with numpy : 0.03509163856506348 nb_pixel_total : 16553 time to create 1 rle with old method : 0.017406702041625977 time for calcul the mask position with numpy : 0.023929119110107422 nb_pixel_total : 23217 time to create 1 rle with old method : 0.02409219741821289 time for calcul the mask position with numpy : 0.024166345596313477 nb_pixel_total : 82158 time to create 1 rle with old method : 0.09049248695373535 time for calcul the mask position with numpy : 0.0263824462890625 nb_pixel_total : 158096 time to create 1 rle with new method : 0.9034571647644043 time for calcul the mask position with numpy : 0.028578519821166992 nb_pixel_total : 30105 time to create 1 rle with old method : 0.033235788345336914 time for calcul the mask position with numpy : 0.027874231338500977 nb_pixel_total : 458223 time to create 1 rle with new method : 0.5816633701324463 time for calcul the mask position with numpy : 0.023960590362548828 nb_pixel_total : 189284 time to create 1 rle with new method : 0.5758886337280273 time for calcul the mask position with numpy : 0.02429509162902832 nb_pixel_total : 78324 time to create 1 rle with old method : 0.08070778846740723 create new chi : 4.380192279815674 time to delete rle : 0.001556396484375 batch 1 Loaded 27 chid ids of type : 3594 ++++++++++++++++++++Number RLEs to save : 11096 TO DO : save crop sub photo not yet done ! save time : 0.735154390335083 nb_obj : 8 nb_hashtags : 2 time to prepare the origin masks : 3.3194453716278076 time for calcul the mask position with numpy : 0.6245341300964355 nb_pixel_total : 7833919 time to create 1 rle with new method : 0.6426572799682617 time for calcul the mask position with numpy : 0.024802207946777344 nb_pixel_total : 122675 time to create 1 rle with old method : 0.1291639804840088 time for calcul the mask position with numpy : 0.024912118911743164 nb_pixel_total : 50903 time to create 1 rle with old method : 0.05459117889404297 time for calcul the mask position with numpy : 0.0245974063873291 nb_pixel_total : 24584 time to create 1 rle with old method : 0.0263822078704834 time for calcul the mask position with numpy : 0.025038719177246094 nb_pixel_total : 14313 time to create 1 rle with old method : 0.015614509582519531 time for calcul the mask position with numpy : 0.026681900024414062 nb_pixel_total : 97468 time to create 1 rle with old method : 0.15287137031555176 time for calcul the mask position with numpy : 0.02446293830871582 nb_pixel_total : 16975 time to create 1 rle with old method : 0.01786494255065918 time for calcul the mask position with numpy : 0.024783611297607422 nb_pixel_total : 76589 time to create 1 rle with old method : 0.08040547370910645 time for calcul the mask position with numpy : 0.024944543838500977 nb_pixel_total : 56974 time to create 1 rle with old method : 0.06996297836303711 create new chi : 2.056874990463257 time to delete rle : 0.0010311603546142578 batch 1 Loaded 17 chid ids of type : 3594 +++++++++Number RLEs to save : 6218 TO DO : save crop sub photo not yet done ! save time : 0.4149041175842285 nb_obj : 7 nb_hashtags : 3 time to prepare the origin masks : 3.138828992843628 time for calcul the mask position with numpy : 0.6660406589508057 nb_pixel_total : 7841726 time to create 1 rle with new method : 0.8654570579528809 time for calcul the mask position with numpy : 0.024610519409179688 nb_pixel_total : 3305 time to create 1 rle with old method : 0.0036079883575439453 time for calcul the mask position with numpy : 0.024362564086914062 nb_pixel_total : 58960 time to create 1 rle with old method : 0.06265497207641602 time for calcul the mask position with numpy : 0.025014877319335938 nb_pixel_total : 72291 time to create 1 rle with old method : 0.07602453231811523 time for calcul the mask position with numpy : 0.0252988338470459 nb_pixel_total : 194734 time to create 1 rle with new method : 0.8585574626922607 time for calcul the mask position with numpy : 0.027898788452148438 nb_pixel_total : 21108 time to create 1 rle with old method : 0.022737503051757812 time for calcul the mask position with numpy : 0.024380922317504883 nb_pixel_total : 41549 time to create 1 rle with old method : 0.04519963264465332 time for calcul the mask position with numpy : 0.023987770080566406 nb_pixel_total : 60727 time to create 1 rle with old method : 0.06400370597839355 create new chi : 2.91396164894104 time to delete rle : 0.0008440017700195312 batch 1 Loaded 15 chid ids of type : 3594 ++++++++++Number RLEs to save : 6220 TO DO : save crop sub photo not yet done ! save time : 0.41416335105895996 nb_obj : 12 nb_hashtags : 2 time to prepare the origin masks : 4.569716930389404 time for calcul the mask position with numpy : 0.5819683074951172 nb_pixel_total : 6965582 time to create 1 rle with new method : 0.8912270069122314 time for calcul the mask position with numpy : 0.02591228485107422 nb_pixel_total : 101754 time to create 1 rle with old method : 0.10968875885009766 time for calcul the mask position with numpy : 0.023691415786743164 nb_pixel_total : 70904 time to create 1 rle with old method : 0.0757441520690918 time for calcul the mask position with numpy : 0.023915767669677734 nb_pixel_total : 100805 time to create 1 rle with old method : 0.10645794868469238 time for calcul the mask position with numpy : 0.024413347244262695 nb_pixel_total : 51341 time to create 1 rle with old method : 0.053609371185302734 time for calcul the mask position with numpy : 0.02428460121154785 nb_pixel_total : 64281 time to create 1 rle with old method : 0.06623601913452148 time for calcul the mask position with numpy : 0.023679733276367188 nb_pixel_total : 6162 time to create 1 rle with old method : 0.0065801143646240234 time for calcul the mask position with numpy : 0.024049043655395508 nb_pixel_total : 71695 time to create 1 rle with old method : 0.07519006729125977 time for calcul the mask position with numpy : 0.02469635009765625 nb_pixel_total : 281299 time to create 1 rle with new method : 0.6322598457336426 time for calcul the mask position with numpy : 0.02516627311706543 nb_pixel_total : 210756 time to create 1 rle with new method : 0.6117110252380371 time for calcul the mask position with numpy : 0.024027109146118164 nb_pixel_total : 64976 time to create 1 rle with old method : 0.06743907928466797 time for calcul the mask position with numpy : 0.0250394344329834 nb_pixel_total : 206204 time to create 1 rle with new method : 0.5760481357574463 time for calcul the mask position with numpy : 0.025617599487304688 nb_pixel_total : 98641 time to create 1 rle with old method : 0.10277247428894043 create new chi : 4.370592832565308 time to delete rle : 0.0015876293182373047 batch 1 Loaded 25 chid ids of type : 3594 ++++++++++++++Number RLEs to save : 11457 TO DO : save crop sub photo not yet done ! save time : 0.7137770652770996 map_output_result : {1403489671: (0.0, 'Should be the crop_list due to order', 0), 1403489669: (0.0, 'Should be the crop_list due to order', 0), 1403489666: (0.0, 'Should be the crop_list due to order', 0), 1403489664: (0.0, 'Should be the crop_list due to order', 0), 1403489663: (0.0, 'Should be the crop_list due to order', 0), 1403489662: (0.0, 'Should be the crop_list due to order', 0), 1403489661: (0.0, 'Should be the crop_list due to order', 0), 1403489658: (0.0, 'Should be the crop_list due to order', 0), 1403489646: (0.0, 'Should be the crop_list due to order', 0), 1403489644: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1403489671, 1403489669, 1403489666, 1403489664, 1403489663, 1403489662, 1403489661, 1403489658, 1403489646, 1403489644] Looping around the photos to save general results len do output : 10 /1403489671.Didn't retrieve data . /1403489669.Didn't retrieve data . /1403489666.Didn't retrieve data . /1403489664.Didn't retrieve data . /1403489663.Didn't retrieve data . /1403489662.Didn't retrieve data . /1403489661.Didn't retrieve data . /1403489658.Didn't retrieve data . /1403489646.Didn't retrieve data . /1403489644.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4328919') ('3318', '30090237', '1403489671', None, None, None, None, None, '4328919') ('3318', None, None, None, None, None, None, None, '4328919') ('3318', '30090237', '1403489669', None, None, None, None, None, '4328919') ('3318', None, None, None, None, None, None, None, '4328919') ('3318', '30090237', '1403489666', None, None, None, None, None, '4328919') ('3318', None, None, None, None, None, None, None, '4328919') ('3318', '30090237', '1403489664', None, None, None, None, None, '4328919') ('3318', None, None, None, None, None, None, None, '4328919') ('3318', '30090237', '1403489663', None, None, None, None, None, '4328919') ('3318', None, None, None, None, None, None, None, '4328919') ('3318', '30090237', '1403489662', None, None, None, None, None, '4328919') ('3318', None, None, None, None, None, None, None, '4328919') ('3318', '30090237', '1403489661', None, None, None, None, None, '4328919') ('3318', None, None, None, None, None, None, None, '4328919') ('3318', '30090237', '1403489658', None, None, None, None, None, '4328919') ('3318', None, None, None, None, None, None, None, '4328919') ('3318', '30090237', '1403489646', None, None, None, None, None, '4328919') ('3318', None, None, None, None, None, None, None, '4328919') ('3318', '30090237', '1403489644', None, None, None, None, None, '4328919') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 30 time used for this insertion : 0.014228582382202148 save_final save missing photos in datou_result : time spend for datou_step_exec : 71.87888050079346 time spend to save output : 0.014676094055175781 total time spend for step 3 : 71.89355659484863 step4:ventilate_hashtags_in_portfolio Mon Jan 12 10:13:55 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 30090237 get user id for portfolio 30090237 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30090237 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre','flou','metal','pet_clair','pehd','pet_fonce','environnement','carton','mal_croppe','background','papier')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30090237 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre','flou','metal','pet_clair','pehd','pet_fonce','environnement','carton','mal_croppe','background','papier')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30090237 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre','flou','metal','pet_clair','pehd','pet_fonce','environnement','carton','mal_croppe','background','papier')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/30090433,30090434,30090435,30090436,30090437,30090438,30090439,30090440,30090441,30090442,30090443?tags=autre,flou,metal,pet_clair,pehd,pet_fonce,environnement,carton,mal_croppe,background,papier Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1403489671, 1403489669, 1403489666, 1403489664, 1403489663, 1403489662, 1403489661, 1403489658, 1403489646, 1403489644] Looping around the photos to save general results len do output : 1 /30090237. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4328919') ('3318', '30090237', '1403489671', None, None, None, None, None, '4328919') ('3318', None, None, None, None, None, None, None, '4328919') ('3318', '30090237', '1403489669', None, None, None, None, None, '4328919') ('3318', None, None, None, None, None, None, None, '4328919') ('3318', '30090237', '1403489666', None, None, None, None, None, '4328919') ('3318', None, None, None, None, None, None, None, '4328919') ('3318', '30090237', '1403489664', None, None, None, None, None, '4328919') ('3318', None, None, None, None, None, None, None, '4328919') ('3318', '30090237', '1403489663', None, None, None, None, None, '4328919') ('3318', None, None, None, None, None, None, None, '4328919') ('3318', '30090237', '1403489662', None, None, None, None, None, '4328919') ('3318', None, None, None, None, None, None, None, '4328919') ('3318', '30090237', '1403489661', None, None, None, None, None, '4328919') ('3318', None, None, None, None, None, None, None, '4328919') ('3318', '30090237', '1403489658', None, None, None, None, None, '4328919') ('3318', None, None, None, None, None, None, None, '4328919') ('3318', '30090237', '1403489646', None, None, None, None, None, '4328919') ('3318', None, None, None, None, None, None, None, '4328919') ('3318', '30090237', '1403489644', None, None, None, None, None, '4328919') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.016111373901367188 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.9884231090545654 time spend to save output : 0.016361474990844727 total time spend for step 4 : 2.00478458404541 step5:final Mon Jan 12 10:13:57 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1403489671: ('0.07820524691358025',), 1403489669: ('0.07820524691358025',), 1403489666: ('0.07820524691358025',), 1403489664: ('0.07820524691358025',), 1403489663: ('0.07820524691358025',), 1403489662: ('0.07820524691358025',), 1403489661: ('0.07820524691358025',), 1403489658: ('0.07820524691358025',), 1403489646: ('0.07820524691358025',), 1403489644: ('0.07820524691358025',)} new output for save of step final : {1403489671: ('0.07820524691358025',), 1403489669: ('0.07820524691358025',), 1403489666: ('0.07820524691358025',), 1403489664: ('0.07820524691358025',), 1403489663: ('0.07820524691358025',), 1403489662: ('0.07820524691358025',), 1403489661: ('0.07820524691358025',), 1403489658: ('0.07820524691358025',), 1403489646: ('0.07820524691358025',), 1403489644: ('0.07820524691358025',)} [1403489671, 1403489669, 1403489666, 1403489664, 1403489663, 1403489662, 1403489661, 1403489658, 1403489646, 1403489644] Looping around the photos to save general results len do output : 10 /1403489671.Didn't retrieve data . /1403489669.Didn't retrieve data . /1403489666.Didn't retrieve data . /1403489664.Didn't retrieve data . /1403489663.Didn't retrieve data . /1403489662.Didn't retrieve data . /1403489661.Didn't retrieve data . /1403489658.Didn't retrieve data . /1403489646.Didn't retrieve data . /1403489644.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4328919') ('3318', '30090237', '1403489671', None, None, None, None, None, '4328919') ('3318', None, None, None, None, None, None, None, '4328919') ('3318', '30090237', '1403489669', None, None, None, None, None, '4328919') ('3318', None, None, None, None, None, None, None, '4328919') ('3318', '30090237', '1403489666', None, None, None, None, None, '4328919') ('3318', None, None, None, None, None, None, None, '4328919') ('3318', '30090237', '1403489664', None, None, None, None, None, '4328919') ('3318', None, None, None, None, None, None, None, '4328919') ('3318', '30090237', '1403489663', None, None, None, None, None, '4328919') ('3318', None, None, None, None, None, None, None, '4328919') ('3318', '30090237', '1403489662', None, None, None, None, None, '4328919') ('3318', None, None, None, None, None, None, None, '4328919') ('3318', '30090237', '1403489661', None, None, None, None, None, '4328919') ('3318', None, None, None, None, None, None, None, '4328919') ('3318', '30090237', '1403489658', None, None, None, None, None, '4328919') ('3318', None, None, None, None, None, None, None, '4328919') ('3318', '30090237', '1403489646', None, None, None, None, None, '4328919') ('3318', None, None, None, None, None, None, None, '4328919') ('3318', '30090237', '1403489644', None, None, None, None, None, '4328919') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 30 time used for this insertion : 0.015601873397827148 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.13918519020080566 time spend to save output : 0.025638818740844727 total time spend for step 5 : 0.1648240089416504 step6:blur_detection Mon Jan 12 10:13:57 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1768209030_3092298_1403489671_12fe5518928c8b57e4d3cd91a2660f60.jpg resize: (2160, 3840) 1403489671 -6.230115887427712 treat image : temp/1768209030_3092298_1403489669_234b57c0778ebb1557126a680b2fc925.jpg resize: (2160, 3840) 1403489669 -6.2241917917691705 treat image : temp/1768209030_3092298_1403489666_ab7440b4d86e6c12adcc58818a5f2a9c.jpg resize: (2160, 3840) 1403489666 -6.0316778382139375 treat image : temp/1768209030_3092298_1403489664_5041fd2674714b51e5b7f68fc76f2594.jpg resize: (2160, 3840) 1403489664 -6.156497079052504 treat image : temp/1768209030_3092298_1403489663_509934a6189a4b4d78cae7712ddbe083.jpg resize: (2160, 3840) 1403489663 -6.171147616729857 treat image : temp/1768209030_3092298_1403489662_56505ed5591c8ae0727d0123bebf9776.jpg resize: (2160, 3840) 1403489662 -6.192495026838389 treat image : temp/1768209030_3092298_1403489661_354f6038865a98fce57c21f7a69afecb.jpg resize: (2160, 3840) 1403489661 -6.124007843815178 treat image : temp/1768209030_3092298_1403489658_974bf3b12e953c5026bec407ca7cf5f1.jpg resize: (2160, 3840) 1403489658 -5.906536807291898 treat image : temp/1768209030_3092298_1403489646_6729ac64e986c265a35fc838d1886135.jpg resize: (2160, 3840) 1403489646 -6.036148939793755 treat image : temp/1768209030_3092298_1403489644_1707e202ec63465f3a846a356310f36d.jpg resize: (2160, 3840) 1403489644 -6.0738129960699965 treat image : temp/1768209030_3092298_1403489671_12fe5518928c8b57e4d3cd91a2660f60_rle_crop_4097600678_0.png resize: (253, 170) 1403494595 -3.605920370120208 treat image : temp/1768209030_3092298_1403489671_12fe5518928c8b57e4d3cd91a2660f60_rle_crop_4097600679_0.png resize: (121, 201) 1403494596 -3.1893628928527016 treat image : temp/1768209030_3092298_1403489671_12fe5518928c8b57e4d3cd91a2660f60_rle_crop_4097600680_0.png resize: (363, 303) 1403494597 -4.988284660643099 treat image : temp/1768209030_3092298_1403489671_12fe5518928c8b57e4d3cd91a2660f60_rle_crop_4097600681_0.png resize: (721, 821) 1403494598 -4.912266364381452 treat image : temp/1768209030_3092298_1403489671_12fe5518928c8b57e4d3cd91a2660f60_rle_crop_4097600682_0.png resize: (324, 259) 1403494599 -4.392277272472966 treat image : temp/1768209030_3092298_1403489671_12fe5518928c8b57e4d3cd91a2660f60_rle_crop_4097600683_0.png resize: (101, 172) 1403494600 -3.385817841942466 treat image : temp/1768209030_3092298_1403489671_12fe5518928c8b57e4d3cd91a2660f60_rle_crop_4097600685_0.png resize: (413, 262) 1403494601 -4.257790215475444 treat image : temp/1768209030_3092298_1403489671_12fe5518928c8b57e4d3cd91a2660f60_rle_crop_4097600687_0.png resize: (266, 346) 1403494602 -4.209358562667713 treat image : temp/1768209030_3092298_1403489671_12fe5518928c8b57e4d3cd91a2660f60_rle_crop_4097600689_0.png resize: (176, 121) 1403494603 0.45277907772077497 treat image : temp/1768209030_3092298_1403489669_234b57c0778ebb1557126a680b2fc925_rle_crop_4097600692_0.png resize: (172, 117) 1403494604 -2.5141138842454396 treat image : temp/1768209030_3092298_1403489666_ab7440b4d86e6c12adcc58818a5f2a9c_rle_crop_4097600700_0.png resize: (281, 190) 1403494605 -3.1635226188659917 treat image : temp/1768209030_3092298_1403489666_ab7440b4d86e6c12adcc58818a5f2a9c_rle_crop_4097600701_0.png resize: (256, 226) 1403494606 -4.604082377272581 treat image : temp/1768209030_3092298_1403489666_ab7440b4d86e6c12adcc58818a5f2a9c_rle_crop_4097600705_0.png resize: (373, 492) 1403494607 -4.254092733113991 treat image : temp/1768209030_3092298_1403489666_ab7440b4d86e6c12adcc58818a5f2a9c_rle_crop_4097600706_0.png resize: (113, 76) 1403494608 1.058318732103208 treat image : temp/1768209030_3092298_1403489666_ab7440b4d86e6c12adcc58818a5f2a9c_rle_crop_4097600707_0.png resize: (264, 111) 1403494609 -2.892748605315842 treat image : temp/1768209030_3092298_1403489664_5041fd2674714b51e5b7f68fc76f2594_rle_crop_4097600710_0.png resize: (116, 81) 1403494610 -3.5804458073843195 treat image : temp/1768209030_3092298_1403489664_5041fd2674714b51e5b7f68fc76f2594_rle_crop_4097600711_0.png resize: (529, 315) 1403494611 -4.000938405823945 treat image : temp/1768209030_3092298_1403489664_5041fd2674714b51e5b7f68fc76f2594_rle_crop_4097600714_0.png resize: (117, 120) 1403494612 -1.3663915709033876 treat image : temp/1768209030_3092298_1403489663_509934a6189a4b4d78cae7712ddbe083_rle_crop_4097600717_0.png resize: (221, 250) 1403494613 -4.154576136573671 treat image : temp/1768209030_3092298_1403489662_56505ed5591c8ae0727d0123bebf9776_rle_crop_4097600720_0.png resize: (281, 304) 1403494614 -4.052040999403957 treat image : temp/1768209030_3092298_1403489662_56505ed5591c8ae0727d0123bebf9776_rle_crop_4097600721_0.png resize: (456, 190) 1403494615 -3.057929898355422 treat image : temp/1768209030_3092298_1403489662_56505ed5591c8ae0727d0123bebf9776_rle_crop_4097600722_0.png resize: (151, 183) 1403494616 -2.230368562457603 treat image : temp/1768209030_3092298_1403489662_56505ed5591c8ae0727d0123bebf9776_rle_crop_4097600725_0.png resize: (445, 530) 1403494617 -4.7458451312972985 treat image : temp/1768209030_3092298_1403489661_354f6038865a98fce57c21f7a69afecb_rle_crop_4097600730_0.png resize: (411, 92) 1403494618 -4.463039477608051 treat image : temp/1768209030_3092298_1403489661_354f6038865a98fce57c21f7a69afecb_rle_crop_4097600733_0.png resize: (185, 197) 1403494619 -4.849950419678059 treat image : temp/1768209030_3092298_1403489661_354f6038865a98fce57c21f7a69afecb_rle_crop_4097600734_0.png resize: (245, 95) 1403494620 -3.7080442240944778 treat image : temp/1768209030_3092298_1403489661_354f6038865a98fce57c21f7a69afecb_rle_crop_4097600735_0.png resize: (115, 305) 1403494621 -3.80076543302147 treat image : temp/1768209030_3092298_1403489661_354f6038865a98fce57c21f7a69afecb_rle_crop_4097600738_0.png resize: (166, 218) 1403494622 -2.8314621515314835 treat image : temp/1768209030_3092298_1403489658_974bf3b12e953c5026bec407ca7cf5f1_rle_crop_4097600744_0.png resize: (208, 104) 1403494623 -2.2694070663345127 treat image : temp/1768209030_3092298_1403489658_974bf3b12e953c5026bec407ca7cf5f1_rle_crop_4097600745_0.png resize: (163, 226) 1403494624 -3.868599068493648 treat image : temp/1768209030_3092298_1403489646_6729ac64e986c265a35fc838d1886135_rle_crop_4097600749_0.png resize: (334, 184) 1403494625 -4.5738435871132905 treat image : temp/1768209030_3092298_1403489646_6729ac64e986c265a35fc838d1886135_rle_crop_4097600750_0.png resize: (279, 127) 1403494626 -3.9344912253872333 treat image : temp/1768209030_3092298_1403489646_6729ac64e986c265a35fc838d1886135_rle_crop_4097600751_0.png resize: (396, 617) 1403494627 -4.51923462194489 treat image : temp/1768209030_3092298_1403489644_1707e202ec63465f3a846a356310f36d_rle_crop_4097600755_0.png resize: (345, 410) 1403494628 -2.543538597465386 treat image : temp/1768209030_3092298_1403489644_1707e202ec63465f3a846a356310f36d_rle_crop_4097600757_0.png resize: (325, 356) 1403494629 -4.374440630323995 treat image : temp/1768209030_3092298_1403489644_1707e202ec63465f3a846a356310f36d_rle_crop_4097600761_0.png resize: (78, 98) 1403494630 -1.2219145687033988 treat image : temp/1768209030_3092298_1403489644_1707e202ec63465f3a846a356310f36d_rle_crop_4097600766_0.png resize: (477, 290) 1403494631 -4.149948108682648 treat image : temp/1768209030_3092298_1403489669_234b57c0778ebb1557126a680b2fc925_rle_crop_4097600695_0.png resize: (179, 108) 1403494632 -4.282027327251544 treat image : temp/1768209030_3092298_1403489669_234b57c0778ebb1557126a680b2fc925_rle_crop_4097600699_0.png resize: (175, 122) 1403494633 -4.666259474121621 treat image : temp/1768209030_3092298_1403489663_509934a6189a4b4d78cae7712ddbe083_rle_crop_4097600715_0.png resize: (292, 167) 1403494634 -2.7361595136243846 treat image : temp/1768209030_3092298_1403489663_509934a6189a4b4d78cae7712ddbe083_rle_crop_4097600716_0.png resize: (131, 149) 1403494635 -3.193775443006352 treat image : temp/1768209030_3092298_1403489661_354f6038865a98fce57c21f7a69afecb_rle_crop_4097600728_0.png resize: (350, 679) 1403494636 -5.363951071576153 treat image : temp/1768209030_3092298_1403489669_234b57c0778ebb1557126a680b2fc925_rle_crop_4097600694_0.png resize: (168, 126) 1403494644 -4.684173596404047 treat image : temp/1768209030_3092298_1403489646_6729ac64e986c265a35fc838d1886135_rle_crop_4097600754_0.png resize: (69, 62) 1403494645 -4.747285324414739 treat image : temp/1768209030_3092298_1403489671_12fe5518928c8b57e4d3cd91a2660f60_rle_crop_4097600684_0.png resize: (123, 224) 1403494714 -3.193580904530206 treat image : temp/1768209030_3092298_1403489671_12fe5518928c8b57e4d3cd91a2660f60_rle_crop_4097600686_0.png resize: (355, 302) 1403494715 -4.799477604631728 treat image : temp/1768209030_3092298_1403489671_12fe5518928c8b57e4d3cd91a2660f60_rle_crop_4097600690_0.png resize: (605, 660) 1403494716 -3.664242915500727 treat image : temp/1768209030_3092298_1403489669_234b57c0778ebb1557126a680b2fc925_rle_crop_4097600691_0.png resize: (546, 760) 1403494717 -4.372982505857521 treat image : temp/1768209030_3092298_1403489669_234b57c0778ebb1557126a680b2fc925_rle_crop_4097600693_0.png resize: (366, 321) 1403494718 -5.07881198341133 treat image : temp/1768209030_3092298_1403489669_234b57c0778ebb1557126a680b2fc925_rle_crop_4097600696_0.png resize: (621, 676) 1403494719 -4.941543512904656 treat image : temp/1768209030_3092298_1403489669_234b57c0778ebb1557126a680b2fc925_rle_crop_4097600698_0.png resize: (190, 353) 1403494720 -3.4858706841365095 treat image : temp/1768209030_3092298_1403489666_ab7440b4d86e6c12adcc58818a5f2a9c_rle_crop_4097600702_0.png resize: (186, 186) 1403494721 -4.079539241508319 treat image : temp/1768209030_3092298_1403489666_ab7440b4d86e6c12adcc58818a5f2a9c_rle_crop_4097600703_0.png resize: (405, 491) 1403494722 -4.411908658128023 treat image : temp/1768209030_3092298_1403489666_ab7440b4d86e6c12adcc58818a5f2a9c_rle_crop_4097600704_0.png resize: (125, 116) 1403494723 -3.726002029120844 treat image : temp/1768209030_3092298_1403489664_5041fd2674714b51e5b7f68fc76f2594_rle_crop_4097600709_0.png resize: (341, 274) 1403494724 -4.769791430778822 treat image : temp/1768209030_3092298_1403489664_5041fd2674714b51e5b7f68fc76f2594_rle_crop_4097600712_0.png resize: (341, 527) 1403494725 -4.79633086010079 treat image : temp/1768209030_3092298_1403489664_5041fd2674714b51e5b7f68fc76f2594_rle_crop_4097600713_0.png resize: (461, 324) 1403494726 -4.612839079936902 treat image : temp/1768209030_3092298_1403489663_509934a6189a4b4d78cae7712ddbe083_rle_crop_4097600718_0.png resize: (340, 217) 1403494727 -4.451903095215759 treat image : temp/1768209030_3092298_1403489663_509934a6189a4b4d78cae7712ddbe083_rle_crop_4097600719_0.png resize: (425, 279) 1403494728 -4.327811872632365 treat image : temp/1768209030_3092298_1403489662_56505ed5591c8ae0727d0123bebf9776_rle_crop_4097600723_0.png resize: (282, 259) 1403494729 -4.087071135881033 treat image : temp/1768209030_3092298_1403489662_56505ed5591c8ae0727d0123bebf9776_rle_crop_4097600724_0.png resize: (226, 246) 1403494730 -4.79361091719825 treat image : temp/1768209030_3092298_1403489662_56505ed5591c8ae0727d0123bebf9776_rle_crop_4097600726_0.png resize: (102, 384) 1403494731 -3.566070382341765 treat image : temp/1768209030_3092298_1403489661_354f6038865a98fce57c21f7a69afecb_rle_crop_4097600727_0.png resize: (256, 402) 1403494732 -4.546414719020528 treat image : temp/1768209030_3092298_1403489661_354f6038865a98fce57c21f7a69afecb_rle_crop_4097600729_0.png resize: (906, 692) 1403494733 -5.032526693323186 treat image : temp/1768209030_3092298_1403489661_354f6038865a98fce57c21f7a69afecb_rle_crop_4097600731_0.png resize: (399, 513) 1403494734 -4.874605498627275 treat image : temp/1768209030_3092298_1403489661_354f6038865a98fce57c21f7a69afecb_rle_crop_4097600732_0.png resize: (320, 464) 1403494735 -4.396121301317755 treat image : temp/1768209030_3092298_1403489661_354f6038865a98fce57c21f7a69afecb_rle_crop_4097600736_0.png resize: (233, 358) 1403494736 -4.721218318181837 treat image : temp/1768209030_3092298_1403489661_354f6038865a98fce57c21f7a69afecb_rle_crop_4097600737_0.png resize: (216, 391) 1403494737 -2.9488358780568587 treat image : temp/1768209030_3092298_1403489661_354f6038865a98fce57c21f7a69afecb_rle_crop_4097600739_0.png resize: (154, 439) 1403494738 -3.0869399055952393 treat image : temp/1768209030_3092298_1403489658_974bf3b12e953c5026bec407ca7cf5f1_rle_crop_4097600740_0.png resize: (310, 240) 1403494739 -4.398063024570993 treat image : temp/1768209030_3092298_1403489658_974bf3b12e953c5026bec407ca7cf5f1_rle_crop_4097600741_0.png resize: (165, 527) 1403494740 -4.056772956039161 treat image : temp/1768209030_3092298_1403489658_974bf3b12e953c5026bec407ca7cf5f1_rle_crop_4097600742_0.png resize: (159, 151) 1403494741 -4.056089508865018 treat image : temp/1768209030_3092298_1403489658_974bf3b12e953c5026bec407ca7cf5f1_rle_crop_4097600743_0.png resize: (242, 498) 1403494742 -3.8439051896059353 treat image : temp/1768209030_3092298_1403489658_974bf3b12e953c5026bec407ca7cf5f1_rle_crop_4097600746_0.png resize: (386, 306) 1403494743 -4.31926415236495 treat image : temp/1768209030_3092298_1403489658_974bf3b12e953c5026bec407ca7cf5f1_rle_crop_4097600747_0.png resize: (350, 543) 1403494744 -3.9366970061423245 treat image : temp/1768209030_3092298_1403489646_6729ac64e986c265a35fc838d1886135_rle_crop_4097600748_0.png resize: (193, 396) 1403494745 -4.394819194280978 treat image : temp/1768209030_3092298_1403489646_6729ac64e986c265a35fc838d1886135_rle_crop_4097600752_0.png resize: (390, 269) 1403494746 -4.21580128380318 treat image : temp/1768209030_3092298_1403489646_6729ac64e986c265a35fc838d1886135_rle_crop_4097600753_0.png resize: (189, 389) 1403494747 -3.4682611366247107 treat image : temp/1768209030_3092298_1403489644_1707e202ec63465f3a846a356310f36d_rle_crop_4097600756_0.png resize: (439, 561) 1403494748 -5.310779202972231 treat image : temp/1768209030_3092298_1403489644_1707e202ec63465f3a846a356310f36d_rle_crop_4097600758_0.png resize: (592, 464) 1403494749 -4.904842547676319 treat image : temp/1768209030_3092298_1403489644_1707e202ec63465f3a846a356310f36d_rle_crop_4097600759_0.png resize: (511, 713) 1403494750 -4.804593482279112 treat image : temp/1768209030_3092298_1403489644_1707e202ec63465f3a846a356310f36d_rle_crop_4097600760_0.png resize: (242, 562) 1403494751 -3.912650077113532 treat image : temp/1768209030_3092298_1403489644_1707e202ec63465f3a846a356310f36d_rle_crop_4097600762_0.png resize: (389, 192) 1403494752 -4.634482259957839 treat image : temp/1768209030_3092298_1403489644_1707e202ec63465f3a846a356310f36d_rle_crop_4097600763_0.png resize: (391, 309) 1403494753 -4.172658288475427 treat image : temp/1768209030_3092298_1403489644_1707e202ec63465f3a846a356310f36d_rle_crop_4097600764_0.png resize: (487, 389) 1403494754 -3.6034953507339305 treat image : temp/1768209030_3092298_1403489644_1707e202ec63465f3a846a356310f36d_rle_crop_4097600765_0.png resize: (210, 486) 1403494755 -4.645790672980765 treat image : temp/1768209030_3092298_1403489669_234b57c0778ebb1557126a680b2fc925_rle_crop_4097600697_0.png resize: (155, 255) 1403494758 -2.3900308831401094 treat image : temp/1768209030_3092298_1403489666_ab7440b4d86e6c12adcc58818a5f2a9c_rle_crop_4097600708_0.png resize: (324, 193) 1403494759 -2.2506365204061702 treat image : temp/1768209030_3092298_1403489671_12fe5518928c8b57e4d3cd91a2660f60_rle_crop_4097600688_0.png resize: (229, 289) 1403494762 -3.880022253331857 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 99 time used for this insertion : 0.018186569213867188 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 99 time used for this insertion : 0.021485090255737305 save missing photos in datou_result : time spend for datou_step_exec : 40.20574736595154 time spend to save output : 0.04558563232421875 total time spend for step 6 : 40.25133299827576 step7:brightness Mon Jan 12 10:14:37 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1768209030_3092298_1403489671_12fe5518928c8b57e4d3cd91a2660f60.jpg treat image : temp/1768209030_3092298_1403489669_234b57c0778ebb1557126a680b2fc925.jpg treat image : temp/1768209030_3092298_1403489666_ab7440b4d86e6c12adcc58818a5f2a9c.jpg treat image : temp/1768209030_3092298_1403489664_5041fd2674714b51e5b7f68fc76f2594.jpg treat image : temp/1768209030_3092298_1403489663_509934a6189a4b4d78cae7712ddbe083.jpg treat image : temp/1768209030_3092298_1403489662_56505ed5591c8ae0727d0123bebf9776.jpg treat image : temp/1768209030_3092298_1403489661_354f6038865a98fce57c21f7a69afecb.jpg treat image : temp/1768209030_3092298_1403489658_974bf3b12e953c5026bec407ca7cf5f1.jpg treat image : temp/1768209030_3092298_1403489646_6729ac64e986c265a35fc838d1886135.jpg treat image : temp/1768209030_3092298_1403489644_1707e202ec63465f3a846a356310f36d.jpg treat image : temp/1768209030_3092298_1403489671_12fe5518928c8b57e4d3cd91a2660f60_rle_crop_4097600678_0.png treat image : temp/1768209030_3092298_1403489671_12fe5518928c8b57e4d3cd91a2660f60_rle_crop_4097600679_0.png treat image : temp/1768209030_3092298_1403489671_12fe5518928c8b57e4d3cd91a2660f60_rle_crop_4097600680_0.png treat image : temp/1768209030_3092298_1403489671_12fe5518928c8b57e4d3cd91a2660f60_rle_crop_4097600681_0.png treat image : temp/1768209030_3092298_1403489671_12fe5518928c8b57e4d3cd91a2660f60_rle_crop_4097600682_0.png treat image : temp/1768209030_3092298_1403489671_12fe5518928c8b57e4d3cd91a2660f60_rle_crop_4097600683_0.png treat image : temp/1768209030_3092298_1403489671_12fe5518928c8b57e4d3cd91a2660f60_rle_crop_4097600685_0.png treat image : temp/1768209030_3092298_1403489671_12fe5518928c8b57e4d3cd91a2660f60_rle_crop_4097600687_0.png treat image : temp/1768209030_3092298_1403489671_12fe5518928c8b57e4d3cd91a2660f60_rle_crop_4097600689_0.png treat image : temp/1768209030_3092298_1403489669_234b57c0778ebb1557126a680b2fc925_rle_crop_4097600692_0.png treat image : temp/1768209030_3092298_1403489666_ab7440b4d86e6c12adcc58818a5f2a9c_rle_crop_4097600700_0.png treat image : temp/1768209030_3092298_1403489666_ab7440b4d86e6c12adcc58818a5f2a9c_rle_crop_4097600701_0.png treat image : temp/1768209030_3092298_1403489666_ab7440b4d86e6c12adcc58818a5f2a9c_rle_crop_4097600705_0.png treat image : temp/1768209030_3092298_1403489666_ab7440b4d86e6c12adcc58818a5f2a9c_rle_crop_4097600706_0.png treat image : temp/1768209030_3092298_1403489666_ab7440b4d86e6c12adcc58818a5f2a9c_rle_crop_4097600707_0.png treat image : temp/1768209030_3092298_1403489664_5041fd2674714b51e5b7f68fc76f2594_rle_crop_4097600710_0.png treat image : temp/1768209030_3092298_1403489664_5041fd2674714b51e5b7f68fc76f2594_rle_crop_4097600711_0.png treat image : temp/1768209030_3092298_1403489664_5041fd2674714b51e5b7f68fc76f2594_rle_crop_4097600714_0.png treat image : temp/1768209030_3092298_1403489663_509934a6189a4b4d78cae7712ddbe083_rle_crop_4097600717_0.png treat image : temp/1768209030_3092298_1403489662_56505ed5591c8ae0727d0123bebf9776_rle_crop_4097600720_0.png treat image : temp/1768209030_3092298_1403489662_56505ed5591c8ae0727d0123bebf9776_rle_crop_4097600721_0.png treat image : temp/1768209030_3092298_1403489662_56505ed5591c8ae0727d0123bebf9776_rle_crop_4097600722_0.png treat image : temp/1768209030_3092298_1403489662_56505ed5591c8ae0727d0123bebf9776_rle_crop_4097600725_0.png treat image : temp/1768209030_3092298_1403489661_354f6038865a98fce57c21f7a69afecb_rle_crop_4097600730_0.png treat image : temp/1768209030_3092298_1403489661_354f6038865a98fce57c21f7a69afecb_rle_crop_4097600733_0.png treat image : temp/1768209030_3092298_1403489661_354f6038865a98fce57c21f7a69afecb_rle_crop_4097600734_0.png treat image : temp/1768209030_3092298_1403489661_354f6038865a98fce57c21f7a69afecb_rle_crop_4097600735_0.png treat image : temp/1768209030_3092298_1403489661_354f6038865a98fce57c21f7a69afecb_rle_crop_4097600738_0.png treat image : temp/1768209030_3092298_1403489658_974bf3b12e953c5026bec407ca7cf5f1_rle_crop_4097600744_0.png treat image : temp/1768209030_3092298_1403489658_974bf3b12e953c5026bec407ca7cf5f1_rle_crop_4097600745_0.png treat image : temp/1768209030_3092298_1403489646_6729ac64e986c265a35fc838d1886135_rle_crop_4097600749_0.png treat image : temp/1768209030_3092298_1403489646_6729ac64e986c265a35fc838d1886135_rle_crop_4097600750_0.png treat image : temp/1768209030_3092298_1403489646_6729ac64e986c265a35fc838d1886135_rle_crop_4097600751_0.png treat image : temp/1768209030_3092298_1403489644_1707e202ec63465f3a846a356310f36d_rle_crop_4097600755_0.png treat image : temp/1768209030_3092298_1403489644_1707e202ec63465f3a846a356310f36d_rle_crop_4097600757_0.png treat image : temp/1768209030_3092298_1403489644_1707e202ec63465f3a846a356310f36d_rle_crop_4097600761_0.png treat image : temp/1768209030_3092298_1403489644_1707e202ec63465f3a846a356310f36d_rle_crop_4097600766_0.png treat image : temp/1768209030_3092298_1403489669_234b57c0778ebb1557126a680b2fc925_rle_crop_4097600695_0.png treat image : temp/1768209030_3092298_1403489669_234b57c0778ebb1557126a680b2fc925_rle_crop_4097600699_0.png treat image : temp/1768209030_3092298_1403489663_509934a6189a4b4d78cae7712ddbe083_rle_crop_4097600715_0.png treat image : temp/1768209030_3092298_1403489663_509934a6189a4b4d78cae7712ddbe083_rle_crop_4097600716_0.png treat image : temp/1768209030_3092298_1403489661_354f6038865a98fce57c21f7a69afecb_rle_crop_4097600728_0.png treat image : temp/1768209030_3092298_1403489669_234b57c0778ebb1557126a680b2fc925_rle_crop_4097600694_0.png treat image : temp/1768209030_3092298_1403489646_6729ac64e986c265a35fc838d1886135_rle_crop_4097600754_0.png treat image : temp/1768209030_3092298_1403489671_12fe5518928c8b57e4d3cd91a2660f60_rle_crop_4097600684_0.png treat image : temp/1768209030_3092298_1403489671_12fe5518928c8b57e4d3cd91a2660f60_rle_crop_4097600686_0.png treat image : temp/1768209030_3092298_1403489671_12fe5518928c8b57e4d3cd91a2660f60_rle_crop_4097600690_0.png treat image : temp/1768209030_3092298_1403489669_234b57c0778ebb1557126a680b2fc925_rle_crop_4097600691_0.png treat image : temp/1768209030_3092298_1403489669_234b57c0778ebb1557126a680b2fc925_rle_crop_4097600693_0.png treat image : temp/1768209030_3092298_1403489669_234b57c0778ebb1557126a680b2fc925_rle_crop_4097600696_0.png treat image : temp/1768209030_3092298_1403489669_234b57c0778ebb1557126a680b2fc925_rle_crop_4097600698_0.png treat image : temp/1768209030_3092298_1403489666_ab7440b4d86e6c12adcc58818a5f2a9c_rle_crop_4097600702_0.png treat image : temp/1768209030_3092298_1403489666_ab7440b4d86e6c12adcc58818a5f2a9c_rle_crop_4097600703_0.png treat image : temp/1768209030_3092298_1403489666_ab7440b4d86e6c12adcc58818a5f2a9c_rle_crop_4097600704_0.png treat image : temp/1768209030_3092298_1403489664_5041fd2674714b51e5b7f68fc76f2594_rle_crop_4097600709_0.png treat image : temp/1768209030_3092298_1403489664_5041fd2674714b51e5b7f68fc76f2594_rle_crop_4097600712_0.png treat image : temp/1768209030_3092298_1403489664_5041fd2674714b51e5b7f68fc76f2594_rle_crop_4097600713_0.png treat image : temp/1768209030_3092298_1403489663_509934a6189a4b4d78cae7712ddbe083_rle_crop_4097600718_0.png treat image : temp/1768209030_3092298_1403489663_509934a6189a4b4d78cae7712ddbe083_rle_crop_4097600719_0.png treat image : temp/1768209030_3092298_1403489662_56505ed5591c8ae0727d0123bebf9776_rle_crop_4097600723_0.png treat image : temp/1768209030_3092298_1403489662_56505ed5591c8ae0727d0123bebf9776_rle_crop_4097600724_0.png treat image : temp/1768209030_3092298_1403489662_56505ed5591c8ae0727d0123bebf9776_rle_crop_4097600726_0.png treat image : temp/1768209030_3092298_1403489661_354f6038865a98fce57c21f7a69afecb_rle_crop_4097600727_0.png treat image : temp/1768209030_3092298_1403489661_354f6038865a98fce57c21f7a69afecb_rle_crop_4097600729_0.png treat image : temp/1768209030_3092298_1403489661_354f6038865a98fce57c21f7a69afecb_rle_crop_4097600731_0.png treat image : temp/1768209030_3092298_1403489661_354f6038865a98fce57c21f7a69afecb_rle_crop_4097600732_0.png treat image : temp/1768209030_3092298_1403489661_354f6038865a98fce57c21f7a69afecb_rle_crop_4097600736_0.png treat image : temp/1768209030_3092298_1403489661_354f6038865a98fce57c21f7a69afecb_rle_crop_4097600737_0.png treat image : temp/1768209030_3092298_1403489661_354f6038865a98fce57c21f7a69afecb_rle_crop_4097600739_0.png treat image : temp/1768209030_3092298_1403489658_974bf3b12e953c5026bec407ca7cf5f1_rle_crop_4097600740_0.png treat image : temp/1768209030_3092298_1403489658_974bf3b12e953c5026bec407ca7cf5f1_rle_crop_4097600741_0.png treat image : temp/1768209030_3092298_1403489658_974bf3b12e953c5026bec407ca7cf5f1_rle_crop_4097600742_0.png treat image : temp/1768209030_3092298_1403489658_974bf3b12e953c5026bec407ca7cf5f1_rle_crop_4097600743_0.png treat image : temp/1768209030_3092298_1403489658_974bf3b12e953c5026bec407ca7cf5f1_rle_crop_4097600746_0.png treat image : temp/1768209030_3092298_1403489658_974bf3b12e953c5026bec407ca7cf5f1_rle_crop_4097600747_0.png treat image : temp/1768209030_3092298_1403489646_6729ac64e986c265a35fc838d1886135_rle_crop_4097600748_0.png treat image : temp/1768209030_3092298_1403489646_6729ac64e986c265a35fc838d1886135_rle_crop_4097600752_0.png treat image : temp/1768209030_3092298_1403489646_6729ac64e986c265a35fc838d1886135_rle_crop_4097600753_0.png treat image : temp/1768209030_3092298_1403489644_1707e202ec63465f3a846a356310f36d_rle_crop_4097600756_0.png treat image : temp/1768209030_3092298_1403489644_1707e202ec63465f3a846a356310f36d_rle_crop_4097600758_0.png treat image : temp/1768209030_3092298_1403489644_1707e202ec63465f3a846a356310f36d_rle_crop_4097600759_0.png treat image : temp/1768209030_3092298_1403489644_1707e202ec63465f3a846a356310f36d_rle_crop_4097600760_0.png treat image : temp/1768209030_3092298_1403489644_1707e202ec63465f3a846a356310f36d_rle_crop_4097600762_0.png treat image : temp/1768209030_3092298_1403489644_1707e202ec63465f3a846a356310f36d_rle_crop_4097600763_0.png treat image : temp/1768209030_3092298_1403489644_1707e202ec63465f3a846a356310f36d_rle_crop_4097600764_0.png treat image : temp/1768209030_3092298_1403489644_1707e202ec63465f3a846a356310f36d_rle_crop_4097600765_0.png treat image : temp/1768209030_3092298_1403489669_234b57c0778ebb1557126a680b2fc925_rle_crop_4097600697_0.png treat image : temp/1768209030_3092298_1403489666_ab7440b4d86e6c12adcc58818a5f2a9c_rle_crop_4097600708_0.png treat image : temp/1768209030_3092298_1403489671_12fe5518928c8b57e4d3cd91a2660f60_rle_crop_4097600688_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 99 time used for this insertion : 0.02118515968322754 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 99 time used for this insertion : 0.01967930793762207 save missing photos in datou_result : time spend for datou_step_exec : 9.545157670974731 time spend to save output : 0.04689788818359375 total time spend for step 7 : 9.592055559158325 step8:velours_tree Mon Jan 12 10:14:47 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.25013303756713867 time spend to save output : 4.4345855712890625e-05 total time spend for step 8 : 0.25017738342285156 step9:send_mail_cod Mon Jan 12 10:14:47 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P30090237_12-01-2026_10_14_47.pdf 30090433 change filename to text .change filename to text .imagette300904331768209287 30090434 imagette300904341768209287 30090435 change filename to text .change filename to text .imagette300904351768209287 30090436 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette300904361768209287 30090437 imagette300904371768209289 30090438 change filename to text .imagette300904381768209289 30090440 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette300904401768209290 30090441 imagette300904411768209290 30090442 imagette300904421768209290 30090443 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette300904431768209290 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=30090237 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/30090433,30090434,30090435,30090436,30090437,30090438,30090439,30090440,30090441,30090442,30090443?tags=autre,flou,metal,pet_clair,pehd,pet_fonce,environnement,carton,mal_croppe,background,papier your option no_mail is active, we will not send the real mail to your client args[1403489671] : ((1403489671, -6.230115887427712, 492609224), (1403489671, 0.06009012034159913, 2107752395), '0.07820524691358025') We are sending mail with results at report@fotonower.com args[1403489669] : ((1403489669, -6.2241917917691705, 492609224), (1403489669, -0.05439256618971903, 2107752395), '0.07820524691358025') We are sending mail with results at report@fotonower.com args[1403489666] : ((1403489666, -6.0316778382139375, 492609224), (1403489666, 0.04149600688861913, 2107752395), '0.07820524691358025') We are sending mail with results at report@fotonower.com args[1403489664] : ((1403489664, -6.156497079052504, 492609224), (1403489664, 0.10503352477835663, 2107752395), '0.07820524691358025') We are sending mail with results at report@fotonower.com args[1403489663] : ((1403489663, -6.171147616729857, 492609224), (1403489663, -0.024032958749635513, 2107752395), '0.07820524691358025') We are sending mail with results at report@fotonower.com args[1403489662] : ((1403489662, -6.192495026838389, 492609224), (1403489662, -0.2229464885331811, 496442774), '0.07820524691358025') We are sending mail with results at report@fotonower.com args[1403489661] : ((1403489661, -6.124007843815178, 492609224), (1403489661, -0.08649627369547169, 496442774), '0.07820524691358025') We are sending mail with results at report@fotonower.com args[1403489658] : ((1403489658, -5.906536807291898, 492609224), (1403489658, 0.03723532131921321, 2107752395), '0.07820524691358025') We are sending mail with results at report@fotonower.com args[1403489646] : ((1403489646, -6.036148939793755, 492609224), (1403489646, -0.029468655603910064, 2107752395), '0.07820524691358025') We are sending mail with results at report@fotonower.com args[1403489644] : ((1403489644, -6.0738129960699965, 492609224), (1403489644, -0.09212187260810857, 496442774), '0.07820524691358025') We are sending mail with results at report@fotonower.com refus_total : 0.07820524691358025 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos_view ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=30090237 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30090237_12-01-2026_10_14_47.pdf results_Auto_P30090237_12-01-2026_10_14_47.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30090237_12-01-2026_10_14_47.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','30090237','results_Auto_P30090237_12-01-2026_10_14_47.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30090237_12-01-2026_10_14_47.pdf','pdf','','0.71','0.07820524691358025') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1403489671, 1403489669, 1403489666, 1403489664, 1403489663, 1403489662, 1403489661, 1403489658, 1403489646, 1403489644] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4328919') ('3318', '30090237', '1403489671', None, None, None, None, None, '4328919') ('3318', None, None, None, None, None, None, None, '4328919') ('3318', '30090237', '1403489669', None, None, None, None, None, '4328919') ('3318', None, None, None, None, None, None, None, '4328919') ('3318', '30090237', '1403489666', None, None, None, None, None, '4328919') ('3318', None, None, None, None, None, None, None, '4328919') ('3318', '30090237', '1403489664', None, None, None, None, None, '4328919') ('3318', None, None, None, None, None, None, None, '4328919') ('3318', '30090237', '1403489663', None, None, None, None, None, '4328919') ('3318', None, None, None, None, None, None, None, '4328919') ('3318', '30090237', '1403489662', None, None, None, None, None, '4328919') ('3318', None, None, None, None, None, None, None, '4328919') ('3318', '30090237', '1403489661', None, None, None, None, None, '4328919') ('3318', None, None, None, None, None, None, None, '4328919') ('3318', '30090237', '1403489658', None, None, None, None, None, '4328919') ('3318', None, None, None, None, None, None, None, '4328919') ('3318', '30090237', '1403489646', None, None, None, None, None, '4328919') ('3318', None, None, None, None, None, None, None, '4328919') ('3318', '30090237', '1403489644', None, None, None, None, None, '4328919') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.01692509651184082 save_final save missing photos in datou_result : time spend for datou_step_exec : 7.896413564682007 time spend to save output : 0.01715707778930664 total time spend for step 9 : 7.9135706424713135 step10:split_time_score Mon Jan 12 10:14:55 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('09', 10),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 12012026 30090237 Nombre de photos uploadées : 10 / 23040 (0%) 12012026 30090237 Nombre de photos taguées (types de déchets): 0 / 10 (0%) 12012026 30090237 Nombre de photos taguées (volume) : 0 / 10 (0%) elapsed_time : load_data_split_time_score 1.6689300537109375e-06 elapsed_time : order_list_meta_photo_and_scores 5.245208740234375e-06 ?????????? elapsed_time : fill_and_build_computed_from_old_data 0.0007236003875732422 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.24027729034423828 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.04645872957598881 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30090232_12-01-2026_10_09_46.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30090232 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30090232 AND mptpi.`type`=3726 To do Qualite : 0.03407844745125184 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30090235_12-01-2026_10_05_03.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30090235 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30090235 AND mptpi.`type`=3726 To do Qualite : 0.03970347315771708 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30090236_12-01-2026_10_08_36.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30090236 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30090236 AND mptpi.`type`=3726 To do Qualite : 0.07820524691358025 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30090237_12-01-2026_10_14_47.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30090237 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30090237 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'12012026': {'nb_upload': 10, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1403489671, 1403489669, 1403489666, 1403489664, 1403489663, 1403489662, 1403489661, 1403489658, 1403489646, 1403489644] Looping around the photos to save general results len do output : 1 /30090237Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4328919') ('3318', '30090237', '1403489671', None, None, None, None, None, '4328919') ('3318', None, None, None, None, None, None, None, '4328919') ('3318', '30090237', '1403489669', None, None, None, None, None, '4328919') ('3318', None, None, None, None, None, None, None, '4328919') ('3318', '30090237', '1403489666', None, None, None, None, None, '4328919') ('3318', None, None, None, None, None, None, None, '4328919') ('3318', '30090237', '1403489664', None, None, None, None, None, '4328919') ('3318', None, None, None, None, None, None, None, '4328919') ('3318', '30090237', '1403489663', None, None, None, None, None, '4328919') ('3318', None, None, None, None, None, None, None, '4328919') ('3318', '30090237', '1403489662', None, None, None, None, None, '4328919') ('3318', None, None, None, None, None, None, None, '4328919') ('3318', '30090237', '1403489661', None, None, None, None, None, '4328919') ('3318', None, None, None, None, None, None, None, '4328919') ('3318', '30090237', '1403489658', None, None, None, None, None, '4328919') ('3318', None, None, None, None, None, None, None, '4328919') ('3318', '30090237', '1403489646', None, None, None, None, None, '4328919') ('3318', None, None, None, None, None, None, None, '4328919') ('3318', '30090237', '1403489644', None, None, None, None, None, '4328919') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.015544891357421875 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.7629776000976562 time spend to save output : 0.015771865844726562 total time spend for step 10 : 0.7787494659423828 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 10 set_done_treatment 123.96user 111.98system 4:30.52elapsed 87%CPU (0avgtext+0avgdata 4785740maxresident)k 982432inputs+131928outputs (15136major+11752030minor)pagefaults 0swaps