python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 8 -a ' -a 4871 -l 100 ' -s datou_current_4871 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1562829 load datou : 4871 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 we have a portfolio with more photos than limit : 2247>100 please execute split_portfolio.py -i 22700488 -l 100 size over we load limit photo not treated list_input_json: {} Current got : datou_id : 4871, datou_cur_ids : ['2795252'] with mtr_portfolio_ids : ['22700488'] and first list_photo_ids : [] new path : /proc/1562829/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : blur_detection over limit max, limiting to limit_max 20 list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 20 ; length of list_pids : 20 ; length of list_args : 20 time to download the photos : 2.4983224868774414 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:blur_detection Tue May 6 18:57:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec inside step blur_detection methode: ratio et variance treat image : temp/1746550647_1562829_1356383163_f54f973c9dcae3fe098276d4b111e238.jpg resize: (1080, 1632) 1356383163 -4.902221278211745 treat image : temp/1746550647_1562829_1356383159_cc8328dfbae4c7d3c0d465bf74918601.jpg resize: (1080, 1632) 1356383159 -0.8422418713654749 treat image : temp/1746550647_1562829_1356383155_7d53c4516a7552ff2616ca9ce0fdcde7.jpg resize: (1080, 1632) 1356383155 -1.4628584991507998 treat image : temp/1746550647_1562829_1356383151_dc3661ae12f6e612c0f0cb837d7271ec.jpg resize: (1080, 1632) 1356383151 -1.2416336235530196 treat image : temp/1746550647_1562829_1356383131_3c86dafe01701f532f7d6f400d1bedbc.jpg resize: (1080, 1632) 1356383131 -2.7112706256593304 treat image : temp/1746550647_1562829_1356383129_2d0ccff7e6de8fc02c0576a66d989bb4.jpg resize: (1080, 1632) 1356383129 -5.5504479272989755 treat image : temp/1746550647_1562829_1356383125_3b06f8d2e31b496fd388663abcbb33bc.jpg resize: (1080, 1632) 1356383125 -3.7437391112140745 treat image : temp/1746550647_1562829_1356383122_b3c9ff96fd01b2aec2fe769d8192b6c0.jpg resize: (1080, 1632) 1356383122 -4.686423610392634 treat image : temp/1746550647_1562829_1356383118_3283ff514cd5cceaf2450f75dc00a967.jpg resize: (1080, 1632) 1356383118 -4.724620463986447 treat image : temp/1746550647_1562829_1356383115_61e5ccc9f486be56244d03fa33f5b630.jpg resize: (1080, 1632) 1356383115 -6.318851708898062 treat image : temp/1746550647_1562829_1356380712_1efc84b56f70852bd6225790a3d8f949.jpg resize: (1080, 1632) 1356380712 -6.1195240346601505 treat image : temp/1746550647_1562829_1356380707_bb0e3a8dd1cd3192c38a0a20b63da7bb.jpg resize: (1080, 1632) 1356380707 -5.221834836889904 treat image : temp/1746550647_1562829_1356380703_7336b6bd0ef4d4aab9e095422eddf2aa.jpg resize: (1080, 1632) 1356380703 -4.810611827771462 treat image : temp/1746550647_1562829_1356380699_3d6fcce8f93379349ccca6013ee8e9bd.jpg resize: (1080, 1632) 1356380699 -3.6666618888206672 treat image : temp/1746550647_1562829_1356379993_c99983d926342805dcfcd7c8b1240eeb.jpg resize: (1080, 1632) 1356379993 -5.941497408716539 treat image : temp/1746550647_1562829_1356379990_7ccaaa751bf940871211cb2d72f86e55.jpg resize: (1080, 1632) 1356379990 -5.00879407405211 treat image : temp/1746550647_1562829_1356379987_b03d3b2db46e6ed6f531ec82a47904f3.jpg resize: (1080, 1632) 1356379987 -3.122611564385865 treat image : temp/1746550647_1562829_1356379983_e99b3fadff1014b0465dda508fb65d24.jpg resize: (1080, 1632) 1356379983 -5.415731711176258 treat image : temp/1746550647_1562829_1356379980_06c8e4310f4c09e01b94f2414f778aac.jpg resize: (1080, 1632) 1356379980 -5.55147947251485 treat image : temp/1746550647_1562829_1356379976_84da1e907b372807fabf0f1fcca9c815.jpg resize: (1080, 1632) 1356379976 -2.213772952672802 Inside saveOutput : final : True verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 20 time used for this insertion : 0.012098550796508789 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 20 time used for this insertion : 0.0140533447265625 begin to insert list_values into mtr_datou_result : length of list_values in save_final : 20 time used for this insertion : 0.016048431396484375 save missing photos in datou_result : time spend for datou_step_exec : 15.647297859191895 time spend to save output : 0.047789812088012695 total time spend for step 1 : 15.695087671279907 caffe_path_current : About to save ! 2 After save, about to update current ! update_current_state 14.38user 3.91system 0:20.62elapsed 88%CPU (0avgtext+0avgdata 142240maxresident)k 184inputs+9392outputs (5major+157548minor)pagefaults 0swaps