python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 12 -a ' -a 533 -l 200 --rand=1 ' -s datou_current_533 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3154023 load datou : 533 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 we have a portfolio with more photos than limit : 266>200 please execute split_portfolio.py -i 31285871 -l 200 size over we load limit photo not treated list_input_json: {} Date 2026-10-10 17:10:29.355193 Current got : datou_id : 533, datou_cur_ids : ['4398314'] with mtr_portfolio_ids : ['31285871'] and first list_photo_ids : [] new path : /proc/3154023/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! DataTypes for each output/input checked ! List Step Type Loaded in datou : tfhub_classification2, argmax list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! B[Errno 28] No space left on device can't download the photo : 1420083609 complete_path : /home/admin/workarea/git/Velours/python/temp/1791645029_3154023_1420083609_b18dedcef17fa61167eb38890a518de0.jpg FB[Errno 28] No space left on device can't download the photo : 1420083607 complete_path : /home/admin/workarea/git/Velours/python/temp/1791645029_3154023_1420083607_22bf9108fa93ac10ad268156342fbe26.jpg FB[Errno 28] No space left on device can't download the photo : 1420083604 complete_path : /home/admin/workarea/git/Velours/python/temp/1791645029_3154023_1420083604_47418e10aaaa2bac06946765c199402d.jpg FB[Errno 28] No space left on device can't download the photo : 1420083601 complete_path : /home/admin/workarea/git/Velours/python/temp/1791645029_3154023_1420083601_93e46a69d51251eb71b618b68c4151b3.jpg FB[Errno 28] No space left on device can't download the photo : 1420081035 complete_path : /home/admin/workarea/git/Velours/python/temp/1791645029_3154023_1420081035_ae08b17b32bd052f38adea0b06e1ec7f.jpg FB[Errno 28] No space left on device can't download the photo : 1420081033 complete_path : /home/admin/workarea/git/Velours/python/temp/1791645029_3154023_1420081033_28c20e6990aa84a5ef0f3450198e4abb.jpg FB[Errno 28] No space left on device can't download the photo : 1420081032 complete_path : /home/admin/workarea/git/Velours/python/temp/1791645029_3154023_1420081032_ad949665537c2c96b4bfe97bea7e5c9c.jpg FB[Errno 28] No space left on device can't download the photo : 1420080989 complete_path : /home/admin/workarea/git/Velours/python/temp/1791645029_3154023_1420080989_b0db81cde9701ee33bc38bf46247aa80.jpg FB[Errno 28] No space left on device can't download the photo : 1420080946 complete_path : /home/admin/workarea/git/Velours/python/temp/1791645029_3154023_1420080946_7a0be839b6376a5fc733d8fabe3cfa37.jpg FB[Errno 28] No space left on device can't download the photo : 1420080943 complete_path : /home/admin/workarea/git/Velours/python/temp/1791645029_3154023_1420080943_9a9439982fcdda8198a6a15d021d5c04.jpg FB[Errno 28] No space left on device can't download the photo : 1420077429 complete_path : /home/admin/workarea/git/Velours/python/temp/1791645029_3154023_1420077429_8651d38ff98b9cce07afb7eadc646d9c.jpg FB[Errno 28] No space left on device can't download the photo : 1420077370 complete_path : /home/admin/workarea/git/Velours/python/temp/1791645029_3154023_1420077370_d7b3c9f15552b7789bed678d1c585231.jpg FB[Errno 28] No space left on device can't download the photo : 1420077295 complete_path : /home/admin/workarea/git/Velours/python/temp/1791645029_3154023_1420077295_ee44592a56896576ca190ffa10e447cc.jpg FB[Errno 28] No space left on device can't download the photo : 1420077222 complete_path : /home/admin/workarea/git/Velours/python/temp/1791645029_3154023_1420077222_a00b82f4a3ac65d39baf9d575284effa.jpg FB[Errno 28] No space left on device can't download the photo : 1420077170 complete_path : /home/admin/workarea/git/Velours/python/temp/1791645029_3154023_1420077170_69479df370a4b8707b6e78357911d0c8.jpg FB[Errno 28] No space left on device can't download the photo : 1420077110 complete_path : /home/admin/workarea/git/Velours/python/temp/1791645029_3154023_1420077110_5b535f5c62d5ff306602def9955ffebf.jpg FB[Errno 28] No space left on device can't download the photo : 1420075771 complete_path : /home/admin/workarea/git/Velours/python/temp/1791645029_3154023_1420075771_238867dede8004e6558406b9616b7712.jpg FB[Errno 28] No space left on device can't download the photo : 1420075770 complete_path : /home/admin/workarea/git/Velours/python/temp/1791645029_3154023_1420075770_c9310a3e351c78e95550abb6e3a95c2e.jpg FB[Errno 28] No space left on device can't download the photo : 1420075769 complete_path : /home/admin/workarea/git/Velours/python/temp/1791645029_3154023_1420075769_ef87a5127b4f64c74f00042f97f21016.jpg FB[Errno 28] No space left on device can't download the photo : 1420075768 complete_path : /home/admin/workarea/git/Velours/python/temp/1791645029_3154023_1420075768_2eeb69bc0d839f29fadd319cff25543c.jpg FB[Errno 28] No space left on device can't download the photo : 1420075767 complete_path : /home/admin/workarea/git/Velours/python/temp/1791645029_3154023_1420075767_3938c03e60ae8ec5ec1a894869928dac.jpg FB[Errno 28] No space left on device can't download the photo : 1420075766 complete_path : /home/admin/workarea/git/Velours/python/temp/1791645029_3154023_1420075766_d3547a15975e5509528a2f83a7e2b192.jpg FB[Errno 28] No space left on device can't download the photo : 1420074570 complete_path : /home/admin/workarea/git/Velours/python/temp/1791645029_3154023_1420074570_d44f92ff7c7a86d09b205c3610bb0546.jpg FB[Errno 28] No space left on device can't download the photo : 1420074569 complete_path : /home/admin/workarea/git/Velours/python/temp/1791645029_3154023_1420074569_5457f85c7eb82d6d86f942d04886c11b.jpg FB[Errno 28] No space left on device can't download the photo : 1420074534 complete_path : /home/admin/workarea/git/Velours/python/temp/1791645029_3154023_1420074534_f0bc8f6f2f7ee405258a90fabad90356.jpg FB[Errno 28] No space left on device can't download the photo : 1420074478 complete_path : /home/admin/workarea/git/Velours/python/temp/1791645029_3154023_1420074478_a1e4f922a2101bf640e33ca39c287370.jpg FB[Errno 28] No space left on device can't download the photo : 1420074423 complete_path : /home/admin/workarea/git/Velours/python/temp/1791645029_3154023_1420074423_0ede6ad2d121533452e51676b0ed0868.jpg FB[Errno 28] No space left on device can't download the photo : 1420074371 complete_path : /home/admin/workarea/git/Velours/python/temp/1791645029_3154023_1420074371_73983d2a7aabbe4487a8cf710d73ed00.jpg FB[Errno 28] No space left on device can't download the photo : 1420073476 complete_path : /home/admin/workarea/git/Velours/python/temp/1791645029_3154023_1420073476_32664689d81634209cdd5e880904c013.jpg FB[Errno 28] No space left on device can't download the photo : 1420073475 complete_path : /home/admin/workarea/git/Velours/python/temp/1791645029_3154023_1420073475_c0abdd0c3f93370d3e016740ccd682ea.jpg FB[Errno 28] No space left on device can't download the photo : 1420073474 complete_path : /home/admin/workarea/git/Velours/python/temp/1791645029_3154023_1420073474_d3a861cb4b8bbcf72fae2f03e6a9bedb.jpg FB[Errno 28] No space left on device can't download the photo : 1420073472 complete_path : /home/admin/workarea/git/Velours/python/temp/1791645029_3154023_1420073472_e4386088715796bf0de90db72226bf26.jpg FB[Errno 28] No space left on device can't download the photo : 1420073468 complete_path : /home/admin/workarea/git/Velours/python/temp/1791645029_3154023_1420073468_cd99c04ad322bd761db59efe0a8902e4.jpg FB[Errno 28] No space left on device can't download the photo : 1420073464 complete_path : /home/admin/workarea/git/Velours/python/temp/1791645029_3154023_1420073464_62b4579f2b509a846e2af2b6ddb93d78.jpg FB[Errno 28] No space left on device can't download the photo : 1420073392 complete_path : /home/admin/workarea/git/Velours/python/temp/1791645029_3154023_1420073392_b13946e7c76de6af3c8b5d53318a26c8.jpg FB[Errno 28] No space left on device can't download the photo : 1420073390 complete_path : /home/admin/workarea/git/Velours/python/temp/1791645029_3154023_1420073390_10443bb8e3e77ecd62ca1746f43a5bd4.jpg FB[Errno 28] No space left on device can't download the photo : 1420073387 complete_path : /home/admin/workarea/git/Velours/python/temp/1791645029_3154023_1420073387_b830abe5baedf6af9f0cec3032611183.jpg FB[Errno 28] No space left on device can't download the photo : 1420073386 complete_path : /home/admin/workarea/git/Velours/python/temp/1791645029_3154023_1420073386_6ae4dd77b49cb55f08ed4f6cc970fa77.jpg FB[Errno 28] No space left on device can't download the photo : 1420073385 complete_path : /home/admin/workarea/git/Velours/python/temp/1791645029_3154023_1420073385_e6e768a343a129abf9e1a78ab3668cd9.jpg FB[Errno 28] No space left on device can't download the photo : 1420073382 complete_path : /home/admin/workarea/git/Velours/python/temp/1791645029_3154023_1420073382_fb8502fbe9e60f4d097e20f56d716598.jpg FB[Errno 28] No space left on device can't download the photo : 1420073157 complete_path : /home/admin/workarea/git/Velours/python/temp/1791645029_3154023_1420073157_3a6841cf66e6ef4e8e9b21d9b34f3e0a.jpg FB[Errno 28] No space left on device can't download the photo : 1420073156 complete_path : /home/admin/workarea/git/Velours/python/temp/1791645029_3154023_1420073156_5cd05a686b148f87ebfc9c4f91c5ff9b.jpg FB[Errno 28] No space left on device can't download the photo : 1420073154 complete_path : /home/admin/workarea/git/Velours/python/temp/1791645029_3154023_1420073154_1d4aed65681fce7210dded26b7235a2f.jpg FB[Errno 28] No space left on device can't download the photo : 1420073151 complete_path : /home/admin/workarea/git/Velours/python/temp/1791645029_3154023_1420073151_7c16ef13cc2fe56fa0e5ee0aa02a9dc5.jpg FB[Errno 28] No space left on device can't download the photo : 1420073149 complete_path : /home/admin/workarea/git/Velours/python/temp/1791645029_3154023_1420073149_106b426e4be8fca1b14321d9677c948a.jpg FB[Errno 28] No space left on device can't download the photo : 1420073125 complete_path : /home/admin/workarea/git/Velours/python/temp/1791645029_3154023_1420073125_5e76d391859bb6258e3607734f4e0c61.jpg FB[Errno 28] No space left on device can't download the photo : 1420071022 complete_path : /home/admin/workarea/git/Velours/python/temp/1791645029_3154023_1420071022_d76051d4531c52a48c91362bc9bebe4f.jpg FB[Errno 28] No space left on device can't download the photo : 1420071021 complete_path : /home/admin/workarea/git/Velours/python/temp/1791645029_3154023_1420071021_4851d4220baff946b6144947173d2de2.jpg FB[Errno 28] No space left on device can't download the photo : 1420071020 complete_path : /home/admin/workarea/git/Velours/python/temp/1791645029_3154023_1420071020_77deaa87d8e89fd0b8cf52eafe9d877f.jpg FB[Errno 28] No space left on device can't download the photo : 1420071019 complete_path : /home/admin/workarea/git/Velours/python/temp/1791645029_3154023_1420071019_4cdc7a5e3a19bf87549e6070985bcdef.jpg FB[Errno 28] No space left on device can't download the photo : 1420071018 complete_path : /home/admin/workarea/git/Velours/python/temp/1791645029_3154023_1420071018_5df37ff04f35fb86fa69fb020d58415e.jpg FB[Errno 28] No space left on device can't download the photo : 1420071016 complete_path : /home/admin/workarea/git/Velours/python/temp/1791645029_3154023_1420071016_4aab19bb395403764c55ee8921e240ac.jpg FB[Errno 28] No space left on device can't download the photo : 1420071004 complete_path : /home/admin/workarea/git/Velours/python/temp/1791645029_3154023_1420071004_57324d22ad69b91036ff1fcb2609ba8c.jpg FB[Errno 28] No space left on device can't download the photo : 1420071002 complete_path : /home/admin/workarea/git/Velours/python/temp/1791645029_3154023_1420071002_f309847c46115760888c3ee2f6c747e9.jpg FB[Errno 28] No space left on device can't download the photo : 1420071001 complete_path : /home/admin/workarea/git/Velours/python/temp/1791645029_3154023_1420071001_1295fa1bad5945e1a1b13ee5cc91dfd2.jpg FB[Errno 28] No space left on device can't download the photo : 1420071000 complete_path : /home/admin/workarea/git/Velours/python/temp/1791645029_3154023_1420071000_294a34a327155c0364a1df5db6d71e0e.jpg Fall photo missing in this thread we have missing 56 photos in the step downloads : photo missing : [1420083609, 1420083607, 1420083604, 1420083601, 1420081035, 1420081033, 1420081032, 1420080989, 1420080946, 1420080943, 1420077429, 1420077370, 1420077295, 1420077222, 1420077170, 1420077110, 1420075771, 1420075770, 1420075769, 1420075768, 1420075767, 1420075766, 1420074570, 1420074569, 1420074534, 1420074478, 1420074423, 1420074371, 1420073476, 1420073475, 1420073474, 1420073472, 1420073468, 1420073464, 1420073392, 1420073390, 1420073387, 1420073386, 1420073385, 1420073382, 1420073157, 1420073156, 1420073154, 1420073151, 1420073149, 1420073125, 1420071022, 1420071021, 1420071020, 1420071019, 1420071018, 1420071016, 1420071004, 1420071002, 1420071001, 1420071000] try to delete the photos missing in DB Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1420083609 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1420083607 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1420083604 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1420083601 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1420081035 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1420081033 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1420081032 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1420080989 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1420080946 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1420080943 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1420077429 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1420077370 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1420077295 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1420077222 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1420077170 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1420077110 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1420075771 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1420075770 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1420075769 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1420075768 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1420075767 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1420075766 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1420074570 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1420074569 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1420074534 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1420074478 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1420074423 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1420074371 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1420073476 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1420073475 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1420073474 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1420073472 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1420073468 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1420073464 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1420073392 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1420073390 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1420073387 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1420073386 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1420073385 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1420073382 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1420073157 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1420073156 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1420073154 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1420073151 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1420073149 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1420073125 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1420071022 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1420071021 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1420071020 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1420071019 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1420071018 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1420071016 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1420071004 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1420071002 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1420071001 Url missing : :https://www.fotonower.com/api/v1/photo/onerrorloadautomation/1420071000 length of list_filenames : 0 ; length of list_pids : 0 ; length of list_args : 0 time to download the photos : 20.861183166503906 About to test input to load empty input or other problem ret : 2 len(total_photo_id_missing) : 56 1.98user 1.84system 0:23.87elapsed 16%CPU (0avgtext+0avgdata 136464maxresident)k 472inputs+72outputs (12major+106466minor)pagefaults 0swaps