o ĎiB@sddlmZddlZddlZddlZddlmZddlmZddl m Z ddl Z ddl Z ddlmZ d,d d Zd dddddgdfd-d d!Zdd dddgddfd.d)d*Zed+krae edSdS)/) annotationsN) OrderedDict)Path)Literal) AsciiTablealldc s|j}|r d} |} nd} |dkrdnd} |dkrdnd} |dur/|jdd d |jd d n|d } fd d t|jD}fdd t|jD}|dkr|jd}|durft||jkd}||}|durx|dddd|||f}nB|dddddd||f}n2|jd}|durt||jkd}||}|dur|dd|||f}n |dddd||f}t||d kdkrd }n t ||d k}|rt | j | | | | ||d|St | | | | ||S)NzS {:<18} {} {:<{nameStrLen}} @[ IoU={:<9} | area={:>6s} | maxDets={:>3d} ] = {:0.3f}zB {:<18} {} @[ IoU={:<9} | area={:>6s} | maxDets={:>3d} ] = {:0.3f}rzAverage PrecisionzAverage Recallz(AP)z(AR)rz0.2f:cg|] \}}|kr|qSr).0iaRng)areaRngrX/home/jeff/fluffinator/venv/lib/python3.10/site-packages/sahi/scripts/coco_evaluation.py z'_cocoeval_summarize..cr rr)rrmDet)maxDetsrrrr precisionrecall) nameStrLen) paramsiouThrs enumerate areaRngLblrevalnpwherelenmeanprintformat)cocoevalapiouThrcatIdxrrcatNamerpiStrnameStrtitleStrtypeStriouStraindmindstmean_sr)rrr_cocoeval_summarizesB.   r6bboxFi)ii$ld( dataset_pathstr result_pathCOCOtypeCOCOevalmetric classwiseboolmax_detectionsintout_dirstr | Path | Noneareas list[int]c Ast|tr|n|g} ddg} | D]}|| vrtd|dq|dur3tjddttdd d d }|dur?t|ts?|g}| durMt| d krMtd t } t | }t |}Wdn1sdwYd|vrqi|d<ddl }|jdddd}t |||j}Wdn1swYzc||}t|j}| D]M}d|d}d|}t||}t | }t |}Wdn1swYz||}WntytdYn w||||}| durd| dgd| dg| d| d g| d | dgg|j_||j_|g|j_t|ts(t|tjs(|gn||j_dd dd dddddddd d! }|durS|D]}||vrQtd"|dqB||t|d dd#|d$}t|d dd#|d$}t|d d%d#|d$}t|d dd&|d$} t|d dd'|d$}!t|d dd(|d$}"t|d dd&|d$}#t|d dd'|d$}$t|d dd(|d$}%t|ddd&|d$}&t|ddd'|d$}'t|ddd(|d$}(t||||#|$|%| |!|"|&|'|(g d|_ |r|j!d)})t||)j"dkrtd*t|d+|)j"dd}*t#|D]\}+},|$|,d}-t|-d,}.|.|*kr|.n|*}*qg}/t#|D] \}+},|j%|,gd-}0t|0dkr8q#|$|,d}-t|d |+d#||-d,|*d.}1t|d |+d&||-d,|*d.}2t|d |+d'||-d,|*d.}3t|d |+d(||-d,|*d.}4t|d d|+d#||-d,|*d/}5t|d d|+d&||-d,|*d/}6t|d d|+d'||-d,|*d/}7t|d d|+d(||-d,|*d/}8|/|d0|-d,d1t&|1d2f|/|d0|-d,d3t&|2d2f|/|d0|-d,d4t&|3d2f|/|d0|-d,d5t&|4d2f|/|d0|-d,d6t&|5d2f|/|d0|-d,d7t&|6d2f|/|d0|-d,d8t&|7d2f|/|d0|-d,d9t&|8d2fq#t'dt|/dtt(j)|/d:d;gd}9t(j*fdd=|:D7};t,|;}|>| |=<q|j }1|1dd@dA|1d d@dA|1dd@dA|1d d@dA|1dd@dA|1dd@dA|1dd@dA|1dd@dA|1dd@| |dB<|rdCdD|/D| dE<qWt./|nt./|w| s t0|j1} t0| j2d d dFt3t0| dG}?t |?ddHdI}@t j| |@ddJdKWdn 1s6wYtdL|?| |?dMS)Na(Evaluation in COCO protocol. Args: dataset_path (str): COCO dataset json path. result_path (str): COCO result json path. COCO, COCOeval: Pass COCO and COCOeval class after safely imported metric (str | list[str]): Metrics to be evaluated. Options are 'bbox', 'segm', 'proposal'. classwise (bool): Whether to evaluating the AP for each class. max_detections (int): Maximum number of detections to consider for AP calculation. Default: 500 iou_thrs (List[float], optional): IoU threshold used for evaluating recalls/mAPs. If set to a list, the average of all IoUs will also be computed. If not specified, [0.50, 0.55, 0.60, 0.65, 0.70, 0.75, 0.80, 0.85, 0.90, 0.95] will be used. Default: None. metric_items (list[str] | str, optional): Metric items that will be returned. If not specified, ``['AR@10', 'AR@100', 'AR@500', 'AR_s@500', 'AR_m@500', 'AR_l@500' ]`` will be used when ``metric=='proposal'``, ``['mAP', 'mAP50', 'mAP75', 'mAP_s', 'mAP_m', 'mAP_l', 'mAP50_s', 'mAP50_m', 'mAP50_l']`` will be used when ``metric=='bbox' or metric=='segm'``. out_dir (str): Directory to save evaluation result json. areas (List[int]): area regions for coco evaluation calculations Returns: dict: eval_results (dict[str, float]): COCO style evaluation metric. export_path (str): Path for the exported eval result json. r7segmzmetric z is not supportedNg?gffffff?g!@rT)endpointzD3 integers should be specified as areas, representing 3 area regionsinforwz.jsonF)modesuffixdeletez Evaluating z... z2The testing results of the whole dataset is empty. ) mAPmAP75mAP50mAP_smAP_mmAP_lmAP50_smAP50_mmAP50_lAR_sAR_mAR_lz metric item r)r'r(rrg?smallmediumlargerzThe number of categories z* is not equal to the number of precisions name)catIds)r'r)rrr*r)r'r(r)rrr*r__mAPz0.3f_mAP_s_mAP_m_mAP_l_mAP50_mAP50_s_mAP50_m_mAP50_lcategoryAPcsg|] }|dqS)Nr)rr num_columnsresults_flattenrrr<sz!evaluate_core..cSsg|]}|qSrr)rresultrrrr>s) rYr[rZr\r]r^r_r`raz.3f _mAP_copypastecSsi|]\}}||qSrr)rkeyvaluerrr Psz!evaluate_core..results_per_category)parentsexist_okz eval.jsonzutf-8)encoding),r )indent separatorsz5COCO evaluation results are successfully exported to ) eval_results export_path)4 isinstancelistKeyErrorr linspacerBroundr" ValueErrorropenjsonloadtempfileNamedTemporaryFiledumprhcatskeysr$loadRes IndexErrorrrrirndarrayrevaluate accumulater6appendstatsrshaperloadCats getImgIdsfloatmin itertoolschain zip_longestrangertableosunlinkrparentmkdirr9)Ar8r:r;r=r>r?rAiou_thrs metric_itemsrCrEmetricsallowed_metricsrf dataset_dictrtmp_filetemp_dataset_pathcocoGtcat_idsmsgiou_type json_fileresultscocoDtcocoEvalcoco_metric_names metric_itemrYr[rZr_r`rar\r]r^rbrcrd precisionsmax_cat_name_lenidxcatIdnm cat_name_lenr~ image_idsr'ap_sap_map_lap50ap50_sap50_map50_lheaders results_2d table_datarr{valroutfilerrur evaluate_core>s,                "            & &&&&&&*  0   rdataset_json_pathresult_json_path str | NoneLiteral['bbox', 'segm']rlist[float] | float | None return_dictc Cs\zddlm} ddlm} Wn tytdwt||||||||| | d } |r,| SdS)a Args: dataset_json_path (str): file path for the coco dataset json file result_json_path (str): file path for the coco result json file out_dir (str): dir to save eval result type (bool): 'bbox' or 'segm' classwise (bool): whether to evaluate the AP for each class max_detections (int): Maximum number of detections to consider for AP alculation. Default: 500 iou_thrs (float): IoU threshold used for evaluating recalls/mAPs areas (List[int]): area regions for coco evaluation calculations return_dict (bool): If True, returns a dict with 'eval_results' 'export_path' fields. r)r;)r=zYPlease run "pip install -U pycocotools" to install pycocotools first for coco evaluation.) r8r:r>r?rArrCrEr;r=N)pycocotools.cocor;pycocotools.cocoevalr=ModuleNotFoundErrorr) rrrCr<r?rArrErr;r=rxrrrras.   r__main__)rNNrr r N)r8r9r:r9r;r<r=r<r>r9r?r@rArBrCrDrErF)rr9rr9rCrr<rr?r@rArBrrrErFrr@) __future__rrrr collectionsrpathlibrtypingrfirenumpyr terminaltablesrr6rr__name__FirerrrrsB      4 ( 0