o j9:j"@sUdZddlmZddlZddlZddlZddlmZddlm Z m Z m Z ddl m Z e r3ddlmZddlmZeeZGd d d Zeeeeee feedBedBgdfZd ed <Gd ddZGdddZdS)a[Metrics collection and management system for Dynamo. This module provides context managers for gathering and reporting metrics during compilation and runtime. It includes two main components: - MetricsContext: A context manager for collecting metrics during compilation, supporting nested contexts and various metric types (counters, sets, key-value pairs) - RuntimeMetricsContext: A specialized context for runtime metrics collection that doesn't require explicit context management The metrics system enables comprehensive monitoring and analysis of both compilation and execution performance. ) annotationsN)Callable)Any TYPE_CHECKING TypeAlias)Self)Iterator)CapturedTracebackc@s:eZdZdZddddZdd d ZdddZdddZdS)TopNz_ Helper to record a list of metrics, keeping only the top N "most expensive" elements. at_mostintreturnNonecCs||_g|_dSN)r heap)selfr rd/home/nk/hobo-godmode/plappi-mvp/.venv/lib/python3.10/site-packages/torch/_dynamo/metrics_context.py__init__(s z TopN.__init__keyrvalcCs0t|j|jkr tjntj}||j||fdSr)lenrr heapqheappush heappushpop)rrrfnrrradd,szTopN.addcCs t|jSr)rrrrrr__len__1s z TopN.__len__Iterator[tuple[Any, int]]cCsddt|jddDS)Ncss|] \}}||fVqdSrr).0rrrrr 5sz TopN.__iter__..T)reverse)sortedrrrrr__iter__4sz TopN.__iter__N)r )r r rr)rrrr rr)rr )rr )__name__ __module__ __qualname____doc__rrrr%rrrrr #s    r r OnExitTypec@seZdZd2ddZd3dd Zd4ddZd5ddZd6ddZd7ddZd8d9d!d"Z d:d$d%Z d8d;d(d)Z dd/d0Zd1S)?MetricsContexton_exitr*rrcCs"||_i|_d|_d|_g|_dS)aQ Use this class as a contextmanager to create a context under which to accumulate a set of metrics, e.g., metrics gathered during a compilation. On exit of the contextmanager, call the provided 'on_exit' function and pass a dictionary of all metrics set during the lifetime of the contextmanager. rN)_on_exit_metrics_start_time_ns_level_editsrr,rrrr?s  zMetricsContext.__init__rcCs,|jdkr i|_t|_|jd7_|S)z/ Initialize metrics recording. r)r0r.timetime_nsr/rrrr __enter__Ls  zMetricsContext.__enter__exc_typetype[BaseException] | None exc_valueBaseException | None _tracebackrcCsn|jd8_|jdksJ|jdkr5zt}||j||j||WdSty4tdYdSwdS)z> At exit, call the provided on_exit function. r3rz0Unexpected exception logging compilation metricsN) r0r4r5r-r/r. Exceptionlog exception)rr7r9r; end_time_nsrrr__exit__Xs   zMetricsContext.__exit__boolcCs |jdkS)z4 True if we've entered the context. r)r0rrrr in_progressls zMetricsContext.in_progressmetricstrvaluer cCsD|jdkr td|d||jvrd|j|<|j||7<dS)7 Increment a metric by a given amount. rzCannot increment  outside of a MetricsContextNr0 RuntimeErrorr.rrCrErrr incrementrs   zMetricsContext.incrementpredset[str]csddfdd|jDS)Nz c3s.|]\}}|@rdd|VqdS)zPrevious Traceback: N)joinformat)r!ekrLrrr"}s z/MetricsContext._render_edits..)rOr1)rrLrrSr _render_edits|s zMetricsContext._render_editsF overwritecCsl|jdkr td|d||jvr"|s"t||hd|d|jtjdd|hf||j|<dS) z Set a metric to a given value. Raises if the metric has been assigned previously in the current context. r Cannot set rGz RuntimeError: Metric 'z]' has already been set in the current context (see above for current and previous traceback).r3skipN)r0rIr.rTr1appendr extract)rrCrErUrrrsets   zMetricsContext.setrcCs@|jdkr td|d||jvri|j|<||j||<dS)a= Treats a give metric as a dictionary and set the k and value within it. Note that the metric must be a dictionary or not present. We allow this to be called multiple times (i.e. for features, it's not uncommon for them to be used multiple times within a single compilation). rrVrGNrH)rrCrrErrr set_key_values   zMetricsContext.set_key_valuevaluesdict[str, Any]cCs~|jdkr td|j|@}|r'|s't|t|d|d|jtj ddt|f|j |dS)z Set multiple metrics directly. This method does NOT increment. Raises if any metric has been assigned previously in the current context and overwrite is not set to True. r1Cannot update metrics outside of a MetricsContextz RuntimeError: Metric(s) z_ have already been set in the current context. (see above for current and previous traceback).r3rWN) r0rIr.keysrTr[r1rYr rZupdate)rr]rUexistingrrrras   zMetricsContext.updatecCs.|jdkr td|jdkr||dSdS)zA Update, but only when at the outermost context. rr_r3N)r0rIra)rr]rrr update_outers  zMetricsContext.update_outercCsD|jdkr td|d||jvrt|j|<|j||dS)z8 Records a metric as a set() of values. rz Cannot add rGN)r0rIr.r[rrJrrr add_to_sets   zMetricsContext.add_to_setrcCs:|jdkrdS||jvrt|j|<|j|||dS)z; Records a metric as a TopN set of values. rN)r0r.r r)rrCrrrrr add_top_ns   zMetricsContext.add_top_nNr,r*rr)rr)r7r8r9r:r;rrr)rrA)rCrDrEr rr)rLrMrrD)F)rCrDrErrUrArr)rCrDrrDrErrr)r]r^rUrArr)r]r^rr)rCrDrErrr)rCrDrrrr rr)r&r'r(rr6r@rBrKrTr[r\rarcrdrerrrrr+>s         r+c@s.eZdZdddZ ddddZdddZdS)RuntimeMetricsContextr,r*rrcCs||_i|_d|_dS)z Similar to MetricsContext, but used to gather the runtime metrics that are decoupled from compilation, where there's not a natural place to insert a context manager. rN)r-r.r/r2rrrrs zRuntimeMetricsContext.__init__NrCrDrEr extradict[str, Any] | NonecCsp|jst|_||jvrd|j|<|j||7<|r4|D]\}}||jvr3|dur3||j|<q!dSdS)rFrN)r.r4r5r/items)rrCrErhrRvrrrrKs    zRuntimeMetricsContext.incrementcCsl|jr4z,zt}||j||jddWnty#tdYnwWi|_dSWi|_dSi|_wdS)zW Call the on_exit function with the metrics gathered so far and reset. Nz,Unexpected exception logging runtime metrics)r.r4r5r-r/r<r=r>)rr?rrrfinishs  zRuntimeMetricsContext.finishrfr)rCrDrEr rhrirr)rr)r&r'r(rrKrlrrrrrgs   rg)r) __future__rrloggingr4collections.abcrtypingrrrtyping_extensionsrrtorch.utils._tracebackr getLoggerr&r=r r dictrDtype BaseExceptionr*__annotations__r+rgrrrrs*