U Tg"@sddlZddlZddlZddlZddlmZddlmZddlm Z ddl m Z ddl m Z e dZedkre dZedkrdZed d d Zejd d dddejddd dddejdddddejdddddejdddddejdd dddejddd dd!e ede\ZZeed"krBeed#edZed#ZejdkrhedZnejZejdk rejdejz ddlZWnek re d$YnXej!dk rejdej!zdd%l"m#Z#Wnek re d&YnXee#_$ee#_%dd'l&m'Z'm(Z(e'Z)e(Z*d(d)Z+d*d+Z,d1d-d.Z-ej.erle/d/rle+ee)e*nFe0eD]:\Z1Z2Z3e4e3d0D] Z5ej6e1e5Z7e+e7e)e*qqvdS)2N)call) OptionParser)find_executable)basename)inputzwhisper-resize.pyzwhisper-resizez%prog storagePath configPath storagePath the Path to the directory containing whisper files (CAN NOT BE A SUBDIR, use --subdir for that) configPath the path to your carbon config files z %prog 0.1)usageversionz--doitF store_truezThis is not a drill, lets do it)defaultactionhelpz-qz--quietzDisplay extra debugging infoz--subdirstringz&only process a subdir of whisper files)r typer z --carbonlibzEfolder where the carbon lib files are if its not in your path alreadyz --whisperlibzFfolder where the whisper lib files are if its not in your path alreadyz --confirmz5ask for comfirmation prior to resizing a whisper filez-xz --extra_argsz.pass any additional arguments to the %s scriptz\[ERROR] Can't find the whisper module, try using --whisperlib to explicitly include the path)settingszZ[ERROR] Can't find the carbon module, try using --carbonlib to explicitly include the path)loadStorageSchemasloadAggregationSchemascCsJd}d}d}d}t|}t|}|D]"} | |r&dd| jD} qJq&|D]} | |rN| j\} } qlqN| dkrxd} | dkrd} | D] }d|d |d f}||7}q|d D] }d|d |d f}||7}q||krd}|d||f7}d|d}d| }||kr(d}|d|||f7}| |dkrPd}|d||d| f7}|dkrFt|g}tt j D]}| |qn| dt | | dt | t|D]}| |qt j dk st jdkrt|t|t jdkrtdt _t jdkrtdt jdkrFt|}|d krFtd|td dS)a0 method to process a given metric, and resize it if necessary Parameters: fullPath - full path to the metric whisper file schemas - carbon storage schemas loaded from config agg_schemas - carbon storage aggregation schemas load from confg rFcSsg|] }|qS)ZgetTuple).0archiverrc/home/ankuromar296_gmail_com/.local/lib/python3.8/site-packages/../../../bin/whisper-auto-resize.py sz!processMetric..Ng?Zaveragez%s:%s rrarchivesZsecondsPerPointZpointsTz%updating Retentions from: %s to: %s z{0:.2f} xFilesFactorz0%s xFilesFactor differs real: %s should be: %s aggregationMethodz6%s aggregation schema differs real: %s should be: %s z--xFilesFactor=z--aggregationMethod=z+Would you like to run this command? [y/n]: zSkipping command zError running: %s)whisperinfogetMetricFromPathmatchesrformatwhisperResizeExecutableshlexsplitoptions extra_argsappendstrquietconfirmprintZdoitrsysexit)ZfullPathschemas agg_schemasZschema_config_argsZschema_file_argsZrebuildmessagesrZmetricZschemaZarchive_configZ agg_schemarrZ retentionZcurrent_schemaZ fileRetentionZinfo_xFilesFactorZstr_xFilesFactorcmdxexitcoderrr processMetricfsz                  r4cCs<tjtjtj}||d}|dd}|dd}|S)z this method takes the full file path of a whisper file an converts it to a gaphite metric name Parameters: filePath - full file path to a whisper file Returns a string representing the metric name r.wsp/.)ospathnormpathrLOCAL_DATA_DIRsepreplace)ZfilePathdata_dirZ metric_namerrrrs    rValid options : yes or nocCs2t|}|dkrdS|dkr$dSt|qdS)a ask the user if they would like to perform the action Parameters: question - the question you would like to ask the user to confirm. error_response - the message to display if an invalid option is given. )yyesT)nnoFN)rlowerr+)questionZerror_responseZanswerrrrr*s r*r5z*.wsp)r?)8r,r8fnmatchr# subprocessroptparserdistutils.spawnros.pathrZ six.movesrr"Z option_parser add_option parse_argsr%argslen print_helpr-Z storagePathZ configPathsubdirZ processPathZ whisperlibr9insertr ImportError SystemExitZ carbonlibZ carbon.confrZCONF_DIRr;Zcarbon.storagerrr.r/r4rr*isfileendswithwalkroot_filesfilterfjoinfullpathrrrrs            c