EVOLUTION-MANAGER
Edit File: VDOService.cpython-36.opt-1.pyc
3 x?agct � @ s� d Z ddlmZ ddlmZ ddlmZ ddlmZ ddlmZ ddlmZ dd lm Z dd lm Z dd lm Z m Z dd lm Z dd lmZ ddlmZmZ ddlmZmZ ddlmZmZmZ ddlmZmZ ddlZddlZddlZddl Z ddl Z ddl Z ddl m Z ddl!Z!ddl"Z"ddl#Z#ddl$Z$G dd� de �Z%G dd� dee%�Z&G dd� dee%�Z'G dd� dee%�Z(G d d � d ee%�Z)G d d � d e �Z*dS ) z� VDOService - manages the VDO service on the local node $Id: //eng/vdo-releases/aluminum/src/python/vdo/vdomgmnt/VDOService.py#41 $ � )�absolute_import)�division)�print_function)�unicode_literals� )� ArgumentError)� Constants)�Defaults)� MgmntUtils)�Service� ServiceError)� SizeString)�VDOKernelModuleService)�DeveloperExitStatus�StateExitStatus)�SystemExitStatus�UserExitStatus)�Command� CommandError� runCommand)� Transaction� transactionalN)� gethostbynamec s( e Zd ZdZed�f� fdd� Z� ZS )�VDOServiceErrorz)Base class for VDO service exceptions. zVDO volume errorc s t t| �j|f|�|� d S )N)�superr �__init__)�self�msg�args�kwargs)� __class__� � /usr/lib/python3.6/VDOService.pyr > s zVDOServiceError.__init__)�__name__� __module__� __qualname__�__doc__�_r � __classcell__r! r! )r r" r 8 s r c s( e Zd ZdZed�f� fdd� Z� ZS )� VDODeviceAlreadyConfiguredErrorz8The specified device is already configured for a VDO. zDevice already configuredc s t t| �j|f|�|� d S )N)r r) r )r r r r )r r! r" r H s z(VDODeviceAlreadyConfiguredError.__init__)r# r$ r% r& r' r r( r! r! )r r" r) B s r) c s( e Zd ZdZed�f� fdd� Z� ZS )�VDOServiceExistsErrorz VDO service exists exception. zVDO volume existsc s t t| �j|f|�|� d S )N)r r* r )r r r r )r r! r" r R s z VDOServiceExistsError.__init__)r# r$ r% r& r' r r( r! r! )r r" r* L s r* c s( e Zd ZdZed�f� fdd� Z� ZS )�VDOMissingDeviceErrorz2VDO underlying device does not exist exception. z Underlying device does not existc s t t| �j|f|�|� d S )N)r r+ r )r r r r )r r! r" r \ s z VDOMissingDeviceError.__init__)r# r$ r% r& r' r r( r! r! )r r" r+ V s r+ c s( e Zd ZdZed�f� fdd� Z� ZS )� VDOServicePreviousOperationErrorz3VDO volume previous operation was not completed. z+VDO volume previous operation is incompletec s t t| �j|f|�|� d S )N)r r, r )r r r r )r r! r" r g s z)VDOServicePreviousOperationError.__init__)r# r$ r% r& r' r r( r! r! )r r" r, a s r, c s e Zd ZdZejd�ZdZdZe d�Z e d�Z e d�Z e d�Z e d �Ze d �Ze d �Ze d �Ze d �Ze d�Ze d�Ze d�Ze d�Ze d�Ze d�Ze d�Ze d�Ze d�ZdgZ ddddd d d d d d!d"d#� Z G d$d%� d%e �Z e d&d'� �Z!d(d)� Z"d�d+d,�Z#d-d.� Z$e%d/d0� �Z&e%d�d2d3��Z'd4d5� Z(d6d7� Z)d8d9� Z*d:d;� Z+e%d<d=� �Z,e%d>d?� �Z-e%d@dA� �Z.dBdC� Z/d�dEdF�Z0dGdH� Z1d�dIdJ�Z2d�dKdL�Z3d�dMdN�Z4dOdP� Z5dQdR� Z6dSdT� Z7dUdV� Z8dWdX� Z9e:dYdZ� �Z;e d[d\� �Z<e=� fd]d^��Z>� fd_d`�Z?e=� fdadb��Z@� fdcdd�ZA� fdedf�ZB� fdgdh�ZCe:didj� �ZDdkdl� ZEdmdn� ZFdodp� ZGdqdr� ZHdsdt� ZIdudv� ZJdwdx� ZKdydz� ZLd{d|� ZMd}d~� ZNdd�� ZOd�d�� ZPd�d�� ZQd�d�d��ZRd�d�� ZSd�d�� ZTd�d�� ZUd�d�� ZVd�d�� ZWd�d�� ZXd�d�� ZYd�d�� ZZd�d�� Z[d�d�� Z\d�d�� Z]d�d�� Z^d�d�� Z_d�d�� Z`d�d�� Zad�d�� Zbd�d�� Zcd�d�� Zdd�d�� Zed�d�� Zfd�d�� Zgd�d�� Zhd�d�d��Zid�d�� Zje%d�d�� �Zkd�d�� Zld�d�� Zmd�d�� Znd�d�� Zo� fd�dZpd�d�dĄZqd�dƄ Zrd�dȄ Zsd�dʄ Ztd�d̄ Zud�d΄ Zvd�dЄ Zwd�d�d҄Zxd�dԄ Zyd�dք Zzd�d Z{d�dڄ Z|� Z}S )�� VDOServicea� VDOService manages a vdo device mapper target on the local node. Attributes: ackThreads (int): Number of threads dedicated to performing I/O operation acknowledgement calls. activated (bool): If True, should be started by the `start` method. bioRotationInterval (int): Number of I/O operations to enqueue for one bio submission thread in a batch before moving on to enqueue for the next. bioThreads (int): Number of threads used to submit I/O operations to the storage device. blockMapCacheSize (sizeString): Memory allocated for block map pages. blockMapPeriod (int): Block map period. cpuThreads (int): Number of threads used for various CPU-intensive tasks such as hashing. device (path): The device used for storage for this VDO volume. enableCompression (bool): If True, compression should be enabled on this volume the next time the `start` method is run. enableDeduplication (bool): If True, deduplication should be enabled on this volume the next time the `start` method is run. hashZoneThreads (int): Number of threads across which to subdivide parts of VDO processing based on the hash value computed from the block data indexCfreq (int): The Index checkpoint frequency. indexMemory (str): The Index memory setting. indexSparse (bool): If True, creates a sparse Index. indexThreads (int): The Index thread count. If 0, use a thread per core logicalSize (SizeString): The logical size of this VDO volume. logicalThreads (int): Number of threads across which to subdivide parts of the VDO processing based on logical block addresses. maxDiscardSize (SizeString): the max discard size for this VDO volume. physicalSize (SizeString): The physical size of this VDO volume. physicalThreads (int): Number of threads across which to subdivide parts of the VDO processing based on physical block addresses. slabSize (SizeString): The size increment by which a VDO is grown. Using a smaller size constrains the maximum physical size that can be accomodated. Must be a power of two between 128M and 32G. uuid (str): uuid of vdo volume. writePolicy (str): sync, async, async-unsafe or auto. z vdo.vdomgmnt.Service.VDOServicez !VDOServiceZVDOszAcknowledgement threadszBio submission threadszBio rotation intervalzBlock map cache sizezBlock map periodz Block sizeZ CompressionzCPU-work threadsZ DeduplicationzHash zone threadsz Logical sizezLogical threadszMax discard sizez MD RAID5 modez Physical sizezPhysical threadszVDO statisticsz Write policy�device�blockMapCacheSize�blockMapPeriod�maxDiscardSize�uuid� ackThreads�bioRotationInterval� bioThreads� cpuThreads�hashZoneThreads�logicalThreads�physicalThreads) r/ r0 r1 r2 � vdoAckThreads�vdoBioRotationInterval� vdoBioThreads� vdoCpuThreads�vdoHashZoneThreads�vdoLogicalThreads�vdoPhysicalThreadsc @ sT e Zd ZdZdZdZdZdZdZdZ eded ed ed ed ede diZ e d d� �Z dS )zVDOService.OperationState� beginCreate�beginGrowLogical�beginGrowPhysical� beginImport�beginRunningSetWritePolicy�finished�unknown�createz grow logicalz grow physical�importz write policyc C s | j | j| j| j| j| jgS )z�Return a list of the possible specific operation states. "Specific operation state" means a state that is specifically set via normal processing. )rA rB rC rD rE rF )�clsr! r! r" �specificOperationStates� s z1VDOService.OperationState.specificOperationStatesN) r# r$ r% rA rB rC rD rE rF rG �names� classmethodrK r! r! r! r" �OperationState� s rN c C sx x8| j D ].}t||d�dk rtd�j|�}t|td��qW t|dd�dk rt|jdkrt|jrttd�j|�}t|td��dS )z�Validates that any options specified in the arguments are solely those which are modifiable. Argument: args - arguments passed from the user Nz+Cannot change option {0} after VDO creation)� exitStatusr2 � z8Cannot change uuid to a specific value when --all is set)� fixedOptions�getattrr' �formatr r r2 �all)rJ r �optionr r! r! r" �validateModifiableOptions� s z$VDOService.validateModifiableOptionsc C sd | j � | jr.td�j| j� �}| j|� dS | jtd�j| j� �� d| _| jj| j� | d� dS )zCMarks the VDO device as activated, updating the configuration. z{0} already activatedNzActivating VDO {0}T)� _handlePreviousOperationFailure� activatedr' rS �getName� _announce�config�addVdo)r r r! r! r" �activate� s zVDOService.activateTc C s^ | j � r(| jtd�j| j� | j� �� n2|rF| jtd�j| j� �� n| jsZ| jtd�� dS )z.Logs the VDO volume state during create/start.z'VDO instance {0} volume is ready at {1}zVDO volume created at {0}z,VDO volume cannot be started (not activated)N)�runningrZ r' rS �getInstanceNumber�getPathrX )r Z wasCreatedr! r! r" � announceReady s zVDOService.announceReadyc C sR | j td�j| j� �� | j� tdd| j� ddg� | j td�j| j� �� dS )zConnect to index.z Attempting to get {0} to connect�dmsetup�message�0z index-enablez{0} connect succeededN)rZ r' rS rY rW r )r r! r! r" �connect s zVDOService.connectc C s� | j � | jtd�j| j� �� tj� }| j� rD| j� |j | j � |j | j j td�j| j� �� ttjd | jg�j� }|j d� |dkr�| jtj|d�� | jj| j� � dS )z�Convert the VDO device to be used by LVM. This will stop the VDO device, run the conversion tool and then remove the entry from the VDO config file. zConverting VDO {0}z!Device {0} could not be convertedz/vdoprepareforlvmNrP z )rW rZ r' rS rY r � transactionr^ �stop� addUndoStage�start� setMessage�log�errorr r ZconversionUtilityDirr. �strip�textwrap�indentr[ � removeVdo)r rf �outputr! r! r" �convert" s zVDOService.convertFc C s� | j td�j| j� �� | jjdj| jj�� | j� | j � | j � | j | j � | j � | j| j� | j| jj� tj� }|j| jj� |jtj| jj| j� �� | j|� | j| j � | j � | j| jj � dS )z Creates and starts a VDO target.zCreating VDO {0}zconfFile is {0}N) rZ r' rS rY rk �debugr[ �filepathrW �_checkForExistingVDO�_validateParameters�_checkForExistingUUIDr2 �_setStableName�_installKernelModule� vdoLogLevel�_setOperationStaterN rA r rf rh �persist� functools�partialrp �_constructVdoFormat�_setUUID�_constructServiceStartrF )r �forcerf r! r! r" rH > s" zVDOService.createc C sd | j � | js.td�j| j� �}| j|� dS | jtd�j| j� �� d| _| jj| j� | d� dS )zGMarks the VDO device as not activated, updating the configuration. z{0} already deactivatedNzDeactivating VDO {0}FT)rW rX r' rS rY rZ r[ r\ )r r r! r! r" � deactivateh s zVDOService.deactivatec C s� | j � yDt� j� }|d kr4tdd| j� ddg� ntdd| j� ddg� W n0 tk r| | jjtd �j | j� �� � Y nX d S ) z*Disables deduplication on this VDO device.� � r rb rc rd z index-closez index-disablez$Cannot stop deduplication on VDO {0}N)r� r� r ) rW r Z targetVersionr rY � Exceptionrk rl r' rS )r �versionr! r! r" � disconnectw s zVDOService.disconnectc C s& | j � | j r | j� r | j� | jS )z9Returns the instance number of a vdo if running, or zero.)rW �instanceNumberr^ �_determineInstanceNumber)r r! r! r" r_ � s z VDOService.getInstanceNumberc C s t jjd| j� �S )z)Returns the full path to this VDO device.z /dev/mapper)�os�path�joinrY )r r! r! r" r` � s zVDOService.getPathc C st | j � | j� s.td�j| j� �}t|td��|j� || jk r^td�j| j�}t|t d��n&|| jkr�td�jt j �}t|t d��| j | j j� | jjtd�j| j� �� |j� }| jt|�d�}tj� }|j| jjtd�j| j� �� tdd | jd |g� |jd � | jd � | j� | j � }|d |d t j }t dj|��| _| jjtd�j| j� �� | j | j j � d S )zpGrows the logical size of this VDO volume. Arguments: newLogicalSize (SizeString): The new size. z VDO volume {0} must be running)rO z(Can't shrink a VDO volume (old size {0})z.Can't grow a VDO volume by less than {0} bytesz)Increasing logical size of VDO volume {0})� numSectorsz Device {0} could not be changedrb �reloadz--tableNF� logicalBlocks� blockSizez{0}sz(Increased logical size of VDO volume {0}) rW r^ r' rS rY r r � roundToBlock� logicalSizer r �VDO_BLOCK_SIZEr{ rN rB rk �info� toSectors�_generateModifiedDmTable�strr rf rj rl r �_name�_suspend�_resume�_getVDOConfigFromVDO� SECTOR_SIZEr rF )r ZnewLogicalSizer r� �vdoConfrf � vdoConfigr� r! r! r" � growLogical� sB zVDOService.growLogicalc C s� | j � | j� s.td�j| j� �}t|td��| j| j�}|j � || j k rjtd�j| j �}t|t d��n&|| j kr�td�jt j �}t|t d��| j| jj� | jjtd�j| j� �� | jt|j� �d�}tj� }|j| jjtd�j| j� �� tdd | jd |g� |jd � | j d � | j � | j � }|d t j }|d | }t dj|��| _ | jjtd�j| j� �� | j| jj!� d S )z�Grows the physical size of this VDO volume. Arguments: newPhysicalSize (SizeString): The new size. If None, use all the remaining free space in the volume group. z VDO volume {0} must be running)rO z(Can't shrink a VDO volume (old size {0})z.Can't grow a VDO volume by less than {0} bytesz*Increasing physical size of VDO volume {0})Z storageSizez Device {0} could not be changedrb r� z--tableNFr� �physicalBlocksz{0}sz)Increased physical size of VDO volume {0})"rW r^ r' rS rY r r �_getDeviceSizer. r� � physicalSizer r r� r{ rN rC rk r� r� r� �toBlocksr rf rj rl r r� r� r� r� r� r rF )r r ZnewPhysicalSizer� rf r� �sectorsPerBlockr� r! r! r" � growPhysical� sD zVDOService.growPhysicalc C sn | j td�j| j� �� | jjdj| jj�� | j� | j � }|d }|d t j }|d | }t dj|��| _ |d | }t dj|��| _|d | _|d }|d | _|d | _|d | _| j}|d | _|dk r�|| _| j� | j� | j| j� | j� | j| j� | j| jj � t j � }|j | jj � |j t!j"| jj#| j� �� | j$| j� | j%� | j| jj&� dS )z Imports and starts a VDO target.zImporting VDO {0}zconfFile is {0}� VDOConfigr� r� z{0}sr� �slabSize� IndexConfig�memory�sparse�checkpointFrequency�UUIDN)'rZ r' rS rY rk rs r[ rt rW �_getConfigFromVDOr r� r r� r� r� �indexMem� indexSparse� indexCfreqr2 ru rv rw rx ry rz r{ rN rD r rf rh r| r} r~ rp r� r� rF ) r r[ r� r� r� r� � indexConfigr2 rf r! r! r" � importDevice s@ zVDOService.importDevicec C sX | j � ytdd| j� ddg� W n0 tk rR | jjtd�j| j� �� � Y nX dS )z)Enables deduplication on this VDO device.rb rc rd z index-enablez%Cannot start deduplication on VDO {0}N)rW r rY r� rk rl r' rS )r r! r! r" � reconnectF s zVDOService.reconnectNc C s� | j td�j| j� �� ytj| j� W n0 tk rX |sTtd�j| j�}t|��Y nX g }y | j ||� |sx| j � W nV t k r� |dk r�t |�dkr�|j td�j| j� �� |jdd� |D �� � Y nX | jj| j� � | j� s�| j� dS )a% Removes a VDO target. If removeSteps is not None it as an empty list to which the processing commands for removal will be appended. If force was not specified and the instance previous operation failure is not recoverable VDOServicePreviousOperationError will be raised. zRemoving VDO {0}z.Device {0} not found. Remove VDO with --force.Nr zSteps to clean up VDO {0}:c S s g | ]}d j |��qS )z {0})rS )�.0�sr! r! r" � <listcomp>t s z%VDOService.remove.<locals>.<listcomp>)rZ r' rS rY r� �statr. �OSErrorr+ rg rW r, �len�append�extendr[ rp � _hasHolders�_clearMetadata)r r� � removeStepsr ZlocalRemoveStepsr! r! r" �removeR s, zVDOService.removec C s> y$t dddtj| j� g�}|j� dkS tk r8 dS X dS )z-Returns True if the VDO service is available.rb �statusz--targetrP FN)r r � vdoTargetNamerY rm r� )r �resultr! r! r" r^ � s zVDOService.runningc ! C s� | j td�j| j� �� | j� | jsD| jjtd�j| j� �� dS | j� rtt j � rt| jj td�j| j� �� dS | j | j � | j� | j� �y|r�y | j� W n0 tk r� | jjtd�j| j� �� � Y nX tdd| jd| j� d | j� g� | j�s"y | j� W n tk �r Y nX | j� | j�rP| jjtd �j| j� | j�� y| j�rb| j � W n2 tk �r� | jjtd �j| j� �� � Y nX | j � W n2 tk �r� | jjtd �j| j� �� � Y nX dS ) z�Starts the VDO target mapper. In noRun mode, we always assume the service is not yet running. Raises: ServiceError zStarting VDO {0}z VDO service {0} not activatedNz0VDO service {0} already started; no changes madezDevice {0} not read-onlyrb rH z--uuidz--tablez$started VDO service {0} instance {1}z$Could not enable compression for {0}z&Could not set up device mapper for {0}) rZ r' rS rY rW rX rk r� r^ r � noRunMode�warning�_validateAvailableMemory� indexMemoryry �_checkConfiguration� _forceRebuildr� rl r r� �_getUUID�_generateDeviceMapperTable�enableDeduplicationr� r� r� �enableCompression�_startCompression�_startFullnessMonitoring)r Z forceRebuildr! r! r" ri � sV zVDOService.startc C s | j � | j� }d|d }|d }|d tj }tdj|d | ��}tdj|d | ��}tdj|d tj ��}|d } | j| d �} i } tj| | j< tj | j �| t d �< tj | j �| | j < tj | j�| | j< t|�| | j< t|�| | j< t|�| t d �< || t d�< | d | t d�< | | t d�< | j| t d�< tj | d �| t d�< | j� | t d�< | j� �r�| j| � |�r�| j| � n | j| � tj� dk�rtj dd| j � g�| t d�< y&t dd| j � g�} t j!| �| | j"< W n$ t#k �r t d�| | j"< Y nX | S ) zAReturns a dictionary representing the status of this object. zVDO-r� r� r� z{0}sr� r� z{0}Br� r� r� ZActivatez Slab sizer� zIndex checkpoint frequencyzIndex memory settingzIndex parallel factorr� z Index sparsez Index statusr rb r� zDevice mapper statusZvdostatsz --verbosez not available)$rW r� r r� r rS r� �_getIndexMemory�vdoBlockSizeKey� enableStringrX r' r� �vdoCompressionEnabledKeyr� �vdoDeduplicationEnabledKeyr� �vdoLogicalSizeKey�vdoPhysicalSizeKey� indexThreads�_getDeduplicationStatusr^ �_getStatusFromDmsetupTable�_getPendingChanges�_getStatusFromConfigr� �getuidr Z statusHelperrY r r` �yaml� safe_load�vdoStatisticsKeyr� ) r �pendingr[ r2 r� r� r� r� r� r� r� r� r� r! r! r" r� � sZ zVDOService.statusc C sd | j td�j| j� �� |}|sFy| j� d}W n tk rD Y nX |r�| j� r�tj� r�| j r�| j j td�j| j� �� dS | j� }|r�| j � r�td�j| j� �}t |td��|r�| j� s�| �r(dd| j� g}|dk r�|jd j|�� |�r(|�r t|dd � n td �j| j� �}t |td��d d g}|dk �rJ|jd j|�� |�rb|�rbt|dd � |�rt| j||� dd| j� g}|dk �r�|jd j|�� d}|�r|�rxbtd�D ]V}y t|� dS tk �r� } zdt| �k�r�d}P W Y dd} ~ X nX tjd� �q�W |�s | j� | j� �r`|�rBtd�j| j� �}ntd�j| j� �}t |td��dS )a� Stops the VDO target mapper. In noRun mode, assumes the service is already running. If removeSteps is not None it is a list to which the processing commands will be appended. If force was not specified and the instance previous operation failed VDOServicePreviousOperationError will be raised. Raises: ServiceError VDOServicePreviousOperationError zStopping VDO {0}Tz VDO service {0} already stoppedNz"cannot stop VDO volume {0}: in use)rO Zumountz-f� )�noThrowz&cannot stop VDO volume with mounts {0}ZudevadmZsettlerb r� � zDevice or resource busyFr z*cannot stop VDO service {0}: device in usezcannot stop VDO service {0}) rZ r' rS rY rW r, r^ r r� �previousOperationFailurerk r� r� r r � _hasMountsr` r� r� r �_stopFullnessMonitoring�ranger� r� �time�sleep�)_generatePreviousOperationFailureResponser ) r r� r� �executer^ r �commandZinUseZunused_i�exr! r! r" rg sr zVDOService.stopc C s� |r | j dj| j� d�� n| j dj| j� d�� | j� |rD| jsR| r�| j r�dj|r^dnd�}| jjt|�| j� � dS || _| jj | j� | d� | jr�| j � n| j � dS ) zoChanges the compression setting on a VDO. If the VDO is running the setting takes effect immediately. z"Enabling compression on vdo {name})�namez#Disabling compression on vdo {name}z compression already {0} on VDO �enabled�disabledNT) rZ rS rY rW r� rk r� r' r[ r\ r� �_stopCompression)r �enablerc r! r! r" �setCompressionz s" zVDOService.setCompressionc C s || _ d| _dS )a3 Sets the configuration reference and other attributes dependent on the configuration. This method must tolerate the possibility that the configuration is None to handle instantiation from YAML representation. At present, there is nothing for which we attempt to use the configuration. FN)�_config�_configUpgraded)r r[ r! r! r" � setConfig� s zVDOService.setConfigc C sz |r | j dj| j� d�� n| j dj| j� d�� | j� |rD| jsR| r�| j r�dj|r^dnd�}| jjt|�| j� � dS || _| jj | j� | d� | j � �rv| j�rn| j � d}x2t t j�D ]$}| j� }|t jkr�tjd � q�P q�W |t jkr�nt|t jk�r ttd �j| j� �td ��nL|t jk�rLtd �j| j� �}| jj|� n td �j|| j� �}t|td ��n| j� dS )zqChanges the deduplication setting on a VDO. If the VDO is running the setting takes effect immediately. z$Enabling deduplication on vdo {name})r� z%Disabling deduplication on vdo {name}z!deduplication already {0} on VDO r� r� NTr z$Error enabling deduplication for {0})rO z2Timeout enabling deduplication for {0}, continuingz;Unexpected kernel status {0} enabling deduplication for {0})rZ rS rY rW r� rk r� r' r[ r\ r^ r� r� r ZDEDUPLICATION_TIMEOUTr� ZdeduplicationStatusOpeningr� r� ZdeduplicationStatusOnlineZdeduplicationStatusErrorr r �warnr� )r r� rc r� Z_ir! r! r" �setDeduplication� sJ zVDOService.setDeduplicationc C sD | j � | jt|d| j�t|d| j�t|d| j�� d}x�| jD ]�}t||d�}|dk r@|dkr�| j� r~| jdj | j � �� q@y| j |� | j |� W n: t k r� } z | jdj | j � |�� w@W Y dd}~X nX t| | j| |� d }q@t| | j| |� d }q@W |�r@| jj| j � | d � | j� �r@| jtd �j | j � �� dS ) z�Sets any of the modifiable options that are specified in the arguments. Argument: args - arguments passed from the user Raises: ArgumentError r> r? r@ FNr2 zBCan't modify uuid on VDO {0} while it is running. Skipping change.z3Can't modify uuid on VDO {0}. Skipping change: {1}.Tz7Note: Changes will not apply until VDO {0} is restarted)rW � _validateModifiableThreadCountsrR r7 r8 r9 �modifiableOptionsr^ rZ rS rY rw r� r �setattrr[ r\ r' )r r ZmodifiedrU �valuer� r! r! r" �setModifiableOptions� sB z VDOService.setModifiableOptionsc C s^ | j � || jkrZ|| _| j� s6| jj| j� | d� n$| j| jj� | j � | j| jj � dS )zaChanges the write policy on a VDO. If the VDO is running it is restarted with the new policyTN) rW � writePolicyr^ r[ r\ rY r{ rN rE � _performRunningSetWritePolicyrF )r Zpolicyr! r! r" �setWritePolicy s zVDOService.setWritePolicyc C s6 ddddddddd d d d d ddddddddddddgS )z8Returns the list of standard attributes for this object.r3 rX r4 r5 r/ r0 r6 � compression� deduplicationr. r7 r� r� r� r� �logicalBlockSizer� r8 r1 �_operationStater� r9 r� r2 r� r! r! r! r! r" �getKeys# s2 zVDOService.getKeysc C s | dd �S )NZ YAMLInstancer! )rJ r! r! r" �_yamlMakeInstanceA s z VDOService._yamlMakeInstancec s� t t| �j}tj| j�|d< t| j�|d< tj| j�|d< tj| j �|d< tj| j �|d< t| j �|d< t| j �|d< t| j �|d< t| j�|d < | j|d < |S ) NrX r/ r r r� r� r1 r� r� r� )r r- � _yamlDatar r� rX r� r/ r� r� r� r� r1 r� r� r� )r �data)r r! r" r F s zVDOService._yamlDatac s" t t| �j|� | j|dtj| j��tjk| _t| j|dt | j ���| _ | j|dtj| j ��tjk| _ | j|dtj| j ��tjk| _ | j|dtj| j ��tjk| _ t| j|dt | j���| _t| j|dt | j���| _t| j|dt | j���| _t| j|d t | j���| _d |k�r |d | _d S ) NrX r/ r r r� r� r1 r� r� r� )r r- �_yamlSetAttributes�_defaultIfNoner r� rX r� r r� r/ r� r� r� r� r1 r� r� r� )r Z attributes)r r! r" r V s< z VDOService._yamlSetAttributesc s. t t| �j}|jddddddddd d g � |S ) NrX r/ r r r� r� r1 r� r� r� )r r- � _yamlSpeciallyHandledAttributesr� )r Zspecials)r r! r" r � s z*VDOService._yamlSpeciallyHandledAttributesc s� |dkr| j � S |dkr | j� S |dkr0| j� S |dkr@| j� S |dkrXtt| �j|�S |dkrh| j� S |dkrx| j� S t dj t | �j |d ���d S ) Nr[ � isConstructed�operationStater� r� Z%unrecoverablePreviousOperationFailurer� z('{obj}' object has no attribute '{attr}')�obj�attr) �_computedConfig�_computedIsConstructed�_computedOperationState�!_computedPreviousOperationFailurer r- � __getattr__�._computedUnrecoverablePreviousOperationFailure�_computedWritePolicy�AttributeErrorrS �typer# )r r� )r r! r" r � s zVDOService.__getattr__c s, t t| �j|� | j|� | jj| _d | _|jd�| _ | j |dt j �| _ | j |dt j �| _ | j |dt j�| _| j |dt j�| _| j |dt j�| _| j |dt j�| _tj| _| j |dt j�}|tjkr�d | _| j |d t j�}|tjk| _| j |d t j�}|tjk| _| j |d t j�}|tjk| _ | j |d t j �| _ |jdt d��| _ | j |dt j �| _ | j |dt j!�| _!t j"| _"t d�| _#| j |dt j$�| _$| j |dt j%�| _%| j |dt j&�| _'d| _(d| _)|jd�| _*|jd�| _+| j |dt j,�| _-| j.| j |dt j/�� | j |dt j0�}|tjk| _1| j |d t j2�| _3d S ) Nr. r: r; r< r/ r0 r= � emulate512i r r r] r> ZvdoLogicalSizerd r? r1 r@ Z vdoSlabSizer� Fr rz r2 �cfreqr� � sparseIndex�udsParallelFactor)4r r- r r� rN rG r �_previousOperationFailure�getr. r r r3 r4 r5 r/ r0 r6 r r� r r r� r r� r r� r] rX r7 r r� r8 r1 � mdRaid5Moder� r9 r� r� � _writePolicy�_writePolicySetr� rz r2 r r� �_setMemoryAttrr� r r� r r� ) r r� Zconf�kwr r r r] r� )r r! r" r � sp zVDOService.__init__c s` |dkr| j |� n2|dkr*|| _d| _n |dkr4ntt| �j||� |dkr\t| |�j� d S ) Nr� r� TZ identifierr1 r� r� )r1 r� r� )r" r r! r r- � __setattr__rR r� )r r� r� )r r! r" r$ � s zVDOService.__setattr__c C s | j |�}|d kr|S |S )N)r )r r� �defaultr� r! r! r" r s zVDOService._defaultIfNonec C s | j j|� t|� d S )N)rk r� �print)r rc r! r! r" rZ s zVDOService._announcec C sZ | j j� }|d| j k r6td�j| j� �}t|td��t| j t j �| _ t | j t j �| _ dS )zQCheck and fix the configuration of this VDO. Raises: ServiceError r� i z$Insufficient block map cache for {0})rO Ni )r/ r� r8 r' rS rY r r �maxr0 r ZblockMapPeriodMin�minZblockMapPeriodMax)r � cachePagesr r! r! r" r� s z VDOService._checkConfigurationc C s� |dks|dkrdS dddt jg}dd� t|dd �j� D �}td d� |D ��}|td d� | jj� j� D ��O }t|�}g }xF|D ]>}y,t j td |g��}||d kr�|j |� W q� Y q�X q�W t |�dkr�dj |�}td�j||�} t| td��dS )z� Checks that the device does not have an already existing UUID. Arguments: uuid (str) - the uuid to check for Raises: VDOServiceError NrP rb �tablez--targetc S s g | ]}|d kr|�qS )zNo devices foundr! )r� �liner! r! r" r� < s z4VDOService._checkForExistingUUID.<locals>.<listcomp>T)r� c S s g | ]}|j d �d �qS )r� � )�split)r� r* r! r! r" r� > s c S s g | ] }|j �qS r! )r. )r� �vdor! r! r" r� @ s � vdodumpconfigr� r z, z6UUID {0} already exists in VDO volume(s) stored on {1})rO )r r� r � splitlines�setr[ Z getAllVdos�values�listr� r� r� r� r� r' rS r r ) r r2 �cmdZ vdoTablesZvdosZ conflictVdosr. r[ Z conflictListr r! r! r" rw + s( z VDOService._checkForExistingUUIDc C sp | j r td�j| j� �}t|��| jj| j�rFtd�j| j�}t|��| j � rltd�j| j� �}t |t d��dS )z�Check to see if there is an existing VDO volume running with the same name as this VDO, or it already exists in this config file Raises: VDOServiceExistsError VDODeviceAlreadyConfiguredError z VDO volume {0} already existsz)Device {0} already configured for VDO usez2Name conflict with extant device mapper target {0})rO N) r r' rS rY r* r[ ZisDeviceConfiguredr. r) �_mapperDeviceExistsr r )r r r! r! r" ru R s z VDOService._checkForExistingVDOc C s� y6t j| j�j}tj|�s4| jjdj| jd�� dS W n8 tk rn } z | jjdj| j|d�� dS d}~X nX dddj| jd�d d d g}t |� dS ) z.Clear the VDO metadata from the storage devicez-Not clearing {devicePath}, not a block device)� devicePathNz,Not clearing {devicePath}, cannot stat: {ex})r6 r� Zddz if=/dev/zerozof={devicePath}z oflag=directzbs=4096zcount=1) r� r� r. �st_mode�S_ISBLKrk rs rS r� r )r �moder� r� r! r! r" r� j s" zVDOService._clearMetadatac C sl ddl m} | jsfd}y| jj| j� �}W n tk r> Y n"X |j| jj kr`|j | jj dd� d| _| jS )z[Update the instance properties as necessary and return the configuration instance. r )� ConfigurationNF)r| T) rP r: r� r� �getVdorY r r rN rG r{ rF )r r: �servicer! r! r" r s zVDOService._computedConfigc C s | j | jjkS )zYReturns a boolean indicating if the instance represents a fully constructed vdo. )r rN rF )r r! r! r" r � s z!VDOService._computedIsConstructedc C s4 | }y| j j| j� �}W n tk r, Y nX |jS )z�Return the operation state of the instance. If there is an instance in the configuration the state reported is from that instance else it's from this instance. )r[ r; rY r r )r r< r! r! r" r � s z"VDOService._computedOperationStatec C s. | j dkr(| j| jjko$| j| jjk| _ | j S )zCReturns a boolean indicating if the instance operation failed. N)r r rN rG rF )r r! r! r" r � s z,VDOService._computedPreviousOperationFailurec C s | j o| j| jj| jjgkS )zhReturns a boolean indicating if a previous operation failure cannot be automatically recovered. )r� r rN rA rD )r r! r! r" r � s z9VDOService._computedUnrecoverablePreviousOperationFailurec C s: | }| j s4y| jj| j� �}W n tk r2 Y nX |jS )z�Return the write policy of the instance. If this instance's write policy was not explicitly set and there is an instance in the configuration the write policy reported is from that instance else it's from this instance. )r! r[ r; rY r r )r r< r! r! r" r � s z VDOService._computedWritePolicyc C s | j j� }ttj|d�d �S )zCCompute the --slab-bits parameter value for the slabSize attribute.r� g�������?)r� r� �int�mathrk )r Zblocksr! r! r" �_computeSlabBits� s zVDOService._computeSlabBitsc C s6 | j jdj| j� �� tj� }| j� |j| j� d S )Nz construction - starting; vdo {0}) rk rs rS rY r rf ri rh rg )r rf r! r! r" r� � s z!VDOService._constructServiceStartc C s� | j jdj| j� �� tj� }| j|� |j| j� | j � }|d t j }|d | }t dj|��| _ |d | }t dj|��| _d S )Nz1construction - formatting logical volume; vdo {0}r� r� z{0}sr� )rk rs rS rY r rf � _formatTargetrh r� r� r r� r r� r� )r r� rf r� r� r� r� r! r! r" r � s z VDOService._constructVdoFormatc C s~ dj | j� �}y,t|d��}t|j� j� �| _W dQ R X W n> tk rx } z"| jj t d�j | j� |�� W Y dd}~X nX dS )z;Determine the instance number of a running VDO using sysfs.z/sys/kvdo/{0}/instance�rNz8unable to determine VDO service {0} instance number: {1}) rS rY �openr= �readrm r� r� rk r� r' )r r� �f�errr! r! r" r� s z#VDOService._determineInstanceNumberc C s t d| jg� dS )zaCalls vdoforcerebuild to exit read-only mode and force a metadata rebuild at next start. ZvdoforcerebuildN)r r. )r r! r! r" r� s zVDOService._forceRebuildc C s> dg}|j dt| j� � | j}|dkr.tj}| js<tj| _|j dt|� � | jr^|j d� | jj � dkr�|j d| jj � � | jtjkr�|j dt| j � � � |r�|j d � |j | j � y&t |�j� }|r�| jtj|d �� W nV tk �r8 } z8|j� j� }tjd |�}|d k �r$t|td ��|�W Y d d }~X nX d S )zFormats the VDO target.Z vdoformatz--uds-checkpoint-frequency=g z--uds-memory-size=z --uds-sparser z--logical-size=z --slab-bits=z--forcez z.*Cannot format deviceN)rO )r� r� r� r� r r� r� r� r� �toBytesZ asLvmTextr? r. r �rstriprZ rn ro r ZgetStandardError�re�matchr r )r r� Z commandLine�memValrq �erl ZdetectionMatchr! r! r" r@ s6 zVDOService._formatTargetc C s� | j j� }| jj� }| jj� }djdt| j�dt| j�dt| j �dt| j �dt| j �dt| j �dt| j �g�}d t|�tjd | jt| j� d �t| j�t|�t| j�| j| j| jd t|�|g}| js�|jd dg� dj|�}|S )zRGenerate the device mapper table line from the properties of this object. r� �ack�bior4 �cpu�hash�logical�physicalrd ZV2r� � maxDiscardr �off)r� r� r/ r� r1 r� r� r3 r5 r4 r6 r7 r8 r9 r r� r. r� r r0 r r� r� r� r� )r r� r) ZmaxDiscardBlocksZthreadCountConfigZ argumentsr� r! r! r" r� = s0 z%VDOService._generateDeviceMapperTablec s� t dd| jg�j� }| jj|� d }|jd�}|jd�}tt||��� x t|j � �D ]\}}|� |< qTW dj � fdd�|D �|t � �d � �S ) z�Changes the specified parameters in the dmsetup table to the specified values. Raises: CommandError if the current table cannot be obtained Returns: a valid new dmsetup table. rb r* z6logicalStart numSectors targetName version storagePathz1 storageSize blockSize cacheBlocks blockMapPeriodz! mdRaid5Mode writePolicy poolNamer� c s g | ] }� | �qS r! r! )r� �key)�dmTabler! r" r� x s z7VDOService._generateModifiedDmTable.<locals>.<listcomp>NzglogicalStart numSectors targetName version storagePath storageSize blockSize cacheBlocks blockMapPeriodz�logicalStart numSectors targetName version storagePath storageSize blockSize cacheBlocks blockMapPeriod mdRaid5Mode writePolicy poolName) r r� rG rk r� r- �dict�zipr3 �itemsr� r� )r r r* � tableOrderZtableOrderItems� tableItemsrT �valr! )rU r" r� [ s z#VDOService._generateModifiedDmTablec C s, t d�j| j� | jj| j d�}t|��dS )ah Generates the required response to a previous operation failure. Logs a message indicating that the previous operation failed and raises the VDOServicePreviousOperationError exception with the same message. Arguments: operation (str) - the operation that failed; default to "create". Raises: VDOServicePreviousOperationError z8VDO volume {0} previous operation ({1}) is incomplete{2}z(; recover by performing 'remove --force'N)r' rS rY rN rL r r, )r r r! r! r" r� | s z4VDOService._generatePreviousOperationFailureResponsec C s� | j s$| jjtd�j| j� �� dS | j| jj� krXtd�j| j� | j�}t |t d��n�| j| jj krp| j � n|| j| jj kr�| j� nd| j| jjkr�| j� nL| j| jjkr�| j � n4| j| jjkr�| j� n td�j| j�}t |t d��d| _dS )aB Handles a previous operation failure. If the failure can be corrected automatically it is. If not, the method logs a message indicating that the previous operation failed and raises the VDOServicePreviousOperationError exception with the same message. Raises: VDOServicePreviousOperationError if the previous operation failure is a non-recoverable error. VDOServiceError if unexpected/unhandled operation state is encountered. Excepting corruption or incorrect setting of state this indicates that the developer augmented the code with an operation (new or old) which can experience a catastrophic failure requiring some form of recovery but failed to update specificOperationStates() and/or failed to add a clause to this method to address the new failure. z0No failure requiring recovery for VDO volume {0}Nz.VDO volume {0} in unknown operation state: {1})rO z5Missing handler for recover from operation state: {0}F)r� rk rs r' rS rY r rN rK r r rA r� rB �_recoverGrowLogicalrC �_recoverGrowPhysicalrD rE � _recoverRunningSetWritePolicyr )r r r! r! r" rW � s0 z*VDOService._handlePreviousOperationFailurec C sr |}t j|t j�s&ttd�j|d���tjt j|�j �rRt dd|g�}|j � j � }|dkrnttd�j|d���|S )z�Take the server name and convert it to a device name that can be opened from the kernel Arguments: devicePath (path): path to a device. Raises: ArgumentError z{path} does not exist)r� �readlinkz-frP z {path} could not be resolved) r� �access�F_OKr r' rS r� �S_ISLNK�lstatr7 r Zrunrm )r r6 Z resolvedPathr4 r! r! r" �_getBaseDevice� s zVDOService._getBaseDevicec C s t jtd| jg��}|S )zbReturns a dictionary of the configuration values as reported from the actual vdo storage. r/ )r� r� r r. )r r[ r! r! r" r� � s z VDOService._getConfigFromVDOc C s t jtd| jg��}|d S )ztReturns a dictionary of the index configuration values as reported by the actual uds index used by the vdo. r/ r� )r� r� r r. )r r[ r! r! r" �_getIndexConfigFromVDO� s z!VDOService._getIndexConfigFromVDOc C s t jtd| jg��}d|d S )z>Returns the uuid as reported from the actual vdo storage. r/ zVDO-r� )r� r� r r. )r r[ r! r! r" r� � s zVDOService._getUUIDc C s t jtd| jg��}|d S )zbReturns a dictionary of the configuration values as reported from the actual vdo storage. r/ r� )r� r� r r. )r r[ r! r! r" r� � s z VDOService._getVDOConfigFromVDOc C sN t d�}y,tdd| j� g�}|jd�}|tjj }W n tk rH Y nX |S )Nz not availablerb r� r� )r' r rY r- r ZdmsetupStatusFieldsZdeduplicationStatusr� )r r� rq Zfieldsr! r! r" r� � s z"VDOService._getDeduplicationStatusc C s8 | j |�}tjj|�}tdd| d g�}tdj|��S )z�Get the size of the device passed in. Arguments: devicePath (path): path to a device. Returns: Size of device as a SizeString object �catz/sys/class/block/z/sizez{0}s)rd r� r� �basenamer r rS )r r6 ZbasePathZbaseNamerq r! r! r" r� s zVDOService._getDeviceSizec C sf y t ddddd|g�j� }W n4 tk rP } z| jjdt|� � dS d}~X nX |dkr^dS |S dS ) z�Get the UUID of the device passed in, Arguments: devicePath (path): path to a device. Returns: UUID as a string, or None if none found Zblkidz-sr� z-or� zblkid failed: NrP )r rm r rk r� r� )r r6 rq r� r! r! r" �_getDeviceUUID s zVDOService._getDeviceUUIDc C s8 |dks4d }|| }|d kr"d}n|d kr0d}nd}|S ) z�Takes the input indexMemory value from vdodumpconfig and converts it into a fractional Gigabyte value, if necessary. Returns: The index memory value (in Gigabytes). i r� � � g �?i g �?g �?l i ���i ���r! )r rJ ZmaxInt32r! r! r" r� - s zVDOService._getIndexMemoryc C s� | j � }tdj|d tj ��}td�|| j< td�|| j< td�|| j< td�|| j < td�|| j < td�|| j < td�|| j < td�|| j < |d |td�< tj|d dk�|td�< t|�|| j< |d || j< |d |td �< d |k�rtdj|d tj ��}t|�|| j< d |k�r.|d || j< d|k�rF|d || j< d|k�r^|d || j < d|k�rv|d || j < d|k�r�|d || j < d|k�r�|d || j < d|k�r�|d || j < dS )zlUpdates the input status dictionary with parameter values from the dmsetup table for the running device.z{0}BZ cacheBlocksz non-existentZ storagePathzStorage devicer� i zEmulate 512 byter0 r� zConfigured write policyrR rL rM r4 rN rO rP rQ N)�_getCurrentDmTabler rS r r� r' �vdoMaxDiscardSizeKey�vdoAckThreadsKey�vdoBioSubmitThreadsKey�vdoBioRotationIntervalKey�vdoCpuThreadsKey�vdoHashZoneThreadsKey�vdoLogicalThreadsKey�vdoPhysicalThreadsKeyr� r� �vdoBlockMapCacheSizeKey�vdoBlockMapPeriodKey)r � statusDictrU ZcacheBlocksInBytesZdiscardBlocksInBytesr! r! r" r� D sJ z%VDOService._getStatusFromDmsetupTablec C s� | j |td�< tj| jdk�|td�< t| j�|| j< | j|| j < | j |td�< t| j �|| j < | j || j< | j|| j< | j|| j< | j|| j< | j|| j< | j|| j< | j|| j< dS )zcUpdates the input status dictionary with parameter values from the config file for this object.zStorage devicei zEmulate 512 bytezConfigured write policyN)r. r' r r� r r� r/ rt r0 ru r� r1 rl r3 rm r5 rn r4 ro r6 rp r7 rq r8 rr r9 rs )r rv r! r! r" r� v s z VDOService._getStatusFromConfigc C s� t dd| jg�j� }| jj|� d}|jd�}|jd�}|t|�d� }|dt|�� }|j|ddd � � |j|d dd � � d d � |D �}tt ||��}|S )z�Obtains the dmsetup table for the VDO device. Raises: CommandError if the current table cannot be obtained. Returns: The current dmsetup table. rb r* z*logicalStart numSectors targetName versionz. storagePath storageSize blockSize cacheBlocksz0 blockMapPeriod mdRaid5Mode writePolicy poolNamer� Nr r� r c S s g | ]}|j � rt|�n|�qS r! )� isdecimalr= )r� �ir! r! r" r� � s z1VDOService._getCurrentDmTable.<locals>.<listcomp>zXlogicalStart numSectors targetName version storagePath storageSize blockSize cacheBlocksz�logicalStart numSectors targetName version storagePath storageSize blockSize cacheBlocks blockMapPeriod mdRaid5Mode writePolicy poolName) r r� rG rk r� r- r� r� rV rW )r r* rY rZ ZtableOptionalItemsrU r! r! r" rk � s z VDOService._getCurrentDmTablec C s� | j | j| j| j| j| j| j| j| j| j d� }x|| j D ]r}||krDq6|| |krRq6t | | j | d�}t ||| �}|dk r6t |�|kr6dj dt |��}|| ||| < q6W dS )zrUpdates the input status dictionary with pending changes to modifiable parameters for the running device. ) r/ r0 r1 r: r; r< r= r> r? r@ Nz{0}[{1}]z )rt ru rl rm ro rn rp rq rr rs r� rR r� rS )r rv ZoptionToStatusKeysrU Z configValueZ statusValueZ pendingValuer! r! r" r� � s( z VDOService._getPendingChangesc C s� y*t j| j� �}t j|j�}t j|j�}W n tk r> dS X dj||d�}t jj |�r�t j |�}t |�dkr�| j j dj| j� dj|�d�� dS dS ) z�Tests whether other devices are holding the VDO device open. This handles the case where there are LVM entities stacked on top of us. Returns: True iff the VDO device has something holding it open. Fz&/sys/dev/block/{major}:{minor}/holders)�major�minorr z&{path} is being held open by {holders}r� )r� �holdersT)r� r� r` ry �st_rdevrz r� rS r� �isdir�listdirr� rk r� r� )r �stry rz ZholdersDirectoryr{ r! r! r" r� � s zVDOService._hasHoldersc C sR t dgdd�}|rNtjdtj| j� � d �}x |j� D ]}|j|�r8dS q8W dS )z�Tests whether filesystems are mounted on the VDO device. Returns: True iff the VDO device has something mounted on it. ZmountT)r� z(\A|\s+)z\s+F)r rH �compile�escaper` r0 �search)r Z mountListZmatcherr+ r! r! r" r� � s zVDOService._hasMountsc C sZ t � }y |j� W n0 tk rB | jjtd�j|j� �� � Y nX |dk rV|j|� dS )z�Install the kernel module providing VDO support. Arguments: logLevel: the level of logging to use; if None, do not set level z Kernel module {0} not installedN) r ri r� rk rl r' rS rY Z setLogLevel)r ZlogLevelZkmsr! r! r" ry � s z VDOService._installKernelModulec C s, yt j| j� � dS tk r& dS X dS )zOReturns True if there already exists a dm target with the name of this VDO.TFN)r� r� r` r� )r r! r! r" r5 s z VDOService._mapperDeviceExistsc C s� t j� }|j| jjtd�j| j� �� | j| j d�}|j| jjtd�j| j� �� t dd| j d|g� |jd� | j d� | j � dS ) zHPeforms the changing of the write policy on a running vdo instance. z Device {0} could not be read)r� z Device {0} could not be changedrb r� z--tableNF)r rf rj rk rl r' rS rY r� r� r r� r� r� )r rf r� r! r! r" r� s z(VDOService._performRunningSetWritePolicyc C s� | j s"| jjtd�j| j� �� nz| j| jjkrPtd�j| j� �}t |t d��nL| j � }|d |d t j }tdj|��| _| j� r�| j� | j| jj� dS )zcRecovers a VDO target from a previous grow logical failure. Raises: VDOServiceError z5No grow logical recovery necessary for VDO volume {0}zCPrevious operation failure for VDO volume {0} not from grow logical)rO r� r� z{0}sN)r� rk rs r' rS rY r rN rB r r r� r r� r r� r^ r� r{ rF )r r r� r� r! r! r" r\ ' s z VDOService._recoverGrowLogicalc C s� | j s"| jjtd�j| j� �� nz| j| jjkrPtd�j| j� �}t |t d��nL| j � }|d |d t j }tdj|��| _| j� r�| j� | j| jj� dS )zdRecovers a VDO target from a previous grow physical failure. Raises: VDOServiceError z6No grow physical recovery necessary for VDO volume {0}zDPrevious operation failure for VDO volume {0} not from grow physical)rO r� r� z{0}sN)r� rk rs r' rS rY r rN rC r r r� r r� r r� r^ r� r{ rF )r r r� r� r! r! r" r] G s z VDOService._recoverGrowPhysicalc C sr | j s"| jjtd�j| j� �� nL| j| jjkrPtd�j| j� �}t |t d��n | j � r`| j � | j | jj� dS )z�Recovers a VDO target from a previous setting of write policy against a running VDO. Raises: VDOServiceError z9No set write policy recovery necessary for VDO volume {0}zGPrevious operation failure for VDO volume {0} not from set write policy)rO N)r� rk rs r' rS rY r rN rE r r r^ r� r{ rF )r r r! r! r" r^ g s z(VDOService._recoverRunningSetWritePolicyc C s� | j jtd�j| j� �� ytdd| j� g� W n@ tk rp } z$| j jtd�j| j� |�� � W Y dd}~X nX | j� | j jtd�j| j� �� dS )zResumes a suspended VDO.zResuming VDO volume {0}rb Zresumez"Can't resume VDO volume {0}; {1!s}NzResumed VDO volume {0}) rk r� r' rS rY r r� rl r� )r r� r! r! r" r� � s zVDOService._resumec s. t |�}|dkrt|�}tt| �jd|� d S )Ng �?r� )�floatr= r r- r$ )r r� r� )r r! r" r" � s zVDOService._setMemoryAttrc C s. || _ |r*| jj| j� | dd� | jj� d S )NT)�replace)r r[ r\ rY r| )r �stater| r! r! r" r{ � s z VDOService._setOperationStatec s t jj| j��d�g }t jj��r��fdd��fdd�t j��D �D �}�d k r�| j��� � d k r�| jjdj � d�� � fdd�|D �}t |�d kr�| jjd j �|d �� d d� |D �}t |�d kr�|}|j � |d | _| jjd j | jd�� n| jjdj ��d�� d S )Nz/dev/disk/by-idc s g | ]}t jj|�� kr|�qS r! )r� r� �realpath)r� Zabsname)r� r! r" r� � s z-VDOService._setStableName.<locals>.<listcomp>c 3 s | ]}t jj� |�V qd S )N)r� r� r� )r� r� )�idDirr! r" � <genexpr>� s z,VDOService._setStableName.<locals>.<genexpr>zpruning {uuid} from aliases)r2 c s g | ]}� |kr|�qS r! r! )r� �a)� deviceUUIDr! r" r� � s r z'found aliases for {original}: {aliases})�original�aliasesc S s g | ]}t jd |�dk r|�qS )z.*/[dm][dm]-uuid-N)rH rI )r� r� r! r! r" r� � s z using {new})�newz+no aliases for {original} found in {idDir}!)r� r� ) r� r� r� r. r} r~ rh rk rs rS r� �sort)r r� Z uuidAliasesr! )r� r� r� r" rx � s2 zVDOService._setStableNamec C s� |dkr dS y.|dkr&t d| jg� nt dd|| jg� W nB tk r| } z&td�j| j� |�}t|td��W Y dd}~X nX dS )z�Sets a new uuid for the vdo volume, either by providing a value or having the tool generate a new random one. Arguments: uuid (str) - the uuid to set Raises: Exception NrP Z vdosetuuidz--uuidz,Can't set the UUID for VDO volume {0}; {1!s})rO )r r. r� r' rS rY r r )r r2 r� r r! r! r" r� � s zVDOService._setUUIDc C s | j d� dS )z9Starts compression on a VDO volume if it is running. TN)�_toggleCompression)r r! r! r" r� � s z VDOService._startCompressionc C sJ yt dd| j� g� W n. tk rD | jjtd�j| j� �� Y nX d S )N� vdodmeventdz-rz$Could not register {0} with dmeventd)r rY r� rk r� r' rS )r r! r! r" r� � s z#VDOService._startFullnessMonitoringc C s | j d� dS )z8Stops compression on a VDO volume if it is running. FN)r� )r r! r! r" r� � s zVDOService._stopCompressionc C s: dd| j � g}|d k r&|jdj|�� |r6t|dd� d S )Nr� z-ur� T)r� )rY r� r� r )r r� r� r� r! r! r" r� � s z"VDOService._stopFullnessMonitoringc C s� | j jtd�j| j� |r dnd�� | jdd� y tdd|r@dnd | j� g� W n@ tk r� } z$| j jtd �j| j� |�� � W Y dd}~X nX | j jtd �j| j� �� dS ) zSuspends a running VDO.z"Suspending VDO volume {0} with {1}�flushzno flushTNrb ZsuspendrP z --noflushz#Can't suspend VDO volume {0}; {1!s}zSuspended VDO volume {0}) rk r� r' rS rY r� r r� rl )r r� r� r! r! r" r� s zVDOService._suspendc C sR | j � s dS | jtd�j|r dnd| j� �� tdd| j� dd|rFd nd g� dS ) z�Turns compression on or off if the VDO is running. Arguments: enable (boolean): True if compression should be enabled Nz{0} compression on VDO {1}ZStartingZStoppingrb rc rd r ZonrS )r^ rZ r' rS rY r )r r� r! r! r" r� s z VDOService._toggleCompressionc C s� t djtjt|����}d}yPtdddg�}x<|j� D ]0}tjd|�}|dk r6|j d�}t dj|��}q6W W n t k r� Y nX |dkr�| j j d � dS |j � |j � kr�ttd j|d ����dS ) a= Validates whether there is likely enough kernel memory to at least create the index. If there is an error getting the info, don't fail the create, just let the real check be done in vdoformat. Arguments: indexMemory - the amount of memory requested or default. Raises: ArgumentError z{0}gNZgrepZ MemAvailablez /proc/meminfozMemAvailable:\s*(\d+)r z{0}kz#Unable to validate available memoryzGNot enough available memory in system for index requirement of {needed})Zneeded)r rS �localer� r� r r0 rH rI �groupr� rk r� rF r r' )r r� Z memoryNeededZmemoryAvailabler� r+ r� Z availabler! r! r" r� s" z#VDOService._validateAvailableMemoryc C sl |dkr| j }|dkr | j}|dkr*| j}|dksB|dksB|dkrh|dkoX|dkoX|dk rhttd���dS )aY Validates that the hash zone, logical and physical thread counts are consistent (all zero or all non-zero). Arguments: hashZone - hash zone thread count to use, may be None logical - logical thread count to use, may be None physical - physical thread count to use, may be None Raises: ArgumentError Nr zRhash zone, logical and physical threads must either all be zero or all be non-zero)r7 r8 r9 r r' )r ZhashZonerP rQ r! r! r" r� A s z*VDOService._validateModifiableThreadCountsc C s$ | j | j� | j| j| j| j� d S )N)r� r� r� r7 r8 r9 )r r! r! r" rv Z s z VDOService._validateParameters)T)F)FN)F)F)FN)F)N)T)T)~r# r$ r% r& �loggingZ getLoggerrk Zyaml_tagZvdosKeyr' rm rn ro rt ru r� r� rp r� rq r� rr rl ZvdoMdRaid5ModeKeyr� rs r� ZvdoWritePolicyKeyrQ r� �objectrN rM rV r] ra re r rr rH r� r� r_ r` r� r� r� r� r� r^ ri r� rg r� r� r� r� r � staticmethodr r �propertyr r r r r r$ r rZ r� rw ru r� r r r r r r r? r� r r� r� r@ r� r� r� rW rd r� re r� r� r� r� rh r� r� r� rk r� r� r� ry r5 r� r\ r] r^ r� r" r{ rx r� r� r� r� r� r� r� r� r� rv r( r! r! )r r" r- m s� ' ) 7 ; > 8 = G _ 23 4 J ' * !3 2!$ + "r- )+r& Z __future__r r r r rP r r r r r r r r r r r r Z vdo.utilsr r r r r r} r� r� r> r� rH Zsocketr r� rn r� r� r r) r* r+ r, r- r! r! r! r" �<module> s@