Files
Mangio-RVC-Fork/train/__pycache__/utils.cpython-39.pyc

124 lines
11 KiB
Plaintext
Raw Normal View History

2023-03-31 17:47:00 +08:00
a
Q"d<>6<00>@sddlZddlZddlZddlZddlZddlZddlZddlZddlZ ddl
m Z ddl Z da ejejejd<04>ead+dd<07>Zd,dd <09>Zd
d <0B>Zd d <0A>Ziiiidfdd<10>Zd-dd<13>Zdd<15>Zd.dd<17>Zdd<19>Zd/dd<1C>Zd0dd<1F>Zd d!<21>Zd"d#<23>Zd$d%<25>Zd1d'd(<28>Z Gd)d*<2A>d*<2A>Z!dS)2<>N)<01>readF)<02>stream<61>level<65>cs<>tj<01>|<00>sJ<00>tj|dd<02><02><00>fdd<04>}||d<05>||d<06>t<05>d<07><00>d}<06>d }|durv|d
krv|<03><07>d <00>t<05>d <0C>||<06><02>t |||fS) N<>cpu<70><01> map_locationcs<><00>|}t|d<01>r|j<01><02>}n|<00><02>}i}|<03><03>D]r\}}zF||||<||j||jkr~td|||j||jf<00>t<06>Wq2t<07>d|<00>|||<Yq20q2t|d<01>r<>|jj |dd<05>n|j |dd<05>dS)N<>module<6C> shape-%s-mismatch|need-%s|get-%s<>%s is not in the checkpointF<74><01>strict)
<EFBFBD>hasattrr <00>
state_dict<EFBFBD>items<6D>shape<70>print<6E>KeyError<6F>logger<65>info<66>load_state_dict)<07>modelZbkey<65>saved_state_dictr<00>new_state_dict<63>k<>v<><01>checkpoint_dict<63><00>./data/docker/liujing04/vc-webui/train/utils.py<70>gos  
zload_checkpoint_d.<locals>.go<67>combd<62>sbd<62>Loaded model weights<74> iteration<6F> learning_rater<00> optimizer<65>%Loaded checkpoint '{}' (iteration {}))
<EFBFBD>os<6F>path<74>isfile<6C>torch<63>loadrrr<00>formatr)<08>checkpoint_pathr!r"r&<00>load_optr r$r%rrr<00>load_checkpoint_ds 


r0c CsHtj<01>|<00>sJ<00>tj|dd<02>}|d}t|d<04>r<|j<06><07>}n|<01><07>}i}|<06><08>D]r\}} zF||||<||j ||j kr<>t
d|||j ||j f<00>t <0B>WqPt <0C> d|<00>| ||<YqP0qPt|d<04>r<>|jj|dd<08>n|j|dd<08>t <0C> d <09>|d
}
|d } |du<01>r*|d k<02>r*|<02>|d <00>t <0C> d<0E>||
<EFBFBD><02>||| |
fS)Nrrrr r
r Fr r#r$r%rr&r')r(r)r*r+r,rr rrrrrrrrr-) r.rr&r/rrrrrrr$r%rrr<00>load_checkpointVs4
  

r1cCsNt<00>d<01>||<04><02>t|d<02>r(|j<04><05>}n|<00><05>}t<06>|||<01><05>|d<03>|<04>dS)N<>6Saving model and optimizer state at iteration {} to {}r )rr$r&r%<00>rrr-rr rr+Zsave)rr&r%r$r.rrrr<00>save_checkpoint{s<04>
 <02><02>r4cCsnt<00>d<01>||<05><02>t|d<02>r(|j<04><05>}n|<00><05>}t|d<02>rF|j<04><05>}n|<01><05>}t<06>||||<02><05>|d<03>|<05>dS)Nr2r )r!r"r$r&r%r3)r!r"r&r%r$r.Zstate_dict_combdZstate_dict_sbdrrr<00>save_checkpoint_d<5F>s <04><02><02>r5i"Vc Cs<>|<02><00>D]\}}|<00>|||<01>q|<03><00>D]\}}|<00>|||<01>q(|<04><00>D]\}}|j|||dd<02>qH|<05><00>D]\}}|<00>||||<06>qldS)NZHWC)Z dataformats)rZ
add_scalarZ add_histogramZ add_imageZ add_audio) <09>writer<65> global_step<65>scalarsZ
histograms<EFBFBD>imagesZaudiosZaudio_sampling_raterrrrr<00> summarize<7A>sr:<00>G_*.pthcCs8t<00>tj<02>||<01><02>}|jdd<02>d<03>|d}t|<03>|S)NcSstd<01>ttj|<00><02><01>S)N<>)<05>int<6E>join<69>filter<65>str<74>isdigit)<01>frrr<00><lambda><3E><00>z(latest_checkpoint_path.<locals>.<lambda>)<01>key<65><79><EFBFBD><EFBFBD><EFBFBD>)<06>globr(r)r><00>sortr)Zdir_pathZregexZf_list<73>xrrr<00>latest_checkpoint_path<74>s
rJc Cs<>ts0ddl}|<01>d<02>dat<03>d<04>}|<02>tj<06>ddlm}ddl }|j
dd<06>\}}|j |ddd d
<EFBFBD>}|j ||d <0B>|<03> d <0C>|<03>d <0A>|<03><0F>|j<10><11>|j|j<10><13>|jdd<0F>}|<08>|j<10><16>ddd<10>d<00>}|<03><17>|S)Nr<00>AggT<67>
matplotlib)<02>
<00><00>Zfigsize<7A>auto<74>lower<65>none<6E>Zaspect<63>originZ interpolation<6F><01>axZFramesZChannelsr<<00>Zdtype<70>seprF<00><01>)<18>MATPLOTLIB_FLAGrL<00>use<73>logging<6E> getLogger<65>setLevel<65>WARNING<4E>matplotlib.pylab<61>pylab<61>numpy<70>subplots<74>imshow<6F>colorbar<61>xlabel<65>ylabel<65> tight_layout<75>canvas<61>draw<61>
fromstring<EFBFBD> tostring_rgb<67>uint8<74>reshape<70>get_width_height<68>close) Z spectrogramrL<00>
mpl_logger<EFBFBD>plt<6C>np<6E>figrV<00>im<69>datarrr<00>plot_spectrogram_to_numpy<70>s*

  
<02>


rxc Cs<>ts0ddl}|<02>d<02>dat<03>d<04>}|<03>tj<06>ddlm}ddl }|j
dd<06>\}}|j |<00> <0C>ddd d
<EFBFBD>}|j ||d <0B>d } |dur<>| d |7} |<04>| <09>|<04>d<0E>|<04><10>|j<11><12>|j|j<11><14>|jdd<10>}
|
<EFBFBD>|j<11><17>ddd<11>d<00>}
|<04><18>|
S)NrrKTrL)<02><00>rOrPrQrRrSrUzDecoder timestepz
zEncoder timestepr<rWrFrY)r[rLr\r]r^r_r`rarbrcrdreZ transposerfrgrhrirjrkrlrmrnrorprq) Z alignmentrrLrrrsrtrurVrvrgrwrrr<00>plot_alignment_to_numpy<70>s0

  <02> 


r{cCs"t|<00>\}}t<01>|<02>tj<05><01>|fS<00>N)rr+Z FloatTensorZastypertZfloat32)<03> full_path<74> sampling_raterwrrr<00>load_wav_to_torch<63>s r<00>|csBt|dd<02><02>"}<02>fdd<04>|D<00>}Wd<00>n1s40Y|S)Nzutf-8)<01>encodingcsg|]}|<01><00><00><01><00><01>qSr)<02>strip<69>split)<02>.0<EFBFBD>line<6E>r<>rr<00>
<listcomp><3E>rDz+load_filepaths_and_text.<locals>.<listcomp>)<01>open)<04>filenamer<65>rBZfilepaths_and_textrr<>r<00>load_filepaths_and_text<78>s0r<>Tc Csdt<00><01>}|jddtddd<05>|jddtddd<05>|jd d
td d d <0A>|jddtd dd <0A>|jddtddd <0A>|jddtddd<05>|jddtddd<05>|jddtddd<05>|jddtdd d<05>|jd!d"tdd#d<05>|jd$d%tdd&d<05>|<01><05>}|j}tj<08> d'|j<06>}tj<08>
|<04><01>st<07> |<04>d(|j }tj<08> |d)<29>}|<00>r<>t |d*<2A><02>}|<07><0E>}Wd+<00>n1<00>sb0Yt |d,<2C><02>}|<07>|<08>Wd+<00>n1<00>s<>0Yn4t |d*<2A><02>}|<07><0E>}Wd+<00>n1<00>s<>0Yt<10>|<08>} tfi| <09><01>}
||
_|
_|j|
_||
_|j|
_|j|
_|j|
_|j|
_|j|
j_|j |
_ |j|
_|j|
_|j|
_d-||
j_ |
S).u4
todo:
结尾七人组:
保存频率、总epoch done
bs done
pretrainG、pretrainD done
卡号os.en["CUDA_VISIBLE_DEVICES"] done
if_latest todo
模型if_f0 todo
采样率自动选择config done
是否缓存数据集进GPU:if_cache_data_in_gpu done
-m:
自动决定training_files路径,改掉train_nsf_load_pretrain.py里的hps.data.training_files done
-c不要了
z-sez--save_every_epochTz!checkpoint save frequency (epoch))<03>typeZrequired<65>helpz-tez --total_epoch<63> total_epochz-pgz --pretrainGr<zPretrained Discriminator path)r<><00>defaultr<74>z-pdz --pretrainDzPretrained Generator pathz-gz--gpus<75>0z
split by -z-bsz --batch_sizez
batch sizez-ez--experiment_dirzexperiment dirz-srz --sample_ratezsample rate, 32k/40k/48kz-f0z--if_f0z0use f0 as one of the inputs of the model, 1 or 0z-lz --if_latestz,if only save the latest G/D pth file, 1 or 0z-cz--if_cache_data_in_gpuz,if caching the dataset in GPU memory, 1 or 0z./logszconfigs/%s.json<6F> config.json<6F>rN<72>wz%s/filelist.txt)!<21>argparseZArgumentParserZ add_argumentr=r@Z
parse_args<EFBFBD>experiment_dirr(r)r><00>exists<74>makedirs<72> sample_rater<65>r<00>write<74>json<6F>loads<64>HParams<6D> model_dir<69>save_every_epoch<63>namer<65><00> pretrainG<6E> pretrainD<6E>gpus<75>
batch_size<EFBFBD>train<69>if_f0<66> if_latest<73>if_cache_data_in_gpurw<00>training_files) ZinitZparser<65>argsr<73>r<><00> config_path<74>config_save_pathrBrw<00>config<69>hparamsrrr<00> get_hparams<6D>sT

 ( , (
 
 r<>cCsbtj<01>|d<01>}t|d<02><02>}|<02><04>}Wd<00>n1s60Yt<05>|<03>}tfi|<04><01>}||_|S)Nr<4E>r<>) r(r)r>r<>rr<>r<>r<>r<>)r<>r<>rBrwr<>r<>rrr<00>get_hparams_from_dir-s &
r<>cCsNt|d<01><02>}|<01><01>}Wd<00>n1s(0Yt<02>|<02>}tfi|<03><01>}|S)Nr<4E>)r<>rr<>r<>r<>)r<>rBrwr<>r<>rrr<00>get_hparams_from_file8s
 &
r<>cCs<>tj<01>tj<01>t<04><01>}tj<01>tj<01>|d<01><02>s>t<07>d<02> |<01><01>dSt
<EFBFBD> d<03>}tj<01>|d<04>}tj<01>|<03>r<>t |<03><01> <0A>}||kr<>t<07>d<05> |dd<06>|dd<06><00><02>nt |d<07><02>|<02>dS)Nz.gitzL{} is not a git repository, therefore hash value comparison will be ignored.zgit rev-parse HEADZgithashz7git hash values are different. {}(saved) != {}(current)<29>r<>)r(r)<00>dirname<6D>realpath<74>__file__r<5F>r>r<00>warnr-<00>
subprocessZ getoutputr<74>rr<>)r<>Z
source_dirZcur_hashr)Z
saved_hashrrr<00>check_git_hashAs<02>
  <14>r<><00> train.logcCsvt<00>tj<03>|<00><01>at<05>tj<07>t<00>d<01>}tj<03> |<00>s>t<02>
|<00>t<00> tj<03> ||<01><02>}|<03>tj<07>|<03> |<02>t<05>|<03>tS)Nz.%(asctime)s %(name)s %(levelname)s %(message)s)r]r^r(r)<00>basenamerr_<00>DEBUGZ Formatterr<72>r<>Z FileHandlerr>Z setFormatterZ
addHandler)r<>r<>Z formatter<65>hrrr<00>
get_loggerUs 
 
 

r<>c@sTeZdZdd<02>Zdd<04>Zdd<06>Zdd<08>Zd d
<EFBFBD>Zd d <0C>Zd d<0E>Z dd<10>Z
dd<12>Z dS)r<>cKs8|<01><00>D]*\}}t|<03>tkr*tfi|<03><01>}|||<qdSr|)rr<><00>dictr<74>)<04>self<6C>kwargsrrrrr<00>__init__es zHParams.__init__cCs
|j<00><01>Sr|)<02>__dict__<5F>keys<79>r<>rrrr<>ksz HParams.keyscCs
|j<00><01>Sr|)r<>rr<>rrrrnsz HParams.itemscCs
|j<00><01>Sr|)r<><00>valuesr<73>rrrr<>qszHParams.valuescCs
t|j<01>Sr|)<02>lenr<6E>r<>rrr<00>__len__tszHParams.__len__cCs
t||<01>Sr|)<01>getattr<74>r<>rErrr<00> __getitem__wszHParams.__getitem__cCs t|||<02>Sr|)<01>setattr)r<>rE<00>valuerrr<00> __setitem__zszHParams.__setitem__cCs
||jvSr|)r<>r<>rrr<00> __contains__}szHParams.__contains__cCs
|j<00><01>Sr|)r<><00>__repr__r<5F>rrrr<><00>szHParams.__repr__N) <0C>__name__<5F>
__module__<EFBFBD> __qualname__r<5F>r<>rr<>r<>r<>r<>r<>r<>rrrrr<>dsr<>)Nr)Nr)r;)N)r<>)T)r<>)"r(<00> tracebackrG<00>sysr<73>r]r<>r<>rcrtZscipy.io.wavfilerr+r[Z basicConfig<69>stdoutr<74>rr0r1r4r5r:rJrxr{rr<>r<>r<>r<>r<>r<>r<>rrrr<00><module>s8 
E
% 



C