•  


GitHub - labmlai/labml: ?? Monitor deep learning model training and hardware usage from your mobile phone ??
Skip to content

?? Monitor deep learning model training and hardware usage from your mobile phone ??

License

Notifications You must be signed in to change notification settings

labmlai/labml

Repository files navigation

Monitor deep learning model training and hardware usage from mobile.

PyPI - Python Version PyPI Status Docs Twitter

?? Features

  • Monitor running experiments from mobile phone or laptop
  • Monitor hardware usage on any computer with a single command
  • Integrate with just 2 lines of code (see examples below)
  • Keeps track of experiments including infomation like git commit, configurations and hyper-parameters
  • API for custom visualizations Open In Colab Open In Colab
  • Pretty logs of training progress
  • Open source!

Hosting the experiments server

Prerequisites

To install MongoDB , refer to the official documentation here .

Installation

Install the package using pip:

pip install labml-app

Starting the server

#
 Start the server on the default port (5005)

labml app-server

#
 To start the server on a different port, use the following command

labml app-server --port PORT

Optional: to setup and configure Nginx in your server, please refer to this .

You can access the user interface either by visiting http://localhost:{port} or, if configured on a separate machine, by navigating to http://{server-ip}:{port} .

Monitor Experiments

Installation

  1. Install the package using pip.
pip install labml
  1. Create a file named .labml.yaml at the top level of your project folder, and add the following line to the file:
app_url
: 
http://localhost:{port}/api/v1/default


#
 If you are setting up the project on a different machine, include the following line instead,

app_url
: 
http://{server-ip}:{port}/api/v1/default

PyTorch example

from
 labml
 import
 tracker
, 
experiment


with
 experiment
.
record
(
name
=
'sample'
, 
exp_conf
=
conf
):
    
for
 i
 in
 range
(
50
):
        
loss
, 
accuracy
 =
 train
()
        
tracker
.
save
(
i
, {
'loss'
: 
loss
, 
'accuracy'
: 
accuracy
})

Distributed training example

from
 labml
 import
 tracker
, 
experiment


uuid
 =
 experiment
.
generate_uuid
() 
# make sure to sync this in every machine

experiment
.
create
(
uuid
=
uuid
,
                  
name
=
'distributed training sample'
,
                  
distributed_rank
=
0
,
                  
distributed_world_size
=
8
,
                  )
with
 experiment
.
start
():
    
for
 i
 in
 range
(
50
):
        
loss
, 
accuracy
 =
 train
()
        
tracker
.
save
(
i
, {
'loss'
: 
loss
, 
'accuracy'
: 
accuracy
})

?? Documentation

Guides

?? Screenshots

Formatted training loop output

Sample Logs

Custom visualizations based on Tensorboard logs

Analytics
#
 Install packages and dependencies

pip install labml psutil py3nvml

#
 Start monitoring

labml monitor

Citing

If you use LabML for academic research, please cite the library using the following BibTeX entry.

@misc{labml,
 author = {Varuna Jayasiri, Nipun Wijerathne},
 title = {labml.ai: A library to organize machine learning experiments},
 year = {2020},
 url = {https://labml.ai/},
}
- "漢字路" 한글한자자동변환 서비스는 교육부 고전문헌국역지원사업의 지원으로 구축되었습니다.
- "漢字路" 한글한자자동변환 서비스는 전통문화연구회 "울산대학교한국어처리연구실 옥철영(IT융합전공)교수팀"에서 개발한 한글한자자동변환기를 바탕하여 지속적으로 공동 연구 개발하고 있는 서비스입니다.
- 현재 고유명사(인명, 지명등)을 비롯한 여러 변환오류가 있으며 이를 해결하고자 많은 연구 개발을 진행하고자 하고 있습니다. 이를 인지하시고 다른 곳에서 인용시 한자 변환 결과를 한번 더 검토하시고 사용해 주시기 바랍니다.
- 변환오류 및 건의,문의사항은 juntong@juntong.or.kr로 메일로 보내주시면 감사하겠습니다. .
Copyright ⓒ 2020 By '전통문화연구회(傳統文化硏究會)' All Rights reserved.
 한국   대만   중국   일본