PyTorch and dynamic learning rate application - with code
Stick to blogging and share your gains in study and work
Make a note of yourselfRecord and summarize knowledge points to deepen understandingGive some help to people in need, step less on a pit and take more steps
Try to arrange the layout in an appropriate way, with both graphics and text If you write wrong or don't understand, you can lea ...
Posted by kevingarnett2000 on Mon, 11 Oct 2021 14:59:32 -0700
Practical tutorial | preservation and migration of pytoch model
Practical tutorial | preservation and migration of pytoch model In this article, the author first introduces several typical scenarios of model reuse; Then it introduces how to view the relevant parameter information in the pytoch model; Then it introduces how to load the model, how to carry out additional training and transfer learning of the ...
Posted by prometheos on Fri, 08 Oct 2021 23:22:46 -0700
[pytoch series-25]: neural network foundation - nonlinear regression of multiple neurons with activation function
Author home page( Silicon based workshop of slow fire rock sugar): Slow fire rock sugar (Wang Wenbing) blog silicon based workshop of slow fire rock sugar _csdnblog
Website of this article: https://blog.csdn.net/HiWangWenBing/article/details/120600621
catalogue
Introduction deep learning model framework
Chapter 1 business area analysis
on ...
Posted by sysgenmedia on Wed, 06 Oct 2021 14:32:30 -0700
Deep learning_ Batch normalization
It is very difficult to train deep neural networks, especially in short practice. In this section, we will introduce batch normalization, which is a popular and effective technology to continuously accelerate the convergence speed of deep networks. After the combination, the residual will be introduced quickly, and batch normalization enables r ...
Posted by richtux on Wed, 06 Oct 2021 08:38:50 -0700
A series of artificial intelligence experiments -- Python implementation of gradient test
In the actual process of building neural network, forward propagation is easy to realize and has high correctness; The implementation of back propagation is difficult, and there are often bug s. For items requiring high accuracy, gradient test is particularly important.
Principle of gradient test
The definition of derivative (gradient) in mat ...
Posted by msaspence on Tue, 05 Oct 2021 10:35:50 -0700
SRCNN image super resolution reconstruction (tf2)
preface
The image with low resolution caused by enlargement and reduction is converted into an image with high resolution. More attention is paid to filling new pixels in the process of reconstructing the picture. SRCNN is also the ancestor of applying deep learning to image reconstruction. The network structure is very simple, so I deci ...
Posted by nerotic on Sun, 03 Oct 2021 19:21:01 -0700
Week 5 assignment: convolutional neural network (Part3)
1, MobileNetV1 network
Briefly read Google's 2017 paper mobilenets: efficient revolutionary neural networks for mobile vision applications to experience Depthwise convolution and Pointwise convolution. Also, read the code: https://github.com/OUCTheoryGroup/colab_demo/blob/master/202003_models/MobileNetV1_CIFAR10.ipynb type the code into Colab ...
Posted by Devsense on Sun, 03 Oct 2021 10:56:37 -0700
Neural network transplanted to STM32
Transplanting neural network to STM32
A recent project needs to use the network for fitting, and use the fitting results as control. I wonder if I can do neural network calculation directly on the single chip microcomputer, so that I can calculate in real time without relying on the upper computer. Therefore, there are two main problems to be ...
Posted by zulx on Sat, 02 Oct 2021 13:52:23 -0700
IFLYTEK face key point detection competition - punch in 1
During this period, I participated in the Coggle 30 days of ML punch in and signed up for the CV competition. The competition Title address is: https://challenge.xfyun.cn/topic/info?type=key -points-of-human-face&ch=dw-sq-1 Overview of competition questions:
Face recognition is a biometric recognition technology based on human facial f ...
Posted by e_00_3 on Wed, 29 Sep 2021 17:53:47 -0700
Access, initialization and sharing of Python model parameters
Firstly, a multi-layer perceptron with a single hidden layer is defined, its parameters are initialized by the default method, and a forward operation is performed.
import torch
from torch import nn
from torch.nn import init
net=nn.Sequential(nn.Linear(4,3),nn.ReLU(),nn.Linear(3,1))
#Pytoch will be initialized by default
print(net)
X=torch.r ...
Posted by sgt.wolfgang on Mon, 27 Sep 2021 19:06:33 -0700