PyTorch and dynamic learning rate application - with code

Stick to blogging and share your gains in study and work Make a note of yourselfRecord and summarize knowledge points to deepen understandingGive some help to people in need, step less on a pit and take more steps Try to arrange the layout in an appropriate way, with both graphics and text If you write wrong or don't understand, you can lea ...

Posted by kevingarnett2000 on Mon, 11 Oct 2021 14:59:32 -0700

Practical tutorial | preservation and migration of pytoch model

Practical tutorial | preservation and migration of pytoch model In this article, the author first introduces several typical scenarios of model reuse; Then it introduces how to view the relevant parameter information in the pytoch model; Then it introduces how to load the model, how to carry out additional training and transfer learning of the ...

Posted by prometheos on Fri, 08 Oct 2021 23:22:46 -0700

[pytoch series-25]: neural network foundation - nonlinear regression of multiple neurons with activation function

Author home page( Silicon based workshop of slow fire rock sugar): Slow fire rock sugar (Wang Wenbing) blog silicon based workshop of slow fire rock sugar _csdnblog Website of this article: https://blog.csdn.net/HiWangWenBing/article/details/120600621 catalogue Introduction deep learning model framework Chapter 1 business area analysis on ...

Posted by sysgenmedia on Wed, 06 Oct 2021 14:32:30 -0700

Deep learning_ Batch normalization

It is very difficult to train deep neural networks, especially in short practice. In this section, we will introduce batch normalization, which is a popular and effective technology to continuously accelerate the convergence speed of deep networks. After the combination, the residual will be introduced quickly, and batch normalization enables r ...

Posted by richtux on Wed, 06 Oct 2021 08:38:50 -0700

A series of artificial intelligence experiments -- Python implementation of gradient test

In the actual process of building neural network, forward propagation is easy to realize and has high correctness; The implementation of back propagation is difficult, and there are often bug s. For items requiring high accuracy, gradient test is particularly important. Principle of gradient test The definition of derivative (gradient) in mat ...

Posted by msaspence on Tue, 05 Oct 2021 10:35:50 -0700

SRCNN image super resolution reconstruction (tf2)

preface The image with low resolution caused by enlargement and reduction is converted into an image with high resolution. More attention is paid to filling new pixels in the process of reconstructing the picture. SRCNN is also the ancestor of applying deep learning to image reconstruction. The network structure is very simple, so I deci ...

Posted by nerotic on Sun, 03 Oct 2021 19:21:01 -0700

Week 5 assignment: convolutional neural network (Part3)

1, MobileNetV1 network Briefly read Google's 2017 paper mobilenets: efficient revolutionary neural networks for mobile vision applications to experience Depthwise convolution and Pointwise convolution. Also, read the code: https://github.com/OUCTheoryGroup/colab_demo/blob/master/202003_models/MobileNetV1_CIFAR10.ipynb type the code into Colab ...

Posted by Devsense on Sun, 03 Oct 2021 10:56:37 -0700

Neural network transplanted to STM32

Transplanting neural network to STM32 A recent project needs to use the network for fitting, and use the fitting results as control. I wonder if I can do neural network calculation directly on the single chip microcomputer, so that I can calculate in real time without relying on the upper computer. Therefore, there are two main problems to be ...

Posted by zulx on Sat, 02 Oct 2021 13:52:23 -0700

IFLYTEK face key point detection competition - punch in 1

During this period, I participated in the Coggle 30 days of ML punch in and signed up for the CV competition. The competition Title address is: https://challenge.xfyun.cn/topic/info?type=key -points-of-human-face&ch=dw-sq-1 Overview of competition questions: Face recognition is a biometric recognition technology based on human facial f ...

Posted by e_00_3 on Wed, 29 Sep 2021 17:53:47 -0700

Access, initialization and sharing of Python model parameters

Firstly, a multi-layer perceptron with a single hidden layer is defined, its parameters are initialized by the default method, and a forward operation is performed. import torch from torch import nn from torch.nn import init net=nn.Sequential(nn.Linear(4,3),nn.ReLU(),nn.Linear(3,1)) #Pytoch will be initialized by default print(net) X=torch.r ...

Posted by sgt.wolfgang on Mon, 27 Sep 2021 19:06:33 -0700