重磅干货,第一时间送达
导读
作为深度学习中的一大重要板块,模型架构始终是大家研究的热点,除了AutoML技术,有哪些突破常规比较新奇的网络架构?
# 回答一
作者:言有三
来源链接:
https://www.zhihu.com/question/337470480/answer/7663808551 渐变的宽度-金字塔结构
2 分支众多-分形结构
3 一切可连-环形网络
4 不规则的卷积核-可变形网络
[2] Dai J, Qi H, Xiong Y, et al. Deformable Convolutional Networks[J]. 2017.
5 测试可变的网络-可分叉网络
# 回答二
作者:人民艺术家
来源链接:
https://www.zhihu.com/question/337470480/answer/824132026总结
changelog
多路径特征处理
组卷积的演变
花式卷积
卷积混搭
图像领域的注意力结构
多尺度特征提取
ASPP新花样
扩张卷积的讲究
深监督
SE/SK/M&R
新奇的结构
相关资料
Identity mapping (https://www.yuque.com/lart/architecture/db7i2a#sNMiq)
(arxiv 2016)RESNET IN RESNET: GENERALIZING RESIDUAL ARCHITECTURES (https://www.yuque.com/lart/architecture/db7i2a#BBwPC) (ICLR 2018)LOG-DENSENET: HOW TO SPARSIFY A DENSENET (https://www.yuque.com/lart/architecture/db7i2a#2r6Xt) (ECCV 2018)Sparsely Aggregated Convolutional Networks (https://www.yuque.com/lart/architecture/db7i2a#Z015s)
Multi-branch (https://www.yuque.com/lart/architecture/db7i2a#MHuqj)
(ICCV 2019)Drop an Octave: Reducing Spatial Redundancy in Convolutional Neural Networks with Octave Convolution (https://www.yuque.com/lart/architecture/db7i2a#dNFUy)
(CVPR 2019)ELASTIC: Improving CNNs with Dynamic Scaling Policies (https://www.yuque.com/lart/architecture/db7i2a#wIMKs)
(CVPR 2019)Deep High-Resolution Representation Learning for Human Pose Estimation(HRNet) (https://www.yuque.com/lart/architecture/db7i2a#XDV4W)
(arxiv)High-Resolution Representations for Labeling Pixels and Regions(HRNetV2) (https://www.yuque.com/lart/architecture/db7i2a#RFPoS)
(CVPR 2017)Multigrid Neural Architectures (https://www.yuque.com/lart/architecture/db7i2a#2jve3)
(arxiv 2016)Deeply-Fused Nets (https://www.yuque.com/lart/architecture/db7i2a#BVMXu)
(IJCAI 2018)Deep Convolutional Neural Networks with Merge-and-Run Mappings (https://www.yuque.com/lart/architecture/db7i2a#pfrES)
AlexNet(2012) (https://www.yuque.com/lart/architecture/group#7mobe)
(CVPR 2017)ResNeXt (https://www.yuque.com/lart/architecture/group#7phku)
(MMM 2017)Logarithmic Group Convolution (https://www.yuque.com/lart/architecture/group#cGiXD)
(CVPR 2017)Deep Roots (https://www.yuque.com/lart/architecture/group#eIk8T)
(arixv 2014)Rigid-Motion Scattering for Texture Classification (https://www.yuque.com/lart/architecture/group#ALoI3)
(ICCV 2017)Factorized Convolutional Neural Networks (https://www.yuque.com/lart/architecture/group#NaHZ4)
(arixv 2016)Xception (https://www.yuque.com/lart/architecture/group#4o328)
(arxiv 2017)MobileNet (https://www.yuque.com/lart/architecture/group#k0YUN)
(ICCV 2019)HBONet: Harmonious Bottleneck on Two Orthogonal Dimensions (https://www.yuque.com/lart/architecture/group#74Z7o)
(ICCV 2017)IGCV1: Interleaved Group Convolutions for Deep Neural Networks (https://www.yuque.com/lart/architecture/group#rxMY2)
(CVPR 2018)IGCV2: Interleaved Structured Sparse Convolutional Neural Networks (https://www.yuque.com/lart/architecture/group#CnFUw)
(BMVC 2018)IGCV3: Interleaved Low-Rank Group Convolutions for Efficient Deep Neural Networks (https://www.yuque.com/lart/architecture/group#GMxWY)
(CVPR 2018)ShuffleNetV1 (https://www.yuque.com/lart/architecture/group#Kh3DL)
其他相关文章 (https://www.yuque.com/lart/architecture/group#XCSB0)
(ICLR 2015)Flatted Convolution (https://www.yuque.com/lart/architecture/conv#uGzbq)
(ICCV 2019)4-Connected Shift Residual Networks (https://www.yuque.com/lart/architecture/conv#VIBd6)
MixNet: Mixed Depthwise Convolutional Kernels (https://www.yuque.com/lart/architecture/mixnet#4d9jS)
Res2Net: A New Multi-scale Backbone Architecture (https://www.yuque.com/lart/architecture/mixnet#w6WTr)
Residual Attention Network for Image Classification (https://www.yuque.com/lart/architecture/vw6t5t#cNg2C)
Attention Augmented Convolutional Networks (https://www.yuque.com/lart/architecture/vw6t5t#xcDTJ)
Graph-Based Global Reasoning Networks (https://www.yuque.com/lart/architecture/vw6t5t#TeeOb)
SRM : A Style-based Recalibration Module for Convolutional Neural Networks (https://www.yuque.com/lart/architecture/vw6t5t#fHk1g)
Spatial Group-wise Enhance: Improving Semantic Feature Learning in Convolutional Networks (https://www.yuque.com/lart/architecture/vw6t5t#5yiAM)
Non-local Neural Networks (https://www.yuque.com/lart/architecture/vw6t5t#1rIG9)
Asymmetric Non-local Neural Networks for Semantic Segmentation (https://www.yuque.com/lart/architecture/vw6t5t#HHV2p)
Compact Generalized Non-local Network (https://www.yuque.com/lart/architecture/vw6t5t#eIgbE)
A2-Nets: Double Attention Networks (https://www.yuque.com/lart/architecture/vw6t5t#f1LV0)
GCNet: Non-local Networks Meet Squeeze-Excitation Networks and Beyond (https://www.yuque.com/lart/architecture/vw6t5t#iHP1x)
CBAM: Convolutional Block Attention Module (https://www.yuque.com/lart/architecture/vw6t5t#VL9QW)
BAM: Bottleneck Attention Module (https://www.yuque.com/lart/architecture/vw6t5t#tH1FF)
A Relation-Augmented Fully Convolutional Network for Semantic Segmentationin Aerial Scenes (https://www.yuque.com/lart/architecture/vw6t5t#8aEEw)
Dual Attention Network for Scene Segmentation (https://www.yuque.com/lart/architecture/vw6t5t#1e4w5)
相关链接 (https://www.yuque.com/lart/architecture/vw6t5t#0pYLl)
参考资料 (https://www.yuque.com/lart/architecture/vw6t5t#EuuVn)
综述论文 (https://www.yuque.com/lart/architecture/vw6t5t#LZ7gr)
PPM (https://www.yuque.com/lart/architecture/mutli#A095s)
ASPP (https://www.yuque.com/lart/architecture/mutli#x7GOY)
GPM (https://www.yuque.com/lart/architecture/mutli#xrRq4)
FPA (https://www.yuque.com/lart/architecture/mutli#REGYY)
Omni-Scale Residual Block (https://www.yuque.com/lart/architecture/mutli#E2GkI)
DenseASPP (https://www.yuque.com/lart/architecture/moreaspp#A2Lp6)
HDC (https://www.yuque.com/lart/architecture/moredilated#4lXNe)
Dilated Residual NetWorks (https://www.yuque.com/lart/architecture/moredilated#J0CcE)
Smoothed Dilated Convolutions (https://www.yuque.com/lart/architecture/moredilated#BgmZO)
DSN (https://www.yuque.com/lart/architecture/dsn)
SE (https://www.yuque.com/lart/architecture/upvx1p#bMTs0)
SK (https://www.yuque.com/lart/architecture/upvx1p#bzKZs)
M&R (https://www.yuque.com/lart/architecture/upvx1p#KJWYv)
FRACTALNET: ULTRA-DEEP NEURAL NETWORKS WITHOUT RESIDUALS (https://www.yuque.com/lart/architecture/arch#uplDt)
Deep Pyramidal Residual Networks (https://www.yuque.com/lart/architecture/arch#I57ao)
Deep Layer Aggregation (https://www.yuque.com/lart/architecture/arch#iuakf)
UNet++: A Nested U-Net Architecture for Medical Image Segmentation (https://www.yuque.com/lart/architecture/arch#492Mv)
DEEP CONVOLUTIONAL NEURAL NETWORK DESIGN PATTERNS:[https://arxiv.org/pdf/1611.00847.pdf (https://arxiv.org/pdf/1611.00847.pdf)
交流群
欢迎加入公众号读者群一起和同行交流,目前有美颜、三维视觉、计算摄影、检测、分割、识别、医学影像、GAN、算法竞赛等微信群
个人微信(如果没有备注不拉群!) 请注明:地区+学校/企业+研究方向+昵称
下载1:何恺明顶会分享
在「AI算法与图像处理」公众号后台回复:何恺明,即可下载。总共有6份PDF,涉及 ResNet、Mask RCNN等经典工作的总结分析
下载2:终身受益的编程指南:Google编程风格指南
在「AI算法与图像处理」公众号后台回复:c++,即可下载。历经十年考验,最权威的编程规范!
下载3 CVPR2021 在「AI算法与图像处理」公众号后台回复:CVPR,即可下载1467篇CVPR 2020论文 和 CVPR 2021 最新论文