first commit

.gitattributes

@@ -33,3 +33,14 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+*.jpg filter=lfs diff=lfs merge=lfs -text
+*.whl filter=lfs diff=lfs merge=lfs -text
+*.pdf filter=lfs diff=lfs merge=lfs -text
+*.png filter=lfs diff=lfs merge=lfs -text
+*.rknn filter=lfs diff=lfs merge=lfs -text
+*.caffemodel filter=lfs diff=lfs merge=lfs -text
+*.JPEG filter=lfs diff=lfs merge=lfs -text
+*.so filter=lfs diff=lfs merge=lfs -text
+*.so.* filter=lfs diff=lfs merge=lfs -text
+*.a filter=lfs diff=lfs merge=lfs -text
+opencv_version filter=lfs diff=lfs merge=lfs -text

CHANGELOG.md

@@ -0,0 +1,152 @@
+# CHANGELOG
+
+## v2.1.0
+
+- Support RV1103B (Beta)
+- Support RK2118 (Beta)
+- Support Flash Attention (Only RK3562 and RK3576)
+- Improve MatMul API
+- Improve support for int32 and int64
+- Support more operators and operator fusion
+
+## v2.0.0-beta0
+
+ - Support RK3576 (Beta)
+ - Support RK2118 (Beta)
+ - Support SDPA (Scaled Dot Product Attention) to improve transformer performance
+ - Improve custom operators support
+ - Improve MatMul API
+ - Improve support for Reshape,Transpose,BatchLayernorm,Softmax,Deconv,Matmul,ScatterND etc.
+ - Support pytorch 2.1
+ - Improve support for QAT models of pytorch and onnx
+ - Optimize automatic generation of C++ code
+
+
+
+## v1.6.0
+
+ - Support ONNX model of OPSET 12~19
+ - Support custom operators (including CPU and GPU)
+ - Improve support for dynamic weight convolution, Layernorm, RoiAlign, Softmax, ReduceL2, Gelu, GLU, etc.
+ - Added support for python3.7/3.9/3.11
+ - Add rknn_convert function
+ - Improve transformer support
+ - Improve MatMul API, such as increasing the K limit length, RK3588 adding int4 * int4 -> int16 support, etc.
+ - Reduce RV1106 rknn_init initialization time, memory consumption, etc.
+ - RV1106 adds int16 support for some operators
+ - Fixed the problem that the convolution operator of RV1106 platform may make random errors in some cases.
+ - Improve user manual
+ - Reconstruct the rknn model zoo and add support for multiple models such as detection, segmentation, OCR, and license plate recognition.
+
+
+
+## v1.5.2
+
+- Improve dynamic shape support
+- Improve matmul api support
+- Add GPU back-end implementations for some operators such as matmul
+- Improve transformer support
+- Reduce rknn_init memory usage
+- Optimize rknn_init time-consuming
+
+
+
+## v1.5.0
+
+- Support RK3562
+- Support more NPU operator fuse, such as Conv-Silu/Conv-Swish/Conv-Hardswish/Conv-sigmoid/Conv-HardSwish/Conv-Gelu ..
+- Improve support for  NHWC output layout
+- RK3568/RK3588：The maximum input resolution up to 8192
+- Improve support for Swish/DataConvert/Softmax/Lstm/LayerNorm/Gather/Transpose/Mul/Maxpool/Sigmoid/Pad
+- Improve support for CPU operators (Cast, Sin, Cos, RMSNorm, ScalerND, GRU)
+- Limited support for dynamic resolution
+- Provide MATMUL API
+- Add RV1103/RV1106 rknn_server application as proxy between PC and board
+- Add more examples such as rknn_dynamic_shape_input_demo and video demo for yolov5
+- Bug fix
+
+
+
+## v1.4.0
+
+- Support more NPU operators, such as Reshape、Transpose、MatMul、 Max、Min、exGelu、exSoftmax13、Resize etc.
+
+- Add **Weight Share**  function, reduce memory usage.
+
+- Add **Weight Compression** function, reduce memory and bandwidth usage.(RK3588/RV1103/RV1106)
+
+- RK3588 supports storing weights or feature maps on SRAM, reducing system bandwidth consumption.
+
+- RK3588 adds the function of running a single model on multiple cores at the same time.
+
+- Add new output layout NHWC (C has alignment restrictions) .
+
+- Improve support for non-4D input.
+
+- Add more examples such as rknn_yolov5_android_apk_demo and rknn_internal_mem_reuse_demo.
+
+- Bug fix.
+
+    
+
+## v1.3.0
+
+- Support RV1103/RV1106（Beta SDK）
+- rknn_tensor_attr support w_stride(rename from stride) and h_stride
+- Rename rknn_destroy_mem()
+- Support more NPU operators, such as Where, Resize, Pad, Reshape, Transpose etc.
+- RK3588 support multi-batch multi-core mode
+- When RKNN_LOG_LEVEL=4, it supports to display the MACs utilization and bandwidth occupation of each layer.
+- Bug fix
+
+
+
+## v1.2.0
+
+- Support RK3588
+- Support more operators, such as GRU、Swish、LayerNorm etc.
+- Reduce memory usage
+- Improve zero-copy interface implementation
+- Bug fix
+
+
+
+## v1.1.0
+
+- Support INT8+FP16 mixed quantization to improve model accuracy
+- Support specifying input and output dtype, which can be solidified into the model
+- Support multiple inputs of the model with different channel mean/std
+- Improve the stability of multi-thread + multi-process runtime
+- Support flashing cache for fd pointed to internal tensor memory which are allocated by users
+- Improve dumping internal layer results of the model
+- Add rknn_server application as proxy between PC and board
+- Support more operators, such as HardSigmoid、HardSwish、Gather、ReduceMax、Elu
+- Add LSTM support (structure cifg and peephole are not supported, function: layernormal, clip is not supported)
+- Bug fix
+
+
+
+## v1.0
+
+- Optimize the performance of rknn_inputs_set()
+- Add more functions for zero-copy
+- Add new OP support, see OP support list document for details.
+- Add multi-process support
+- Support per-channel quantitative model
+- Bug fix
+
+
+
+## v0.7
+
+- Optimize the performance of rknn_inputs_set(), especially for models whose input width is 8-byte aligned.
+
+- Add new OP support, see OP support list document for details.
+
+- Bug fix
+
+    
+
+## v0.6
+- Initial version
+

LICENSE

@@ -0,0 +1,5 @@
+**Copyright Statement**
+
+Copyright(C) 2024 Rockchip Electronics Co., Ltd. All rights reserved.
+
+BY OPENING OR USING THIS FILE, RECEIVER HEREBY ACKNOWLEDGES AND AGREES THAT THE SOFTWARE/FIRMWARE AND ITS DOCUMENTATIONS ("ROCKCHIP SOFTWARE") RECEIVED FROM ROCKCHIP ON AN "AS-IS" BASIS ONLY WITHOUT ANY AND ALL WARRANTIES, EITHER EXPRESS, IMPLIED OR STATUTORY, INCLUDING, WITHOUT LIMITATION, ANY WARRANTY OR CONDITION WITH RESPECT TO TITLE, MERCHANTABILITY, FITNESS FOR ANY PARTICULAR PURPOSE, OR NON-INFRINGEMENT. NEITHER DOES ROCKCHIP PROVIDE ANY WARRANTY WHATSOEVER WITH RESPECT TO ANY OPEN SOURCE TECHNOLOGIES, THIRD-PARTY TECHNOLOGIES OR ANY STANDARD TECHNOLOGIES WHICH MAY BE SUPPORTED BY, INCORPORATED IN, OR SUPPLIED WITH THE ROCKCHIP SOFTWARE. RECEIVER EXPRESSLY ACKNOWLEDGES THAT IT IS RECEIVER'S SOLE RESPONSIBILITY TO OBTAIN AND MAINTAIN ALL NECESSARY LICENSES AND RIGHTS FROM THEIR RESPECTIVE OWNERS TO USE ANY SUCH THIRD-PARTY TECHNOLOGIES OR ANY STANDARD TECHNOLOGIES. RECEIVER'S SOLE AND EXCLUSIVE REMEDY AND ROCKCHIP'S ENTIRE AND CUMULATIVE LIABILITY WITH RESPECT TO THE ROCKCHIP SOFTWARE RELEASED HEREUNDER WILL BE, AT ROCKCHIP 'S OPTION, TO REVISE OR REPLACE THE ROCKCHIP SOFTWARE AT ISSUE, OR REFUND ANY FEES OR CHARGE PAID BY RECEIVER TO ROCKCHIP FOR SUCH ROCKCHIP SOFTWARE AT ISSUE.

README.md

@@ -0,0 +1,84 @@
+# Description
+  RKNN software stack can help users to quickly deploy AI models to Rockchip chips. The overall framework is as follows:
+    <center class="half">
+        <div style="background-color:#ffffff;">
+        <img src="res/framework.png" title="RKNN"/>
+    </center>
+
+  In order to use RKNPU, users need to first run the RKNN-Toolkit2 tool on the computer, convert the trained model into an RKNN format model, and then inference on the development board using the RKNN C API or Python API.
+
+- RKNN-Toolkit2 is a software development kit for users to perform model conversion, inference and performance evaluation on PC and Rockchip NPU platforms.
+
+- RKNN-Toolkit-Lite2 provides Python programming interfaces for Rockchip NPU platform to help users deploy RKNN models and accelerate the implementation of AI applications.
+
+- RKNN Runtime provides C/C++ programming interfaces for Rockchip NPU platform to help users deploy RKNN models and accelerate the implementation of AI applications.
+
+- RKNPU kernel driver is responsible for interacting with NPU hardware. It has been open source and can be found in the Rockchip kernel code.
+
+# Support Platform
+  - RK3588 Series
+  - RK3576 Series
+  - RK3566/RK3568 Series
+  - RK3562 Series
+  - RV1103/RV1106
+  - RV1103B
+  - RK2118
+
+
+Note:
+
+​      **For RK1808/RV1109/RV1126/RK3399Pro, please refer to :**
+
+​          https://github.com/airockchip/rknn-toolkit
+
+​          https://github.com/airockchip/rknpu
+
+​          https://github.com/airockchip/RK3399Pro_npu
+
+
+# Download
+- You can also download all packages, docker image, examples, docs and platform-tools from [RKNPU2_SDK](https://console.zbox.filez.com/l/I00fc3), fetch code: rknn
+- You can get more examples from [rknn mode zoo](https://github.com/airockchip/rknn_model_zoo)
+
+# Notes
+- RKNN-Toolkit2 is not compatible with [RKNN-Toolkit](https://github.com/airockchip/rknn-toolkit)
+- Currently only support on:
+  - Ubuntu 18.04 python 3.6/3.7
+  - Ubuntu 20.04 python 3.8/3.9
+  - Ubuntu 22.04 python 3.10/3.11
+- Latest version:v2.1.0
+
+
+
+# RKNN LLM
+
+If you want to deploy LLM (Large Language Model), we have introduced a new SDK called RKNN-LLM. For details, please refer to:
+
+https://github.com/airockchip/rknn-llm
+
+
+
+# CHANGELOG
+
+## v2.1.0
+ - Support RV1103B (Beta)
+- Support RK2118 (Beta)
+- Support Flash Attention (Only RK3562 and RK3576)
+- Improve MatMul API
+- Improve support for int32 and int64
+- Support more operators and operator fusion
+
+ for older version, please refer [CHANGELOG](CHANGELOG.md)
+
+# Feedback and Community Support
+- [Redmine](https://redmine.rock-chips.com) (**Feedback recommended, Please consult our sales or FAE for the redmine account**)
+- QQ Group Chat: 1025468710 (full, please join group 3)
+- QQ Group Chat2: 547021958 (full, please join group 3)
+- QQ Group Chat3: 469385426
+<center class="half">
+  <img width="200" height="200"  src="res/QQGroupQRCode.png" title="QQ Group Chat"/>
+  <img width="200" height="200"  src="res/QQGroup2QRCode.png" title="QQ Group Chat2"/>
+  <img width="200" height="200"  src="res/QQGroup3QRCode.png" title="QQ Group Chat3"/>
+</center>
+
+

autosparsity/README.md

@@ -0,0 +1,58 @@
+## AutoSparsity
+
+Enables sparse training and inference for PyTorch models.
+
+
+## Usage
+
+### Step 1
+
+Install autosparsity package
+
+```bash
+pip install packages/autosparsity-1.0-cp38-cp38m-linux_x86_64.whl
+```
+
+### Step 2
+
+Taking ResNet50 in torchvision as an example to generate the sparse model.
+
+```bash
+python examples/autosparsity.py
+```
+To sparsity a custom model, just add the sparsity_model functionwhen model training, as follows:
+
+```python
+# insert model autosparsity code before training
+import torch
+import torchvision.models as models
+from autosparsity.sparsity import sparsity_model
+
+...
+
+model = models.resnet34(pretrained=True).cuda()
+mode = 0
+sparsity_model(model, optimizer, mode)
+
+# normal training
+x, y = DataLoader(args)
+for epoch in range(epochs):
+    y_pred = model(x)
+    loss = loss_func(y_pred, y)
+    loss.backward()
+    optimizer.step()
+    ...
+```
+
+- Note: Make sure CUDA is available
+
+
+### Step3
+
+Use RKNN-Toolkite to perfom sparse inference
+
+```bash
+python examples/test.py
+```
+- Note: Only supports RK3576 target platform
+

autosparsity/examples/README.md

@@ -0,0 +1,68 @@
+# Sparse Infer
+
+This tool is used for the Torch model to autosparsity the weights during the training, which can save model storage and reduce model inference time in RKNN sparse inference.
+
+## Usage
+
+### Step 1
+
+Install autosparsity package
+
+```bash
+pip install ../packages/autosparsity-1.0-cp38-cp38m-linux_x86_64.whl
+```
+
+### Step 2
+
+Taking ResNet50 in torchvision as an example to generate the sparse model.
+
+```bash
+python autosparsity.py
+```
+To sparsity a custom model, just add the sparsity_model functionwhen model training, as follows:
+
+```python
+# insert model autosparsity code before training
+import torch
+import torchvision.models as models
+from autosparsity.sparsity import sparsity_model
+
+...
+
+model = models.resnet34(pretrained=True).cuda()
+mode = 0
+sparsity_model(model, optimizer, mode)
+
+# normal training
+x, y = DataLoader(args)
+for epoch in range(epochs):
+    y_pred = model(x)
+    loss = loss_func(y_pred, y)
+    loss.backward()
+    optimizer.step()
+    ...
+```
+
+- Note: Make sure CUDA is available
+
+
+### Step3
+
+Perfom sparse inference
+
+```bash
+python test.py
+```
+- Note: Only supports RK3576 target platform
+
+### Expected Results:
+
+This will print the , as follows:
+```
+-----TOP 5-----
+[155] score:0.877372 class:"Shih-Tzu"
+[283] score:0.042477 class:"Persian cat"
+[ 82] score:0.006625 class:"ruffed grouse, partridge, Bonasa umbellus"
+[154] score:0.006625 class:"Pekinese, Pekingese, Peke"
+[204] score:0.004696 class:"Lhasa, Lhasa apso"
+```

autosparsity/examples/autosparsity.py

@@ -0,0 +1,17 @@
+import torch
+import torchvision.models as models
+from autosparsity.sparsity import sparsity_model
+
+
+if __name__ == "__main__":
+
+    model = models.resnet50(pretrained=True).cuda()
+    optimizer = None
+    mode = 0
+    sparsity_model(model, optimizer, mode)
+
+    model.eval()
+    x = torch.randn((1,3,224,224)).cuda()
+    torch.onnx.export(
+        model, x, 'resnet50.onnx', input_names=['inputs'], output_names=['outputs']
+    )

autosparsity/examples/datasets.txt

@@ -0,0 +1 @@
+./dog_224x224.jpg

autosparsity/examples/labels.txt

@@ -0,0 +1,1000 @@
+0:tench, Tinca tinca
+1:goldfish, Carassius auratus
+2:great white shark, white shark, man-eater, man-eating shark, Carcharodon carcharias
+3:tiger shark, Galeocerdo cuvieri
+4:hammerhead, hammerhead shark
+5:electric ray, crampfish, numbfish, torpedo
+6:stingray
+7:cock
+8:hen
+9:ostrich, Struthio camelus
+10:brambling, Fringilla montifringilla
+11:goldfinch, Carduelis carduelis
+12:house finch, linnet, Carpodacus mexicanus
+13:junco, snowbird
+14:indigo bunting, indigo finch, indigo bird, Passerina cyanea
+15:robin, American robin, Turdus migratorius
+16:bulbul
+17:jay
+18:magpie
+19:chickadee
+20:water ouzel, dipper
+21:kite
+22:bald eagle, American eagle, Haliaeetus leucocephalus
+23:vulture
+24:great grey owl, great gray owl, Strix nebulosa
+25:European fire salamander, Salamandra salamandra
+26:common newt, Triturus vulgaris
+27:eft
+28:spotted salamander, Ambystoma maculatum
+29:axolotl, mud puppy, Ambystoma mexicanum
+30:bullfrog, Rana catesbeiana
+31:tree frog, tree-frog
+32:tailed frog, bell toad, ribbed toad, tailed toad, Ascaphus trui
+33:loggerhead, loggerhead turtle, Caretta caretta
+34:leatherback turtle, leatherback, leathery turtle, Dermochelys coriacea
+35:mud turtle
+36:terrapin
+37:box turtle, box tortoise
+38:banded gecko
+39:common iguana, iguana, Iguana iguana
+40:American chameleon, anole, Anolis carolinensis
+41:whiptail, whiptail lizard
+42:agama
+43:frilled lizard, Chlamydosaurus kingi
+44:alligator lizard
+45:Gila monster, Heloderma suspectum
+46:green lizard, Lacerta viridis
+47:African chameleon, Chamaeleo chamaeleon
+48:Komodo dragon, Komodo lizard, dragon lizard, giant lizard, Varanus komodoensis
+49:African crocodile, Nile crocodile, Crocodylus niloticus
+50:American alligator, Alligator mississipiensis
+51:triceratops
+52:thunder snake, worm snake, Carphophis amoenus
+53:ringneck snake, ring-necked snake, ring snake
+54:hognose snake, puff adder, sand viper
+55:green snake, grass snake
+56:king snake, kingsnake
+57:garter snake, grass snake
+58:water snake
+59:vine snake
+60:night snake, Hypsiglena torquata
+61:boa constrictor, Constrictor constrictor
+62:rock python, rock snake, Python sebae
+63:Indian cobra, Naja naja
+64:green mamba
+65:sea snake
+66:horned viper, cerastes, sand viper, horned asp, Cerastes cornutus
+67:diamondback, diamondback rattlesnake, Crotalus adamanteus
+68:sidewinder, horned rattlesnake, Crotalus cerastes
+69:trilobite
+70:harvestman, daddy longlegs, Phalangium opilio
+71:scorpion
+72:black and gold garden spider, Argiope aurantia
+73:barn spider, Araneus cavaticus
+74:garden spider, Aranea diademata
+75:black widow, Latrodectus mactans
+76:tarantula
+77:wolf spider, hunting spider
+78:tick
+79:centipede
+80:black grouse
+81:ptarmigan
+82:ruffed grouse, partridge, Bonasa umbellus
+83:prairie chicken, prairie grouse, prairie fowl
+84:peacock
+85:quail
+86:partridge
+87:African grey, African gray, Psittacus erithacus
+88:macaw
+89:sulphur-crested cockatoo, Kakatoe galerita, Cacatua galerita
+90:lorikeet
+91:coucal
+92:bee eater
+93:hornbill
+94:hummingbird
+95:jacamar
+96:toucan
+97:drake
+98:red-breasted merganser, Mergus serrator
+99:goose
+100:black swan, Cygnus atratus
+101:tusker
+102:echidna, spiny anteater, anteater
+103:platypus, duckbill, duckbilled platypus, duck-billed platypus, Ornithorhynchus anatinus
+104:wallaby, brush kangaroo
+105:koala, koala bear, kangaroo bear, native bear, Phascolarctos cinereus
+106:wombat
+107:jellyfish
+108:sea anemone, anemone
+109:brain coral
+110:flatworm, platyhelminth
+111:nematode, nematode worm, roundworm
+112:conch
+113:snail
+114:slug
+115:sea slug, nudibranch
+116:chiton, coat-of-mail shell, sea cradle, polyplacophore
+117:chambered nautilus, pearly nautilus, nautilus
+118:Dungeness crab, Cancer magister
+119:rock crab, Cancer irroratus
+120:fiddler crab
+121:king crab, Alaska crab, Alaskan king crab, Alaska king crab, Paralithodes camtschatica
+122:American lobster, Northern lobster, Maine lobster, Homarus americanus
+123:spiny lobster, langouste, rock lobster, crawfish, crayfish, sea crawfish
+124:crayfish, crawfish, crawdad, crawdaddy
+125:hermit crab
+126:isopod
+127:white stork, Ciconia ciconia
+128:black stork, Ciconia nigra
+129:spoonbill
+130:flamingo
+131:little blue heron, Egretta caerulea
+132:American egret, great white heron, Egretta albus
+133:bittern
+134:crane
+135:limpkin, Aramus pictus
+136:European gallinule, Porphyrio porphyrio
+137:American coot, marsh hen, mud hen, water hen, Fulica americana
+138:bustard
+139:ruddy turnstone, Arenaria interpres
+140:red-backed sandpiper, dunlin, Erolia alpina
+141:redshank, Tringa totanus
+142:dowitcher
+143:oystercatcher, oyster catcher
+144:pelican
+145:king penguin, Aptenodytes patagonica
+146:albatross, mollymawk
+147:grey whale, gray whale, devilfish, Eschrichtius gibbosus, Eschrichtius robustus
+148:killer whale, killer, orca, grampus, sea wolf, Orcinus orca
+149:dugong, Dugong dugon
+150:sea lion
+151:Chihuahua
+152:Japanese spaniel
+153:Maltese dog, Maltese terrier, Maltese
+154:Pekinese, Pekingese, Peke
+155:Shih-Tzu
+156:Blenheim spaniel
+157:papillon
+158:toy terrier
+159:Rhodesian ridgeback
+160:Afghan hound, Afghan
+161:basset, basset hound
+162:beagle
+163:bloodhound, sleuthhound
+164:bluetick
+165:black-and-tan coonhound
+166:Walker hound, Walker foxhound
+167:English foxhound
+168:redbone
+169:borzoi, Russian wolfhound
+170:Irish wolfhound
+171:Italian greyhound
+172:whippet
+173:Ibizan hound, Ibizan Podenco
+174:Norwegian elkhound, elkhound
+175:otterhound, otter hound
+176:Saluki, gazelle hound
+177:Scottish deerhound, deerhound
+178:Weimaraner
+179:Staffordshire bullterrier, Staffordshire bull terrier
+180:American Staffordshire terrier, Staffordshire terrier, American pit bull terrier, pit bull terrier
+181:Bedlington terrier
+182:Border terrier
+183:Kerry blue terrier
+184:Irish terrier
+185:Norfolk terrier
+186:Norwich terrier
+187:Yorkshire terrier
+188:wire-haired fox terrier
+189:Lakeland terrier
+190:Sealyham terrier, Sealyham
+191:Airedale, Airedale terrier
+192:cairn, cairn terrier
+193:Australian terrier
+194:Dandie Dinmont, Dandie Dinmont terrier
+195:Boston bull, Boston terrier
+196:miniature schnauzer
+197:giant schnauzer
+198:standard schnauzer
+199:Scotch terrier, Scottish terrier, Scottie
+200:Tibetan terrier, chrysanthemum dog
+201:silky terrier, Sydney silky
+202:soft-coated wheaten terrier
+203:West Highland white terrier
+204:Lhasa, Lhasa apso
+205:flat-coated retriever
+206:curly-coated retriever
+207:golden retriever
+208:Labrador retriever
+209:Chesapeake Bay retriever
+210:German short-haired pointer
+211:vizsla, Hungarian pointer
+212:English setter
+213:Irish setter, red setter
+214:Gordon setter
+215:Brittany spaniel
+216:clumber, clumber spaniel
+217:English springer, English springer spaniel
+218:Welsh springer spaniel
+219:cocker spaniel, English cocker spaniel, cocker
+220:Sussex spaniel
+221:Irish water spaniel
+222:kuvasz
+223:schipperke
+224:groenendael
+225:malinois
+226:briard
+227:kelpie
+228:komondor
+229:Old English sheepdog, bobtail
+230:Shetland sheepdog, Shetland sheep dog, Shetland
+231:collie
+232:Border collie
+233:Bouvier des Flandres, Bouviers des Flandres
+234:Rottweiler
+235:German shepherd, German shepherd dog, German police dog, alsatian
+236:Doberman, Doberman pinscher
+237:miniature pinscher
+238:Greater Swiss Mountain dog
+239:Bernese mountain dog
+240:Appenzeller
+241:EntleBucher
+242:boxer
+243:bull mastiff
+244:Tibetan mastiff
+245:French bulldog
+246:Great Dane
+247:Saint Bernard, St Bernard
+248:Eskimo dog, husky
+249:malamute, malemute, Alaskan malamute
+250:Siberian husky
+251:dalmatian, coach dog, carriage dog
+252:affenpinscher, monkey pinscher, monkey dog
+253:basenji
+254:pug, pug-dog
+255:Leonberg
+256:Newfoundland, Newfoundland dog
+257:Great Pyrenees
+258:Samoyed, Samoyede
+259:Pomeranian
+260:chow, chow chow
+261:keeshond
+262:Brabancon griffon
+263:Pembroke, Pembroke Welsh corgi
+264:Cardigan, Cardigan Welsh corgi
+265:toy poodle
+266:miniature poodle
+267:standard poodle
+268:Mexican hairless
+269:timber wolf, grey wolf, gray wolf, Canis lupus
+270:white wolf, Arctic wolf, Canis lupus tundrarum
+271:red wolf, maned wolf, Canis rufus, Canis niger
+272:coyote, prairie wolf, brush wolf, Canis latrans
+273:dingo, warrigal, warragal, Canis dingo
+274:dhole, Cuon alpinus
+275:African hunting dog, hyena dog, Cape hunting dog, Lycaon pictus
+276:hyena, hyaena
+277:red fox, Vulpes vulpes
+278:kit fox, Vulpes macrotis
+279:Arctic fox, white fox, Alopex lagopus
+280:grey fox, gray fox, Urocyon cinereoargenteus
+281:tabby, tabby cat
+282:tiger cat
+283:Persian cat
+284:Siamese cat, Siamese
+285:Egyptian cat
+286:cougar, puma, catamount, mountain lion, painter, panther, Felis concolor
+287:lynx, catamount
+288:leopard, Panthera pardus
+289:snow leopard, ounce, Panthera uncia
+290:jaguar, panther, Panthera onca, Felis onca
+291:lion, king of beasts, Panthera leo
+292:tiger, Panthera tigris
+293:cheetah, chetah, Acinonyx jubatus
+294:brown bear, bruin, Ursus arctos
+295:American black bear, black bear, Ursus americanus, Euarctos americanus
+296:ice bear, polar bear, Ursus Maritimus, Thalarctos maritimus
+297:sloth bear, Melursus ursinus, Ursus ursinus
+298:mongoose
+299:meerkat, mierkat
+300:tiger beetle
+301:ladybug, ladybeetle, lady beetle, ladybird, ladybird beetle
+302:ground beetle, carabid beetle
+303:long-horned beetle, longicorn, longicorn beetle
+304:leaf beetle, chrysomelid
+305:dung beetle
+306:rhinoceros beetle
+307:weevil
+308:fly
+309:bee
+310:ant, emmet, pismire
+311:grasshopper, hopper
+312:cricket
+313:walking stick, walkingstick, stick insect
+314:cockroach, roach
+315:mantis, mantid
+316:cicada, cicala
+317:leafhopper
+318:lacewing, lacewing fly
+319:dragonfly, darning needle, devil's darning needle, sewing needle, snake feeder, snake doctor, mosquito hawk, skeeter hawk
+320:damselfly
+321:admiral
+322:ringlet, ringlet butterfly
+323:monarch, monarch butterfly, milkweed butterfly, Danaus plexippus
+324:cabbage butterfly
+325:sulphur butterfly, sulfur butterfly
+326:lycaenid, lycaenid butterfly
+327:starfish, sea star
+328:sea urchin
+329:sea cucumber, holothurian
+330:wood rabbit, cottontail, cottontail rabbit
+331:hare
+332:Angora, Angora rabbit
+333:hamster
+334:porcupine, hedgehog
+335:fox squirrel, eastern fox squirrel, Sciurus niger
+336:marmot
+337:beaver
+338:guinea pig, Cavia cobaya
+339:sorrel
+340:zebra
+341:hog, pig, grunter, squealer, Sus scrofa
+342:wild boar, boar, Sus scrofa
+343:warthog
+344:hippopotamus, hippo, river horse, Hippopotamus amphibius
+345:ox
+346:water buffalo, water ox, Asiatic buffalo, Bubalus bubalis
+347:bison
+348:ram, tup
+349:bighorn, bighorn sheep, cimarron, Rocky Mountain bighorn, Rocky Mountain sheep, Ovis canadensis
+350:ibex, Capra ibex
+351:hartebeest
+352:impala, Aepyceros melampus
+353:gazelle
+354:Arabian camel, dromedary, Camelus dromedarius
+355:llama
+356:weasel
+357:mink
+358:polecat, fitch, foulmart, foumart, Mustela putorius
+359:black-footed ferret, ferret, Mustela nigripes
+360:otter
+361:skunk, polecat, wood pussy
+362:badger
+363:armadillo
+364:three-toed sloth, ai, Bradypus tridactylus
+365:orangutan, orang, orangutang, Pongo pygmaeus
+366:gorilla, Gorilla gorilla
+367:chimpanzee, chimp, Pan troglodytes
+368:gibbon, Hylobates lar
+369:siamang, Hylobates syndactylus, Symphalangus syndactylus
+370:guenon, guenon monkey
+371:patas, hussar monkey, Erythrocebus patas
+372:baboon
+373:macaque
+374:langur
+375:colobus, colobus monkey
+376:proboscis monkey, Nasalis larvatus
+377:marmoset
+378:capuchin, ringtail, Cebus capucinus
+379:howler monkey, howler
+380:titi, titi monkey
+381:spider monkey, Ateles geoffroyi
+382:squirrel monkey, Saimiri sciureus
+383:Madagascar cat, ring-tailed lemur, Lemur catta
+384:indri, indris, Indri indri, Indri brevicaudatus
+385:Indian elephant, Elephas maximus
+386:African elephant, Loxodonta africana
+387:lesser panda, red panda, panda, bear cat, cat bear, Ailurus fulgens
+388:giant panda, panda, panda bear, coon bear, Ailuropoda melanoleuca
+389:barracouta, snoek
+390:eel
+391:coho, cohoe, coho salmon, blue jack, silver salmon, Oncorhynchus kisutch
+392:rock beauty, Holocanthus tricolor
+393:anemone fish
+394:sturgeon
+395:gar, garfish, garpike, billfish, Lepisosteus osseus
+396:lionfish
+397:puffer, pufferfish, blowfish, globefish
+398:abacus
+399:abaya
+400:academic gown, academic robe, judge's robe
+401:accordion, piano accordion, squeeze box
+402:acoustic guitar
+403:aircraft carrier, carrier, flattop, attack aircraft carrier
+404:airliner
+405:airship, dirigible
+406:altar
+407:ambulance
+408:amphibian, amphibious vehicle
+409:analog clock
+410:apiary, bee house
+411:apron
+412:ashcan, trash can, garbage can, wastebin, ash bin, ash-bin, ashbin, dustbin, trash barrel, trash bin
+413:assault rifle, assault gun
+414:backpack, back pack, knapsack, packsack, rucksack, haversack
+415:bakery, bakeshop, bakehouse
+416:balance beam, beam
+417:balloon
+418:ballpoint, ballpoint pen, ballpen, Biro
+419:Band Aid
+420:banjo
+421:bannister, banister, balustrade, balusters, handrail
+422:barbell
+423:barber chair
+424:barbershop
+425:barn
+426:barometer
+427:barrel, cask
+428:barrow, garden cart, lawn cart, wheelbarrow
+429:baseball
+430:basketball
+431:bassinet
+432:bassoon
+433:bathing cap, swimming cap
+434:bath towel
+435:bathtub, bathing tub, bath, tub
+436:beach wagon, station wagon, wagon, estate car, beach waggon, station waggon, waggon
+437:beacon, lighthouse, beacon light, pharos
+438:beaker
+439:bearskin, busby, shako
+440:beer bottle
+441:beer glass
+442:bell cote, bell cot
+443:bib
+444:bicycle-built-for-two, tandem bicycle, tandem
+445:bikini, two-piece
+446:binder, ring-binder
+447:binoculars, field glasses, opera glasses
+448:birdhouse
+449:boathouse
+450:bobsled, bobsleigh, bob
+451:bolo tie, bolo, bola tie, bola
+452:bonnet, poke bonnet
+453:bookcase
+454:bookshop, bookstore, bookstall
+455:bottlecap
+456:bow
+457:bow tie, bow-tie, bowtie
+458:brass, memorial tablet, plaque
+459:brassiere, bra, bandeau
+460:breakwater, groin, groyne, mole, bulwark, seawall, jetty
+461:breastplate, aegis, egis
+462:broom
+463:bucket, pail
+464:buckle
+465:bulletproof vest
+466:bullet train, bullet
+467:butcher shop, meat market
+468:cab, hack, taxi, taxicab
+469:caldron, cauldron
+470:candle, taper, wax light
+471:cannon
+472:canoe
+473:can opener, tin opener
+474:cardigan
+475:car mirror
+476:carousel, carrousel, merry-go-round, roundabout, whirligig
+477:carpenter's kit, tool kit
+478:carton
+479:car wheel
+480:cash machine, cash dispenser, automated teller machine, automatic teller machine, automated teller, automatic teller, ATM
+481:cassette
+482:cassette player
+483:castle
+484:catamaran
+485:CD player
+486:cello, violoncello
+487:cellular telephone, cellular phone, cellphone, cell, mobile phone
+488:chain
+489:chainlink fence
+490:chain mail, ring mail, mail, chain armor, chain armour, ring armor, ring armour
+491:chain saw, chainsaw
+492:chest
+493:chiffonier, commode
+494:chime, bell, gong
+495:china cabinet, china closet
+496:Christmas stocking
+497:church, church building
+498:cinema, movie theater, movie theatre, movie house, picture palace
+499:cleaver, meat cleaver, chopper
+500:cliff dwelling
+501:cloak
+502:clog, geta, patten, sabot
+503:cocktail shaker
+504:coffee mug
+505:coffeepot
+506:coil, spiral, volute, whorl, helix
+507:combination lock
+508:computer keyboard, keypad
+509:confectionery, confectionary, candy store
+510:container ship, containership, container vessel
+511:convertible
+512:corkscrew, bottle screw
+513:cornet, horn, trumpet, trump
+514:cowboy boot
+515:cowboy hat, ten-gallon hat
+516:cradle
+517:crane
+518:crash helmet
+519:crate
+520:crib, cot
+521:Crock Pot
+522:croquet ball
+523:crutch
+524:cuirass
+525:dam, dike, dyke
+526:desk
+527:desktop computer
+528:dial telephone, dial phone
+529:diaper, nappy, napkin
+530:digital clock
+531:digital watch
+532:dining table, board
+533:dishrag, dishcloth
+534:dishwasher, dish washer, dishwashing machine
+535:disk brake, disc brake
+536:dock, dockage, docking facility
+537:dogsled, dog sled, dog sleigh
+538:dome
+539:doormat, welcome mat
+540:drilling platform, offshore rig
+541:drum, membranophone, tympan
+542:drumstick
+543:dumbbell
+544:Dutch oven
+545:electric fan, blower
+546:electric guitar
+547:electric locomotive
+548:entertainment center
+549:envelope
+550:espresso maker
+551:face powder
+552:feather boa, boa
+553:file, file cabinet, filing cabinet
+554:fireboat
+555:fire engine, fire truck
+556:fire screen, fireguard
+557:flagpole, flagstaff
+558:flute, transverse flute
+559:folding chair
+560:football helmet
+561:forklift
+562:fountain
+563:fountain pen
+564:four-poster
+565:freight car
+566:French horn, horn
+567:frying pan, frypan, skillet
+568:fur coat
+569:garbage truck, dustcart
+570:gasmask, respirator, gas helmet
+571:gas pump, gasoline pump, petrol pump, island dispenser
+572:goblet
+573:go-kart
+574:golf ball
+575:golfcart, golf cart
+576:gondola
+577:gong, tam-tam
+578:gown
+579:grand piano, grand
+580:greenhouse, nursery, glasshouse
+581:grille, radiator grille
+582:grocery store, grocery, food market, market
+583:guillotine
+584:hair slide
+585:hair spray
+586:half track
+587:hammer
+588:hamper
+589:hand blower, blow dryer, blow drier, hair dryer, hair drier
+590:hand-held computer, hand-held microcomputer
+591:handkerchief, hankie, hanky, hankey
+592:hard disc, hard disk, fixed disk
+593:harmonica, mouth organ, harp, mouth harp
+594:harp
+595:harvester, reaper
+596:hatchet
+597:holster
+598:home theater, home theatre
+599:honeycomb
+600:hook, claw
+601:hoopskirt, crinoline
+602:horizontal bar, high bar
+603:horse cart, horse-cart
+604:hourglass
+605:iPod
+606:iron, smoothing iron
+607:jack-o'-lantern
+608:jean, blue jean, denim
+609:jeep, landrover
+610:jersey, T-shirt, tee shirt
+611:jigsaw puzzle
+612:jinrikisha, ricksha, rickshaw
+613:joystick
+614:kimono
+615:knee pad
+616:knot
+617:lab coat, laboratory coat
+618:ladle
+619:lampshade, lamp shade
+620:laptop, laptop computer
+621:lawn mower, mower
+622:lens cap, lens cover
+623:letter opener, paper knife, paperknife
+624:library
+625:lifeboat
+626:lighter, light, igniter, ignitor
+627:limousine, limo
+628:liner, ocean liner
+629:lipstick, lip rouge
+630:Loafer
+631:lotion
+632:loudspeaker, speaker, speaker unit, loudspeaker system, speaker system
+633:loupe, jeweler's loupe
+634:lumbermill, sawmill
+635:magnetic compass
+636:mailbag, postbag
+637:mailbox, letter box
+638:maillot
+639:maillot, tank suit
+640:manhole cover
+641:maraca
+642:marimba, xylophone
+643:mask
+644:matchstick
+645:maypole
+646:maze, labyrinth
+647:measuring cup
+648:medicine chest, medicine cabinet
+649:megalith, megalithic structure
+650:microphone, mike
+651:microwave, microwave oven
+652:military uniform
+653:milk can
+654:minibus
+655:miniskirt, mini
+656:minivan
+657:missile
+658:mitten
+659:mixing bowl
+660:mobile home, manufactured home
+661:Model T
+662:modem
+663:monastery
+664:monitor
+665:moped
+666:mortar
+667:mortarboard
+668:mosque
+669:mosquito net
+670:motor scooter, scooter
+671:mountain bike, all-terrain bike, off-roader
+672:mountain tent
+673:mouse, computer mouse
+674:mousetrap
+675:moving van
+676:muzzle
+677:nail
+678:neck brace
+679:necklace
+680:nipple
+681:notebook, notebook computer
+682:obelisk
+683:oboe, hautboy, hautbois
+684:ocarina, sweet potato
+685:odometer, hodometer, mileometer, milometer
+686:oil filter
+687:organ, pipe organ
+688:oscilloscope, scope, cathode-ray oscilloscope, CRO
+689:overskirt
+690:oxcart
+691:oxygen mask
+692:packet
+693:paddle, boat paddle
+694:paddlewheel, paddle wheel
+695:padlock
+696:paintbrush
+697:pajama, pyjama, pj's, jammies
+698:palace
+699:panpipe, pandean pipe, syrinx
+700:paper towel
+701:parachute, chute
+702:parallel bars, bars
+703:park bench
+704:parking meter
+705:passenger car, coach, carriage
+706:patio, terrace
+707:pay-phone, pay-station
+708:pedestal, plinth, footstall
+709:pencil box, pencil case
+710:pencil sharpener
+711:perfume, essence
+712:Petri dish
+713:photocopier
+714:pick, plectrum, plectron
+715:pickelhaube
+716:picket fence, paling
+717:pickup, pickup truck
+718:pier
+719:piggy bank, penny bank
+720:pill bottle
+721:pillow
+722:ping-pong ball
+723:pinwheel
+724:pirate, pirate ship
+725:pitcher, ewer
+726:plane, carpenter's plane, woodworking plane
+727:planetarium
+728:plastic bag
+729:plate rack
+730:plow, plough
+731:plunger, plumber's helper
+732:Polaroid camera, Polaroid Land camera
+733:pole
+734:police van, police wagon, paddy wagon, patrol wagon, wagon, black Maria
+735:poncho
+736:pool table, billiard table, snooker table
+737:pop bottle, soda bottle
+738:pot, flowerpot
+739:potter's wheel
+740:power drill
+741:prayer rug, prayer mat
+742:printer
+743:prison, prison house
+744:projectile, missile
+745:projector
+746:puck, hockey puck
+747:punching bag, punch bag, punching ball, punchball
+748:purse
+749:quill, quill pen
+750:quilt, comforter, comfort, puff
+751:racer, race car, racing car
+752:racket, racquet
+753:radiator
+754:radio, wireless
+755:radio telescope, radio reflector
+756:rain barrel
+757:recreational vehicle, RV, R.V.
+758:reel
+759:reflex camera
+760:refrigerator, icebox
+761:remote control, remote
+762:restaurant, eating house, eating place, eatery
+763:revolver, six-gun, six-shooter
+764:rifle
+765:rocking chair, rocker
+766:rotisserie
+767:rubber eraser, rubber, pencil eraser
+768:rugby ball
+769:rule, ruler
+770:running shoe
+771:safe
+772:safety pin
+773:saltshaker, salt shaker
+774:sandal
+775:sarong
+776:sax, saxophone
+777:scabbard
+778:scale, weighing machine
+779:school bus
+780:schooner
+781:scoreboard
+782:screen, CRT screen
+783:screw
+784:screwdriver
+785:seat belt, seatbelt
+786:sewing machine
+787:shield, buckler
+788:shoe shop, shoe-shop, shoe store
+789:shoji
+790:shopping basket
+791:shopping cart
+792:shovel
+793:shower cap
+794:shower curtain
+795:ski
+796:ski mask
+797:sleeping bag
+798:slide rule, slipstick
+799:sliding door
+800:slot, one-armed bandit
+801:snorkel
+802:snowmobile
+803:snowplow, snowplough
+804:soap dispenser
+805:soccer ball
+806:sock
+807:solar dish, solar collector, solar furnace
+808:sombrero
+809:soup bowl
+810:space bar
+811:space heater
+812:space shuttle
+813:spatula
+814:speedboat
+815:spider web, spider's web
+816:spindle
+817:sports car, sport car
+818:spotlight, spot
+819:stage
+820:steam locomotive
+821:steel arch bridge
+822:steel drum
+823:stethoscope
+824:stole
+825:stone wall
+826:stopwatch, stop watch
+827:stove
+828:strainer
+829:streetcar, tram, tramcar, trolley, trolley car
+830:stretcher
+831:studio couch, day bed
+832:stupa, tope
+833:submarine, pigboat, sub, U-boat
+834:suit, suit of clothes
+835:sundial
+836:sunglass
+837:sunglasses, dark glasses, shades
+838:sunscreen, sunblock, sun blocker
+839:suspension bridge
+840:swab, swob, mop
+841:sweatshirt
+842:swimming trunks, bathing trunks
+843:swing
+844:switch, electric switch, electrical switch
+845:syringe
+846:table lamp
+847:tank, army tank, armored combat vehicle, armoured combat vehicle
+848:tape player
+849:teapot
+850:teddy, teddy bear
+851:television, television system
+852:tennis ball
+853:thatch, thatched roof
+854:theater curtain, theatre curtain
+855:thimble
+856:thresher, thrasher, threshing machine
+857:throne
+858:tile roof
+859:toaster
+860:tobacco shop, tobacconist shop, tobacconist
+861:toilet seat
+862:torch
+863:totem pole
+864:tow truck, tow car, wrecker
+865:toyshop
+866:tractor
+867:trailer truck, tractor trailer, trucking rig, rig, articulated lorry, semi
+868:tray
+869:trench coat
+870:tricycle, trike, velocipede
+871:trimaran
+872:tripod
+873:triumphal arch
+874:trolleybus, trolley coach, trackless trolley
+875:trombone
+876:tub, vat
+877:turnstile
+878:typewriter keyboard
+879:umbrella
+880:unicycle, monocycle
+881:upright, upright piano
+882:vacuum, vacuum cleaner
+883:vase
+884:vault
+885:velvet
+886:vending machine
+887:vestment
+888:viaduct
+889:violin, fiddle
+890:volleyball
+891:waffle iron
+892:wall clock
+893:wallet, billfold, notecase, pocketbook
+894:wardrobe, closet, press
+895:warplane, military plane
+896:washbasin, handbasin, washbowl, lavabo, wash-hand basin
+897:washer, automatic washer, washing machine
+898:water bottle
+899:water jug
+900:water tower
+901:whiskey jug
+902:whistle
+903:wig
+904:window screen
+905:window shade
+906:Windsor tie
+907:wine bottle
+908:wing
+909:wok
+910:wooden spoon
+911:wool, woolen, woollen
+912:worm fence, snake fence, snake-rail fence, Virginia fence
+913:wreck
+914:yawl
+915:yurt
+916:web site, website, internet site, site
+917:comic book
+918:crossword puzzle, crossword
+919:street sign
+920:traffic light, traffic signal, stoplight
+921:book jacket, dust cover, dust jacket, dust wrapper
+922:menu
+923:plate
+924:guacamole
+925:consomme
+926:hot pot, hotpot
+927:trifle
+928:ice cream, icecream
+929:ice lolly, lolly, lollipop, popsicle
+930:French loaf
+931:bagel, beigel
+932:pretzel
+933:cheeseburger
+934:hotdog, hot dog, red hot
+935:mashed potato
+936:head cabbage
+937:broccoli
+938:cauliflower
+939:zucchini, courgette
+940:spaghetti squash
+941:acorn squash
+942:butternut squash
+943:cucumber, cuke
+944:artichoke, globe artichoke
+945:bell pepper
+946:cardoon
+947:mushroom
+948:Granny Smith
+949:strawberry
+950:orange
+951:lemon
+952:fig
+953:pineapple, ananas
+954:banana
+955:jackfruit, jak, jack
+956:custard apple
+957:pomegranate
+958:hay
+959:carbonara
+960:chocolate sauce, chocolate syrup
+961:dough
+962:meat loaf, meatloaf
+963:pizza, pizza pie
+964:potpie
+965:burrito
+966:red wine
+967:espresso
+968:cup
+969:eggnog
+970:alp
+971:bubble
+972:cliff, drop, drop-off
+973:coral reef
+974:geyser
+975:lakeside, lakeshore
+976:promontory, headland, head, foreland
+977:sandbar, sand bar
+978:seashore, coast, seacoast, sea-coast
+979:valley, vale
+980:volcano
+981:ballplayer, baseball player
+982:groom, bridegroom
+983:scuba diver
+984:rapeseed
+985:daisy
+986:yellow lady's slipper, yellow lady-slipper, Cypripedium calceolus, Cypripedium parviflorum
+987:corn
+988:acorn
+989:hip, rose hip, rosehip
+990:buckeye, horse chestnut, conker
+991:coral fungus
+992:agaric
+993:gyromitra
+994:stinkhorn, carrion fungus
+995:earthstar
+996:hen-of-the-woods, hen of the woods, Polyporus frondosus, Grifola frondosa
+997:bolete
+998:ear, spike, capitulum
+999:toilet tissue, toilet paper, bathroom tissue

autosparsity/examples/resnet50.onnx

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4428727ffe996c87fcb871d7e21093c34c64b76f978f9de3c813322d61419470
+size 102146376

autosparsity/examples/test.py

@@ -0,0 +1,81 @@
+import numpy as np
+import cv2
+from rknn.api import RKNN
+
+
+ONNX_MODEL = 'resnet50.onnx'
+RKNN_MODEL = 'resnet50.rknn'
+
+def show_outputs(outputs):
+    output = outputs[0][0]
+    index = sorted(range(len(output)), key=lambda k : output[k], reverse=True)
+    fp = open('./labels.txt', 'r')
+    labels = fp.readlines()
+    top5_str = 'resnet50_sparse_infer\n-----TOP 5-----\n'
+    for i in range(5):
+        value = output[index[i]]
+        if value > 0:
+            topi = '[{:>3d}] score:{:.6f} class:"{}"\n'.format(index[i], value, labels[index[i]].strip().split(':')[-1])
+        else:
+            topi = '[ -1]: 0.0\n'
+        top5_str += topi
+    print(top5_str.strip())
+
+
+if __name__ == '__main__':
+
+    # Create RKNN object
+    rknn = RKNN(verbose=True)
+
+    # Pre-process config
+    print('--> Config model')
+    rknn.config(mean_values=[123.675, 116.28, 103.53], std_values=[58.395, 57.12, 57.375], target_platform='rk3576', sparse_infer=True)
+    print('done')
+
+    # Load model
+    print('--> Loading model')
+    ret = rknn.load_onnx(model=ONNX_MODEL)
+    if ret != 0:
+        print('Load model failed!')
+        exit(ret)
+    print('done')
+
+    # Build model
+    print('--> Building model')
+    ret = rknn.build(do_quantization=True, dataset='./datasets.txt')
+    if ret != 0:
+        print('Build model failed!')
+        exit(ret)
+    print('done')
+
+    # Export rknn model
+    print('--> Export rknn model')
+    ret = rknn.export_rknn(RKNN_MODEL)
+    if ret != 0:
+        print('Export rknn model failed!')
+        exit(ret)
+    print('done')
+
+    # Set inputs
+    img = cv2.imread('./dog_224x224.jpg')
+    img = cv2.cvtColor(img, cv2.COLOR_BGR2RGB)
+    img = np.expand_dims(img, 0)
+
+    # Init runtime environment
+    print('--> Init runtime environment')
+    ret = rknn.init_runtime(target='rk3576')
+    if ret != 0:
+        print('Init runtime environment failed!')
+        exit(ret)
+    print('done')
+
+    # Inference
+    print('--> Running model')
+    outputs = rknn.inference(inputs=[img], data_format=['nhwc'])
+    x = outputs[0]
+    output = np.exp(x)/np.sum(np.exp(x))
+    outputs = [output]
+    show_outputs(outputs)
+    print('done')
+
+    rknn.release()

autosparsity/packages/autosparsity-1.0-cp310-cp310-linux_x86_64.whl

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:91738c554c28a71a17c799d9e8c7e600212c34a8a6cd36a178f13ef005f0b925
+size 1726486

autosparsity/packages/autosparsity-1.0-cp311-cp311-linux_x86_64.whl

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fb6388e740816010b536fbd1e93f99dd38e78a3591df9b25c59e0293f6ecc85b
+size 1723914

autosparsity/packages/autosparsity-1.0-cp36-cp36m-linux_x86_64.whl

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b5741fbe4ffa24d68508ff066b6743e1af58c032b1189e81b1ad805d2007de2d
+size 5122147

autosparsity/packages/autosparsity-1.0-cp37-cp37m-linux_x86_64.whl

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bf04d2f3534947215b0af1a2cdc083f0ec989a88f86c6c03532fb86d14acdd93
+size 5308248

autosparsity/packages/autosparsity-1.0-cp38-cp38-linux_x86_64.whl

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5f9f3329905adeb050e14e01fcd262aa1dc21b65efeba38c74203006330dcc30
+size 6906641

autosparsity/packages/autosparsity-1.0-cp39-cp39-linux_x86_64.whl

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a89321f12ab53480a6bc0db1f30a3e61d229277e3e0e1e313a57ba509631f2d3
+size 1727843

doc/01_Rockchip_RK2118_Quick_Start_RKNN_SDK_V2.1.0_CN.pdf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5faf0a127f6fc5272674420d83de1a401b1e458b1e61a66f93b90f33ea182877
+size 15783332

doc/01_Rockchip_RK2118_Quick_Start_RKNN_SDK_V2.1.0_EN.pdf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7a2cca5f2847658a85e2dc0b39fdf1d9bd19afbef1a7303e67d01555eb96ca06
+size 22421246

doc/01_Rockchip_RKNPU_Quick_Start_RKNN_SDK_V2.1.0_CN.pdf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bd91ab63287eae5e7de735d44ed42e2178d12d495d614098d4c033bb1416dbaa
+size 58526084

doc/01_Rockchip_RKNPU_Quick_Start_RKNN_SDK_V2.1.0_EN.pdf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:513f8bb08f60c192e313c89fa8e2064812b15cebb5e7137a0e8deaf297f65e09
+size 39216171

doc/01_Rockchip_RV1106_RV1103_Quick_Start_RKNN_SDK_V2.1.0_CN.pdf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c32cb3ef8d250bfdac1f86ec6bdeca8e3e0666aea40c36d0330bc6739ba8a400
+size 30662929

doc/01_Rockchip_RV1106_RV1103_Quick_Start_RKNN_SDK_V2.1.0_EN.pdf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1c6055c7b5fc437127b27947dafa059068a48348db0a250d7fa5bfe62f33df99
+size 23683494

doc/02_Rockchip_RKNPU_User_Guide_RKNN_SDK_V2.1.0_CN.pdf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:12426814125e12d82be5113e8dc9351184a452b9f6cc79d52517a0364d941e6d
+size 10793826

doc/02_Rockchip_RKNPU_User_Guide_RKNN_SDK_V2.1.0_EN.pdf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:65118a948dc4ccb29bbacf80b41ced2c6fb2cc09e02a092761a97de714708ac3
+size 8311627

doc/03_Rockchip_RKNPU_API_Reference_RKNN_Toolkit2_V2.1.0_CN.pdf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:44b6ea3f613abb822117d993604cbc56c21bbe354df4a0564b618bacd278b160
+size 716783

doc/03_Rockchip_RKNPU_API_Reference_RKNN_Toolkit2_V2.1.0_EN.pdf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d879cb7e34e267ed9cb1256b59fa87bb33955f1e286a6efc25a0f2702d002288
+size 213701

doc/04_Rockchip_RKNPU_API_Reference_RKNNRT_V2.1.0_CN.pdf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7e7cc3573b8e25c54e6899caf18b787791e329c773e7c4d7b5f9513398612a10
+size 986337

doc/04_Rockchip_RKNPU_API_Reference_RKNNRT_V2.1.0_EN.pdf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f402e099a2728da4aee40c8f088d8dd2be127bd670ba76cbf787701d7b834e1e
+size 336513

doc/05_RKNN_Compiler_Support_Operator_List_V2.1.0.pdf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fa08dd033288dd1a206ee8fe4e9d109b7dd8b9a8b615d5aa58bc72e4eeb0cca3
+size 3702083

doc/RKNNToolKit2_OP_Support-v2.1.0.md

@@ -0,0 +1,519 @@
+# RKNNToolkit2 OPs Support
+
+## ONNX OPs supported by RKNN Toolkit2
+
+According to [ONNX official instructions](https://github.com/microsoft/onnxruntime/blob/master/docs/Versioning.md 'ONNX Version Description'), the corresponding ONNX opset version is 19.
+The list of ONNX OPs supported by RKNN Toolkit2 is as follows:
+<br>(For more restrictions, please refer to <RKNN_Compiler_Support_Operator_List>)
+
+| **Operators**             | **Remarks**                             |
+| ------------------------- | --------------------------------------- |
+| Abs                       | Not Supported                           |
+| Acos                      | Not Supported                           |
+| Acosh                     | Not Supported                           |
+| Add                       |                                         |
+| And                       |                                         |
+| ArgMax                    |                                         |
+| ArgMin                    |                                         |
+| Asin                      | Not Supported                           |
+| Asinh                     | Not Supported                           |
+| Atan                      | Not Supported                           |
+| Atanh                     | Not Supported                           |
+| AveragePool               |                                         |
+| BatchNormalization        |                                         |
+| Bernoulli                 | Not Supported                           |
+| BitShift                  | Not Supported                           |
+| BitwiseAnd                | Not Supported                           |
+| BitwiseNot                | Not Supported                           |
+| BitwiseOr                 | Not Supported                           |
+| BitwiseXor                | Not Supported                           |
+| BlackmanWindow            | Not Supported                           |
+| Cast                      |                                         |
+| CastLike                  | Not Supported                           |
+| Ceil                      | Not Supported                           |
+| Celu                      | Not Supported                           |
+| CenterCropPad             | Not Supported                           |
+| Clip                      |                                         |
+| Col2Im                    | Not Supported                           |
+| Compress                  | Not Supported                           |
+| Concat                    |                                         |
+| ConcatFromSequence        | Not Supported                           |
+| Constant                  |                                         |
+| ConstantOfShape           |                                         |
+| Conv                      |                                         |
+| ConvInteger               | Not Supported                           |
+| ConvTranspose             |                                         |
+| Cos                       |                                         |
+| Cosh                      | Not Supported                           |
+| CumSum                    | Not Supported                           |
+| DeformConv                | Not Supported                           |
+| DepthToSpace              |                                         |
+| DequantizeLinear          |                                         |
+| Det                       | Not Supported                           |
+| DFT                       | Not Supported                           |
+| Div                       |                                         |
+| Dropout                   |                                         |
+| DynamicQuantizeLinear     | Not Supported                           |
+| Einsum                    | Not Supported                           |
+| Elu                       |                                         |
+| Equal                     |                                         |
+| Erf                       |                                         |
+| Exp                       |                                         |
+| Expand                    |                                         |
+| EyeLike                   | only support constant input             |
+| Flatten                   |                                         |
+| Floor                     |                                         |
+| Gather                    |                                         |
+| GatherElements            |                                         |
+| GatherND                  | Not Supported                           |
+| Gemm                      |                                         |
+| GlobalAveragePool         |                                         |
+| GlobalLpPool              | Not Supported                           |
+| GlobalMaxPool             |                                         |
+| Greater                   |                                         |
+| GreaterOrEqual            |                                         |
+| GridSample                | Not Supported                           |
+| GroupNormalization        | Not Supported                           |
+| GRU                       | batchsize: 1                            |
+| HammingWindow             | Not Supported                           |
+| HannWindow                | Not Supported                           |
+| Hardmax                   | Not Supported                           |
+| HardSigmoid               |                                         |
+| HardSwish                 |                                         |
+| Identity                  |                                         |
+| If                        | only support constant input             |
+| InstanceNormalization     |                                         |
+| IsInf                     | Not Supported                           |
+| IsNaN                     | Not Supported                           |
+| LayerNormalization        |                                         |
+| LeakyRelu                 |                                         |
+| Less                      |                                         |
+| LessOrEqual               |                                         |
+| Log                       |                                         |
+| LogSoftmax                | batchsize: 1                            |
+| Loop                      | Not Supported                           |
+| LpNormalization           |                                         |
+| LpPool                    | Not Supported                           |
+| LRN                       |                                         |
+| LSTM                      |                                         |
+| MatMul                    |                                         |
+| MatMulInteger             | Not Supported                           |
+| Max                       |                                         |
+| MaxPool                   |                                         |
+| MaxRoiPool                |                                         |
+| MaxUnpool                 |                                         |
+| Mean                      | Not Supported                           |
+| MeanVarianceNormalization |                                         |
+| MelWeightMatrix           | Not Supported                           |
+| Min                       |                                         |
+| Mish                      |                                         |
+| Mod                       |                                         |
+| Mul                       |                                         |
+| Multinomial               | Not Supported                           |
+| Neg                       | Not Supported                           |
+| NegativeLogLikelihoodLoss | Not Supported                           |
+| NonMaxSuppression         | Not Supported                           |
+| NonZero                   | Not Supported                           |
+| Not                       | Not Supported                           |
+| OneHot                    | Not Supported                           |
+| Optional                  | Not Supported                           |
+| OptionalGetElement        | Not Supported                           |
+| OptionalHasElement        | Not Supported                           |
+| Or                        | Not Supported                           |
+| Pad                       |                                         |
+| Pow                       |                                         |
+| PRelu                     |                                         |
+| QLinearConv               | Not Supported                           |
+| QLinearMatMul             | Not Supported                           |
+| QuantizeLinear            |                                         |
+| RandomNormal              | Not Supported                           |
+| RandomNormalLike          | Not Supported                           |
+| RandomUniform             | Not Supported                           |
+| RandomUniformLike         | Not Supported                           |
+| Range                     | Not Supported                           |
+| Reciprocal                | Not Supported                           |
+| ReduceL1                  | Not Supported                           |
+| ReduceL2                  | Not Supported                           |
+| ReduceLogSum              | Not Supported                           |
+| ReduceLogSumExp           | Not Supported                           |
+| ReduceMax                 |                                         |
+| ReduceMean                |                                         |
+| ReduceMin                 |                                         |
+| ReduceProd                | Not Supported                           |
+| ReduceSum                 |                                         |
+| ReduceSumSquare           | Not Supported                           |
+| Relu                      |                                         |
+| Reshape                   |                                         |
+| Resize                    | mode: nearest2d/bilinear                |
+| ReverseSequence           |                                         |
+| RNN                       | Not Supported                           |
+| RoiAlign                  | pool type: average<br />batchsize: 1    |
+| Round                     | Not Supported                           |
+| Scan                      | Not Supported                           |
+| ScatterElements           | Not Supported                           |
+| ScatterND                 |                                         |
+| Selu                      | Not Supported                           |
+| SequenceAt                | Not Supported                           |
+| SequenceConstruct         | Not Supported                           |
+| SequenceEmpty             | Not Supported                           |
+| SequenceErase             | Not Supported                           |
+| SequenceInsert            | Not Supported                           |
+| SequenceLength            | Not Supported                           |
+| SequenceMap               | Not Supported                           |
+| Shape                     |                                         |
+| Shrink                    | Not Supported                           |
+| Sigmoid                   |                                         |
+| Sign                      | Not Supported                           |
+| Sin                       |                                         |
+| Sinh                      | Not Supported                           |
+| Size                      |                                         |
+| Slice                     | batchsize: 1                            |
+| Softmax                   | batchsize: 1                            |
+| SoftmaxCrossEntropyLoss   | Not Supported                           |
+| Softplus                  |                                         |
+| Softsign                  | Not Supported                           |
+| SpaceToDepth              |                                         |
+| Split                     |                                         |
+| SplitToSequence           | Not Supported                           |
+| Sqrt                      |                                         |
+| Squeeze                   |                                         |
+| STFT                      | Not Supported                           |
+| StringNormalizer          | Not Supported                           |
+| Sub                       |                                         |
+| Sum                       | Not Supported                           |
+| Tan                       | Not Supported                           |
+| Tanh                      |                                         |
+| TfIdfVectorizer           | Not Supported                           |
+| ThresholdedRelu           | Not Supported                           |
+| Tile                      | batchsize: 1<br />not support broadcast |
+| TopK                      | Not Supported                           |
+| Transpose                 |                                         |
+| Trilu                     | Not Supported                           |
+| Unique                    | Not Supported                           |
+| Unsqueeze                 |                                         |
+| Where                     |                                         |
+| Xor                       | Not Supported                           |
+
+## Pytorch OPs supported by RKNN Toolkit2
+
+The Pytorch version supported by RKNN Toolkit2 is >1.6.0, models generated by other versions may not support.  
+The list of Pytorch OPs supported by RKNN Toolkit2 is as follows:
+
+| **Operators**                 | **Remarks**                        |
+| ----------------------------- | ---------------------------------- |
+| aten::_convolution            | same as onnx Conv                  |
+| aten::abs                     | Not supported                      |
+| aten::abs_                    | Not supported                      |
+| aten::adaptive_avg_pool1d     | Not supported                      |
+| aten::adaptive_avg_pool2d     | same as onnx AveragePool           |
+| aten::adaptive_max_pool1d     | Not supported                      |
+| aten::adaptive_max_pool2d     | same as onnx MaxPool               |
+| aten::add                     | same as onnx Add                   |
+| aten::add_                    |                                    |
+| aten::addmm                   | same as onnx Gemm                  |
+| aten::affine_grid_generator   | Not supported                      |
+| aten::alpha_dropout           |                                    |
+| aten::alpha_dropout_          | Not supported                      |
+| aten::arange                  | Not supported                      |
+| aten::avg_pool1d              | Not supported                      |
+| aten::avg_pool2d              | same as onnx AveragePool           |
+| aten::avg_pool3d              | Not supported                      |
+| aten::batch_norm              | same as onnx BatchNormalization    |
+| aten::bmm                     | same as onnx MatMul                |
+| aten::cat                     | same as onnx Concat                |
+| aten::celu                    | Not supported                      |
+| aten::celu_                   | Not supported                      |
+| aten::chunk                   |                                    |
+| aten::clamp                   |                                    |
+| aten::clamp_                  |                                    |
+| aten::clamp_max               | Not supported                      |
+| aten::clamp_max_              | Not supported                      |
+| aten::clamp_min               |                                    |
+| aten::clamp_min_              | Not supported                      |
+| aten::clone                   |                                    |
+| aten::constant_pad_nd         | same as onnx Pad                   |
+| aten::contiguous              |                                    |
+| aten::copy                    |                                    |
+| aten::cos                     | Not supported                      |
+| aten::cos_                    | Not supported                      |
+| aten::cumsum                  | Not supported                      |
+| aten::detach                  |                                    |
+| aten::detach_                 | Not supported                      |
+| aten::div                     | same as onnx Div                   |
+| aten::div_                    |                                    |
+| aten::dropout                 |                                    |
+| aten::dropout_                |                                    |
+| aten::einsum                  | Not supported                      |
+| aten::elu                     | same as onnx Elu                   |
+| aten::elu_                    |                                    |
+| aten::embedding               | same as onnx Gather                |
+| aten::empty                   |                                    |
+| aten::eq                      | Not supported                      |
+| aten::eq_                     | Not supported                      |
+| aten::erf                     | Not supported                      |
+| aten::erf_                    | Not supported                      |
+| aten::erfc                    | Not supported                      |
+| aten::erfc_                   | Not supported                      |
+| aten::exp                     |                                    |
+| aten::exp_                    |                                    |
+| aten::expand                  |                                    |
+| aten::expand_as               | Not supported                      |
+| aten::expm1                   | Not supported                      |
+| aten::expm1_                  | Not supported                      |
+| aten::feature_dropout         |                                    |
+| aten::feature_dropout_        | Not supported                      |
+| aten::flatten                 |                                    |
+| aten::flip                    | Not supported                      |
+| aten::floor                   | Not supported                      |
+| aten::floor_                  | Not supported                      |
+| aten::floor_divide            | Not supported                      |
+| aten::floor_divide_           | Not supported                      |
+| aten::gather                  | Not supported                      |
+| aten::ge                      | Not supported                      |
+| aten::ge_                     | Not supported                      |
+| aten::gelu                    |                                    |
+| aten::gelu_                   | Not supported                      |
+| aten::grid_sampler            | Not supported                      |
+| aten::gru                     |                                    |
+| aten::gt                      |                                    |
+| aten::gt_                     | Not supported                      |
+| aten::hardshrink              | Not supported                      |
+| aten::hardshrink_             | Not supported                      |
+| aten::hardswish               | same as onnx HardSwish             |
+| aten::hardswish_              |                                    |
+| aten::hardtanh                |                                    |
+| aten::hardtanh_               |                                    |
+| aten::index                   | Not supported                      |
+| aten::index_put               | Not supported                      |
+| aten::index_put_              | Not supported                      |
+| aten::instance_norm           | same as onnx InstanceNormalization |
+| aten::Int                     |                                    |
+| aten::layer_norm              |                                    |
+| aten::le                      | Not supported                      |
+| aten::le_                     | Not supported                      |
+| aten::leaky_relu              | same as onnx LeakyRelu             |
+| aten::leaky_relu_             |                                    |
+| aten::lerp                    | Not supported                      |
+| aten::lerp_                   | Not supported                      |
+| aten::log                     | Not supported                      |
+| aten::log_                    | Not supported                      |
+| aten::log10                   | Not supported                      |
+| aten::log10_                  | Not supported                      |
+| aten::log1p                   | Not supported                      |
+| aten::log1p_                  | Not supported                      |
+| aten::log2                    | Not supported                      |
+| aten::log2_                   | Not supported                      |
+| aten::log_sigmoid             | Not supported                      |
+| aten::log_softmax             | Not supported                      |
+| aten::linear                  | same as onnx Gemm                  |
+| aten::lstm                    | same as onnx LSTM                  |
+| aten::lt                      |                                    |
+| aten::lt_                     | Not supported                      |
+| aten::matmul                  | same as onnx MatMul                |
+| aten::max                     |                                    |
+| aten::maximum                 |                                    |
+| aten::max_                    | Not supported                      |
+| aten::max_pool1d              | same as onnx MaxPool               |
+| aten::max_pool1d_with_indices |                                    |
+| aten::max_pool2d              | same as onnx MaxPool               |
+| aten::max_pool2d_with_indices |                                    |
+| aten::mean                    | same as onnx ReduceMean            |
+| aten::meshgrid                | Not supported                      |
+| aten::min                     |                                    |
+| aten::minimum                 |                                    |
+| aten::min_                    | Not supported                      |
+| aten::mish                    |                                    |
+| aten::mm                      | same as onnx MatMul                |
+| aten::mul                     | same as onnx Mul                   |
+| aten::mul_                    |                                    |
+| aten::narrow                  | same as onnx Slice                 |
+| aten::ne                      |                                    |
+| aten::ne_                     | Not supported                      |
+| aten::neg                     | Not supported                      |
+| aten::neg_                    | Not supported                      |
+| aten::new_full                | Not supported                      |
+| aten::new_zeros               | Not supported                      |
+| aten::nonzero                 | Not supported                      |
+| aten::norm                    | Not supported                      |
+| aten::ones                    |                                    |
+| aten::ones_like               |                                    |
+| aten::pad                     | Not supported                      |
+| aten::permute                 | same as onnx Transpose             |
+| aten::pow                     |                                    |
+| aten::pow_                    | Not supported                      |
+| aten::prelu                   | same as onnx PRelu                 |
+| aten::prelu_                  | Not supported                      |
+| aten::prod                    |                                    |
+| aten::reciprocal              |                                    |
+| aten::reciprocal_             | Not supported                      |
+| aten::reflection_pad1d        |                                    |
+| aten::reflection_pad2d        |                                    |
+| aten::relu                    | same as onnx Relu                  |
+| aten::relu6                   | same as onnx Relu                  |
+| aten::relu_                   |                                    |
+| aten::relu6_                  |                                    |
+| aten::repeat                  |                                    |
+| aten::reshape                 |                                    |
+| aten::reshape_                | Not supported                      |
+| torchvision::roi_align        | Not supported                      |
+| aten::rsqrt                   | Not supported                      |
+| aten::rsqrt_                  | Not supported                      |
+| aten::ScalarImplicit          |                                    |
+| aten::select                  |                                    |
+| aten::selu                    | Not supported                      |
+| aten::selu_                   | Not supported                      |
+| aten::sigmoid                 | same as onnx Sigmoid               |
+| aten::sigmoid_                |                                    |
+| aten::silu                    |                                    |
+| aten::silu_                   |                                    |
+| aten::sin                     | Not supported                      |
+| aten::sin_                    | Not supported                      |
+| aten::size                    |                                    |
+| aten::slice                   | same as onnx Slice                 |
+| aten::softmax                 | same as onnx Softmax               |
+| aten::softplus                |                                    |
+| aten::softshrink              | Not supported                      |
+| aten::sort                    | Not supported                      |
+| aten::split                   | same as onnx Split                 |
+| aten::split_with_sizes        |                                    |
+| aten::sqrt                    | Not supported                      |
+| aten::sqrt_                   | Not supported                      |
+| aten::squeeze                 |                                    |
+| aten::squeeze_                | Not supported                      |
+| aten::stack                   |                                    |
+| aten::sub                     | same as onnx Sub                   |
+| aten::sub_                    |                                    |
+| aten::sum                     | same as onnx ReduceSum             |
+| aten::t                       |                                    |
+| aten::t_                      | Not supported                      |
+| aten::tanh                    |                                    |
+| aten::tanh_                   |                                    |
+| aten::threshold               |                                    |
+| aten::threshold_              |                                    |
+| aten::to                      |                                    |
+| aten::topk                    | Not supported                      |
+| aten::transpose               |                                    |
+| aten::transpose_              |                                    |
+| aten::true_divide             | same as onnx Div                   |
+| aten::true_divide_            | Not supported                      |
+| aten::type_as                 |                                    |
+| aten::unfold                  | Not supported                      |
+| aten::unsqueeze               |                                    |
+| aten::upsample_bilinear2d     |                                    |
+| aten::upsample_nearest2d      |                                    |
+| aten::view                    |                                    |
+| aten::view_                   | Not supported                      |
+| aten::view_as                 | Not supported                      |
+| aten::view_as_                | Not supported                      |
+| aten::where                   |                                    |
+| aten::zero_                   | Not supported                      |
+| aten::zeros                   |                                    |
+| aten::zeros_like              |                                    |
+
+
+
+
+## Caffe OPs supported by RKNN Toolkit2
+
+Caffe protocols RKNN Toolkit2 uses only based on the officially modified protocol of berkeley.
+The protocol based on the official revision of berkeley comes from [berkeley caffe](https://github.com/BVLC/caffe/tree/master/src/caffe/proto 'Berkeley Caffe'), commit hash is 21d0608. On this basis RKNN Toolkit2 have added some OPs.  
+Based on this protocol, the list of Caffe OPs supported by RKNN Toolkit2 is as follows:
+
+| **Operators**          | **Remarks**                                                                                                   |
+| ---------------------- | ------------------------------------------------------------------------------------------------------------- |
+| BatchNorm              | same as onnx BatchNormalization                                                                               |
+| bn (BatchNorm + Scale) | same as onnx BatchNormalization according to https://github.com/TimoSaemann/caffe-segnet-cudnn5               |
+| BNLL                   |                                                                                                               |
+| Concat                 | same as onnx Concat                                                                                           |
+| Convolution            | same as onnx Conv                                                                                             |
+| ConvolutionDepthwise   | kernel height/width: [1, 8]<br />others same as onnx Conv                                                     |
+| Crop                   |                                                                                                               |
+| Deconvolution          | same as ConvTranspose                                                                                         |
+| Dropout                |                                                                                                               |
+| Eltwise                |                                                                                                               |
+| Flatten                |                                                                                                               |
+| HardSigmoid            |                                                                                                               |
+| InnerProduct           | same as onnx Gemm                                                                                             |
+| LRN                    | same as onnx LRN                                                                                              |
+| Lstm                   | same as onnx LSTM according to https://github.com/xmfbit/warpctc-caffe                                        |
+| Normalize              |                                                                                                               |
+| Permute                | same as onnx Transpose                                                                                        |
+| Power                  |                                                                                                               |
+| Pooling                | same as onnx pooling                                                                                          |
+| PRelu                  | same as onnx PRelu                                                                                            |
+| Proposal               | batch: 1                                                                                                      |
+| Reduction              | output dims <= 4                                                                                              |
+| Relu                   | same as onnx Relu                                                                                             |
+| Relu6                  | same as onnx Clip                                                                                             |
+| Reorg                  |                                                                                                               |
+| Reshape                | same as onnx Reshape                                                                                          |
+| Resize                 | bilinear; nearest                                                                                             |
+| Reverse                |                                                                                                               |
+| ROIPooling             | same as MaxRoiPool according to https://github.com/twmht/caffe-pva-faster-rcnn                                |
+| Scale                  | same as onnx Mul                                                                                              |
+| Sigmoid                | same as onnx Sigmoid                                                                                          |
+| Slice                  | same as onnx Split                                                                                            |
+| Softmax                | same as onnx Softmax                                                                                          |
+| Split                  | same as onnx Slice                                                                                            |
+| TanH                   | same as onnx TanH                                                                                             |
+| Tile                   | same as onnx Tile                                                                                             |
+| Transpose              | same as onnx Transpose                                                                                        |
+| Upsample               | according to https://github.com/SeanQ88/caffe_upsample and https://github.com/TimoSaemann/caffe-segnet-cudnn5 |
+
+
+## TensorFlow OPs supported by RKNN Toolkit2
+
+The pb files (contain OPs belows) generated by TensorFlow version 1.12 - 1.15 for 1.x and 2.3 - 2.5 for 2.x are supported by RKNN Toolkit2. For more information on TensorFlow version compatibility, please refer to [tensorflow official instructions on OP version](https://www.tensorflow.org/guide/versions 'Tensorflow official instructions on OP version') . 
+The list of TensorFlow OPs supported by RKNN Toolkit2 is as follows:
+
+| **Operators**         | **Remarks**                                               |
+| --------------------- | --------------------------------------------------------- |
+| Add                   | same as onnx Add                                          |
+| AvgPool               | same as onnx AveragePool                                  |
+| Concat                | same as onnx Concat                                       |
+| Conv2D                | same as onnx Conv                                         |
+| DepthToSpace          |                                                           |
+| DepthwiseConv2d       | kernel height/width: [1, 8]<br />others same as onnx Conv |
+| Div                   | same as onnx Div                                          |
+| Dropout               |                                                           |
+| Flatten               |                                                           |
+| LeakyRelu             | same as onnx LeakyRelu                                    |
+| Less                  | same as onnx Less                                         |
+| LRN                   |                                                           |
+| MatMul                |                                                           |
+| MaxPool               | same as onnx MaxPool                                      |
+| Mean                  | output dims <= 4                                          |
+| Pad                   | same as onnx Pad                                          |
+| Relu                  | same as onnx Relu                                         |
+| Reshape               |                                                           |
+| ResizeBilinear        |                                                           |
+| ResizeNearestNeighbor |                                                           |
+| Sigmoid               |                                                           |
+| Slice                 |                                                           |
+| Softmax               |                                                           |
+| Softplus              | same as onnx Softplus                                     |
+| SpaceToDepth          |                                                           |
+| Split                 |                                                           |
+| Squeeze               |                                                           |
+| StridedSlice          |                                                           |
+| Tanh                  | same as onnx TanH                                         |
+| Transpose             |                                                           |
+
+## Darknet OPs supported by RKNN Toolkit2
+The list of Darknet OPs supported by RKNN Toolkit2 is as follows:
+
+| **Operators**           | **Remarks**                                                                                                                                                                   |
+| ----------------------- | ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
+| add                     | same as onnx Add                                                                                                                                                              |
+| batchnormalize          | same as onnx BatchNormalization                                                                                                                                               |
+| concat                  | same as onnx Concat                                                                                                                                                           |
+| convolutional           | same as onnx Conv                                                                                                                                                             |
+| depthwise_convolutional | kernel height/width: [1, 8]<br />others same as onnx Conv                                                                                                                     |
+| fullconnect             |                                                                                                                                                                               |
+| leakyrelu               | same as onnx LeakyRelu                                                                                                                                                        |
+| mish                    |                                                                                                                                                                               |
+| pooling                 | **AveragePool**: same as onnx AveragePool   <br /> **GlobalAveragePool**: same as onnx GlobalAveragePool <br /> **MaxPool/GlobalMaxPool**: same as onnx MaxPool/GlobalMaxPool |
+| route                   |                                                                                                                                                                               |
+| shortcut                |                                                                                                                                                                               |
+| softmax                 |                                                                                                                                                                               |
+| upsampling              |                                                                                                                                                                               |

doc/Using RKNN-ToolKit2 in WSL.md

@@ -0,0 +1,63 @@
+# Using RKNN-ToolKit2 in WSL
+
+## 1. Installing WSL on Windows Host
+- You can refer to the following link for installing WSL: https://learn.microsoft.com/en-us/windows/wsl/install
+
+## 2. Using RKNN-Toolkit2 in WSL
+1. Refer to the document[《Rockchip_RKNPU_Quick_Start》](https://github.com/airockchip/rknn-toolkit2/blob/master/doc/01_Rockchip_RKNPU_Quick_Start_RKNN_SDK_V2.0.0beta0_EN.pdf) to install the RKNN-ToolKit2 environment in WSL
+2. Refer to the document[《Rockchip_RKNPU_User_Guide》](https://github.com/airockchip/rknn-toolkit2/blob/master/doc/02_Rockchip_RKNPU_User_Guide_RKNN_SDK_V2.0.0beta0_EN.pdf) for model conversion, quantization, and other operations in WSL.
+
+## 3. Using RKNN-Toolkit2 for Board Debugging in WSL
+
+### 3.1. Installing adb in WSL Terminal
+```
+sudo apt update
+sudo apt install adb
+```
+
+### 3.2 Connecting the Device in WSL
+You can choose to connect the device through Ethernet or USB.
+
+#### 3.2.1 Ethernet Connection
+```
+# 1. Connect the device using Ethernet cable.
+
+# 2. In WSL, use adb connect to connect to the device.
+adb connect <IP address:port>
+```
+`IP address` is the IP address of the board.
+
+
+#### 3.2.2 USB Connection
+```
+# 1. Connect the device to Windows via USB.
+
+# 2. Use the adbkit tool in Windows to convert USB to TCP.
+npm install --save adbkit
+adbkit usb-device-to-tcp <device_id> -p <port>
+
+# Note: Configure WSL to access Windows network.
+
+# 3. In WSL, use adb connect to connect to the device.
+adb connect <IP address:port>
+```
+- `device_id` can be obtained by running the `adb devices` command in Windows (adb tool must be installed in Windows).
+- `IP address` is the IP address of the Windows host.
+
+### 3.3 Using RKNN-Toolkit2 for Board Debugging
+Refer to the document [《Rockchip_RKNPU_User_Guide》](https://github.com/airockchip/rknn-toolkit2/blob/master/doc/02_Rockchip_RKNPU_User_Guide_RKNN_SDK_V2.0.0beta0_EN.pdf) for board inference, accuracy analysis, and other operations in WSL.
+
+
+
+## NOte:
+1. It is recommended to install WSL2 with Ubuntu version 22.04, which has been verified to work (other versions are theoretically feasible but not tested).
+2. If you encounter the "ImportError: libGL.so.1: cannot open shared object file: No such file or directory" error while using RKNN-ToolKit2 in WSL, execute the following code to resolve it:
+```
+1. Install the required library:
+sudo apt update
+sudo apt install libgl1-mesa-glx
+
+2. Set the environment variable:
+echo 'export LD_LIBRARY_PATH=/usr/lib/x86_64-linux-gnu/mesa' >> ~/.bashrc
+source ~/.bashrc
+```

doc/WSL中使用RKNN_ToolKit2.md

@@ -0,0 +1,63 @@
+# WSL 中 使用RKNN-ToolKit2
+
+## 1. Windows主机安装WSL
+- 可参考 https://learn.microsoft.com/zh-cn/windows/wsl/install
+
+## 2. WSL 中使用RKNN-Toolkit2
+1. 参考[《Rockchip_RKNPU_Quick_Start手册》](https://github.com/airockchip/rknn-toolkit2/blob/master/doc/01_Rockchip_RKNPU_Quick_Start_RKNN_SDK_V2.0.0beta0_CN.pdf)在 WSL 中安装RKNN-ToolKit2环境
+2. 参考[《Rockchip_RKNPU_User_Guide手册》](https://github.com/airockchip/rknn-toolkit2/blob/master/doc/02_Rockchip_RKNPU_User_Guide_RKNN_SDK_V2.0.0beta0_CN.pdf)在 WSL 进行模型转换、量化等操作
+
+## 3. WSL 中使用RKNN-Toolkit2进行连板调试
+
+### 3.1. WSL 终端安装adb
+```
+sudo apt update
+sudo apt install adb
+```
+
+### 3.2 WSL 连接设备
+可选择通过网线或USB进行设备连接
+
+#### 3.2.1 通过网线连接
+```
+# 1. 使用网线连接设备
+
+# 2. 在 WSL 中使用 adb connect 连接设备
+adb connect <IP地址:端口号>
+```
+`IP地址` 为板子的IP地址
+
+
+#### 3.2.2 通过USB连接
+```
+# 1. 在 Windows 上通过USB连接设备
+
+# 2. 在 Windows 上使用adbkit工具，将USB转为TCP
+npm install --save adbkit
+adbkit usb-device-to-tcp <device_id> -p <端口号>
+
+# 注：配置WSL可以访问Windows的网络
+
+# 3. 在 WSL 中使用 adb connect 连接设备
+adb connect <IP地址:端口号>
+```
+- `device_id`可通过在Windows中使用`adb devices`命令查看 (需要Windows中已安装adb工具)
+- `IP地址` 为 Windows主机 的IP地址
+
+### 3.3 使用RKNN-ToolKit2进行连板调试
+参考[《Rockchip_RKNPU_User_Guide手册》](https://github.com/airockchip/rknn-toolkit2/blob/master/doc/02_Rockchip_RKNPU_User_Guide_RKNN_SDK_V2.0.0beta0_CN.pdf)在 WSL 进行连板推理、连板精度分析等操作
+
+
+
+## 注：
+1. 推荐安装 WSL2，Ubuntu版本号为22.04 已验证可行(其余版本未验证，理论可行)
+2. 在WSL使用RKNN-ToolKit2中若出现 "ImportError: libGL.so.1: cannot open shared object file: No such file or directory"，请执行以下代码解决
+```
+1. 安装对应库
+sudo apt update
+sudo apt install libgl1-mesa-glx
+
+2. 设置环境变量
+echo 'export LD_LIBRARY_PATH=/usr/lib/x86_64-linux-gnu/mesa' >> ~/.bashrc
+source ~/.bashrc
+```

doc/rknn_server_proxy.md

@@ -0,0 +1,349 @@
+**目录**
+
+[TOC]
+
+## 1. 连板调试简介
+RKNN Toolkit2的连板功能一般需要更新板端的 rknn_server 和 librknnrt.so/librknnmrt.so，并且手动启动 rknn_server 才能正常工作。
+rknn_server: 是一个运行在板子上的后台代理服务，用于接收PC通过USB传输过来的协议，然后执行板端runtime对应的接口，并返回结果给PC。
+
+- librknnrt.so: 是一个板端的RKNPU Runtime库(非RV1103/RV1106/RV1103B平台不适用)。
+- librknnmrt.so: 是专用于RV1103/RV1106/RV1103B平台的RKNPU Runtime库。
+
+开机后通过ps命令查看rknn_server进程是否已存在，如果已存在，则不需要手动启动，否则需要手动启动。
+
+## 2. 环境要求
+### 2.1 硬件环境
+本文档适用如下硬件平台：
+
+- RV1103
+- RV1103B
+- RV1106
+- RK3562
+- RK3566系列
+- RK3568系列
+- RK3576系列
+- RK3588系列
+
+### 2.2 软件环境
+- 若使用动态形状输入RKNN模型，要求rknn_server和RKNPU Runtime库版本>=1.5.0。
+- 若使用大于2GB的模型，要求rknn_server版本>=2.0.0b0。
+- 在RV1103/RV1106/RV1103B等小内存平台上，建议rknn_server版本>=2.1.0。
+
+
+## 3. rknn_server存放目录
+rknn_server存放在runtime目录下, 请根据板子上的系统选择相应版本的rknn_server,不同芯片和系统对应的rknn_server路径如下：
+### 3.1 Android平台
+|系统|路径|
+|-----|-----|
+|32-bit Android|runtime/Android/rknn_server/arm/rknn_server|
+|64-bit Android|runtime/Android/rknn_server/arm64/rknn_server|
+
+
+### 3.2 Linux平台
+
+|芯片|系统|路径|
+|-----|-----|-----|
+|RV1103/RV1106/RV1103B|32-bit Linux|runtime/Linux/rknn_server/armhf-uclibc/usr/bin/rknn_server|
+|其他芯片|32-bit Linux|runtime/Linux/rknn_server/armhf/usr/bin/rknn_server|
+|其他芯片|64-bit Linux|runtime/Linux/rknn_server/aarch64/usr/bin/rknn_server|
+
+## 4. 启动步骤
+### 4.1 Android平台
+进入rknpu2工程的根目录，在PC端执行下列命令启动代理服务:
+1. 重新挂载系统分区,使系统分区重新可写
+```
+adb root && adb remount
+```
+2. 更新代理程序
+```
+// 64-bit Android系统
+adb push runtime/Android/rknn_server/arm64/rknn_server /vendor/bin/
+// 32-bit Android系统
+adb push runtime/Android/rknn_server/arm/rknn_server /vendor/bin/
+```
+3. 更新RKNPU runtime库 
+```
+// 64-bit Android系统
+adb push runtime/Android/librknn_api/arm64-v8a/librknnrt.so /vendor/lib64
+// 32-bit Android系统
+adb push runtime/Android/librknn_api/armeabi-v7a/librknnrt.so /vendor/lib
+```
+4. 修改代理程序权限
+```
+adb shell chmod +x /vendor/bin/rknn_server
+```
+5. 启动代理服务
+```
+adb shell "killall rknn_server"
+adb shell "nohup /vendor/bin/rknn_server >/dev/null"&
+```
+6. 检查代理服务是否启动成功：
+```
+adb shell ps -ef|grep rknn_server
+```
+查看是否有`rknn_server`的进程id,如果存在表示代理服务启动成功;否则请在板子上手动启动代理服务,步骤如下:
+adb shell命令**进入板子shell界面**后,执行下列命令启动代理服务
+
+```
+nohup /vendor/bin/rknn_server > /dev/null&
+```
+
+### 4.2 Linux平台(非RV1103/RV1106/RV1103B)
+1. 更新代理程序
+```
+// 64-bit Linux系统
+adb push runtime/Linux/rknn_server/aarch64/usr/bin/rknn_server /usr/bin/
+// 32-bit Linux系统
+adb push runtime/Linux/rknn_server/armhf/usr/bin/rknn_server /usr/bin/
+```
+2. 更新RKNPU runtime库 
+```
+// 64-bit Linux系统
+adb push runtime/Linux/librknn_api/aarch64/librknnrt.so /usr/lib
+// 32-bit Linux系统
+adb push runtime/Linux/librknn_api/armhf/librknnrt.so /usr/lib
+```
+3. 修改代理程序权限
+```
+adb shell chmod +x /usr/bin/rknn_server
+```
+4. 启动代理服务
+```
+adb shell "killall rknn_server"
+adb shell "nohup /usr/bin/rknn_server >/dev/null"&
+```
+5. 检查代理服务是否启动成功：
+```
+adb shell ps -ef|grep rknn_server
+```
+查看是否有`rknn_server`的进程id,如果存在表示代理服务启动成功;否则请在板子上手动启动代理服务,方法如下:
+adb shell命令**进入板子shell界面**后,执行下列命令启动代理服务
+
+```
+nohup /usr/bin/rknn_server > /dev/null&
+```
+
+### 4.3Linux平台(RV1103/RV1106/RV1103B)
+RV1103/RV1106/RV1103B上使用的RKNPU Runtime库是librknnmrt.so，使用armhf-uclibc目录下的rknn_server,启动步骤如下：
+1. 更新代理程序
+```
+adb push runtime/Linux/rknn_server/armhf-uclibc/usr/bin/rknn_server /oem/usr/bin
+```
+2. 更新RKNPU runtime库
+```
+adb push runtime/Linux/librknn_api/armhf-uclibc/librknnmrt.so /oem/usr/lib
+```
+3. 修改代理程序权限
+```
+adb shell chmod +x /oem/usr/bin/rknn_server
+```
+4. 启动代理服务
+```
+adb shell "killall rknn_server"
+adb shell "nohup /oem/usr/bin/rknn_server >/dev/null"&
+```
+5. 检查代理服务是否启动成功：
+```
+adb shell ps |grep rknn_server
+```
+查看是否有`rknn_server`的进程id,如果存在表示代理服务启动成功;否则请在板子上手动启动代理服务,方法如下:
+adb shell命令**进入板子shell界面**后,执行下列命令启动代理服务
+
+```
+nohup /oem/usr/bin/rknn_server > /dev/null&
+```
+
+## 5. 查看rknn_server详细日志
+代理服务默认不开启详细日志，如遇到连板过程报错，需开启详细日志来定位错误原因，请参考相应平台执行步骤：
+### 5.1 Android平台
+1. 设置环境变量开启详细日志,并启动代理:
+```
+adb logcat -c
+adb shell "killall rknn_server"
+adb shell "setprop persist.vendor.rknn.server.log.level 5 && nohup /vendor/bin/rknn_server >/dev/null"&
+```
+2. 检查代理服务是否启动成功：
+
+```
+adb shell ps -ef|grep rknn_server
+```
+3. 运行PC上python推理程序
+4. 查看运行日志
+```
+adb logcat
+```
+
+5. 开启详细日志会导致推理速度变慢，恢复默认日志等级的命令如下：
+
+```sh
+adb shell "killall rknn_server"
+adb shell "setprop persist.vendor.rknn.server.log.level 0 && nohup /vendor/bin/rknn_server >/dev/null"&
+```
+
+### 5.2 Linux平台(非RV1103/RV1106/RV1103B)
+
+1. 创建目录,用于保存代理服务的详细日志
+```
+adb shell mkdir -p /userdata
+```
+2. 设置环境变量开启详细日志,并启动代理:
+```
+adb shell "killall rknn_server"
+adb shell "export RKNN_SERVER_LOGLEVEL=5 && nohup /usr/bin/rknn_server >/userdata/server.log"&
+```
+3. 检查代理服务是否启动成功：
+```
+adb shell ps -ef|grep rknn_server
+```
+查看是否有`rknn_server`的进程id,如果存在表示代理服务启动成功;否则请在板子上手动启动代理服务,方法如下:
+adb shell命令进入板子shell界面后,执行下列命令启动代理服务
+```
+export RKNN_SERVER_LOGLEVEL=5
+nohup /usr/bin/rknn_server >/userdata/server.log&
+exit
+```
+4. 运行PC上python推理程序
+5. 查看日志
+```
+adb shell cat /userdata/server.log
+```
+
+6. 开启详细日志会导致推理速度变慢，恢复默认日志等级的命令如下：
+
+```sh
+   adb shell "killall rknn_server"
+   adb shell "export RKNN_SERVER_LOGLEVEL=0 && nohup /usr/bin/rknn_server >/userdata/server.log"&
+```
+
+### 5.3 Linux平台(RV1103/RV1106/RV1103B)
+
+1. 创建目录,用于保存代理服务的详细日志
+```
+adb shell mkdir -p /userdata
+```
+2. 设置环境变量开启详细日志,并启动代理:
+```
+adb shell "killall rknn_server"
+adb shell "export RKNN_SERVER_LOGLEVEL=5 && nohup  /oem/usr/bin/rknn_server >/userdata/server.log"&
+```
+3. 检查代理服务是否启动成功：
+```
+adb shell ps|grep rknn_server
+```
+查看是否有`rknn_server`的进程id,如果存在表示代理服务启动成功;否则请在板子上手动启动代理服务,方法如下:
+adb shell命令进入板子shell界面后,执行下列命令启动代理服务
+```
+export RKNN_SERVER_LOGLEVEL=5
+nohup /oem/usr/bin/rknn_server >/userdata/server.log&
+exit
+```
+4. 运行PC上python推理程序
+5. 查看日志
+```
+adb shell cat /userdata/server.log
+```
+
+6. 开启详细日志会导致推理速度变慢，恢复默认日志等级的命令如下：
+
+```sh
+adb shell "killall rknn_server"
+adb shell "export RKNN_SERVER_LOGLEVEL=0 && nohup  /oem/usr/bin/rknn_server >/userdata/server.log"&
+```
+
+## 6. 常见问题
+### 问题1
+Debian系统上rknn_server服务已经后台启动, 但是连板推理时依旧有如下报错：
+```
+D NPUTransfer: ERROR: socket read fd = 4, n = -1: Connection reset by peer
+D NPUTransfer: Transfer client closed, fd = 4
+E RKNNAPI: rknn_init,  server connect fail!  ret = -9(ERROR_PIPE)!
+E build_graph: The rknn_server on the concected device is abnormal, please start the rknn_server on the device according to:
+               https://github.com/airockchip/rknn-toolkit2/blob/master/doc/rknn_server_proxy.md
+```
+
+**解决方法：**
+这通常是由于Debian固件上的adbd程序没有监听5037端口导致的，可以在板子上执行以下命令来判断:
+```
+netstat -n -t -u -a
+```
+如果输出结果中没有5037端口,则执行下列命令下载和更新adbd程序, 并重启板子;否则,跳过下列步骤。
+```
+wget -O adbd.zip https://ftzr.zbox.filez.com/v2/delivery/data/7f0ac30dfa474892841fcb2cd29ad924/adbd.zip
+unzip adbd.zip
+adb push adbd/linux-aarch64/adbd /usr/bin/adbd
+```
+进入设备shell命令，增加adbd的可执行权限
+
+```sh
+adb shell "chmod +x /usr/bin/adbd"
+adb reboot
+```
+
+重启设备后，按照启动步骤启动rknn_server服务，再次尝试连板推理。
+
+
+### 问题2
+在RV1103/RV1106/RV1103B设备上遇到"E RKNN: failed to allocate fd, ret: -1, errno: 12"或者OOM报错。
+**解决方法：**
+在RV1103/RV1106/RV1103B设备上运行RkLunch-stop.sh，关闭其他占用内存的应用，并将rknn_server升级到>=2.1.0版本后再连板推理。
+
+### 问题3
+RV1103/RV1106/RV1103B使用init_runtime python接口时，没有逐层的耗时。
+原因：RV1103/RV1106/RV1103B上**不支持**perf_debug=True参数。
+
+### 问题4
+RV1103/RV1106/RV1103B使用accuracy_analysis python接口使用时，因为模型太大，板子上存储容量不够导致运行失败。
+
+**解决方法：**
+
+在设备端df -h查看存储空间情况，假设设备存储情况如下：
+
+```sh
+Filesystem                Size      Used Available Use% Mounted on
+ubi0:rootfs              17.0M     14.1M      2.9M  83% /
+devtmpfs                 27.4M         0     27.4M   0% /dev
+tmpfs                    27.5M         0     27.5M   0% /dev/shm
+tmpfs                    27.5M      8.0K     27.5M   0% /tmp
+tmpfs                    27.5M     84.0K     27.4M   0% /run
+/dev/ubi5_0              20.6M     14.5M      6.1M  70% /oem
+/dev/ubi6_0              52.8M     24.5M     28.2M  46% /userdata
+
+```
+
+从上面看出/userdata/目录的可用空间最大，故将/userdata/目录作为精度分析时保存中间结果文件的目录，再重启rknn_server，PC上执行命令如下：
+
+```
+adb shell "killall rknn_server"
+adb shell "export RKNN_DUMP_DIR=/userdata/dumps && nohup /usr/bin/rknn_server >/dev/null"&
+```
+
+RV1103/RV1106/RV1103B的rknn_server默认的保存中间结果路径是/tmp/dumps，如果需要恢复默认路径，请执行下列命令：
+
+```adb shell "killall rknn_server"
+adb shell "killall rknn_server"
+adb shell "unset RKNN_DUMP_DIR && nohup /usr/bin/rknn_server >/dev/null"&
+```
+
+如果设备存储空间不足，并且RV1103/RV1106/RV1103B固件支持NFS挂载，则可以将dump目录挂载到NFS目录后，再执行精度分析。假设目标服务器的IP为192.168.1.1，服务器NFS目录是/data0/nfs_shared，则在设备上执行下列命令将/userdata/dumps挂载到NFS目录
+
+```
+# 以241为例
+mkdir -p /userdata/dumps
+mount -t nfs -o nolock 192.168.1.1:/data0/nfs_shared /userdata/dumps
+```
+
+### 问题5
+
+使用adb命令更新Runtime库后没有生效。
+
+**解决方法**：
+
+更新库后要重新启动rknn_server，下次连板推理才能生效。如果是RV1103/RV1106/RV1103B平台，确保将librknnmrt.so放在/oem/usr/lib目录，如果/usr/lib/目录下有同名的库，要删除/usr/lib/下的librknnmrt.so，并重启rknn_server。
+
+### 问题6
+
+Android系统启动代理服务遇到权限问题。
+
+**解决方法**：
+
+使用adb shell setenforce 0命令来关闭selinux。

rknn-toolkit-lite2/CHANGELOG.txt

@@ -0,0 +1,45 @@
+2024-08-08
+版本: v2.1.0
+1. 修复已知BUG。
+
+2024-03-14
+版本: v2.0.0b0
+1. 功能完善：
+   1.1 新增对RK3576的支持；
+   1.2 init_runtime core_mask参数增加新的可选值：RKNNLite.NPU_CORE_ALL。
+
+2023-12-04
+版本: v1.6.0
+1. 功能完善：
+   1.1 新增适配AARCH64 Python3.11的安装包；
+   1.2 推理接口增加对动态shape模型的支持；
+   1.3 推理接口增加对4维NCHW格式输入的支持。
+
+2023-08-21
+版本: v1.5.2
+1. 更新版本号
+
+版本: v1.5.0
+1. 功能完善：
+   1.1 新增对RK3562的支持；
+   1.2 新增适配AARCH64 Python3.8, Python3.10的安装包；
+   1.3 适配1.5.0版本NPU驱动。
+
+2022-08-31
+版本: v1.4.0
+1. 功能完善：
+   1.1 init_runtime core_mask支持NPU_CORE_0_1和NPU_CORE_0_1_2；
+   1.2 适配1.4.0版本NPU驱动。
+
+2022-04-27
+版本: v1.3.0
+1. 功能完善：
+   1.1 完善init_runtime失败的提示信息；
+   1.2 适配1.3.0版本NPU驱动。
+
+2022-01-14
+版本：v1.2.0
+1. 新功能：
+   1.1 RKNN模型推理；
+   1.2 SDK版本查询；
+   1.3 模型可运行平台查询。

rknn-toolkit-lite2/examples/dynamic_shape/README.md

@@ -0,0 +1,49 @@
+# How to use dynamic shape function
+
+## Model Source
+The model used in this example come from the following open source projects:  
+https://github.com/shicai/MobileNet-Caffe
+
+### Convert to RKNN model
+Please refer to the example in the RKNN Toolkit2 project to generate the RKNN model:
+https://github.com/rockchip-linux/rknn-toolkit2/tree/master/examples/functions/dynamic_shape
+
+## Script Usage
+*Usage:*
+```
+python test.py
+```
+
+## Expected Results
+This example will print the TOP5 labels and corresponding scores of the test image classification results for each different input shape, as follows:
+```
+model: mobilenet_v2
+
+input shape: 1,3,224,224
+W The input[0] need NHWC data format, but NCHW set, the data format and data buffer will be changed to NHWC.
+-----TOP 5-----
+[155] score:0.992188 class:"Shih-Tzu"
+[154] score:0.002636 class:"Pekinese, Pekingese, Peke"
+[204] score:0.002636 class:"Lhasa, Lhasa apso"
+[283] score:0.001698 class:"Persian cat"
+[896] score:0.000273 class:"washbasin, handbasin, washbowl, lavabo, wash-hand basin"
+
+input shape: 1,3,160,160
+W The input[0] need NHWC data format, but NCHW set, the data format and data buffer will be changed to NHWC.
+-----TOP 5-----
+[155] score:0.558594 class:"Shih-Tzu"
+[154] score:0.408447 class:"Pekinese, Pekingese, Peke"
+[204] score:0.031036 class:"Lhasa, Lhasa apso"
+[194] score:0.000956 class:"Dandie Dinmont, Dandie Dinmont terrier"
+[219] score:0.000256 class:"cocker spaniel, English cocker spaniel, cocker"
+
+input shape: 1,3,256,256
+W The input[0] need NHWC data format, but NCHW set, the data format and data buffer will be changed to NHWC.
+-----TOP 5-----
+[155] score:0.980957 class:"Shih-Tzu"
+[154] score:0.008835 class:"Pekinese, Pekingese, Peke"
+[204] score:0.004883 class:"Lhasa, Lhasa apso"
+[193] score:0.000929 class:"Australian terrier"
+[200] score:0.000509 class:"Tibetan terrier, chrysanthemum dog"
+```
+- Note: Different platforms, different versions of tools and drivers may have slightly different results.

rknn-toolkit-lite2/examples/dynamic_shape/mobilenet_v2_for_rk3562.rknn

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f71efa3af9e664e79a3508663f02038e3fdc081cb3f3e4f2be646f6588b622bb
+size 4955210

rknn-toolkit-lite2/examples/dynamic_shape/mobilenet_v2_for_rk3566_rk3568.rknn

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f591b57b93f76226aed9741ecc4910bb7d69c88fe397fdeaedd57fa0f1904373
+size 4623050

rknn-toolkit-lite2/examples/dynamic_shape/mobilenet_v2_for_rk3576.rknn

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e659fee1c0f0e2a9d22fe9e6dc85ea29c6a2dca8a222995c0838a3ece5e9ad49
+size 6006922

rknn-toolkit-lite2/examples/dynamic_shape/mobilenet_v2_for_rk3588.rknn

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b866cf43678a7bec1df7b002d222f369f9a63d5197e0c1eaa9d0a407b1deb433
+size 5856394

rknn-toolkit-lite2/examples/dynamic_shape/synset_label.py

@@ -0,0 +1,1003 @@
+# the labels come from synset.txt, download link: https://s3.amazonaws.com/onnx-model-zoo/synset.txt
+
+labels = \
+{0: 'tench, Tinca tinca',
+ 1: 'goldfish, Carassius auratus',
+ 2: 'great white shark, white shark, man-eater, man-eating shark, Carcharodon carcharias',
+ 3: 'tiger shark, Galeocerdo cuvieri',
+ 4: 'hammerhead, hammerhead shark',
+ 5: 'electric ray, crampfish, numbfish, torpedo',
+ 6: 'stingray',
+ 7: 'cock',
+ 8: 'hen',
+ 9: 'ostrich, Struthio camelus',
+ 10: 'brambling, Fringilla montifringilla',
+ 11: 'goldfinch, Carduelis carduelis',
+ 12: 'house finch, linnet, Carpodacus mexicanus',
+ 13: 'junco, snowbird',
+ 14: 'indigo bunting, indigo finch, indigo bird, Passerina cyanea',
+ 15: 'robin, American robin, Turdus migratorius',
+ 16: 'bulbul',
+ 17: 'jay',
+ 18: 'magpie',
+ 19: 'chickadee',
+ 20: 'water ouzel, dipper',
+ 21: 'kite',
+ 22: 'bald eagle, American eagle, Haliaeetus leucocephalus',
+ 23: 'vulture',
+ 24: 'great grey owl, great gray owl, Strix nebulosa',
+ 25: 'European fire salamander, Salamandra salamandra',
+ 26: 'common newt, Triturus vulgaris',
+ 27: 'eft',
+ 28: 'spotted salamander, Ambystoma maculatum',
+ 29: 'axolotl, mud puppy, Ambystoma mexicanum',
+ 30: 'bullfrog, Rana catesbeiana',
+ 31: 'tree frog, tree-frog',
+ 32: 'tailed frog, bell toad, ribbed toad, tailed toad, Ascaphus trui',
+ 33: 'loggerhead, loggerhead turtle, Caretta caretta',
+ 34: 'leatherback turtle, leatherback, leathery turtle, Dermochelys coriacea',
+ 35: 'mud turtle',
+ 36: 'terrapin',
+ 37: 'box turtle, box tortoise',
+ 38: 'banded gecko',
+ 39: 'common iguana, iguana, Iguana iguana',
+ 40: 'American chameleon, anole, Anolis carolinensis',
+ 41: 'whiptail, whiptail lizard',
+ 42: 'agama',
+ 43: 'frilled lizard, Chlamydosaurus kingi',
+ 44: 'alligator lizard',
+ 45: 'Gila monster, Heloderma suspectum',
+ 46: 'green lizard, Lacerta viridis',
+ 47: 'African chameleon, Chamaeleo chamaeleon',
+ 48: 'Komodo dragon, Komodo lizard, dragon lizard, giant lizard, Varanus komodoensis',
+ 49: 'African crocodile, Nile crocodile, Crocodylus niloticus',
+ 50: 'American alligator, Alligator mississipiensis',
+ 51: 'triceratops',
+ 52: 'thunder snake, worm snake, Carphophis amoenus',
+ 53: 'ringneck snake, ring-necked snake, ring snake',
+ 54: 'hognose snake, puff adder, sand viper',
+ 55: 'green snake, grass snake',
+ 56: 'king snake, kingsnake',
+ 57: 'garter snake, grass snake',
+ 58: 'water snake',
+ 59: 'vine snake',
+ 60: 'night snake, Hypsiglena torquata',
+ 61: 'boa constrictor, Constrictor constrictor',
+ 62: 'rock python, rock snake, Python sebae',
+ 63: 'Indian cobra, Naja naja',
+ 64: 'green mamba',
+ 65: 'sea snake',
+ 66: 'horned viper, cerastes, sand viper, horned asp, Cerastes cornutus',
+ 67: 'diamondback, diamondback rattlesnake, Crotalus adamanteus',
+ 68: 'sidewinder, horned rattlesnake, Crotalus cerastes',
+ 69: 'trilobite',
+ 70: 'harvestman, daddy longlegs, Phalangium opilio',
+ 71: 'scorpion',
+ 72: 'black and gold garden spider, Argiope aurantia',
+ 73: 'barn spider, Araneus cavaticus',
+ 74: 'garden spider, Aranea diademata',
+ 75: 'black widow, Latrodectus mactans',
+ 76: 'tarantula',
+ 77: 'wolf spider, hunting spider',
+ 78: 'tick',
+ 79: 'centipede',
+ 80: 'black grouse',
+ 81: 'ptarmigan',
+ 82: 'ruffed grouse, partridge, Bonasa umbellus',
+ 83: 'prairie chicken, prairie grouse, prairie fowl',
+ 84: 'peacock',
+ 85: 'quail',
+ 86: 'partridge',
+ 87: 'African grey, African gray, Psittacus erithacus',
+ 88: 'macaw',
+ 89: 'sulphur-crested cockatoo, Kakatoe galerita, Cacatua galerita',
+ 90: 'lorikeet',
+ 91: 'coucal',
+ 92: 'bee eater',
+ 93: 'hornbill',
+ 94: 'hummingbird',
+ 95: 'jacamar',
+ 96: 'toucan',
+ 97: 'drake',
+ 98: 'red-breasted merganser, Mergus serrator',
+ 99: 'goose',
+ 100: 'black swan, Cygnus atratus',
+ 101: 'tusker',
+ 102: 'echidna, spiny anteater, anteater',
+ 103: 'platypus, duckbill, duckbilled platypus, duck-billed platypus, Ornithorhynchus anatinus',
+ 104: 'wallaby, brush kangaroo',
+ 105: 'koala, koala bear, kangaroo bear, native bear, Phascolarctos cinereus',
+ 106: 'wombat',
+ 107: 'jellyfish',
+ 108: 'sea anemone, anemone',
+ 109: 'brain coral',
+ 110: 'flatworm, platyhelminth',
+ 111: 'nematode, nematode worm, roundworm',
+ 112: 'conch',
+ 113: 'snail',
+ 114: 'slug',
+ 115: 'sea slug, nudibranch',
+ 116: 'chiton, coat-of-mail shell, sea cradle, polyplacophore',
+ 117: 'chambered nautilus, pearly nautilus, nautilus',
+ 118: 'Dungeness crab, Cancer magister',
+ 119: 'rock crab, Cancer irroratus',
+ 120: 'fiddler crab',
+ 121: 'king crab, Alaska crab, Alaskan king crab, Alaska king crab, Paralithodes camtschatica',
+ 122: 'American lobster, Northern lobster, Maine lobster, Homarus americanus',
+ 123: 'spiny lobster, langouste, rock lobster, crawfish, crayfish, sea crawfish',
+ 124: 'crayfish, crawfish, crawdad, crawdaddy',
+ 125: 'hermit crab',
+ 126: 'isopod',
+ 127: 'white stork, Ciconia ciconia',
+ 128: 'black stork, Ciconia nigra',
+ 129: 'spoonbill',
+ 130: 'flamingo',
+ 131: 'little blue heron, Egretta caerulea',
+ 132: 'American egret, great white heron, Egretta albus',
+ 133: 'bittern',
+ 134: 'crane',
+ 135: 'limpkin, Aramus pictus',
+ 136: 'European gallinule, Porphyrio porphyrio',
+ 137: 'American coot, marsh hen, mud hen, water hen, Fulica americana',
+ 138: 'bustard',
+ 139: 'ruddy turnstone, Arenaria interpres',
+ 140: 'red-backed sandpiper, dunlin, Erolia alpina',
+ 141: 'redshank, Tringa totanus',
+ 142: 'dowitcher',
+ 143: 'oystercatcher, oyster catcher',
+ 144: 'pelican',
+ 145: 'king penguin, Aptenodytes patagonica',
+ 146: 'albatross, mollymawk',
+ 147: 'grey whale, gray whale, devilfish, Eschrichtius gibbosus, Eschrichtius robustus',
+ 148: 'killer whale, killer, orca, grampus, sea wolf, Orcinus orca',
+ 149: 'dugong, Dugong dugon',
+ 150: 'sea lion',
+ 151: 'Chihuahua',
+ 152: 'Japanese spaniel',
+ 153: 'Maltese dog, Maltese terrier, Maltese',
+ 154: 'Pekinese, Pekingese, Peke',
+ 155: 'Shih-Tzu',
+ 156: 'Blenheim spaniel',
+ 157: 'papillon',
+ 158: 'toy terrier',
+ 159: 'Rhodesian ridgeback',
+ 160: 'Afghan hound, Afghan',
+ 161: 'basset, basset hound',
+ 162: 'beagle',
+ 163: 'bloodhound, sleuthhound',
+ 164: 'bluetick',
+ 165: 'black-and-tan coonhound',
+ 166: 'Walker hound, Walker foxhound',
+ 167: 'English foxhound',
+ 168: 'redbone',
+ 169: 'borzoi, Russian wolfhound',
+ 170: 'Irish wolfhound',
+ 171: 'Italian greyhound',
+ 172: 'whippet',
+ 173: 'Ibizan hound, Ibizan Podenco',
+ 174: 'Norwegian elkhound, elkhound',
+ 175: 'otterhound, otter hound',
+ 176: 'Saluki, gazelle hound',
+ 177: 'Scottish deerhound, deerhound',
+ 178: 'Weimaraner',
+ 179: 'Staffordshire bullterrier, Staffordshire bull terrier',
+ 180: 'American Staffordshire terrier, Staffordshire terrier, American pit bull terrier, pit bull terrier',
+ 181: 'Bedlington terrier',
+ 182: 'Border terrier',
+ 183: 'Kerry blue terrier',
+ 184: 'Irish terrier',
+ 185: 'Norfolk terrier',
+ 186: 'Norwich terrier',
+ 187: 'Yorkshire terrier',
+ 188: 'wire-haired fox terrier',
+ 189: 'Lakeland terrier',
+ 190: 'Sealyham terrier, Sealyham',
+ 191: 'Airedale, Airedale terrier',
+ 192: 'cairn, cairn terrier',
+ 193: 'Australian terrier',
+ 194: 'Dandie Dinmont, Dandie Dinmont terrier',
+ 195: 'Boston bull, Boston terrier',
+ 196: 'miniature schnauzer',
+ 197: 'giant schnauzer',
+ 198: 'standard schnauzer',
+ 199: 'Scotch terrier, Scottish terrier, Scottie',
+ 200: 'Tibetan terrier, chrysanthemum dog',
+ 201: 'silky terrier, Sydney silky',
+ 202: 'soft-coated wheaten terrier',
+ 203: 'West Highland white terrier',
+ 204: 'Lhasa, Lhasa apso',
+ 205: 'flat-coated retriever',
+ 206: 'curly-coated retriever',
+ 207: 'golden retriever',
+ 208: 'Labrador retriever',
+ 209: 'Chesapeake Bay retriever',
+ 210: 'German short-haired pointer',
+ 211: 'vizsla, Hungarian pointer',
+ 212: 'English setter',
+ 213: 'Irish setter, red setter',
+ 214: 'Gordon setter',
+ 215: 'Brittany spaniel',
+ 216: 'clumber, clumber spaniel',
+ 217: 'English springer, English springer spaniel',
+ 218: 'Welsh springer spaniel',
+ 219: 'cocker spaniel, English cocker spaniel, cocker',
+ 220: 'Sussex spaniel',
+ 221: 'Irish water spaniel',
+ 222: 'kuvasz',
+ 223: 'schipperke',
+ 224: 'groenendael',
+ 225: 'malinois',
+ 226: 'briard',
+ 227: 'kelpie',
+ 228: 'komondor',
+ 229: 'Old English sheepdog, bobtail',
+ 230: 'Shetland sheepdog, Shetland sheep dog, Shetland',
+ 231: 'collie',
+ 232: 'Border collie',
+ 233: 'Bouvier des Flandres, Bouviers des Flandres',
+ 234: 'Rottweiler',
+ 235: 'German shepherd, German shepherd dog, German police dog, alsatian',
+ 236: 'Doberman, Doberman pinscher',
+ 237: 'miniature pinscher',
+ 238: 'Greater Swiss Mountain dog',
+ 239: 'Bernese mountain dog',
+ 240: 'Appenzeller',
+ 241: 'EntleBucher',
+ 242: 'boxer',
+ 243: 'bull mastiff',
+ 244: 'Tibetan mastiff',
+ 245: 'French bulldog',
+ 246: 'Great Dane',
+ 247: 'Saint Bernard, St Bernard',
+ 248: 'Eskimo dog, husky',
+ 249: 'malamute, malemute, Alaskan malamute',
+ 250: 'Siberian husky',
+ 251: 'dalmatian, coach dog, carriage dog',
+ 252: 'affenpinscher, monkey pinscher, monkey dog',
+ 253: 'basenji',
+ 254: 'pug, pug-dog',
+ 255: 'Leonberg',
+ 256: 'Newfoundland, Newfoundland dog',
+ 257: 'Great Pyrenees',
+ 258: 'Samoyed, Samoyede',
+ 259: 'Pomeranian',
+ 260: 'chow, chow chow',
+ 261: 'keeshond',
+ 262: 'Brabancon griffon',
+ 263: 'Pembroke, Pembroke Welsh corgi',
+ 264: 'Cardigan, Cardigan Welsh corgi',
+ 265: 'toy poodle',
+ 266: 'miniature poodle',
+ 267: 'standard poodle',
+ 268: 'Mexican hairless',
+ 269: 'timber wolf, grey wolf, gray wolf, Canis lupus',
+ 270: 'white wolf, Arctic wolf, Canis lupus tundrarum',
+ 271: 'red wolf, maned wolf, Canis rufus, Canis niger',
+ 272: 'coyote, prairie wolf, brush wolf, Canis latrans',
+ 273: 'dingo, warrigal, warragal, Canis dingo',
+ 274: 'dhole, Cuon alpinus',
+ 275: 'African hunting dog, hyena dog, Cape hunting dog, Lycaon pictus',
+ 276: 'hyena, hyaena',
+ 277: 'red fox, Vulpes vulpes',
+ 278: 'kit fox, Vulpes macrotis',
+ 279: 'Arctic fox, white fox, Alopex lagopus',
+ 280: 'grey fox, gray fox, Urocyon cinereoargenteus',
+ 281: 'tabby, tabby cat',
+ 282: 'tiger cat',
+ 283: 'Persian cat',
+ 284: 'Siamese cat, Siamese',
+ 285: 'Egyptian cat',
+ 286: 'cougar, puma, catamount, mountain lion, painter, panther, Felis concolor',
+ 287: 'lynx, catamount',
+ 288: 'leopard, Panthera pardus',
+ 289: 'snow leopard, ounce, Panthera uncia',
+ 290: 'jaguar, panther, Panthera onca, Felis onca',
+ 291: 'lion, king of beasts, Panthera leo',
+ 292: 'tiger, Panthera tigris',
+ 293: 'cheetah, chetah, Acinonyx jubatus',
+ 294: 'brown bear, bruin, Ursus arctos',
+ 295: 'American black bear, black bear, Ursus americanus, Euarctos americanus',
+ 296: 'ice bear, polar bear, Ursus Maritimus, Thalarctos maritimus',
+ 297: 'sloth bear, Melursus ursinus, Ursus ursinus',
+ 298: 'mongoose',
+ 299: 'meerkat, mierkat',
+ 300: 'tiger beetle',
+ 301: 'ladybug, ladybeetle, lady beetle, ladybird, ladybird beetle',
+ 302: 'ground beetle, carabid beetle',
+ 303: 'long-horned beetle, longicorn, longicorn beetle',
+ 304: 'leaf beetle, chrysomelid',
+ 305: 'dung beetle',
+ 306: 'rhinoceros beetle',
+ 307: 'weevil',
+ 308: 'fly',
+ 309: 'bee',
+ 310: 'ant, emmet, pismire',
+ 311: 'grasshopper, hopper',
+ 312: 'cricket',
+ 313: 'walking stick, walkingstick, stick insect',
+ 314: 'cockroach, roach',
+ 315: 'mantis, mantid',
+ 316: 'cicada, cicala',
+ 317: 'leafhopper',
+ 318: 'lacewing, lacewing fly',
+ 319: "dragonfly, darning needle, devil's darning needle, sewing needle, snake feeder, snake doctor, mosquito hawk, skeeter hawk",
+ 320: 'damselfly',
+ 321: 'admiral',
+ 322: 'ringlet, ringlet butterfly',
+ 323: 'monarch, monarch butterfly, milkweed butterfly, Danaus plexippus',
+ 324: 'cabbage butterfly',
+ 325: 'sulphur butterfly, sulfur butterfly',
+ 326: 'lycaenid, lycaenid butterfly',
+ 327: 'starfish, sea star',
+ 328: 'sea urchin',
+ 329: 'sea cucumber, holothurian',
+ 330: 'wood rabbit, cottontail, cottontail rabbit',
+ 331: 'hare',
+ 332: 'Angora, Angora rabbit',
+ 333: 'hamster',
+ 334: 'porcupine, hedgehog',
+ 335: 'fox squirrel, eastern fox squirrel, Sciurus niger',
+ 336: 'marmot',
+ 337: 'beaver',
+ 338: 'guinea pig, Cavia cobaya',
+ 339: 'sorrel',
+ 340: 'zebra',
+ 341: 'hog, pig, grunter, squealer, Sus scrofa',
+ 342: 'wild boar, boar, Sus scrofa',
+ 343: 'warthog',
+ 344: 'hippopotamus, hippo, river horse, Hippopotamus amphibius',
+ 345: 'ox',
+ 346: 'water buffalo, water ox, Asiatic buffalo, Bubalus bubalis',
+ 347: 'bison',
+ 348: 'ram, tup',
+ 349: 'bighorn, bighorn sheep, cimarron, Rocky Mountain bighorn, Rocky Mountain sheep, Ovis canadensis',
+ 350: 'ibex, Capra ibex',
+ 351: 'hartebeest',
+ 352: 'impala, Aepyceros melampus',
+ 353: 'gazelle',
+ 354: 'Arabian camel, dromedary, Camelus dromedarius',
+ 355: 'llama',
+ 356: 'weasel',
+ 357: 'mink',
+ 358: 'polecat, fitch, foulmart, foumart, Mustela putorius',
+ 359: 'black-footed ferret, ferret, Mustela nigripes',
+ 360: 'otter',
+ 361: 'skunk, polecat, wood pussy',
+ 362: 'badger',
+ 363: 'armadillo',
+ 364: 'three-toed sloth, ai, Bradypus tridactylus',
+ 365: 'orangutan, orang, orangutang, Pongo pygmaeus',
+ 366: 'gorilla, Gorilla gorilla',
+ 367: 'chimpanzee, chimp, Pan troglodytes',
+ 368: 'gibbon, Hylobates lar',
+ 369: 'siamang, Hylobates syndactylus, Symphalangus syndactylus',
+ 370: 'guenon, guenon monkey',
+ 371: 'patas, hussar monkey, Erythrocebus patas',
+ 372: 'baboon',
+ 373: 'macaque',
+ 374: 'langur',
+ 375: 'colobus, colobus monkey',
+ 376: 'proboscis monkey, Nasalis larvatus',
+ 377: 'marmoset',
+ 378: 'capuchin, ringtail, Cebus capucinus',
+ 379: 'howler monkey, howler',
+ 380: 'titi, titi monkey',
+ 381: 'spider monkey, Ateles geoffroyi',
+ 382: 'squirrel monkey, Saimiri sciureus',
+ 383: 'Madagascar cat, ring-tailed lemur, Lemur catta',
+ 384: 'indri, indris, Indri indri, Indri brevicaudatus',
+ 385: 'Indian elephant, Elephas maximus',
+ 386: 'African elephant, Loxodonta africana',
+ 387: 'lesser panda, red panda, panda, bear cat, cat bear, Ailurus fulgens',
+ 388: 'giant panda, panda, panda bear, coon bear, Ailuropoda melanoleuca',
+ 389: 'barracouta, snoek',
+ 390: 'eel',
+ 391: 'coho, cohoe, coho salmon, blue jack, silver salmon, Oncorhynchus kisutch',
+ 392: 'rock beauty, Holocanthus tricolor',
+ 393: 'anemone fish',
+ 394: 'sturgeon',
+ 395: 'gar, garfish, garpike, billfish, Lepisosteus osseus',
+ 396: 'lionfish',
+ 397: 'puffer, pufferfish, blowfish, globefish',
+ 398: 'abacus',
+ 399: 'abaya',
+ 400: "academic gown, academic robe, judge's robe",
+ 401: 'accordion, piano accordion, squeeze box',
+ 402: 'acoustic guitar',
+ 403: 'aircraft carrier, carrier, flattop, attack aircraft carrier',
+ 404: 'airliner',
+ 405: 'airship, dirigible',
+ 406: 'altar',
+ 407: 'ambulance',
+ 408: 'amphibian, amphibious vehicle',
+ 409: 'analog clock',
+ 410: 'apiary, bee house',
+ 411: 'apron',
+ 412: 'ashcan, trash can, garbage can, wastebin, ash bin, ash-bin, ashbin, dustbin, trash barrel, trash bin',
+ 413: 'assault rifle, assault gun',
+ 414: 'backpack, back pack, knapsack, packsack, rucksack, haversack',
+ 415: 'bakery, bakeshop, bakehouse',
+ 416: 'balance beam, beam',
+ 417: 'balloon',
+ 418: 'ballpoint, ballpoint pen, ballpen, Biro',
+ 419: 'Band Aid',
+ 420: 'banjo',
+ 421: 'bannister, banister, balustrade, balusters, handrail',
+ 422: 'barbell',
+ 423: 'barber chair',
+ 424: 'barbershop',
+ 425: 'barn',
+ 426: 'barometer',
+ 427: 'barrel, cask',
+ 428: 'barrow, garden cart, lawn cart, wheelbarrow',
+ 429: 'baseball',
+ 430: 'basketball',
+ 431: 'bassinet',
+ 432: 'bassoon',
+ 433: 'bathing cap, swimming cap',
+ 434: 'bath towel',
+ 435: 'bathtub, bathing tub, bath, tub',
+ 436: 'beach wagon, station wagon, wagon, estate car, beach waggon, station waggon, waggon',
+ 437: 'beacon, lighthouse, beacon light, pharos',
+ 438: 'beaker',
+ 439: 'bearskin, busby, shako',
+ 440: 'beer bottle',
+ 441: 'beer glass',
+ 442: 'bell cote, bell cot',
+ 443: 'bib',
+ 444: 'bicycle-built-for-two, tandem bicycle, tandem',
+ 445: 'bikini, two-piece',
+ 446: 'binder, ring-binder',
+ 447: 'binoculars, field glasses, opera glasses',
+ 448: 'birdhouse',
+ 449: 'boathouse',
+ 450: 'bobsled, bobsleigh, bob',
+ 451: 'bolo tie, bolo, bola tie, bola',
+ 452: 'bonnet, poke bonnet',
+ 453: 'bookcase',
+ 454: 'bookshop, bookstore, bookstall',
+ 455: 'bottlecap',
+ 456: 'bow',
+ 457: 'bow tie, bow-tie, bowtie',
+ 458: 'brass, memorial tablet, plaque',
+ 459: 'brassiere, bra, bandeau',
+ 460: 'breakwater, groin, groyne, mole, bulwark, seawall, jetty',
+ 461: 'breastplate, aegis, egis',
+ 462: 'broom',
+ 463: 'bucket, pail',
+ 464: 'buckle',
+ 465: 'bulletproof vest',
+ 466: 'bullet train, bullet',
+ 467: 'butcher shop, meat market',
+ 468: 'cab, hack, taxi, taxicab',
+ 469: 'caldron, cauldron',
+ 470: 'candle, taper, wax light',
+ 471: 'cannon',
+ 472: 'canoe',
+ 473: 'can opener, tin opener',
+ 474: 'cardigan',
+ 475: 'car mirror',
+ 476: 'carousel, carrousel, merry-go-round, roundabout, whirligig',
+ 477: "carpenter's kit, tool kit",
+ 478: 'carton',
+ 479: 'car wheel',
+ 480: 'cash machine, cash dispenser, automated teller machine, automatic teller machine, automated teller, automatic teller, ATM',
+ 481: 'cassette',
+ 482: 'cassette player',
+ 483: 'castle',
+ 484: 'catamaran',
+ 485: 'CD player',
+ 486: 'cello, violoncello',
+ 487: 'cellular telephone, cellular phone, cellphone, cell, mobile phone',
+ 488: 'chain',
+ 489: 'chainlink fence',
+ 490: 'chain mail, ring mail, mail, chain armor, chain armour, ring armor, ring armour',
+ 491: 'chain saw, chainsaw',
+ 492: 'chest',
+ 493: 'chiffonier, commode',
+ 494: 'chime, bell, gong',
+ 495: 'china cabinet, china closet',
+ 496: 'Christmas stocking',
+ 497: 'church, church building',
+ 498: 'cinema, movie theater, movie theatre, movie house, picture palace',
+ 499: 'cleaver, meat cleaver, chopper',
+ 500: 'cliff dwelling',
+ 501: 'cloak',
+ 502: 'clog, geta, patten, sabot',
+ 503: 'cocktail shaker',
+ 504: 'coffee mug',
+ 505: 'coffeepot',
+ 506: 'coil, spiral, volute, whorl, helix',
+ 507: 'combination lock',
+ 508: 'computer keyboard, keypad',
+ 509: 'confectionery, confectionary, candy store',
+ 510: 'container ship, containership, container vessel',
+ 511: 'convertible',
+ 512: 'corkscrew, bottle screw',
+ 513: 'cornet, horn, trumpet, trump',
+ 514: 'cowboy boot',
+ 515: 'cowboy hat, ten-gallon hat',
+ 516: 'cradle',
+ 517: 'crane',
+ 518: 'crash helmet',
+ 519: 'crate',
+ 520: 'crib, cot',
+ 521: 'Crock Pot',
+ 522: 'croquet ball',
+ 523: 'crutch',
+ 524: 'cuirass',
+ 525: 'dam, dike, dyke',
+ 526: 'desk',
+ 527: 'desktop computer',
+ 528: 'dial telephone, dial phone',
+ 529: 'diaper, nappy, napkin',
+ 530: 'digital clock',
+ 531: 'digital watch',
+ 532: 'dining table, board',
+ 533: 'dishrag, dishcloth',
+ 534: 'dishwasher, dish washer, dishwashing machine',
+ 535: 'disk brake, disc brake',
+ 536: 'dock, dockage, docking facility',
+ 537: 'dogsled, dog sled, dog sleigh',
+ 538: 'dome',
+ 539: 'doormat, welcome mat',
+ 540: 'drilling platform, offshore rig',
+ 541: 'drum, membranophone, tympan',
+ 542: 'drumstick',
+ 543: 'dumbbell',
+ 544: 'Dutch oven',
+ 545: 'electric fan, blower',
+ 546: 'electric guitar',
+ 547: 'electric locomotive',
+ 548: 'entertainment center',
+ 549: 'envelope',
+ 550: 'espresso maker',
+ 551: 'face powder',
+ 552: 'feather boa, boa',
+ 553: 'file, file cabinet, filing cabinet',
+ 554: 'fireboat',
+ 555: 'fire engine, fire truck',
+ 556: 'fire screen, fireguard',
+ 557: 'flagpole, flagstaff',
+ 558: 'flute, transverse flute',
+ 559: 'folding chair',
+ 560: 'football helmet',
+ 561: 'forklift',
+ 562: 'fountain',
+ 563: 'fountain pen',
+ 564: 'four-poster',
+ 565: 'freight car',
+ 566: 'French horn, horn',
+ 567: 'frying pan, frypan, skillet',
+ 568: 'fur coat',
+ 569: 'garbage truck, dustcart',
+ 570: 'gasmask, respirator, gas helmet',
+ 571: 'gas pump, gasoline pump, petrol pump, island dispenser',
+ 572: 'goblet',
+ 573: 'go-kart',
+ 574: 'golf ball',
+ 575: 'golfcart, golf cart',
+ 576: 'gondola',
+ 577: 'gong, tam-tam',
+ 578: 'gown',
+ 579: 'grand piano, grand',
+ 580: 'greenhouse, nursery, glasshouse',
+ 581: 'grille, radiator grille',
+ 582: 'grocery store, grocery, food market, market',
+ 583: 'guillotine',
+ 584: 'hair slide',
+ 585: 'hair spray',
+ 586: 'half track',
+ 587: 'hammer',
+ 588: 'hamper',
+ 589: 'hand blower, blow dryer, blow drier, hair dryer, hair drier',
+ 590: 'hand-held computer, hand-held microcomputer',
+ 591: 'handkerchief, hankie, hanky, hankey',
+ 592: 'hard disc, hard disk, fixed disk',
+ 593: 'harmonica, mouth organ, harp, mouth harp',
+ 594: 'harp',
+ 595: 'harvester, reaper',
+ 596: 'hatchet',
+ 597: 'holster',
+ 598: 'home theater, home theatre',
+ 599: 'honeycomb',
+ 600: 'hook, claw',
+ 601: 'hoopskirt, crinoline',
+ 602: 'horizontal bar, high bar',
+ 603: 'horse cart, horse-cart',
+ 604: 'hourglass',
+ 605: 'iPod',
+ 606: 'iron, smoothing iron',
+ 607: "jack-o'-lantern",
+ 608: 'jean, blue jean, denim',
+ 609: 'jeep, landrover',
+ 610: 'jersey, T-shirt, tee shirt',
+ 611: 'jigsaw puzzle',
+ 612: 'jinrikisha, ricksha, rickshaw',
+ 613: 'joystick',
+ 614: 'kimono',
+ 615: 'knee pad',
+ 616: 'knot',
+ 617: 'lab coat, laboratory coat',
+ 618: 'ladle',
+ 619: 'lampshade, lamp shade',
+ 620: 'laptop, laptop computer',
+ 621: 'lawn mower, mower',
+ 622: 'lens cap, lens cover',
+ 623: 'letter opener, paper knife, paperknife',
+ 624: 'library',
+ 625: 'lifeboat',
+ 626: 'lighter, light, igniter, ignitor',
+ 627: 'limousine, limo',
+ 628: 'liner, ocean liner',
+ 629: 'lipstick, lip rouge',
+ 630: 'Loafer',
+ 631: 'lotion',
+ 632: 'loudspeaker, speaker, speaker unit, loudspeaker system, speaker system',
+ 633: "loupe, jeweler's loupe",
+ 634: 'lumbermill, sawmill',
+ 635: 'magnetic compass',
+ 636: 'mailbag, postbag',
+ 637: 'mailbox, letter box',
+ 638: 'maillot',
+ 639: 'maillot, tank suit',
+ 640: 'manhole cover',
+ 641: 'maraca',
+ 642: 'marimba, xylophone',
+ 643: 'mask',
+ 644: 'matchstick',
+ 645: 'maypole',
+ 646: 'maze, labyrinth',
+ 647: 'measuring cup',
+ 648: 'medicine chest, medicine cabinet',
+ 649: 'megalith, megalithic structure',
+ 650: 'microphone, mike',
+ 651: 'microwave, microwave oven',
+ 652: 'military uniform',
+ 653: 'milk can',
+ 654: 'minibus',
+ 655: 'miniskirt, mini',
+ 656: 'minivan',
+ 657: 'missile',
+ 658: 'mitten',
+ 659: 'mixing bowl',
+ 660: 'mobile home, manufactured home',
+ 661: 'Model T',
+ 662: 'modem',
+ 663: 'monastery',
+ 664: 'monitor',
+ 665: 'moped',
+ 666: 'mortar',
+ 667: 'mortarboard',
+ 668: 'mosque',
+ 669: 'mosquito net',
+ 670: 'motor scooter, scooter',
+ 671: 'mountain bike, all-terrain bike, off-roader',
+ 672: 'mountain tent',
+ 673: 'mouse, computer mouse',
+ 674: 'mousetrap',
+ 675: 'moving van',
+ 676: 'muzzle',
+ 677: 'nail',
+ 678: 'neck brace',
+ 679: 'necklace',
+ 680: 'nipple',
+ 681: 'notebook, notebook computer',
+ 682: 'obelisk',
+ 683: 'oboe, hautboy, hautbois',
+ 684: 'ocarina, sweet potato',
+ 685: 'odometer, hodometer, mileometer, milometer',
+ 686: 'oil filter',
+ 687: 'organ, pipe organ',
+ 688: 'oscilloscope, scope, cathode-ray oscilloscope, CRO',
+ 689: 'overskirt',
+ 690: 'oxcart',
+ 691: 'oxygen mask',
+ 692: 'packet',
+ 693: 'paddle, boat paddle',
+ 694: 'paddlewheel, paddle wheel',
+ 695: 'padlock',
+ 696: 'paintbrush',
+ 697: "pajama, pyjama, pj's, jammies",
+ 698: 'palace',
+ 699: 'panpipe, pandean pipe, syrinx',
+ 700: 'paper towel',
+ 701: 'parachute, chute',
+ 702: 'parallel bars, bars',
+ 703: 'park bench',
+ 704: 'parking meter',
+ 705: 'passenger car, coach, carriage',
+ 706: 'patio, terrace',
+ 707: 'pay-phone, pay-station',
+ 708: 'pedestal, plinth, footstall',
+ 709: 'pencil box, pencil case',
+ 710: 'pencil sharpener',
+ 711: 'perfume, essence',
+ 712: 'Petri dish',
+ 713: 'photocopier',
+ 714: 'pick, plectrum, plectron',
+ 715: 'pickelhaube',
+ 716: 'picket fence, paling',
+ 717: 'pickup, pickup truck',
+ 718: 'pier',
+ 719: 'piggy bank, penny bank',
+ 720: 'pill bottle',
+ 721: 'pillow',
+ 722: 'ping-pong ball',
+ 723: 'pinwheel',
+ 724: 'pirate, pirate ship',
+ 725: 'pitcher, ewer',
+ 726: "plane, carpenter's plane, woodworking plane",
+ 727: 'planetarium',
+ 728: 'plastic bag',
+ 729: 'plate rack',
+ 730: 'plow, plough',
+ 731: "plunger, plumber's helper",
+ 732: 'Polaroid camera, Polaroid Land camera',
+ 733: 'pole',
+ 734: 'police van, police wagon, paddy wagon, patrol wagon, wagon, black Maria',
+ 735: 'poncho',
+ 736: 'pool table, billiard table, snooker table',
+ 737: 'pop bottle, soda bottle',
+ 738: 'pot, flowerpot',
+ 739: "potter's wheel",
+ 740: 'power drill',
+ 741: 'prayer rug, prayer mat',
+ 742: 'printer',
+ 743: 'prison, prison house',
+ 744: 'projectile, missile',
+ 745: 'projector',
+ 746: 'puck, hockey puck',
+ 747: 'punching bag, punch bag, punching ball, punchball',
+ 748: 'purse',
+ 749: 'quill, quill pen',
+ 750: 'quilt, comforter, comfort, puff',
+ 751: 'racer, race car, racing car',
+ 752: 'racket, racquet',
+ 753: 'radiator',
+ 754: 'radio, wireless',
+ 755: 'radio telescope, radio reflector',
+ 756: 'rain barrel',
+ 757: 'recreational vehicle, RV, R.V.',
+ 758: 'reel',
+ 759: 'reflex camera',
+ 760: 'refrigerator, icebox',
+ 761: 'remote control, remote',
+ 762: 'restaurant, eating house, eating place, eatery',
+ 763: 'revolver, six-gun, six-shooter',
+ 764: 'rifle',
+ 765: 'rocking chair, rocker',
+ 766: 'rotisserie',
+ 767: 'rubber eraser, rubber, pencil eraser',
+ 768: 'rugby ball',
+ 769: 'rule, ruler',
+ 770: 'running shoe',
+ 771: 'safe',
+ 772: 'safety pin',
+ 773: 'saltshaker, salt shaker',
+ 774: 'sandal',
+ 775: 'sarong',
+ 776: 'sax, saxophone',
+ 777: 'scabbard',
+ 778: 'scale, weighing machine',
+ 779: 'school bus',
+ 780: 'schooner',
+ 781: 'scoreboard',
+ 782: 'screen, CRT screen',
+ 783: 'screw',
+ 784: 'screwdriver',
+ 785: 'seat belt, seatbelt',
+ 786: 'sewing machine',
+ 787: 'shield, buckler',
+ 788: 'shoe shop, shoe-shop, shoe store',
+ 789: 'shoji',
+ 790: 'shopping basket',
+ 791: 'shopping cart',
+ 792: 'shovel',
+ 793: 'shower cap',
+ 794: 'shower curtain',
+ 795: 'ski',
+ 796: 'ski mask',
+ 797: 'sleeping bag',
+ 798: 'slide rule, slipstick',
+ 799: 'sliding door',
+ 800: 'slot, one-armed bandit',
+ 801: 'snorkel',
+ 802: 'snowmobile',
+ 803: 'snowplow, snowplough',
+ 804: 'soap dispenser',
+ 805: 'soccer ball',
+ 806: 'sock',
+ 807: 'solar dish, solar collector, solar furnace',
+ 808: 'sombrero',
+ 809: 'soup bowl',
+ 810: 'space bar',
+ 811: 'space heater',
+ 812: 'space shuttle',
+ 813: 'spatula',
+ 814: 'speedboat',
+ 815: "spider web, spider's web",
+ 816: 'spindle',
+ 817: 'sports car, sport car',
+ 818: 'spotlight, spot',
+ 819: 'stage',
+ 820: 'steam locomotive',
+ 821: 'steel arch bridge',
+ 822: 'steel drum',
+ 823: 'stethoscope',
+ 824: 'stole',
+ 825: 'stone wall',
+ 826: 'stopwatch, stop watch',
+ 827: 'stove',
+ 828: 'strainer',
+ 829: 'streetcar, tram, tramcar, trolley, trolley car',
+ 830: 'stretcher',
+ 831: 'studio couch, day bed',
+ 832: 'stupa, tope',
+ 833: 'submarine, pigboat, sub, U-boat',
+ 834: 'suit, suit of clothes',
+ 835: 'sundial',
+ 836: 'sunglass',
+ 837: 'sunglasses, dark glasses, shades',
+ 838: 'sunscreen, sunblock, sun blocker',
+ 839: 'suspension bridge',
+ 840: 'swab, swob, mop',
+ 841: 'sweatshirt',
+ 842: 'swimming trunks, bathing trunks',
+ 843: 'swing',
+ 844: 'switch, electric switch, electrical switch',
+ 845: 'syringe',
+ 846: 'table lamp',
+ 847: 'tank, army tank, armored combat vehicle, armoured combat vehicle',
+ 848: 'tape player',
+ 849: 'teapot',
+ 850: 'teddy, teddy bear',
+ 851: 'television, television system',
+ 852: 'tennis ball',
+ 853: 'thatch, thatched roof',
+ 854: 'theater curtain, theatre curtain',
+ 855: 'thimble',
+ 856: 'thresher, thrasher, threshing machine',
+ 857: 'throne',
+ 858: 'tile roof',
+ 859: 'toaster',
+ 860: 'tobacco shop, tobacconist shop, tobacconist',
+ 861: 'toilet seat',
+ 862: 'torch',
+ 863: 'totem pole',
+ 864: 'tow truck, tow car, wrecker',
+ 865: 'toyshop',
+ 866: 'tractor',
+ 867: 'trailer truck, tractor trailer, trucking rig, rig, articulated lorry, semi',
+ 868: 'tray',
+ 869: 'trench coat',
+ 870: 'tricycle, trike, velocipede',
+ 871: 'trimaran',
+ 872: 'tripod',
+ 873: 'triumphal arch',
+ 874: 'trolleybus, trolley coach, trackless trolley',
+ 875: 'trombone',
+ 876: 'tub, vat',
+ 877: 'turnstile',
+ 878: 'typewriter keyboard',
+ 879: 'umbrella',
+ 880: 'unicycle, monocycle',
+ 881: 'upright, upright piano',
+ 882: 'vacuum, vacuum cleaner',
+ 883: 'vase',
+ 884: 'vault',
+ 885: 'velvet',
+ 886: 'vending machine',
+ 887: 'vestment',
+ 888: 'viaduct',
+ 889: 'violin, fiddle',
+ 890: 'volleyball',
+ 891: 'waffle iron',
+ 892: 'wall clock',
+ 893: 'wallet, billfold, notecase, pocketbook',
+ 894: 'wardrobe, closet, press',
+ 895: 'warplane, military plane',
+ 896: 'washbasin, handbasin, washbowl, lavabo, wash-hand basin',
+ 897: 'washer, automatic washer, washing machine',
+ 898: 'water bottle',
+ 899: 'water jug',
+ 900: 'water tower',
+ 901: 'whiskey jug',
+ 902: 'whistle',
+ 903: 'wig',
+ 904: 'window screen',
+ 905: 'window shade',
+ 906: 'Windsor tie',
+ 907: 'wine bottle',
+ 908: 'wing',
+ 909: 'wok',
+ 910: 'wooden spoon',
+ 911: 'wool, woolen, woollen',
+ 912: 'worm fence, snake fence, snake-rail fence, Virginia fence',
+ 913: 'wreck',
+ 914: 'yawl',
+ 915: 'yurt',
+ 916: 'web site, website, internet site, site',
+ 917: 'comic book',
+ 918: 'crossword puzzle, crossword',
+ 919: 'street sign',
+ 920: 'traffic light, traffic signal, stoplight',
+ 921: 'book jacket, dust cover, dust jacket, dust wrapper',
+ 922: 'menu',
+ 923: 'plate',
+ 924: 'guacamole',
+ 925: 'consomme',
+ 926: 'hot pot, hotpot',
+ 927: 'trifle',
+ 928: 'ice cream, icecream',
+ 929: 'ice lolly, lolly, lollipop, popsicle',
+ 930: 'French loaf',
+ 931: 'bagel, beigel',
+ 932: 'pretzel',
+ 933: 'cheeseburger',
+ 934: 'hotdog, hot dog, red hot',
+ 935: 'mashed potato',
+ 936: 'head cabbage',
+ 937: 'broccoli',
+ 938: 'cauliflower',
+ 939: 'zucchini, courgette',
+ 940: 'spaghetti squash',
+ 941: 'acorn squash',
+ 942: 'butternut squash',
+ 943: 'cucumber, cuke',
+ 944: 'artichoke, globe artichoke',
+ 945: 'bell pepper',
+ 946: 'cardoon',
+ 947: 'mushroom',
+ 948: 'Granny Smith',
+ 949: 'strawberry',
+ 950: 'orange',
+ 951: 'lemon',
+ 952: 'fig',
+ 953: 'pineapple, ananas',
+ 954: 'banana',
+ 955: 'jackfruit, jak, jack',
+ 956: 'custard apple',
+ 957: 'pomegranate',
+ 958: 'hay',
+ 959: 'carbonara',
+ 960: 'chocolate sauce, chocolate syrup',
+ 961: 'dough',
+ 962: 'meat loaf, meatloaf',
+ 963: 'pizza, pizza pie',
+ 964: 'potpie',
+ 965: 'burrito',
+ 966: 'red wine',
+ 967: 'espresso',
+ 968: 'cup',
+ 969: 'eggnog',
+ 970: 'alp',
+ 971: 'bubble',
+ 972: 'cliff, drop, drop-off',
+ 973: 'coral reef',
+ 974: 'geyser',
+ 975: 'lakeside, lakeshore',
+ 976: 'promontory, headland, head, foreland',
+ 977: 'sandbar, sand bar',
+ 978: 'seashore, coast, seacoast, sea-coast',
+ 979: 'valley, vale',
+ 980: 'volcano',
+ 981: 'ballplayer, baseball player',
+ 982: 'groom, bridegroom',
+ 983: 'scuba diver',
+ 984: 'rapeseed',
+ 985: 'daisy',
+ 986: "yellow lady's slipper, yellow lady-slipper, Cypripedium calceolus, Cypripedium parviflorum",
+ 987: 'corn',
+ 988: 'acorn',
+ 989: 'hip, rose hip, rosehip',
+ 990: 'buckeye, horse chestnut, conker',
+ 991: 'coral fungus',
+ 992: 'agaric',
+ 993: 'gyromitra',
+ 994: 'stinkhorn, carrion fungus',
+ 995: 'earthstar',
+ 996: 'hen-of-the-woods, hen of the woods, Polyporus frondosus, Grifola frondosa',
+ 997: 'bolete',
+ 998: 'ear, spike, capitulum',
+ 999: 'toilet tissue, toilet paper, bathroom tissue'}

rknn-toolkit-lite2/examples/dynamic_shape/test.py

@@ -0,0 +1,135 @@
+import cv2
+import numpy as np
+import platform
+from synset_label import labels
+from rknnlite.api import RKNNLite
+
+# decice tree for RK356x/RK3576/RK3588
+DEVICE_COMPATIBLE_NODE = '/proc/device-tree/compatible'
+
+def get_host():
+    # get platform and device type
+    system = platform.system()
+    machine = platform.machine()
+    os_machine = system + '-' + machine
+    if os_machine == 'Linux-aarch64':
+        try:
+            with open(DEVICE_COMPATIBLE_NODE) as f:
+                device_compatible_str = f.read()
+                if 'rk3588' in device_compatible_str:
+                    host = 'RK3588'
+                elif 'rk3562' in device_compatible_str:
+                    host = 'RK3562'
+                elif 'rk3576' in device_compatible_str:
+                    host = 'RK3576'
+                else:
+                    host = 'RK3566_RK3568'
+        except IOError:
+            print('Read device node {} failed.'.format(DEVICE_COMPATIBLE_NODE))
+            exit(-1)
+    else:
+        host = os_machine
+    return host
+
+INPUT_SIZE = 224
+
+RK3566_RK3568_RKNN_MODEL = 'mobilenet_v2_for_rk3566_rk3568.rknn'
+RK3588_RKNN_MODEL = 'mobilenet_v2_for_rk3588.rknn'
+RK3562_RKNN_MODEL = 'mobilenet_v2_for_rk3562.rknn'
+RK3576_RKNN_MODEL = 'mobilenet_v2_for_rk3576.rknn'
+
+
+def show_top5(result):
+    output = result[0].reshape(-1)
+    # Get the indices of the top 5 largest values
+    output_sorted_indices = np.argsort(output)[::-1][:5]
+    top5_str = '-----TOP 5-----\n'
+    for i, index in enumerate(output_sorted_indices):
+        value = output[index]
+        if value > 0:
+            topi = '[{:>3d}] score:{:.6f} class:"{}"\n'.format(
+                index, value, labels[index])
+        else:
+            topi = '-1: 0.0\n'
+        top5_str += topi
+    print(top5_str)
+
+
+if __name__ == '__main__':
+
+    # Get device information
+    host_name = get_host()
+    if host_name == 'RK3566_RK3568':
+        rknn_model = RK3566_RK3568_RKNN_MODEL
+    elif host_name == 'RK3562':
+        rknn_model = RK3562_RKNN_MODEL
+    elif host_name == 'RK3576':
+        rknn_model = RK3576_RKNN_MODEL
+    elif host_name == 'RK3588':
+        rknn_model = RK3588_RKNN_MODEL
+    else:
+        print("This demo cannot run on the current platform: {}".format(host_name))
+        exit(-1)
+
+    dynamic_input = [
+        [[1, 3, 192, 192]],
+        [[1, 3, 256, 256]],
+        [[1, 3, 160, 160]],
+        [[1, 3, 224, 224]]
+    ]
+
+    rknn_lite = RKNNLite()
+
+    # Load RKNN model
+    print('--> Load RKNN model')
+    ret = rknn_lite.load_rknn(rknn_model)
+    if ret != 0:
+        print('Load RKNN model failed')
+        exit(ret)
+    print('done')
+
+    img = cv2.imread('./dog_224x224.jpg')
+
+    # Init runtime environment
+    print('--> Init runtime environment')
+    # Run on RK356x / RK3576 / RK3588 with Debian OS, do not need specify target.
+    if host_name in ['RK3576', 'RK3588']:
+        # For RK3576 / RK3588, specify which NPU core the model runs on through the core_mask parameter.
+        ret = rknn_lite.init_runtime(core_mask=RKNNLite.NPU_CORE_0)
+    else:
+        ret = rknn_lite.init_runtime()
+    if ret != 0:
+        print('Init runtime environment failed')
+        exit(ret)
+    print('done')
+
+    # Inference
+    print('--> Running model')
+    print('model: mobilenet_v2\n')
+    print('input shape: 1,3,224,224')
+    real_img = cv2.resize(img, (224, 224))
+    real_img = np.expand_dims(real_img, 0)
+    real_img = np.transpose(real_img, (0, 3, 1, 2))
+    outputs = rknn_lite.inference(inputs=[real_img], data_format=['nchw'])
+    # Show the classification results
+    show_top5(outputs)
+
+    print('input shape: 1,3,160,160')
+    real_img = cv2.resize(img, (160, 160))
+    real_img = np.expand_dims(real_img, 0)
+    real_img = np.transpose(real_img, (0, 3, 1, 2))
+    outputs = rknn_lite.inference(inputs=[real_img], data_format=['nchw'])
+    # Show the classification results
+    show_top5(outputs)
+
+    print('input shape: 1,3,256,256')
+    real_img = cv2.resize(img, (256, 256))
+    real_img = np.expand_dims(real_img, 0)
+    real_img = np.transpose(real_img, (0, 3, 1, 2))
+    outputs = rknn_lite.inference(inputs=[real_img], data_format=['nchw'])
+    # Show the classification results
+    show_top5(outputs)
+
+    print('done')
+
+    rknn_lite.release()

rknn-toolkit-lite2/examples/resnet18/README.md

@@ -0,0 +1,34 @@
+# Example of resnet18
+
+## Model Source
+
+### Original model
+The models used in this example come from the torchvision project:
+https://github.com/pytorch/vision/tree/main/torchvision/models
+
+### Convert to RKNN model
+Please refer to the example in the RKNN Toolkit2 project to generate the RKNN model:
+https://github.com/rockchip-linux/rknn-toolkit2/tree/master/examples/pytorch/resnet18
+
+## Script Usage
+
+Usage
+
+```
+python test.py
+```
+
+## Expected results
+
+This example will print the TOP5 labels and corresponding scores of the test image classification results. For example, the inference results of this example are as follows:
+```
+-----TOP 5-----
+[812] score:0.999680 class:"space shuttle"
+[404] score:0.000249 class:"airliner"
+[657] score:0.000013 class:"missile"
+[466] score:0.000009 class:"bullet train, bullet"
+[895] score:0.000008 class:"warplane, military plane"
+```
+
+1. The label index with the highest score is 812, the corresponding label is `space shuttle`.
+2. Different platforms, different versions of tools and drivers may have slightly different results.