Texas Instruments AM6x Atina'e le tele o meapueata ta'iala mo tagata fa'aoga

O mea pu'e pu'e fa'apipi'i e iai sona sao taua i faiga va'ai fa'aonaponei.
O le fa'aogaina o le tele o meapueata i totonu o se faiga e fa'aleleia atili ai le agava'a ma fa'ataga ai galuega e le mafai ona ausia i se mea pu'e tasi.

Talosaga e fa'aaoga ai meapueata e tele:

Puipuiga Puipuia: Fa'asili le fa'asalalauga mata'ituina, su'esu'eina o mea, ma le sa'o sa'o.
Si'osi'omia View: Fa'aagaoioi le va'aiga fa'ata leo mo galuega e pei o le su'eina o fa'alavelave ma le fa'aogaina o mea.

Cabin Recorder ma meapueata Fa'ata Fa'ata: E maua ai le fa'alauteleina o le ufiufi ma fa'ate'a ai ma'i tauaso.
Ata Faafomai: E ofoina atu le sa'o atoatoa i ta'otoga fa'atautaiga ma fa'ai'uga.

Drones ma Ata Va'alele: Pu'e ata maualuga maualuga mai itu eseese mo fa'aoga eseese.

Feso'ota'i le tele o mea pu'eata CSI-2 i le SoC:
Ina ia fa'afeso'ota'i le tele o mea pu'eata CSI-2 i le SoC, mulimuli i ta'iala o lo'o tu'uina atu i le tusi lesona. Ia mautinoa le fetaui lelei ma le feso'ota'iga o mea pu'eata ta'itasi i ports ua fa'atulaga i luga ole SoC.

Fa'amatalaga Fa'atatau
Atiina o Talosaga Tele-Kamera ile AM6x

Jianzhong Xu, Qutaiba Saleh

FAAMATALAGA
O lenei lipoti o loʻo faʻamatalaina ai le atinaʻeina o talosaga e faʻaaoga ai le tele o kamela CSI-2 i le AM6x aiga o masini. O se faʻataʻitaʻiga o le suʻesuʻeina o mea ma aʻoaʻoga loloto i luga o 4 mea pueata i luga o le AM62A SoC o loʻo tuʻuina atu ma faʻataʻitaʻiga faʻatinoga. O mataupu faavae lautele o le mamanu e faʻaoga i isi SoCs faʻatasi ai ma le CSI-2 faʻaoga, e pei o le AM62x ma le AM62P.

Folasaga

O mea pu'e pu'e fa'apipi'i e iai sona sao taua i faiga va'ai fa'aonaponei. O le fa'aaogaina o meapueata se tele i totonu o se faiga e fa'alautele ai le gafatia o nei faiga ma fa'aagaaga ai mea e le mafai i se mea pu'e tasi. O loʻo i lalo nisi faʻamatalagaample tele o talosaga e fa'aaoga ai le tele o meapueata fa'apipi'i:

Saogalemu Mata'itū: Tele mea pu'eata tu'u fa'ata'atia e maua ai fa'amatalaga mata'ituina lelei. Latou te mafaia panoramic views, faʻaitiitia faʻailoga tauaso, ma faʻaleleia le saʻo o mea e tulituliloaina ma faʻaalia, faʻaleleia atili faiga saogalemu.
Si'osi'omia View: E tele meapueata e fa'aogaina e fai ai se seti fa'aaliga va'aia, fa'atagaina fa'amatalaga tolu-dimensional ma le fa'atatauina o le loloto. E taua tele lenei mo galuega e pei o le suʻeina o faʻalavelave i taʻavale tutoʻatasi, faʻaogaina saʻo mea i robotics, ma faʻaleleia atili o mea moni faʻateleina.

Cabin Recorder and Camera Mirror System: O se masini pu'upu'u ta'avale ma le tele o mea pu'eata e mafai ona tu'uina atu le tele o fa'amatalaga e fa'aaoga ai se masini e tasi. E fa'apena fo'i, se fa'ata fa'ata meapueata ma lua pe sili atu meapueata e mafai ona fa'alautele le tulaga o le aveta'avale view ma fa'ate'a fa'ailoga tauaso mai itu uma o le ta'avale.
Faʻataʻitaʻiga Faʻafomaʻi: E mafai ona faʻaogaina le tele o mea pueata i ata faʻafomaʻi mo galuega e pei o taʻaloga taʻavale, tuʻuina atu i fomai tipitipi le tele o vaaiga mo le faʻaleleia atili o le saʻo. I le endoscopy, e tele meapueata e mafai ai ona su'esu'e mae'ae'a totoga totonu.

Drones and Aerial Imaging: Drones e masani ona faʻapipiʻiina i le tele o mea pueata e puʻeina ai ata maualuga poʻo vitio mai itu eseese. E aoga lea i talosaga e pei o ata i luga o le ea, mataituina o faatoaga, ma le fuaina o fanua.
Faatasi ai ma le alualu i luma o microprocessors, e tele mea pueata e mafai ona tuʻufaʻatasia i totonu o le System-on-Chip e tasi.
(SoC) e tuʻuina atu fofo faʻapitoa ma lelei. O le AM62Ax SoC, faʻatasi ai ma le faʻatinoina o ata vitio / vaʻaiga mataʻutia ma le faʻavaveina o aʻoaʻoga loloto, o se masini lelei mo mataupu faʻaoga ua taʻua i luga. O le isi masini AM6x, le AM62P, ua fausia mo faʻatinoga faʻapipiʻi 3D faʻaaliga maualuga. Faʻapipiʻiina i le 3D faʻataʻitaʻiga faʻavavevave, o le AM62P e mafai ona faigofie ona suʻi faʻatasi ata mai le tele o mea puʻeata ma maua ai se ata maualuga maualuga. view. O foliga fou o le AM62A / AM62P SoC ua tuʻuina atu i lomiga eseese, e pei o le [4], [5], [6], ma isi. O lenei tusi talosaga o le a le toe faia na faʻamatalaga faʻapitoa ae o loʻo taulaʻi atu i le tuʻufaʻatasia o le tele o mea pueata CSI-2 i totonu o faʻamatalaga faʻapipiʻi i AM62A / AM62P.

Laulau 1-1 o loʻo faʻaalia ai le eseesega tele i le va o le AM62A ma le AM62P e tusa ai ma le faʻaogaina o ata.

Laulau 1-1. Eseesega i le va o le AM62A ma le AM62P i le faʻatulagaina o ata

SoC	AM62A	AM62P
Ituaiga Meapue Lagolago	Fa'atasi pe leai se ISP fa'apipi'i	Faatasi ai ma le ISP ua fausia
Fa'amatalaga o mea pu'eata	Mata/YUV/RGB	YUV/RGB
ISP HWA	Ioe	Leai
A'oa'oga loloto HWA	Ioe	Leai
3-D Graphics HWA	Leai	Ioe

Fa'afeso'ota'i le tele o mea pu'eata CSI-2 ile SoC
Ole mea pu'eata ile AM6x SoC o lo'o iai vaega nei, e pei ona fa'aalia ile Ata 2-1:

MIPI D-PHY Receiver: mauaina ata vitio mai mea pueata fafo, lagolago i luga ole 1.5 Gbps i laina faʻamatalaga mo 4 laina.

CSI-2 Receiver (RX): maua ata vitio mai le D-PHY receiver ma a le o le auina saʻo o vaitafe i le ISP pe lafo faʻamaumauga i le DDR memory. O lenei module e lagolagoina e oʻo atu i le 16 telefoni feaveaʻi.
SHIM: o se afifi DMA e mafai ai ona auina atu vaitafe ua puʻeina e manatua i luga ole DMA. E mafai ona fa'atupuina le tele o fa'amatalaga DMA e lenei afifi, fa'atasi ai ma fa'asinomaga ta'itasi e fetaui ma se auala fa'apitoa a le CSI-2 Receiver.

E mafai ona lagolagoina le tele o meapueata i le AM6x e ala i le faʻaogaina o auala faʻapitoa o le CSI-2 RX, e ui lava e naʻo le tasi le CSI-2 RX faʻaoga ile SoC. E mana'omia se vaega fa'aopoopo CSI-2 i fafo e tu'ufa'atasia ai le tele o meapueata ma lafo i le SoC e tasi. E lua ituaiga o CSI-2 aggregating solutions e mafai ona faʻaaogaina, faʻamatalaina i vaega nei.

CSI-2 Aggregator Fa'aaogaina SerDes
O se tasi o auala e tu'ufa'atasia ai le tele o meapueata o le fa'aogaina lea o se fa'asologa fa'asolosolo ma fa'a'ese'ese (SerDes). O fa'amaumauga a le CSI-2 mai mea pu'eata ta'itasi e fa'aliliuina e se serializer ma fa'aliliu atu i se uaea. E maua e le deserializer fa'amatalaga fa'asalalau uma na fa'aliliu mai i uaea (tasi le uaea i le mea pu'eata), toe fa'afo'i vaitafe i fa'amaumauga CSI-2, ona tu'uina atu lea o se vaitafe CSI-2 feso'ota'i i le CSI-2 RX feso'ota'iga i le SoC. E iloa ta'itasi o mea pu'eata i se auala fa'apitoa tulaga ese. O lenei fa'aputuga fofo e ofoina atu le fa'amanuiaga fa'aopoopo o le fa'ataga o feso'ota'iga mamao e o'o atu i le 15m mai mea pu'eata i le SoC.

O le FPD-Link poʻo le V3-Link serializers ma deserializers (SerDes), lagolagoina i le AM6x Linux SDK, o tekinolosi sili ona lauiloa mo lenei ituaiga CSI-2 faʻamaopoopo fofo. O le FPD-Link ma le V3-Link deserializers o loʻo i ai auala pito i tua e mafai ona faʻaogaina e lafo ai faʻailoga faʻapipiʻi faʻavaa e faʻamaopoopo uma mea pueata, e pei ona faʻamatalaina i le [7].
Ata 2-2 o lo'o fa'aalia ai se fa'ata'ita'igaample fa'aogaina o le SerDes e fa'afeso'ota'i le tele o mea pu'eata i le AM6x SoC e tasi.

O se tasiampO lenei fa'aputuga fofo e mafai ona maua i le Arducam V3Link Camera Solution Kit. O lenei pusa o loʻo i ai se faʻamaufaʻailoga e faʻapipiʻi ai le 4 CSI-2 meapueata, faʻapea foʻi ma le 4 paipa V3link serializers ma IMX219 mea pueata, e aofia ai uaea faʻapipiʻi FAKRA ma uaea FPC 22-pin. O le mamanu fa'asino na talanoaina mulimuli ane ua fausia i luga o lenei pusa.

CSI-2 Aggregator e aunoa ma le fa'aaogaina o SerDes
O lenei ituaiga o fa'aputuga e mafai ona fa'afeso'ota'i sa'o ma le tele o kamela MIPI CSI-2 ma fa'aputu fa'amaumauga mai mea pu'eata uma i le tasi CSI-2 o lo'o maua mai ai.

Ata 2-3 o lo'o fa'aalia ai se fa'ata'ita'igaample o lea faiga. O lenei ituaiga o fofo faʻapipiʻi e le faʻaaogaina soʻo se serializer / deserializer ae faʻatapulaʻaina i le mamao maualuga o le CSI-2 faʻamatalaga faʻamatalaga, lea e oʻo atu i le 30cm. E le lagolagoina e le AM6x Linux SDK lenei ituaiga CSI-2 aggregator

Fa'aagaioia le tele o meapueata i le polokalame

Mea pueata Subsystem Polokalama Fa'ata'ita'iga
Ata 3-1 o loʻo faʻaalia ai se faʻataʻitaʻiga poloka maualuga o le polokalama faʻapipiʻi mea pueata i AM62A / AM62P Linux SDK, e fetaui ma le HW system i le Ata 2-2.

O lenei fausaga faakomepiuta e mafai ai e le SoC ona maua ni vaitafe se tele ma le fa'aogaina o SerDes, e pei ona fa'aalia i le Ata 2-2. O le FPD-Link/V3-Link SerDes e tuʻuina atu se tuatusi I2C tulaga ese ma le auala faʻapitoa i mea pueata taʻitasi. E tatau ona faia se fa'apipi'i laau fa'apitoa fa'atasi ma le tuatusi I2C tulaga ese mo mea pu'eata uma. E iloa e le aveta'avale CSI-2 RX mea pu'eata ta'itasi e fa'aaoga ai le numera fa'aola fa'apitoa ma fa'atupuina ai se fa'amatalaga DMA i le vaitafe pu'eata. E faia se node vitiō mo fa'amatalaga DMA uma. O fa'amatalaga mai mea pu'eata ta'itasi e maua ma teuina e fa'aaoga ai le DMA i le manatua e tusa ai. O talosaga avanoa mo tagata e fa'aoga ai nodes vitiō e fetaui ma meapueata ta'itasi e maua ai fa'amaumauga o meapueata. ExampO le fa'aogaina o lenei fa'ata'ita'iga fa'akomepiuta o lo'o tu'uina atu i le Mataupu 4 – Fa'asinomaga Fa'asinomaga.

So'o se aveta'avale fa'apitoa e fa'atatau i le V4L2 fa'avae e mafai ona fa'apipi'i ma ta'alo i totonu o lenei fausaga. Va'ai i le [8] fa'atatau i le fa'aogaina o se aveta'avale fou i totonu o le Linux SDK.

Ata Pipeline Software Architecture

O le AM6x Linux SDK e tuʻuina atu le GStreamer (GST) faʻavae, lea e mafai ona faʻaogaina i le avanoa avanoa e tuʻufaʻatasia ai vaega o le gaosiga o ata mo talosaga eseese. O meafaigaluega Accelerators (HWA) i luga o le SoC, e pei o le Vision Pre-processing Accelerator (VPAC) poʻo le ISP, vitiō encoder/decoder, ma le loloto o le aʻoaʻoina o masini komepiuta, e maua ile GST. plugins. O le VPAC (ISP) lava ia e tele poloka, e aofia ai Vision Imaging Sub-System (VISS), Lens Distortion Correction (LDC), ma Multiscalar (MSC), e tutusa uma ma le GST plugin.
Ata 3-2 o lo'o fa'aalia ai le poloka poloka o se paipa ata masani mai le meapueata i le fa'ailoga po'o le loloto
a'oa'oga talosaga ile AM62A. Mo nisi fa'amatalaga e uiga i le fa'asologa o fa'amatalaga fa'ai'uga, fa'asino ile EdgeAI SDK fa'amaumauga.

Mo AM62P, e sili atu ona faigofie le paipa ata ona e leai se ISP ile AM62P.

Faatasi ai ma se node vitio na faia mo mea pueata taitasi, o le GStreamer-based image pipeline e mafai ai ona faʻaogaina le tele o mea puʻe puʻe (fesoʻotaʻi i le CSI-2 RX interface tutusa) i le taimi e tasi. O se fa'asologa fa'asinomaga e fa'aaoga ai le GStreamer mo fa'aoga tele-kamera o lo'o tu'uina atu i le isi mataupu.

Fa'ailoga Fa'asino

O lenei mataupu o loʻo tuʻuina atu ai se faʻataʻitaʻiga o le faʻaogaina o talosaga e tele-kamera i luga o le AM62A EVM, e faʻaaoga ai le Arducam V3Link Camera Solution Kit e faʻafesoʻotaʻi 4 CSI-2 mea pueata i AM62A ma faʻatautaia mea faʻataʻitaʻi mo mea pueata uma e 4.

Pueata Lagolago
O le Arducam V3Link kit o lo'o galue i mea pu'eata FPD-Link/V3-Link fa'atasi ma meapueata CSI-2 e fetaui ma Raspberry Pi. O mea pu'eata nei ua fa'ata'ita'iina:

D3 Inisinia D3RCM-IMX390-953
Leopard Ata LI-OV2312-FPDLINKIII-110H
IMX219 mea pu'eata i le Arducam V3Link Mea pu'eata Solution Kit

Fa'atūina Meapueata IMX219 e Fa
Mulimuli i faʻatonuga o loʻo tuʻuina atu i le AM62A Starter Kit EVM Quick Start Guide e faʻatulaga ai le SK-AM62A-LP EVM (AM62A SK) ma le ArduCam V3Link Camera Solution Quick Start Guide e faʻafesoʻotaʻi mea pueata i le AM62A SK e ala i le V3Link kit. Ia mautinoa o pine i luga o uaea fefiloi, mea pueata, V3Link laupapa, ma AM62A SK o loʻo faʻaoga lelei uma.

Ata 4-1 o lo'o fa'aalia ai le seti na fa'aogaina mo le fa'asologa o fa'asologa i totonu o lenei lipoti. O vaega autu i le seti e aofia ai:

1X SK-AM62A-LP EVM laupapa
1X Arducam V3Link d-ch adapter laupapa
FPC uaea feso'ota'i Arducam V3Link i SK-AM62A
4X V3Link meapue fa'apipi'i (serializers)
4X RF coaxial uaea e fa'afeso'ota'i V3Link serializers i V3Link d-ch kit
4X IMX219 Meapueata
4X CSI-2 22-pin uaea e faʻafesoʻotaʻi mea pueata i serializers
Uaea: Uaea HDMI, USB-C e fa'amalo ai le SK-AM62A-LP ma le 12V eletise e maua mai mo V3Link d-ch kit)
O isi vaega e le o fa'aalia i le Ata 4-1: micro-SD card, micro-USB cable e fa'aoga ai le SK-AM62A-LP, ma le Ethernet mo le tafe.

Fa'atulagaina o mea pu'eata ma le CSI-2 RX Fa'aoga
Seti le polokalama e tusa ai ma faatonuga o loʻo tuʻuina atu i le Arducam V3Link Quick Start Guide. A mae'a ona fa'agasolo le fa'asologa o mea pu'eata, setup-imx219.sh, le fa'atulagaina o le meapueata, le CSI-2 RX fa'aoga fa'aoga, ma auala mai mea pu'eata ta'itasi i le pona vitio talafeagai o le a fa'atulaga lelei. E fa nodes vitio ua faia mo le fa IMX219 mea pueata. Poloaiga "v4l2-ctl -list-devices" faʻaalia uma masini vitio V4L2, e pei ona faʻaalia i lalo:

E 6 node vitiō ma 1 alalaupapa node i lalo o le tiscsi2rx. O node vitio ta'itasi e fetaui ma se fa'amatalaga DMA e fa'asoa e le aveta'avale CSI2 RX. Mai le 6 ata vitio, 4 o loʻo faʻaaogaina mo le 4 IMX219 mea pueata, e pei ona faʻaalia i luga o le faʻasalalauga paipa i lalo:

E pei ona fa'aalia i luga, o le vaega fa'asalalau 30102000.ticsi2rx e 6 puna puna, ae na'o le 4 muamua e fa'aaogaina, ta'itasi mo le IMX219. E mafai fo'i ona fa'ata'ita'iina fa'akalafi le fa'asologa o paipa fa'asalalau. Fa'asolo le fa'atonuga lea e fa'atupu ai se togi file:

Ona taʻavale lea o le faʻatonuga i lalo ile Linux host PC e faʻatupu ai se PNG file:

Ata 4-2 o se ata na gaosia e fa'aaoga ai fa'atonuga o lo'o tu'uina atu i luga. O vaega i totonu o le faʻapipiʻiina o masini komepiuta o le Ata 3-1 e mafai ona maua i lenei kalafi.

Fa'aola mai Meapueata e Fa
Faatasi ai ma meafaigaluega ma masini komepiuta o loʻo faʻatulagaina lelei, e mafai ona faʻaogaina le tele o meapueata mai le avanoa faʻaoga. Mo AM62A, e tatau ona fa'alogo le ISP ina ia maua ai le ata lelei. Va'ai ile AM6xA ISP Tuning Guide mo le fa'atinoina o le fa'alogo ole ISP. O vaega nei o lo'o fa'aalia eample tele o le tafeina o fa'amatalaga meapueata i se fa'aaliga, fa'asalalauina fa'amaumauga o meapueata i se feso'otaiga, ma le teuina o fa'amaumauga o meapueata i files.

Fa'asa'o Fa'amatalaga Meapueata e Fa'aali
O se fa'aoga autu o lenei faiga tele-pueata o le fa'asalalauina lea o vitio mai mea pu'e uma i se fa'aaliga e feso'ota'i i le SoC tutusa. Ole mea lea ole paipa GStreamer exampLe o le tafeina o le fa IMX219 i se faʻaaliga (o numera node vitio ma numera v4l-subdev i le paipa atonu o le a suia mai le toe faʻafouina i le toe faʻafouina).

Fa'asalalauina fa'amaumauga o meapueata e ala ile Ethernet
Nai lo le tafe atu i se faʻaaliga e fesoʻotaʻi i le SoC tutusa, e mafai foi ona tafe mai faʻamatalaga mea pueata e ala i le Ethernet. O le itu e mauaina e mafai ona avea ma se isi AM62A/AM62P processor poʻo se PC talimalo. O le mea lenei o se example faʻafefeina o faʻamatalaga mea pueata e ala i le Ethernet (faʻaaogaina o mea pueata e lua mo le faigofie) (mataʻituina le faʻaogaina o le encoder plugin o loʻo faʻaaogaina i le paipa):

O le mea lenei o se exampLe o le mauaina o faʻamatalaga o mea puʻe ma faʻafefe i se faʻaaliga i luga o le isi AM62A/AM62P processor:

Fa'asaoina o fa'amaumauga o meapueata i Files
Nai lo le tafe atu i se faʻaaliga poʻo se fesoʻotaʻiga, e mafai ona teuina faʻamatalaga meapueata i totonu o le lotoifale files. O le paipa o lo'o i lalo e teu ai fa'amaumauga a meapueata ta'itasi ile a file (faʻaaogaina o mea pueata e lua e pei o se faʻataʻitaʻigaample mo le faigofie).

Telecamera Deep Learning Inferences

AM62A ua faʻapipiʻiina i se faʻavavega aʻoaʻoga loloto (C7x-MMA) ma e oʻo atu i le lua TOPS, lea e mafai ona faʻatautaia ituaiga eseese o faʻataʻitaʻiga loloto aʻoaʻoga mo le faʻavasegaina, suʻesuʻeina o mea faitino, faʻavasegaga o semantic, ma isi mea. O lenei vaega o lo'o fa'aalia ai le mafai e le AM62A ona fa'ata'ita'iina fa'ata'ita'iga loloto fa'ata'ita'iga fa'ata'ita'iga i luga o fafaga eseese meapueata.

Filifiliga Fa'ata'ita'i
O le TI's EdgeAI-ModelZoo e maua ai le faitau selau o faʻataʻitaʻiga faʻaonaponei, lea e liua / auina atu i fafo mai a latou faʻavae aʻoaʻoga muamua i se faʻapipiʻi faʻafeiloaʻi-faauo ina ia mafai ona ave i luga o le C7x-MMA aʻoaʻoga loloto accelerator. O le Edge AI Studio Model Analyzer e faʻavae i luga o le ao e maua ai se meafaigaluega faʻaoga faigofie "Filifiliga Faʻataʻitaʻiga". O lo'o fa'afou malosi e aofia uma fa'ata'ita'iga o lo'o lagolagoina ile TI EdgeAI-ModelZoo. O le meafaigaluega e le manaʻomia se poto masani muamua ma tuʻuina atu se faʻaoga faigofie e faʻaoga ai foliga e manaʻomia i le faʻataʻitaʻiga manaʻomia.

O le TFL-OD-2000-ssd-mobV1-coco-mlperf na filifilia mo lenei su'ega a'oa'oga loloto tele-pueata. O lenei faʻataʻitaʻiga faʻataʻitaʻiga tele-meafaitino ua atiaʻe i totonu o le TensorFlow framework faʻatasi ai ma le 300 × 300 faʻamatalaga faʻaoga. Laulau 4-1 o loʻo faʻaalia ai uiga taua o lenei faʻataʻitaʻiga pe a aʻoaʻoina i luga o le cCOCO dataset ma pe a ma le 80 vasega eseese.

Laulau 4-1. Fa'ailoga Fa'ailoga o le Fa'ata'ita'iga TFL-OD-2000-ssd-mobV1-coco-mlperf.

Fa'ata'ita'iga	Galuega	I'ugafono	FPS	fa'afanua 50% Sa'o ile COCO	Latency/Frame (ms)	DDR BW Fa'aaogāina (MB/ Fa'avaa)
TFL-OD-2000-ssd- mobV1-coco-mlperf	Su'esu'eina o Mea e Tele	300×300	~152	15.9	6.5	18.839

Fa'atonuga paipa
Ata 4-3 o lo'o fa'aalia ai le 4-kamera loloto a'oa'oga GStreamer paipa. O lo'o tu'uina atu e le TI se seti o le GStreamer plugins e fa'ataga ai le fa'auluina o nisi o fa'agaioiga fa'asalalauga ma le loloto o le a'oa'oga fa'atatau i masini fa'avavevave. O nisi exampo nei mea plugins aofia ai tiovxisp, tiovxmultiscaler, tiovxmosaic, ma tidlinferer. Ole paipa ile Ata 4-3 e aofia ai mea uma e mana'omia plugins mo se laina paipa GStreamer multipath mo mea fa'aoga 4-kamera, e tofu ma ala fa'asalalau muamua, fa'ata'ita'iga loloto a'oa'oga, ma le fa'agasologa. O le kopi plugins aua o auala ta'itasi o meapueata o lo'o fa'aputu i le kalafi mo fa'ata'ita'iga faigofie.
O mea faigaluega o lo'o avanoa o lo'o fa'asoa fa'atasi i ala fa'atapueata. Mo se faʻataʻitaʻiga, AM62A o loʻo i ai ni ata faʻatusa e lua: MSC0 ma MSC1. O le paipa o loʻo faʻamaonia manino le MSC0 e faʻagasolo ai le meapueata 1 ma le meapueata 2 auala, ae o le MSC1 e faʻapitoa i le meapueata 3 ma le meapueata 4.

O le gaosiga o paipa mea pueata e fa o loʻo faʻaititia i lalo ma faʻapipiʻi faʻatasi e faʻaaoga ai le tiovxmosaic plugin. O lo'o fa'aalia le fa'aaliga i luga o le lau e tasi. O le Ata 4-4 o lo'o fa'aalia ai le fa'atinoga o mea pu'eata e fa ma se fa'ata'ita'iga loloto a'oa'oga o lo'o fa'atinoina le su'eina o mea. O paipa ta'itasi (meapueata) o lo'o tamo'e ile 30 FPS ma le aofa'i ole 120 FPS.

O lo'o soso'o ai le fa'asologa o laina paipa mo le fa'aoga loloto o le fa'aogaina o le telecamera o lo'o fa'aalia ile Ata 4-3.

Iloiloga o Galuega

O le faʻatulagaina ma faʻataʻitaʻiga e fa faʻaaoga le V3Link laupapa ma le AM62A SK na faʻataʻitaʻiina i faʻataʻitaʻiga faʻaoga eseese, e aofia ai le faʻaalia saʻo i luga o se lau, faʻafefe i luga o Ethernet (fa UDP auala), puʻeina i le 4 eseese. files, ma faʻatasi ai ma faʻamatalaga loloto aʻoaʻoga. I faʻataʻitaʻiga taʻitasi, matou te mataʻituina le fua faʻavaa ma le faʻaogaina o pusa CPU e suʻesuʻe ai le gafatia atoa o le faiga.

E pei ona fa'aalia muamua i le Ata 4-4, o lo'o fa'aogaina e le pipeline a'oa'oga loloto le tiperfoverlay GStreamer plugin e fa'aalia ai uta o le CPU o se kalafi pa i le pito i lalo ole lau. Ona o le faaletonu, e toe faafou le kalafi i lua sekone e faaali ai uta o se pasene o le faaaogainatagu. I le faaopoopo atu i le tiperfoverlay GStreamer plugin, o le perf_stats meafaigaluega o se filifiliga lona lua e faʻaali saʻo le faʻatinoga autu i luga o le laina faʻatasi ma se filifiliga mo le teuina i se file. O lenei meafaigaluega e sili atu le saʻo pe a faʻatusatusa i le tTiperfoverlayas e faʻaopoopoina e le vaega mulimuli le uta faaopoopo i luga o le ARMm cores ma le DDR e tusi ai le kalafi ma faʻapipiʻi i luga o le lau. O le meafaigaluega a le perf_stats e masani ona fa'aoga e aoina ai fa'ai'uga o le fa'aogaina o meafaigaluega i fa'ata'ita'iga uma o lo'o fa'aalia i lenei pepa. O nisi o mea taua o le gaosiga ma le accelerators na suʻesuʻeina i nei suʻega e aofia ai masini autu (fa A53 Arm cores @ 1.25GHz), o le loloto aʻoaʻoga faʻavavevave (C7x-MMA @ 850MHz), le VPAC (ISP) ma le VISS ma multiscalers (MSC0 ma MSC1), ma le faʻagaioiga DDR.

Siata 5-1 o loʻo faʻaalia ai le faʻatinoga ma le faʻaogaina o punaoa pe a faʻaaoga AM62A ma faʻataʻitaʻiga e fa mo faʻaoga faʻaoga faʻapitoa, e aofia ai le faʻafefeina o meapueata e fa i se faʻaaliga, faʻafefe i luga o Ethernet, ma puʻeina i le fa eseese. files. E lua su'ega o lo'o fa'atinoina i fa'aoga ta'itasi: na'o le meapueata ma fa'atasi ai ma le loloto o le a'oa'oga. E le gata i lea, o le laina muamua i le Laulau 5-1 o loʻo faʻaalia ai le faʻaogaina o meafaigaluega pe a naʻo le faiga faʻaogaina o loʻo faʻaogaina i le AM62A e aunoa ma se faʻaoga faʻaoga. E fa'aaoga lea e fai ma laina fa'avae e fa'atusatusa i le taimi e iloilo ai le fa'aogaina o meafaigaluega o isi mataupu su'ega. E pei ona faʻaalia i le laulau, o mea pueata e fa ma aʻoaʻoga loloto ma faʻaaliga faʻaaliga e faʻaogaina i le 30 FPS taʻitasi, faʻatasi ai ma le aofaʻi o 120 FPS mo kamela e fa. O lenei fua fa'avaa maualuga e maua i le na'o le 86% o le a'oa'oga loloto accelerator (C7x-MMA) atoatoa le gafatia. E le gata i lea, e taua le maitauina o le faʻavavevave aʻoaʻoga loloto na lokaina i le 850MHz nai lo le 1000MHz i nei faʻataʻitaʻiga, e tusa ma le 85% o lona maualuga maualuga.

Laulau 5-1. Fa'atinoga (FPS) ma le Fa'aaogaina o Punaoa a AM62A pe'ā fa'aogaina i le 4 IMX219 Meapueata mo le Fa'aaliga Mata, Ethernet Stream, Fa'amaumauga i Files, ma le Fa'atinoina o le Fa'aa'oa'oga Fa'aloloto

Talosaga n	Paipa (gaioiga )	Tuuina atu	FPS avg paipa s	FPS atoa	MPU A53s @ 1.25 GHz [%]	MCU R5 [%]	DLA (C7x- MMA) @ 850 MHz [%]	VISS [%]	MSC0 [%]	MSC1 [%]	DDR Rd [MB/s]	DDR Wr [MB/s]	DDR Aofa'iga [MB/s]
Leai se App	Fa'avae Leai se gaioiga	NA	NA	NA	1.87	1	0	0	0	0	560	19	579
Meapueata na'o	Vaitafe i le Mata	Mata	30	120	12	12	0	70	61	60	1015	757	1782
	Vaitafe i luga o Ethernet	PDU: 4 uafu 1920×1080	30	120	23	6	0	70	0	0	2071	1390	3461
	Faamaumauga ia files	4 files 1920x1080	30	120	25	3	0	70	0	0	2100	1403	3503
Cam ma le a'oa'oina loloto	A'oa'oga loloto: Su'esu'eina o mea MobV1- coco	Mata	30	120	38	25	86	71	85	82	2926	1676	4602
	A'oa'oga loloto: Su'esu'eina o mea mobV1- coco ma le Vaitafe i luga ole Ethernet	PDU: 4 uafu 1920×1080	28	112	84	20	99	66	65	72	4157	2563	6720
	A'oa'oga loloto: Su'esu'eina o mea MobV1- coco ma fa'amaumau i files	4 files 1920x1080	28	112	87	22	98	75	82	61	2024	2458	6482

Aotelega
O lenei lipoti o talosaga e faʻamatalaina pe faʻapefea ona faʻatinoina le tele o mea pueata i luga o le AM6x aiga o masini. O loʻo tuʻuina atu i totonu o le lipoti se faʻataʻitaʻiga faʻavae i le Arducam's V3Link Camera Solution Kit ma le AM62A SK EVM, faʻatasi ai ma le tele o mea puʻeata e faʻaogaina ai le fa IMX219 mea pueata, e pei o le tafe ma le suʻeina o mea. E faʻamalosia tagata faʻaoga e maua le V3Link Camera Solution Kit mai Arducam ma toe faʻaoga nei meaamples. O loʻo tuʻuina atu foʻi e le lipoti se auiliiliga auiliili o le faʻatinoga o le AM62A aʻo faʻaogaina ni kamela se fa i lalo o faʻasalalauga eseese, e aofia ai le faʻaalia i luga o le mata, faʻafefe i luga o Ethernet, ma le pueina i le files. O lo'o fa'aalia ai fo'i le agava'a o le AM62A e fa'atino ai fa'ata'ita'iga loloto a'oa'oga i luga o fa'ata'otoga eseese e fa meapueata fa'atasi. Afai ei ai ni fesili e uiga i le faʻatinoina o nei examples, tu'u mai se su'esu'ega ile fono TI E2E.

Fa'asinomaga

AM62A Starter Kit EVM Ta'iala vave amata
ArduCam V3Link Mea pu'eata Solution Ta'iala vave amata
Edge AI SDK pepa mo AM62A
Edge AI Ata Pu'eata Fa'aaogāina le Malosiaga AM62A Processor
Meapue Fa'ata Faiga i luga o AM62A
Avetaavale ma Aufaigaluega Mata'ituina ile AM62A
Quad Channel Meapueata Talosaga mo Si'osi'omaga View ma le CMS meapueata Faiga
AM62Ax Linux Academy i luga o le faʻaogaina o le CIS-2 Sensor
Edge AI ModelZoo
Edge AI Studio
Perf_stats meafaigaluega

Vaega TI o loʻo taʻua i lenei tusi talosaga:

FA'AALIGA TAUA MA LE FA'AVAE

TI TU'UINA FA'AMATALAGA FA'INISINIA MA FA'AMA'ITA'I (E A'OA'O AI FAIGA FA'AMATALAGA), PU'OA'IGA FA'ANIA (E A'OA'O AI FAIGA FA'AVAE), FA'AALIGA PO'O ISI FAUTUAGA FA'AMANATU, WEB METOGA, FA'AMATALAGA SAOLIOE, MA ISI PUNAOA “E PEI AI” MA FA'AVAE UMA, MA FA'AVAE UMA FA'AVAE, FA'AMATALAGA MA FA'AMATALAGA, E A'OMA'I E A'OA'O LE FA'ATA'A SO'O SE FA'AVAE FA'AVAE O LE FA'AFO'A'AI, FA'AMATALAGA MO SE FA'AMATALAGA FA'AVAE. MALAMALAMA .

O nei punaoa ua faʻamoemoeina mo tagata atinaʻe tomai faʻatulagaina ma oloa TI. O oe lava e nafa ma

filifilia o oloa TI talafeagai mo lau talosaga,
fuafuaina, faʻamaonia, ma suʻeina lau talosaga, ma
fa'amautinoaina o lau talosaga e fetaui ma tulaga fa'atatau, ma so'o se isi lava saogalemu, puipuiga, fa'atonuga, po'o isi mana'oga.

O nei punaoa e mafai ona suia e aunoa ma se faʻaaliga. TI fa'atagaina oe e fa'aoga nei punaoa mo na'o le atina'eina o se talosaga e fa'aogaina ai oloa TI o lo'o fa'amatalaina i le puna'oa. E fa'asaina isi toe gaosia ma fa'aalia o nei punaoa. E leai se laisene e tu'uina atu i so'o se isi lava aia tatau tau meatotino a le TI po'o so'o se vaega lona tolu o mea tau le atamai. E fa'afitia e TI le nafa, ma o le a e fa'asala atoatoa TI ma ona sui i so'o se tagi, fa'aleagaina, tau, gau, ma noataga e tula'i mai i lou fa'aogaina o nei puna'oa.

O oloa a TI o lo'o tu'uina atu i lalo o Tu'utu'uga o Fa'atauga a le TI po'o isi tu'utu'uga talafeagai o lo'o avanoa i luga ole laiga ti.com po'o tu'uina atu fa'atasi ma ia oloa TI. O le tu'uina atu e le TI o nei puna'oa e le fa'alauteleina pe suia i se isi itu tu'utu'uga talafeagai a le TI po'o fa'atagaga fa'afitiga mo oloa TI.

E tete'e ma teena e le TI so'o se fa'aupuga fa'aopoopo pe 'ese'ese na e fa'ailoa mai.

FAAMATALAGA TAUA

tuatusi meli: Texas Instruments, Pusa Falemeli 655303, Dallas, Texas 75265

Fesili e Fai soo

Q: E mafai ona ou fa'aogaina so'o se ituaiga meapueata ma le AM6x aiga o masini?

E lagolagoina e le aiga AM6x ituaiga mea pueata eseese, e aofia ai i latou o loʻo i ai pe leai foi se ISP fausia. Va'ai i fa'amatalaga mo nisi fa'amatalaga i ituaiga meapue lagolago.

: O a eseesega autu i le va o AM62A ma AM62P i le faʻatulagaina o ata?

O suiga autu e aofia ai ituaiga meapue lagolago, faʻamaumauga o mea puʻeata, faʻatasi o le ISP HWA, Deep Learning HWA, ma le 3-D Graphics HWA. Va'ai i le vaega fa'amatalaga mo se fa'atusatusaga fa'apitoa.

Pepa / Punaoa

Texas Instruments AM6x Atina'e Tele Meapueata [pdf] Taiala mo Tagata Fa'aoga
AM62A, AM62P, AM6x Atinae Tele Meapueata, AM6x, Atinae Tele Meapueata, Tele Meapueata, Meapueata

Fa'asinomaga

Tusi Taiala

Texas Instruments AM6x Atinae le tele o meapueata

Fa'amatalaga