Caravelli-Traversa-Di Ventra equation

The Caravelli-Traversa-Di Ventra equation (CTDV) is a closed-form equation to the evolution of networks of memristors. It was derived by Francesco Caravelli (Los Alamos National Laboratory), Fabio L. Traversa (Memcomputing Inc.) and Massimiliano Di Ventra (UC San Diego) to study the exact evolution of complex circuits made of resistances with memory (memristors). ^[1]

A memristor is a resistive device whose resistance changes as a function of the history of the applied voltage or current. A physical realization of the memristor was introduced in the Nature paper by Strukov and collaborators while studying titanium dioxide junctions, with a resistance experimentally observed to change approximately in accordance to the model ^[2]

${\displaystyle R(x)=R_{off}(1-x)+xR_{on}}$

${\displaystyle {\frac {dx}{dt}}={\frac {1}{\beta }}I\ \ \ \ \ \ \ \ \ \ \ (1)}$ where ${\displaystyle x}$ is a parameter describing the evolution of resistance, ${\displaystyle I}$ is the current across the device and ${\displaystyle \beta }$ is an effective parameter which characterizes the response of the device to a current flow. If the device decays over time to a high resistance state, one can also add a term ${\displaystyle -\alpha x}$ to the right-hand side of the evolution for ${\displaystyle x}$, where ${\displaystyle \alpha }$ is a decay constant. However, such resistive switching has been known since the late 60's. ^[3] The model above is often called Williams-Strukov or Strukov model. Albeit this model is too simplistic to represent real devices, ^[4] it still serves as a good model exhibiting a pinched hysteresis loop in the current-voltage diagram. However, because of Kirchhoff's laws, the evolution of networks of these components becomes utterly complicated, in particular for disordered neuromorphic materials such as nanowires. ^[5] Often, these are called memristive networks. The simplest example of a memristive circuit or network is a memristors crossbar. A memristor crossbar is often used as a way to address single memristors for a variety of applications in artificial intelligence. However, this is a one particular example of memristive network arranged on a two dimensional grid. Memristive networks have also important applications, for instance, in reservoir computing. ^[6] A network of memristors can serve as a reservoir for nonlinearly transforming an input signal into a high-dimensional feature space. The memristor-based reservoir concept was introduced by Kulkarni and Teuscher in 2012. ^[7] While this model was initially employed for tasks like wave pattern classification and associative memory, the readout mechanism utilized a genetic algorithm, which inherently operates non-linearly. ^[8] A memristive network is a circuit that satisfies the Kirchhoff laws, e.g. the conservation of the currents at the nodes, and in which every circuit element is a memristive component. Kirchhoff's laws can be written in terms of the sum of the currents on node n as ^[9]

${\displaystyle {\frac {dx_{i}}{dt}}=f(x_{i};I_{i})}$

${\displaystyle \sum _{i\rightarrow n}I_{i}=0\ \ \ \ \ (2)}$

where the first equation represents the time evolution of the memristive element's internal memory either in current or voltage, and the second equation represents the conservation of currents at the nodes. Since every element is Ohmic, then, ${\displaystyle V=R(x)I}$  which is Ohm's law and ${\displaystyle x}$ is the memory parameters. These parameters typically represent the internal memory of the resistive device and are associated to physical properties of the device changing as an effect of current flowing through the device or the voltage drop. These equations become quickly highly nonlinear because the memristive device is typically nonlinear, and moreover Kirchhoff's laws introduce a higher layer of complexity. A silver nanowire connectome ^[10] can be described using graph theory, and have applications ranging from sensors to information storage.Since memristive devices behave as axons in a neuronal network, the theory of memristive networks is the theory of nanoscale electric physical devices whose behavior parallels the one of real neuronal circuits. ^[11]

In neuromorphic engineering, the goal is the use of very-large-scale integration (VLSI) systems containing electronic analog circuits to mimic neuro-biological architectures similar to the ones in the nervous system. A neuromorphic computer/chip is any device that uses physical artificial neurons (made from silicon) to do computations. ^[12] The development of the formalism of memristive networks is used to understand the behavior of memristors for a variety of purposes, including modelling and understand electronic plasticity in real circuits. Side applications of such theory is to understand the role of instances in memcomputers and self-organizing logic gates. ^[13]

In a typical memristive network simulation one has to solve first for Kirchhoff's laws numerically, obtain voltage drops and currents for each device, and then evolve the parameters of the memristive device and/or junction to obtain the resistance or conductance. ^[14] This means that effectively, as memristive devices change their resistance or conductance, such devices are interacting. Even for the simple memristor model, such a problem leads to nonlinearities strongly dependent on the circuit realizations. The CTDV equation is a model for the evolution of networks of arbitrary circuits composed of devices such as in eqn. (1), with the inclusion of a decay parameter controlling the volatility. It can be considered a generalization of the Strukov et al. model to arbitrary circuits. ^[15]

For the case of the Strukov et al. model, equations (2) can be written explicitly by integrating analytically Kirchhoff's laws. The evolution of a network of memristive devices can be written in a closed form (Caravelli-Traversa-Di Ventra equation): ^[16]

${\displaystyle {\frac {d}{dt}}{\vec {x}}=-\alpha {\vec {x}}+{\frac {1}{\beta }}(I-\chi \Omega X)^{-1}\Omega {\vec {S}}}$

as a function of the properties of the physical memristive network and the external sources, where ${\displaystyle x_{i}}$ is the internal memory parameter of each device. The equation is valid in the case of the Strukov original toy model and it can be considered as a generalization of the single device model; in the case of ideal memristors, ${\displaystyle \alpha =0}$, although the hypothesis of the existence of an ideal memristor is debatable. ^[17] In the equation above, ${\displaystyle \alpha }$ is the "forgetting" time scale constant, typically associated to memory volatility, while ${\displaystyle \chi ={\frac {R_{\text{off}}-R_{\text{on}}}{R_{\text{off}}}}}$ is the adimensional ratio between the resistance gap and off resistance value. ${\displaystyle {\vec {S}}}$ is the vector of the voltage sources in series to each junction. Instead, ${\displaystyle \Omega }$ is a projection matrix in which the circuit enters directly, by projecting on the fundamental loops of the graph; such matrix enforces Kirchhoff's laws. Interestingly, the equation is valid for any network topology simply by changing the corresponding matrix ${\displaystyle \Omega }$. The constant ${\displaystyle \beta }$ has the dimension of a voltage and is associated to the properties of the memristor; its physical origin is the charge mobility in the conductor. The diagonal matrix and vector ${\displaystyle X=\operatorname {diag} ({\vec {X}})}$ and ${\displaystyle {\vec {x}}}$ respectively, are instead the dynamical internal value of the memristive devices, with values between 0 and 1. This equation thus requires adding extra constraints on the memory values in order to be reliable, but can be used for instance to predict analytically the presence of instantonic transitions in memristive networks. ^[16]

References

1. Caravelli; et al. (2017). "The complex dynamics of memristive circuits: analytical results and universal slow relaxation". Physical Review E. 95 (2): 022140. arXiv: 1608.08651 . Bibcode:2017PhRvE..95b2140C. doi:10.1103/PhysRevE.95.022140. PMID   28297937. S2CID   6758362.
2. Strukov, Dmitri B.; Snider, Gregory S.; Stewart, Duncan R.; Williams, R. Stanley (May 2008). "The missing memristor found". Nature. 453 (7191): 80–83. Bibcode:2008Natur.453...80S. doi:10.1038/nature06932. ISSN   1476-4687. PMID   18451858. S2CID   4367148.
3. Argall, F. (1968), "Switching Phenomena in Titanium Oxide Thin Films", Solid-State Electronics , 11 (5): 535–541, Bibcode:1968SSEle..11..535A, doi:10.1016/0038-1101(68)90092-0
4. Ascoli, A.; Corinto, F.; Senger, V.; Tetzlaff, R. (22 May 2013). "Memristor Model Comparison". IEEE Circuits and Systems Magazine. 13 (2): 89–105. doi:10.1109/MCAS.2013.2256272. ISSN   1531-636X. S2CID   26077752.
5. Kuncic, Zdenka; Nakayama, Tomonobu (2021-01-01). "Neuromorphic nanowire networks: principles, progress and future prospects for neuro-inspired information processing". Advances in Physics: X. 6 (1). Bibcode:2021AdPhX...694234K. doi: 10.1080/23746149.2021.1894234 . ISSN   2374-6149. S2CID   233636661.
6. Tanaka, Gouhei; Yamane, Toshiyuki; Héroux, Jean Benoit; Nakane, Ryosho; Kanazawa, Naoki; Takeda, Seiji; Numata, Hidetoshi; Nakano, Daiju; Hirose, Akira (2019-07-01). "Recent advances in physical reservoir computing: A review". Neural Networks. 115: 100–123. arXiv: 1808.04962 . doi:10.1016/j.neunet.2019.03.005. ISSN   0893-6080. PMID   30981085.
7. Kulkarni, Manjari S.; Teuscher, Christof (2012-07-04). "Memristor-based reservoir computing". Proceedings of the 2012 IEEE/ACM International Symposium on Nanoscale Architectures. ACM. pp. 226–232. doi:10.1145/2765491.2765531. ISBN   978-1-4503-1671-2. S2CID   14350758.
8. Zhang, Yang; Wang, Zhongrui; Zhu, Jiadi; Yang, Yuchao; Rao, Mingyi; Song, Wenhao; Zhuo, Ye; Zhang, Xumeng; Cui, Menglin; Shen, Linlin; Huang, Ru; Yang, J. Joshua (2020). "Brain-inspired computing with memristors: Challenges in devices, circuits, and systems". Appl. Phys. Rev. 7 (1): 011308. Bibcode:2020ApPRv...7a1308Z. doi: 10.1063/1.5124027 .
9. Zhu, Ruomin; Hochstetter, Joel; Loeffler, Alon; Diaz-Alvarez, Adrian; Nakayama, Tomonobu; Lizier, Joseph T.; Kuncic, Zdenka (2021). "Information dynamics in neuromorphic nanowire networks". Scientific Reports. 11 (1): 13047. Bibcode:2021NatSR..1113047Z. doi:10.1038/s41598-021-92170-7. PMC   8219687 . PMID   34158521.
10. Milano, Gianluca; Miranda, Enrique; Ricciardi, Carlo (2022-06-01). "Connectome of memristive nanowire networks through graph theory". Neural Networks. 150: 137–148. doi:10.1016/j.neunet.2022.02.022. hdl: 11696/73972 . ISSN   0893-6080. PMID   35313246.
11. Caravelli, Francesco; Milano, Gianluca; Ricciardi, Carlo; Kuncic, Zdenka (2023). "Mean Field Theory of Self-Organizing Memristive Connectomes". Annalen der Physik. 535 (8). arXiv: 2301.10145 . Bibcode:2023AnP...53500090C. doi:10.1002/andp.202300090.
12. "002.08 N.I.C.E. Workshop 2014: Towards Intelligent Computing with Neuromemristive Circuits and Systems – Feb. 2014". digitalops.sandia.gov. Retrieved 2019-08-26.
13. Bearden, S. R. B.; Manukian, H.; Traversa, F. L.; Di Ventra, M. (27 March 2018). "Instantons in Self-Organizing Logic Gates". Physical Review Applied. 9 (34029): 034029. arXiv: 1708.08949 . Bibcode:2018PhRvP...9c4029B. doi:10.1103/PhysRevApplied.9.034029.
14. Milano, Gianluca; Miranda, Enrique; Ricciardi, Carlo (June 2022). "Connectome of memristive nanowire networks through graph theory". Neural Networks. 150: 137–148. doi:10.1016/j.neunet.2022.02.022. hdl: 11696/73972 . PMID   35313246.
15. Wang, Wei; Song, Wenhao; Yao, Peng; Li, Yang; Van Nostrand, Joseph; Qiu, Qinru; Ielmini, Daniele; Yang, J. Joshua (18 December 2020). "Integration and Co-design of Memristive Devices and Algorithms for Artificial Intelligence". iScience. 23 (12). Bibcode:2020iSci...23j1809W. doi:10.1016/j.isci.2020.101809. PMC   7718163 . PMID   33305176.
16. Caravelli; et al. (2021). "Global minimization via classical tunneling assisted by collective force field formation". Science Advances. 7 (52): 022140. arXiv: 1608.08651 . Bibcode:2021SciA....7.1542C. doi:10.1126/sciadv.abh1542. PMID   28297937. S2CID   231847346.
17. Abraham, Isaac (2018-07-20). "The case for rejecting the memristor as a fundamental circuit element". Scientific Reports. 8 (1): 10972. Bibcode:2018NatSR...810972A. doi:10.1038/s41598-018-29394-7. ISSN   2045-2322. PMC   6054652 . PMID   30030498.

External links

• Memristive Circuits - MIT Net Advances in Physics, Accessed January 9, 2024
• Memcomputing and Instantons, NASA, Accessed January 9, 2024
• Kirchhoff's laws and memristive circuits, Bachelor thesis, Accessed January 9, 2024
• F. Sheldon thesis, PhD thesis, Accessed January 9, 2024
• Talk by JP Carbajal, Caravelli-Traversa-Di Ventra equation for optimization (minute 40), Accessed January 9, 2024