INTRODUCTION
Research background
The von Neumann architecture performance was remarkably improved by downsizing and increasing the number of transistors pursuant to Moore’s law [1] However, recently, the number of transistors on a chip were reached the limit and got more difficult for further improving computation performance Simultaneously, advances in the development of artificial neural networks necessitate the creation of new chip platforms capable of supporting them with high power efficiency [2] To address such issues, neuromorphic computing was proposed Neuromorphic device is an integrated circuit that replicate the structure of live neuron cells, particularly for brain simulation, which initially coined in 1990 by Carver Mead [3] The human brain outperforms supercomputers in terms of computing power due to its fast signal processing speed and low power consumption [4] Human brain is composed by billion neurons are connected and transmit information via synapses Synapses, which construct a small gap between neurons that plays an analog logic and learning role in a neural network [5] Synapses in a brain network transmit electrical signal from presynaptic to postsynaptic neurons to create a decision This process could be reproduced in an electronic device, allowing us to potentially imitate the operation of the brain by replicating the essential functions of biological synapses [6] Unconventional computing refers to computational frameworks that are inspired by the dynamics of natural systems, such as biological brains, to accomplish transformational advancements in cognitive technology [7] In order to overcome the restrictions of traditional materials and procedures, researchers investigating "non- von Neumann" solutions, that is expected to have a low power consumption and the ability to handle increasingly complex problems
Artificial neural networks (ANNs) are computational models that simulate neurons and their networks An ANN is made up of three layers: input layer, hidden layer, and output layer They are represented a neuron-like network interconnected via binding weights between layers, known as synapse-like weighted links, which indicates the strength of the connections between neurons Feedforward networks (FNNs) and recurrent networks (RNNs) are the two most common ANN network architectures FNNs are recommended for static (non-temporal) data processing, whereas RNNs are preferable for dynamic (temporal) data processing Besides that, because of their distinct feedback connections, RNNs are capable of simulating dynamical systems driven by sequential inputs
Figure 1.1 Structure comparison between feedforward neural network (FNN, left) and recurrent neural network (RNN, right) The yellow circles, blue circles and green circles represented input layer, hidden layer, and output layer, respectively While FNN recommended to independent data, the output of RNN depend on the prior elements within the sequence, hence, the RNN has their distinct feedback connections in the hidden layer
The motivation for physical neural network implementation is to create fast information processing devices with low learning cost We rely primarily on advanced material science for this physical implementation ANNs models have recently been widely used in material science because of their unique features, which
3 allow them to be used as an alternative in electrical circuits with dynamic data processing [8] Among the possible applications of various designs of material-based neural networks, reservoir computing (RC) is a promising route RC is originally a recurrent neural network (RNN) based framework, therefore, it’s suitable for dynamic (temporal) information processing As compared to conventional recurrent neural networks, RC offers the possibility of being able to learn quicker at a lower cost [9] Its implementation based on an algorithm that learn data changes over time, input data are transformed into spatiotemporal pattern in a high-dimensional space by an RNN in the reservoir, then a pattern analysis from the spatiotemporal patterns is performed in the readout The network nodes in the reservoir should change over time according to the input, as a result, the internal state of the reservoir is determined by both past and present inputs [10]
Figure 1.2 RC framework where a reservoir for nonlinear mapping input into a high- dimensional computational space (Left) The reservoir random network is unregulated and only the readout is trained by a simple supervised readout layer to learn the linear combinations of network states Here, Ag/Ag 2 S aggregated NPs plays the role as reservoir layer by create a randomly connected network and combining with electrodes pattern to replicate RC system (Right)
As illustrated in Figure 1.2, on the left side, a RC system consists of the input layer transmits time inputs, the reservoir, a nonlinear randomly connected network, for mapping input into a high-dimensional computational space, and the outputs layer is linked to a higher dimensional computational space The reservoir random network is unregulated and only the readout is trained by a simple supervised readout layer to
4 optimizing the output weights and hence target task can be constructed just by performing a weighted linear combination of all the outputs As a result, the main benefit of RC over other neural network methods is quick learning, which results in a lower training cost Another benefit is that the dynamic behavior of reservoir random network may be advantageously implemented in hardware utilizing a variety of physical system in substrates and devices For instances, RC could also be applied in a variety of physical systems such as photonic and memristive systems [11], thus, such physical reservoir computing is receiving increased attention in a variety of scientific areas The physical realization of RC models has gained a lot of interest Any system that is capable of exhibiting nonlinear dynamical responses has the potential to function as a reservoir [11] A material-based reservoir must meet certain requirements in order to operate computing efficiently Nonlinearity, phase shift and high dimensionality are three of these prerequisites [12] When a RC system parameter variation causes a transition between non-chaotic and chaotic regimes, it is often recommended that the parameter be set close to the transition point (the so- called edge of chaos) where the transformation by a reservoir is neither very expanding nor very contracting [11] This edge of chaos condition is crucial for all
RC computing However, because it is difficult to check in a material reservoir, these three properties are chosen instead of the edge of chaos These electrical characteristics are needed for in-materio RC devices because they must demonstrate nonlinear sequential input into a high-dimensional computational space The nonlinearity property enables reservoir to function as a nonlinear mapping, it is also essential for efficiently extracting nonlinear dependencies of input High dimensionality is necessary to map input into high-dimensional space The dimensionality related to the number of independent signals obtained from reservoir This characteristic enables the extraction of input's spatiotemporal dependencies Another essential property is phase shift, which represent for the influence of past inputs on current reservoirs state This feature is especially crucial for describing sequential data with short-term memory
In this nanoscale era, the advances in nanoscale technology are boosting a great impulse towards the miniaturization of device manufacturing, integration, and system design Furthermore, nanoscale techniques have an enormous potential for developing novel materials and devices with distinct properties, balancing thermodynamic and kinetic effects A hardware technique created employing nano- architectural approaches, provides a framework for the development of biologically inspired nanoscale logic and memory devices, known as the atomic switch [13] The atomic switch is a memristive electro-ionic circuit element which provides multistate, nonlinear switching and synapse-like memory characteristics, operating through a bias-driven filamentary switching mechanism across a metal–insulator–metal junction [14] A complex network comprised of nanomaterials (such as overlapping nanowire junctions [15] or aggregated nanoparticles [16]) enables the formation of a group of atomic switches The distributed nonlinear dynamics of the atomic switching network (ASN) make it an ideal candidate for RC
Considering their properties, noble metals such as silver nanomaterials are among the most intriguing elements Recently, there has been a surge of interest in the study of the electrical characteristics of Ag/Ag2S, especially for its atomic switching network construction Some Ag/Ag2S topologies and structures such as thin films [17] or nanowires [14] was investigated which manifesting atomic switching behavior, results in a consistent in I-V nonlinearity behavior and higher harmonics generation, exhibiting neuromorphic features Such traits are projected to be improved by increasing relative surface area and built more interaction between the nanomaterials Here, we investigated Ag/Ag2S nanoparticles (NPs) which has large surface area In this study, the purpose is to investigate whether Ag/Ag2S aggregated NPs enable to play the role as reservoir layer by create a randomly connected network and combining with electrodes pattern to replicate RC system, as illustrated on the right side of Figure 1.2 Several investigations on nanomaterial-enabled RC computing in physical devices have been conducted, which are combined as references and
6 guidelines to inspire us to perform this work Some representations were discussed in the following section.
Literature survey: in-materio unconventional computing
1.2.1 Atomic switch networks for reservoir computing
A next-generation computing system by ASN device which utilize Ag/Ag2S nanowire junction has been reported [15] This ASN device contained 128 measurement electrodes, which is fabricated by using conventional lithographic methods by patterning platinum onto a thermally oxidized Si wafer followed by insulation with SU-8 and evaporated copper grid (Figure 1.3(a)) In the center, a complex network of overlapping silver nanowire junctions grown onto a multi- electrode array is functionalized to produce Ag∣Ag2S∣Ag atomic switches with controllable densities of up to 10 9 junctions/cm 2 , as shown in insect of Figure 1.3(b) The atomic switch operation is regulated by filament formation between silver nanowire junctions, result in this ASN device exhibit non-linear characteristics, validated for memristive activity, as depicted in Figure 1.3(b)
Figure 1.3 (a) Next-generation atomic switching network (ASN) device structure comprise of 128 lithographically patterned platinum measurement electrodes, insulating SU-8 dielectric layer point contacts and evaporated copper grid (b) Memristive-like non-linear characteristics observed in single junctions of ASN device Inset: enlarge view of silver nanowire junctions in the device center region
Utilizing the dynamic, non-linear guided by interacting atomic switches from silver
7 nanowire junctions, the ASN device was applied to the RC benchmark task of waveform generation A 11 Hz bipolar sinusoidal voltage was injected to ASN for inducing switching activity, and the readout output was collected to optimized target wave forms: cosine, triangle, sawtooth square The experimental accuracies in the 70–90% range were obtained, using 62 measurement electrodes, as shown in Figure 1.4
Figure 1.4 Result of RC benchmark task: waveform generation for ASN device with Ag/Ag 2 S nanowire junction
1.2.2 Gold nanoparticles network for reconfigurable Boolean logic
In an effort to realize unconventional computing in terms of materials engineering, a novel approach wherein new materials trained with new computational models can evolve as artificial intelligent systems to mimic logic gate functions One such in- materio unconventional computing was studied in disordered Au nanoparticles, where the non-linear negative differential resistance output response was reconstructed to reconfigurable Boolean logic operations via real-time voltage optimizations with Evolutionary algorithm [16] As shown in Figure 1.5 the device uses the nonlinear behavior generated by the interconnection of a disordered Au
8 nanoparticle network assembly in a 200 nm diameter circular area between the eight Ti/Au electrodes At a low-temperature environment (≈ 0.3 𝐾), the device exhibits Coulomb blockade and employs single-electron tunneling (SET) features VIN1 and
VIN2 are used as two electrodes input which introduced time-varying voltage signals The other six electrodes are used to apply static control voltages V1–V5 and measure the resultant current IOUT A static voltage V6 is also applied to the back gate Based on the strongly nonlinear (switching) behavior of the SETs and their mutual interactions, these configuration voltages are repeatedly utilized to realize fully reconfigurable, robust Boolean logic in disordered Au NP networks
Figure 1.5 Schematic of disordered Au nanoparticles network reconfigurable Boolean logic The Au NPs, which are coupled by insulating molecules (1-octanethiols), are confined in a circular area (200 nm in diameter) constructed from 8 radial metal (Ti/Au) electrodes on top of a highly doped Si/SiO 2 substrate, which serves as a back gate At low temperature (≈
0.3 𝐾), as a result of the Coulomb oscillations of the individual NPs, this disordered NP assembly generates an interconnected network of robust nonlinear periodic switches These non-linear negative differential resistance output responses were reconstructed to reconfigurable Boolean logic operations via real-time voltage optimizations with Evolutionary algorithm.
However, the drawback for this demonstration lay in the operating temperature condition is near-zero K, along with time inefficient training as each V parameter had to be trained individually Therefore, in the field of material-based machine intelligence, what we desire for is a room temperature computation with straightforward and simultaneous parameter optimization model
1.2.3 Spoken digit classification with silver iodide (AgI) nanowire networks
Another investigation the ability of silver nanomaterials enables to realize physical
RC was conducted by Sam Lilak et al [18] An atomic switch networks comprising silver iodide (AgI) junctions has been physically characterized and utilized to classify spoken digit audio data In this work, silver iodide was produced at ambient temperature by reaction of iodine vapor with silver nanowires in vapor phase This material provides voltage-controlled resistance in both the bulk and when integrated into crossbar architectures, rendering it suitable as a memristive material for RC applications As show in Figure 1.6, a 16-electrode grid of Pt was fabricated by photolithography, metal deposition and lift-off process, served as substrate for AgI ASN device enabling spatiotemporal stimulation and monitoring AgI nanowire networks was tested for non-linear, temporal computation through the spoken digit classification
Figure 1.6 Schematic diagram of an AgI-based ASN device, from nanowire junction to chip (a) Filament formation process between two AgI nanowire junction (b) Enlarge view of AgI nanowire network from scanning electron microscopy (SEM) image and optical image at the center of 16-electrode pattern
Figure 1.7 (a) Flow chart for spoken digit recognition RC task using ASN-based devices involved encoding and separation of raw audio data into mel-frequency Individual mel- frequency was arranged to minimize input thrashing and then introduced as input voltage to the ASN device Output data was collected from the rest electrodes (b) Performance of the spoken digit classification task, as compared to using the “Input Only” mode, task performance was improved by the “Reservoir” readout method, as depicted via mean accuracy and standard deviation Task performance still can be maintained under low- power operation of AgI ASNs
AgI devices displayed distributed nonlinear dynamics over the whole nanowire network, resulting in a stable and repeatable nonlinear modification of the input signal Based on these qualities, AgI nanowire networks were examined for spoken digit recognition RC task, as shown schematically in Figure 1.7(a) Firstly, raw audio data (spoken digit voice) were encoding and separation of into mel-frequency cepstrum coefficients (MFCCs) Individual MFCCs was arranged to minimize input thrashing and then introduced as input voltage to the ASN device Output data was collected from the rest electrodes and optimized by linear regression The result was depicted in Figure 1.7(b), the ASN reservoir demonstrated highly accurate, as compared to using the “Input Only” mode, task performance was improved by the “Reservoir” readout method, as depicted via mean accuracy and standard deviation Task performance still can be maintained under low-power operation of AgI ASNs across a wide range of input voltages (0.5–10 V)
The novel AgI-based ASN devices described here acted as a dynamic, memristive reservoir for nonlinear temporal data processing and proved the potential to effectively classify spoken digits with high accuracy
Combining all those preceding studies, these silver nanomaterial networks constitute both a promising material system ripe for further exploration and a possibility to advance the paradigm of in-materio RC computing forward practical applications Hence, silver nanomaterials, particularly silver nanoparticles are considered as ideally research subjects in our study
Outline of research
In the present study, we report the utilizing of Ag/Ag2S nanoparticles for developing material-based RC The purpose is to investigate the possibility of using Ag/Ag2S nanoparticles to develop a new computing paradigm called in-materio reservoirs
Firstly, chapter one introduces the motivation, research field and literature survey to draw the objective and research scope for this study Chapter two explains detail about synthesis material process, device fabrication and experiment set up for characterizing Ag/Ag2S NPs device
Secondly, the characterization methods and working principle were investigated The structural properties of Ag/Ag2S nanoparticles are confirmed by X-ray diffractometry (XRD) and transmission electron microscopy (TEM) Electrical characteristics are investigated via current-voltage (I-V) and voltage-time (V-t) measurement by using a Source Meter and a multifunctional data acquisition system The characteristics requirements for building the in-materio physical reservoir computing, such as nonlinearity, high dimensionality, and phase shift have been investigated These procedure and result depict in chapter three
Lastly, after demonstrating that the Ag/Ag2S nanoparticle aggregates had the nonlinearity electrical behavior and additional characteristics required for RC hardware namely phase-shift and higher harmonics which are vital for the implementation of RC computing, in chapter four, RC benchmark task waveform generation is realized by a linear combination of outputs Others more complicated
RC task such as: objects classification, Boolean logic operations and spoken digit classification are also performed with microscale platinum electrodes to implement the nonlinear dynamics of Ag/Ag2S nanoparticles Finally, chapter five presents the conclusion of this study along with some specific suggestions.
METHODOLOGY
Ag/Ag 2 S nanoparticles synthesis
The Ag/Ag2S nanoparticles were synthesized at room temperature by modified Brust- Schiffrin procedure [19] referring from earlier study of C Battocchio et al [20] As illustrated in Figure 2.1, experiment process is as follow: 200 mg silver nitrate (Signa- Aldrich, MW: 79.55 gr/mol) in deionized (DI) water was mixed with toluene solution of 360 mg tetraoctylammonium bromide (Signa-Aldrich, MW: 546.79 gr/mol), then 0.37 ml allyl mercaptan (Tokyo Chemical Industry, MW: 17.03 gr/mol) in toluene was added to the solution and left to react for 30 minutes while being stirred magnetically Subsequently, a reducing agent of 260 mg sodium borohydride (Tokyo Chemical Industry, MW: 37.83 gr/mol) solution in DI water was added to the mixture and allowed to react for 2 hours under magnetically stirred The water phase was then removed, and 250 ml ethanol was added to wash the excess of allyl mercaptan and toluene solution The obtained solution then centrifugated at 4000 rpm for 20 minutes to separate the nanoparticles from the liquid phase The Ag/Ag2S NPs was attained and ready to be used for further experiments
Figure 2.1 Ag/Ag 2 S NPs was synthesized following Brust-Schiffrin method
Device fabrication
For device realization, the optical lithography along with metal deposition was used to create the metal 16 electrodes Firstly, electrodes pattern was designed by LayoutEditor software and used as the model for optical lithography Next, SiO2/Si substrate was washed with acetone, immersed in isopropyl alcohol (IPA), washed again by DI water, each step takes 5 minutes, then dried with N2 gas Thereafter, 1 àm thickness of LOR-10 was put onto substrate using spin coater under 3000 rpm for
50 s, followed by heated it on hot place in 5 mins under 180 ℃ Then, 1.8 àm thin, homogenous layer of photosensitive resist is covered the substrate by sprinkling resist solution (S1818G filtered by 0.45 àm PTFE filter paper) onto the sample, which is then spun at 4000 rpm for 20 s After baking the resist on hot plate (90 ℃, 5 mins), the sample is placed in a mask aligner, which is equipped with a high-powered light source performed by SUSS MicroTec photolithography machine, that exposes the resist film through the mask By immersing the sample in developer MF-319 for 1 min, the corresponding parts of the resist film are removed, then rinse by DI water and dried with N2 gas The metallization step was done by depositing Pt/Ti (electrode material) with 24/6 nm of thickness on a SiO2/Si substrate, following metallization, the resist is typically removed by dimethyl-sulfoxide at 80 ℃ for 40 mins under sonicating in a lift-off process There is a circular gap with 30 àm diameter in the central of electrodes array and the distance between two nearest electrodes is 4.5 àm The 16 platinum electrodes pattern was archived and the RC in-materio reservoir device was formed by drop-casted 5 àL of the synthesized Ag/Ag2S NPs on the center of electrodes while putting on a hot plate set at 50 ℃ for ethanol solvent evaporation
A chip package was fabricated for the device, each electrode was connected to a pin, hence, multiples output electrodes could be recorded simultaneously to investigate the dynamic computing inside a reservoir The device realization procedure was briefly illustrated in Figure 2.2
Figure 2.2 (a) The Ag/Ag 2 S NPs in-materio RC device realization by drop-casting those particles onto 16-electrodes produced by optical lithography, as a result the device was fabricated The optical microscope image shows the center area enlarged view of electrodes pattern There is a circular gap with 30 àm diameter in the central of electrodes array and the distance between two nearest electrodes is 4.5 àm (b) A chip package was fabricated for the device with each electrode was connected to a pin for simultaneously measurement
Characteristic measurement
To explore the characteristics of produced nanoparticles, a variety of characterization approaches were studied X-ray diffraction spectrometry (XRD) and transmission electron microscopy (TEM) were used to investigate the structural properties of Ag/Ag2S NPs such as element identification, morphology, and particle size
X-ray diffraction (XRD) is a method for analyzing crystalline materials Ag/Ag2S NPs sample preparing for XRD characterization is required in powder form Following a successful synthesis as mentioned above, the Ag/Ag2S nanoparticle in ethanol solvent was collected and centrifuged, followed by a drying of the precipitates to get nanoparticle powder as show in Figure 2.3 (a) In this study, the sample was analysis using an X-ray diffractometer (Rigaku RINT-2100) with Cu Kα radiation at
40 kV (λ = 0.154 nm) The scan rate was 0.02 degrees per second This method's operating process relies on an emitted X-ray beam with a λ wavelength that assails lattice structure in a crystal plane at an θ angle The result for XRD characterization will be shown in section 3.1.1
Figure 2.3 (a) The sample holder covered by Ag/Ag 2 S powder prepared for X-ray diffraction (XRD) analysis process (b) X-ray diffractometer (Rigaku RINT-2100) picture.
Transmission electron microscopy (TEM) is a method for examining the characteristics of extremely tiny objects particularly in nanoscale In this study, transmission electron microscopy (TEM, JEOL-2100) with acceleration voltage at
200 kV was utilized for morphology analysis of Ag/Ag2S nanoparticles Because the wavelength of an electron is substantially short, TEM was used to examine particles at much higher magnification and resolution Compared to scanning electron microscope, which can only scan and observed the sample's surface, TEM also produces better resolution pictures From TEM image the morphology of nanoparticles is able to observe, and the particles diameter can be calculated Sample preparation for TEM is also simple, there is a sample holder have grid shape and the Ag/Ag2S NPs in ethanol solvent was drop into the grid then get it dry by using hot plate at 50 ℃, the sample holder image and sample preparation are briefly illustrated in Figure 2.4 This is how TEM operate: a beam of electrons is fired by an electron gun Using extreme high-level voltages of up to several million volts, electrons were accelerated to exceedingly high speeds The vacuum system is required to ensure the acceleration process Then, a condenser lens focuses the electron beam into a narrow beam Electrons pass through the ultra-thin specimen and depending on the transparent degree of the sample to electrons, some components of the beam are transmitted The objective lens converts the sample's output beam into a picture The TEM analysis result will be shown in section 3.1.2
Figure 2.4 Transmission electron microscopy (TEM) sample preparation and TEM sample grid holder structure
The purpose of fabricating the device is to investigate the possibility of Ag/Ag2S nanoparticles to be used as an in-materio reservoir computing hard-ware Therefore, the required electrical property of RC devices must appear on this Ag/Ag2S NPs device Several characterization techniques, including current-voltage (I-V) characteristics and RC characterize measurement, were used to explore the electrical properties of the Ag/Ag2S nanoparticles-based device
Current-voltage measurement was carried out by using a Source Meter (Keithley 2400) The experiment set up was shown in Figure 2.5, the Ag/Ag2S NPs device was connected to probe via a Source Meter, to extract the electrical responses a bias 0 V to 4 V with 0.02 V step voltage in 1000 milliseconds time step was repeatedly applied sweeping of forward and reversed to the device, a 1 mA compliance current was set at to prevent the device damage A PC wired to Source Meter with LabView software functionalized to control the measurement procedure The I-V data were recorded at ambient temperature
Figure 2.5 Current-voltage measurement set up by using a Source Meter (Keithley 2400) The experiment was carried out under room temperature.
Time series data is the most commonly used sort of data for RC tasks Exploiting the material network's dynamics is critical for RC to be efficiently trained to perform a given task Therefore, it is essential to build up a measuring system that enable to record multiple output signals from different points of the Ag/Ag2S network over time to be used as the reservoir states The Ag/Ag2S NPs device was connected to a measuring system that was set up to execute the RC characterization and RC tasks indicated in Figure 2.6 The input signal caused the dynamics of the Ag/Ag2S network is fed through a signal generating device (which can generate the desired input data) Subsequently, the multifunction data acquisition DAQ (National Instruments PXIe- 6363) system measures and reads output signals gathered simultaneously from multiple electrode pads of the device design Multifunction DAQ’s wires link the electrode to the electrical probes To monitor the I/O signals, the PC plays the role as a software interface between the signal generating device and the DAQ using the LabVIEW program
Figure 2.6 Schematic of an electrical measurement setup used for obtaining the dynamic outputs for constructing the RC characterization and carrying out RC task The Ag/Ag 2 S reservoir device receives an input signal from the signal generating device via the input electrical probe, and the corresponding individual outputs from the device's numerous electrodes are read by the DAQ via the output electrical probe and the PC using LabVIEW for software optimization.
DEVICE CHARACTERIZATION
Structural properties
3.1.1 X-ray diffraction spectrometer (XRD) result
For element identification for obtained nanoparticles, X-ray diffractometry (XRD, Rigaku RNIT-2100) with Cu Kα radiation 40kV (λ = 0.154 nm) and scanning rate was 0.02 °/s was performed Figure 3.1 show the XRD profiles of the synthesized nanoparticles with the inset is enlarged view for the Ag2S peaks area indicated by blue squares which is overwhelmed by Ag peaks intensity indicated by orange circles The Ag and Ag2S phase in XRD result was matched with the references of PDF No: 01-071-3762 Quality: I [21] and PDF No: 01-075-1061 Quality: B [22], respectively
As shown in the XRD profile, these two substances were assigned to the acquired peaks, and it was proven that the Ag2S phase and the Ag phase coexistence in the produced nanoparticles
Figure 3.1 Synthesized Ag/Ag 2 S NPs structure characteristics X-ray diffractometry (XRD) pattern for archived nanoparticles sample, the obtained peaks were attributed to Ag and
Ag 2 S peaks, and it was confirmed that these two substances coexistence in the produced nanoparticles
3.1.2 Transmission electron microscopy (TEM) result
The morphology of Ag/Ag2S nanoparticles were confirmed by transmission electron microscopy (TEM, JEOL-2100) with acceleration voltage at 200 kV As shown in Figure 3.2(a), nanoparticles have spherical forms, the average particle sizes were estimated by calculating the diameter from measuring the area of nanoparticles from TEM images using Image J software To determine the average diameter of nanoparticles, a Gaussian curve was fitted to the histogram of particle size distribution obtained from TEM image analysis, the average diameter was specified around 31.37 nm, which is depicted in Figure 3.2(b)
Figure 3.2 (a) Transmission electron microscopy (TEM) image of Ag/Ag 2 S NPs with 100 nm scale bar (b) The distribution of the diameters of particles calculated from TEM image, the average diameter of synthesized sample was extracted by fitting with Gaussian curve for histogram of particles size distribution The average of particles diameter approximate 31.37 nm with standard deviation is around 15.53.
Electrical properties
3.2.1 Current-voltage characteristic result (Non-linearity behavior)
To investigate the electrical properties, current-voltage measurement was carried out by using a Source Meter (Keithley 2400) The repeated sweeping of forward and reversed bias 0 V to 4 V with step voltage 0.02 V each one second was applied to the
22 device, the compliance current was set at 1 mA to prevent the device damage As depicted in Figure 3.3(a) an intensely nonlinear response and a gradually increase in the output current were observed In the first sweep, the current began to raise at 3 V and reached 0.5 mA, allowing the development of certain silver filaments among the nanoparticles During the first sweep's reverse bias, the output current displayed nonlinear response with the curve of forward sweep and the current slowly decreased, representing filament disintegration Following that, in the second sweep, the output current began to rise at an applied bias voltage of around 0.8 V, which was lower than the first sweep Furthermore, considerable current variations occurred in the 2V to 4V range, indicating the production and destruction process of conduction paths proceeded randomly at various gap sites among NPs A sufficient potential applied across the nanoparticles is the source for the production and destruction of silver filament between the particles When the bias voltage was connected to the system, an amount of charging electrons was introduced into the device, initiating the redox reaction process at the surface of Ag/Ag2S nanoparticles [23] The gap between each nanoparticle was created by Ag2S and the organic layer, after the voltage was applied,
Ag nanoparticles oxidized the electrode, Ag + ions were reduced by the electron injected, silver metallic bridges were generated by the breakage of the insulating layer, and the conduction paths was formed among the nanoparticles Additional bias sweep results in the gradually increase of the output current up to reach the compliance current 1 mA, indicating a strong connection was generated in the Ag/Ag2S nanoparticles network, as shown in the third sweeping voltage
Figure 3.3 Electrical characteristics of Ag/Ag 2 S RC device (a) Current-voltage curves of the device after multiple reverse and forward bias sweeps 0 to 4 V that showing nonlinear responds and gradually increase in currents, indicating the randomly forming process of conduction paths inside Ag/Ag 2 S networks (b) Input a cycle bias in the range of -4 V to 4 V result in switching with pinched hysteresis can be observed in both negative and positive voltage regions
For further understanding the nonlinear transformation characteristic provided by the Ag/Ag2S reservoir systems, a cycle bias in the range of -4 V to 4 V also with 0.02 V step voltage in 1000 milliseconds time step was injected to the device As shown in Figure 3.3(b), there were switching with pinched hysteresis can be observed in both negative and positive voltage regions It worth to notice that the current start to
24 behave switching at approximately same voltage value around 3 V to 4 V in both areas, indicating the nonlinear switching characteristic of Ag/Ag2S NPs device enable to manifest in bipolar or unipolar potential applied
Beside the non-linearity feature, a reservoir must also create diverse dynamics inside the network to assist in reservoir task The current state of the reservoir is dependent on current input and previous reservoir state as described in Equation 3.1 [11]:
Where 𝑋(𝑡), 𝑓, 𝑤 !" , 𝑈(𝑡), 𝑤 #$% and 𝑋(𝑡 − 1) are reservoir state at the time 𝑡, activation function, input weight, input state, reservoir weight and reservoir state at past time 𝑡 − 1, respectively Therefore, another requirement for RC device is the phase shift property that delays the output signals result in complex dynamic evoked from material network system, which is essential for enabling RC performance For investigating this phenomena, Ag/Ag2S NPs network was perturbated by a bipolar sinusoidal wave with frequency 11 Hz, peak amplitude 1 V and multiple responses reflect on the rich reservoir states were recorded by using a multifunction data acquisition DAQ The result was depicted in voltage–time (V–t) curves for sinusoidal inputs and nonlinearly responses outputs As shown in Figure 3.4(a), the form and phase of the output waves varies for each output, represented by three typical output signals: O13, O14, O15 For analyzing phase-differences between given input and output voltage, Lissajous curve plot was applied to all outputs readout from 15 electrode pads of Ag/Ag2S NPs device, and the result was performed in Figure 3.4(b)
Figure 3.4 (a) Voltage-time curves of a sinusoidal input signal with frequency 11 Hz, 1 V peak amplitude and their corresponding nonlinear outputs (b) Lissajous plot of output from
15 electrode pads versus input voltage shown the ellipse shape indicated phase shift properties of Ag/Ag 2 S NPs RC device
The voltage–time plots show various phase differences between the input and the outputs, indicating delayed output All of 15 delayed outputs were then plot as Lissajous curves exhibited nonlinear relationship between the input and output voltages via amplitude and phase changes The elliptical shape of the Lissajous plot obtained for the NPs-based device is desirable since it reveals as a complex network Ag/Ag2S NPs enable to induce phase delays Thus, from the above result the device possessed phase shift property and has the potential for developing RC device
RC devices must have nonlinearly transformed sequential input into high- dimensional computational spaces as an electrical attribute [11] To further investigate RC characteristics of the device, a bipolar sinusoidal wave with frequency
11 Hz and peak amplitude 1 V, 3 V and 4 V respectively was applied to the device for perturbation After recording the output signal and converted it by fast Fourier transform (FFT) to obtain an output amplitude characteristic in frequency domain and plotted in log-scale The current response contains harmonics of the excitation frequency A harmonic frequency is one that is equal to an integer multiplied by the fundamental frequency As depicted in Figure 3.5(a)-(c), the even and odd harmonic were generated in all the cases The intensity and quantity of higher harmonic were increase with the higher amplitude of input sinusoidal wave Especially, in case of 4Vpp the device was achieved the richest higher harmonic with over 15 odd and even overtones Moreover, as compared in Figure 3.5(d) the averaged intensities of 15 readout channels for odd and even harmonics frequency for each input peak amplitude showing the outstanding rate of harmonic generation when 4Vpp was applied This phenomenon results from the aggregated of Ag/Ag2S NPs which creates non-linear redox reactivity in various levels at multiple gap-points in the network, thus conduction paths with different electrical properties of resistive or capacitive were created [15][16] As a result, high dimensional information of the outputs with regard to amplitude and frequencies was generated When these random networks are perturbed by sinusoidal wave, charge-discharge processes from simultaneously
27 varied input intensities occur due to their diverse redox states and varying degree between Ag/Ag2S nanoparticles This result is consistent with the current-voltage characteristic as previous analysis in Figure 3.3(a), there was an intense fluctuation in current occurred around bias voltage 4 V, indicate the charge-discharge process strongly arise between various gap-points of nanoparticles Therefore, input amplitude 4 V was used to perform these following supervised learning tasks to Ag/Ag2S NPs in-materio reservoir device The device exhibits high-dimensional mapping, which is required for attaining classification tasks with high accuracy
Figure 3.5 Fast Fourier transform spectrum of output current after applied a bipolar sinusoidal wave with 11 Hz frequency and peak amplitude 1 V (a), 3 V (b), 4 V (c), respectively Higher harmonic generation property was observed in frequency domain indicates that the device exhibits high-dimensional mapping (d) Average intensities of 15 outputs for odd and even harmonics frequency compared between peak amplitude 1 V, 3 V and 4 V showing the outstanding rate of harmonics generation in case of 4 V peak applied
One concept that also essential for RC time-series data task performance is time constant, which affected to the way reservoir process the data injected and generate reservoir states [24] Electrochemical impedance spectroscopy (EIS) was conducted to investigate the Ag/Ag2S NPs device time constant A Nyquist plot with real part of impedance is plotted on the X axis, and the imaginary part is plotted on the Y axis, was shown in Figure 3.6(a) The Nyquist plot result depicted an almost full semicircle, which indicate the presence of parallel resistor–capacitor circuit components In order to perform curve fitting, an equivalent circuit model was established based on these results (Figure 3.6(b)) In this circuit, CPE is the “Constant Phase Element” which is the capacitive component with inhomogeneous structure in RC circuit The experimental plots and fitting curves match well for the majority of the electrodes in the device From equivalent circuit, the capacitance and resistance value were evaluated with averagely values of 𝑅 ≈ 309151 𝛺 and 𝐶 ≈ 1.29 × 10 &' 𝐹 Following that the time constant of this RC circuit was calculated by the formula:
Figure 3.6 (a) Impedance spectroscopy of one electrode from Ag/Ag 2 S NPs device depicted an almost full semicircle, which indicate the presence of parallel resistor–capacitor circuit components (b) An analogous circuit model was demonstrated based on fitting impedance curve results.
RESERVOIR COMPUTING DEMONSTRATION
Waveform generation
To demonstrate the necessity of nonlinearity and high dimensionality for improving
RC performance, waveform generation was carried out as a representative RC benchmark task The same input that was used for investigating higher harmonics generation was reused, a bipolar sinusoidal wave with frequency 11 Hz and peak amplitude 1 V and 4 V was applied to the device for perturbation A multifunction data acquisition DAQ (National Instruments PXIe-6363) system was used for input signal generation and output data recording The 15 output responses were collected over 60 s with a sampling rate of 1000, each output had a different internal state of reservoir Xi(t), with i represent the number of outputs, as illustrated in Figure 4.1
Figure 4.1 Schematic of waveform generation task Input of bipolar sinusoidal wave with frequency 11 Hz and peak amplitude 1 V and 4 V was applied to the device, 15 output responses were collected and supervised trained to fit multiple desired target waveform namely cosine, triangular, square and sawtooth
From the time series data obtained, a total of 1 s epoch was used for the data analysis with 70 % for training and 30 % for testing In training, ridge regression was carried out to optimize the output weights of the reservoir state to the supervised target 𝑌 The weights are calculated as Equation 4.1 follow:
𝑊 &'( = (𝑋 ) 𝑋 + 𝜆𝐼)𝑋 ) 𝑌 (4.1) where 𝑋, 𝜆, 𝐼, 𝑌 are reservoir state matrix, ridge regularization co-efficient, identity
30 matrix, and target matrix, respectively In this waveform generation task, 𝜆 was set to 0.1, the target waves were cosine, triangular, square, sawtooth, sin2ω and sin3ω The Fourier series uses an infinite series of periodic sine trigonometric functions of different coefficients to produce other forms of complex function like: cosine (Equation 4.2), triangular (Equation 4.3), square (Equation 4.4), sawtooth (Equation 4.5) [25] On the other hand, sin2ω and sin3ω are just double and triple frequency of input data for demonstrating the role of higher harmonics
Such series were replicated with our Ag/Ag2S NPs reservoir device by weight training using multiple linear regression After optimizing the weight, the predicted reservoir output 𝑍(𝑡) was constructed using a weighted linear combination of the optimized weights (Equation 4.6) and the fitting value between predicted and target data was presented by normalized mean square error (NMSE) calculation according to Equation 4.7:
The performance of each wave target was plotted with train and predict part (blue and red dot, respectively) corresponding to desired target wave (black line) as depicted in Figure 4.2
Figure 4.2 Waveform generation of sinusoidal wave input (11 Hz frequency, V PP = 1.0 V
AC bias voltage) for (a) cosine, (b) triangular, (c) square, (d) sawtooth, (e) sin2ω and (f) sin3ω The train data (blue dot) and the predict data (red dot) are plotted against the target wave (black line) 1 s epoch was used for the data analysis with 70 % for training and 30 % for testing Fitting value between predict and target data was presented by normalized mean square error (NMSE) calculate from Equation 4.7
The multiple outputs voltage from 15 electrode channels were recorded simultaneously and used to construct various target waveforms of cosine, triangular, square, sawtooth sin2ω and sin3ω The output weights were trained via supervised linear regression For quantifying the performance, NMSE was calculated The cosine wave in Figure 4.2(a) showed the lowest NMSE value of 0.003 (red dot) after training (blue dot), followed by triangular (0.023), square (0.208) and sawtooth (0.323) in the increasing order Compared to cosine and triangular, the square of odd and sawtooth of both odd and even harmonics are more complex and require rather large series of such harmonic combinations to be replicated, thereby the NMSE value got higher for these two targets waveforms Whereas the NMSE of sin2ω and sin3ω are significantly higher than others target waveform with 0.697 and 0.743, respectively Indicating that under this input condition, the second and third harmonics exhibited from the device are inadequate to reconstruct the double and triple frequency waveform of input data To check the importance of the rich harmonic generation towards waveform reconstruction, 4Vpp amplitude of bipolar sinusoidal input was also applied to the Ag/Ag2S reservoir device performance As previously compared in Figure 3.5(d), the averaged intensities of odd and even harmonics frequency for input peak amplitude showing the outstanding rate of harmonic generation when 4 V was applied Moreover, the second and third harmonics are completely overwhelming the others Hence, there are an expectation for better performance which can reconstruct all desired waveform with better NMSE, especially for the case of sin2ω and sin3ω The waveform generation results for 4 V input were shown in Figure 4.3
Figure 4.3 Waveform generation of sinusoidal wave input (11 Hz frequency, V PP = 4.0 V
AC bias voltage) for (a) cosine, (b) triangular, (c) square, (d) sawtooth, (e) sin2ω and (f) sin3ω The train data (blue dot) and the predict data (red dot) are plotted against the target wave (black line) 1 s epoch was used for the data analysis with 70 % for training and 30 % for testing Fitting value between predict and target data was presented by normalized mean square error (NMSE) calculate from Equation (6)
A clearly improve in the NMSE of 4 V peak input amplitude for triangular, square and sawtooth is seen in Figure 4.3 with the cosine being least affected The cosine is a phase shifted version of the sine wave hence requires mostly fundamental frequency to construct it while the triangular and square are a series of mostly odd harmonics, with sawtooth having both odd and even Triangular has similarity curvatures with the sine wave hence even at lower input peak amplitude, with less than number of odd harmonics they can still be replicated Complex waveforms like square and sawtooth both require multiple linear combinations of odd and/or even harmonics along with sine waves of different phase and amplitudes It suggests that as the complexity of waveform increases, for a reservoir to learn different time-series waveform targets efficiently, so is the rich reservoir dynamics that includes harmonics of many different intensities to be linearly summed up are indeed important For the case of sin2ω and sin3ω, a significantly improve in NMSE was obtained, especially with sin3ω This result is coincident with the analysis of higher harmonic intensities in Figure 3.5(d) The second and third harmonics are dramatically greater in 4Vpp input, specifically the third harmonic is excessively superior to 1Vpp,which explain for the greatly enhancement in target optimization The NMSE was improved when increasing the input voltage as the richer high dimensional information was attained According to the findings, an adequate input voltage amplitude is essential for archiving better performance of RC benchmark task in particular and other RC demonstrations in general.
Nonlinearity – memory
To investigate more about nonlinearity characteristic and establish the sort of RC task that the device can accomplish, an analyzing the degree of non-linearity and memory inherent was performed A simple function approximation task as show in Equation 4.8 [26] was studied, which allows to control the degree of the nonlinearity and the memory required in the tasks separately
𝑦(𝑡) = 𝑓-𝑠(𝑡 − 𝜏)3 = 𝑠𝑖𝑛-𝜈𝑠(𝑡 − 𝜏)3 (4.8) Where 𝑓 is a nonlinear function, in this case 𝑓(𝑥) =𝑠𝑖𝑛 𝑠𝑖𝑛 𝑥 and 𝜈𝑠(𝑡 − 𝜏) is the
35 input signal with (𝜈, 𝜏) are task parameter that control the “extent” of the required nonlinearity and “degree” of the required memory, respectively
To perform the simple approximation task, a uniform distribution 𝜇(−4, 4) was introduced to the device as the input signal The 15 output responses were collected over 60 s using a multifunction DAQ system Each output had a different internal state of reservoir Among them, 80 % of the datasets were used for training and 20 % were used for testing In training, ridge regression was carried out to optimize the output weights of the reservoir state to the supervised target 𝑦(𝑡) The weights are calculated as Equation 4.9 follow:
Where 𝑋, 𝜆, 𝐼, 𝑦(𝑡) are reservoir state matrix, ridge regularization co-efficient, identity matrix, and target matrix, respectively In this task, 𝜆 was set to 0.1 After optimizing the weight, the predicted reservoir output 𝑍(𝑡) was constructed using a weighted linear combination of the optimized weights and the test accuracy was calculated from fitting value between predicted and target data according to Equation 4.10:
Figure 4.4 show a heat-map table summarizing the results of comparison test accuracy by changing of the pair nonlinearity and memory task parameter As seen by the color bar, the heat-map depicts the test fitting accuracy as a color gradient in the plot, with green indicating the highest performance and red representing the poorest It can be seen that, the device performance was remained high accuracy whether how much nonlinearity parameter 𝜈 was changed, however in case of memory, the performance shows a suddenly drop in accuracy when 𝜏 value change from 3 to 4 and continuing decrease for higher delay step The result is coincident with I-V characteristic demonstrated before, where the device shown highly
36 nonlinearity response in output currents with pinched hysteresis Through this investigation we can confirm the strength of nonlinearity and the depth of memory of the device There is a general tendency of decreasing accuracy for every 𝜈, with rising
𝜏, demonstrating that, regardless of the growing degree of non-linearity, tasks with the least past memory construction usually outperform higher ones These results indicate that, the nonlinear dynamic of Ag/Ag2S NPs device is suitable for the tasks requiring strong nonlinear transformation with short memory
Figure 4.4 Nonlinear-memory heat-map table summarizing the results of comparison test accuracy by changing of the pair nonlinearity and memory task parameter ( 𝜈 , 𝜏 ).
Objects classification
For demonstrating the classification ability by utilizing the nonlinearity and higher harmonic generation properties, Ag/Ag2S NPs device was used to perform the object classification task for tactile sensory information of grasped objects getting from Toyota Human Support Robot (HSR) [27] As depicted in Figure 4.5, a force-torque sensor mounted to a robot arm produces tactile sensory information of grabbed items
Four toys with different hardness were used for generating tactile sensory input datasets which is block, bus, dog and hedgehog (HH) The torque magnitude of the robot hand when it grasps an object with consistent force is referred to as grasping data Every 0.1N, a measurement of the robot's force-torque sensor was taken The corresponding torque values from the objects grasping datasets were organized into
5 bits/s information, then each bit was sampled at the rate of 1000 points/s to obtain a stream of input sequenced over both time and voltage with amplifier 4 V was applied over the data range by using the LabVIEW software interface The input time- series dataset of individual objects was then fed to the device and their corresponding outputs were synchronized collected from the rest 15 electrode pads via a multifunction DAQ system, which were finally used for training and testing the binary classification, using one-hot vector encoding, where the weights of the correctly classified object were optimized to represent the target vector value of ‘1’, while another was optimized to the value ‘0’ 80 % of the datasets were used for training the reservoir outputs, and the classification performance was evaluated using the remaining 20 % of the dataset After training, reservoir outputs of two objects were then used simultaneously as test datasets for supervised binary classification and after evaluating the pairs of test dataset, the results were plotted as show in Figure 4.6
Figure 4.5 Objects classification task schematic Toyota HSR’s arm with force-torque sensor that generates tactile sensory information of grasped objects by applying force from the gripper Four toys with different hardness were used as grasped objects to create tactile data: Bus, Block, Dog, Hedgehog (HH) Time-series dataset of grasped objects were generated from sensor data driven by LabVIEW program then fed to the device, and their outputs were collected, which were used for training and testing the binary classification Supervised target of one-hot vector binary classification where the true positive object predicted is Bus (blue) with supervised target vector ‘1’ and true negative predicted Block (black) with value ‘0’, as an example Other pairs of objects were tested by utilizing the same process
Based on the hardness characteristic, grasped objects were categorized into two groups for classifying label First group for objects with significant differences in hardness, which is named soft-hard (Hedgehog versus Block, Bus), and second one for objects having quite same hardness, which is named soft/soft (Hedgehog versus Dog) and hard/hard (Block versus Bus) The finest results we obtained showed in Figure 4.6, Ag/Ag2S NPs device succeeded to classify both type of object groups In
39 both cases, even though the line is not completely following the trend of ideal target but it’s still showing the clear separation between two lines of indicated objects The ability to achieve such separation lies in the Ag/Ag2S reservoir’s inherent non-linear high dimensional operation As described above and depicted in Figure 4.5, the series input signal was fed into device with different bias step levels over times, this was allowed the reservoir recurrent network to produce higher dimensional information over every time frame and fetch different spatial information particular to a given input, hence producing high dimensional outputs The nonlinear effect can process and sequentially map the incoming data to high dimensional output This can lead to feature extractions imparting the reservoir separability property useful for classifying different spatio-temporal inputs into various categories As a result, the device successful to perform classification task of the tactile objects data
Figure 4.6 One-hot vector binary classification of tactile grasped objects results For classification label, objects were categorized into 2 groups based on their hardness: (a) soft- hard pairs and (b) soft/soft hard/hard pairs The graph shows the classification result of the predicted objects of the test data for both type of groups, with corresponding colors codes for each toy The binary classification task for each pair of objects displayed a successful classification where the supervised object separated line following same tendency of ideal target vector with value ‘1’ for true positive object and others being ‘0’ for true negative object
Boolean logic configuration
The Ag/Ag2S NPs device was then integrated with a measurement system driven by LabVIEW software to carry out the RC task of Boolean logic optimization at ambient conditions As demonstrated in Figure 4.7(a), in a Boolean logic task, firstly, two inputs Vin1 and Vin2 series of ‘0’ and ‘1’ sampled as 1 bit/sec were generated and simultaneously passed onto the Ag/Ag2S reservoir layer through 2 electrode pads, with input voltage amplitude 0 V and 4 V represented for logic state ‘0’ and logic state ‘1’, respectively Subsequently, multiple outputs from the rest 14 electrode pads were collected via a multifunction DAQ system The time series data set was split into 70 % for training data (28 s) and 30 % (12 s) for testing data After supervised training by the output weights (Wout) with a multi linear regression model (using the Moore-Penrose pseudo inverse algorithm), the reservoir output signals R(t) was construct by weighted linearly combined all the outputs and added the regression intercept factor b0 as Equation 4.11 [28] The predicted output was evaluated over test dataset with the same trained optimized output weights that used to reconstruct the target y(t) of Boolean functions like OR, AND, XOR, NOR, NAND and XNOR gates The device performance was examined by calculating the accuracy from normalized mean square error (NMSE) as Equation 4.12 and Equation 4.13
Figure 4.7 (a) The schematic of RC task of Boolean logic function optimization with an OR supervised target as an example Two different inputs of time-series binary ‘0’ and ‘1’ were fed to the Ag/Ag 2 S reservoir simultaneously, and multiple outputs were collected A weighted linear readout of all the output states was then used to reconstruct to approach to the target of Boolean functions OR gates The training was supervised and optimized to fit the desired Boolean target till the error was minimized (b) Schematic explains how Boolean targets are optimized from two binary inputs and the truth table of three logic gate: OR, AND, XOR as the reconstructed targets.
Using the supervised learning procedure described above, we succeeded to realize fully reconfigurable, robust Boolean logic from in-materio RC Ag/Ag2S NPs networks at room temperature Every desired target logic gate AND, OR, XOR, NAND, NOR, and XNOR as show in Figure 4.8(a), Figure 4.8(b), Figure 4.8(c), Figure 4.8(d), Figure 4.8(e) and Figure 4.8(f), respectively, were reconstructed as corresponded to the training and predicted data, indicating the successful implementation The repeatability of the task was proven by assessing the device performance on three different test datasets of the same time length The test accuracy was calculated from Equation 4.13 Figure 4.8 shows that the accuracy of about 94 % for OR, AND, NOR, NAND and 84 % for XOR and XNOR were achievable and referring standard deviation of approximately 1.2 (AND, NAND), 0.7 (OR, NOR) and 2.0 (XOR, XNOR) among all three datasets clearly suggests that the fitting is reproducible Basically, a reservoir with nonlinear dynamics is necessary to implement those logic operations with increasing classifiers complexity, especially XOR or XNOR gate [29] Although the training and predicted (blue and red dot line) followed their respective targets, however there were noise fluctuations appeared for all the gates at the step edges transitioning from ‘0’ to ‘1’ state and a mismatch in following the horizontal lines A reasonable reason can explain for that is because the sudden change in the device capacitance requiring time to adjust to the given voltage state when such linear drop in the voltage occurs, result in the weight adjustments on those parts give out noisy fitting [13] Notably, the behavior is more prominent for XOR and XNOR as these gates are exclusively complex and difficult to optimize relative to their counterparts right at the edges When compared to the other gates, XOR and XNOR are linearly inseparable and necessitating a high dimensional space to handle them The voltage readout dynamics of varying amplitudes from Ag/Ag2S network can be exploited as high dimensional spatial features when collected from different electrode pads, as analyzed in Figure 3.5 However, the chaotic and contingent of charge-discharge processes occurred due to their diverse redox states and varying degree of Ag/Ag2S capacitive junctions between nanoparticles results in the distortion responses Thereby reducing the performance of XOR /XNOR slightly
44 than AND, OR, NAND and NOR gates [30] These results are corresponding to previous report which utilized in-materio reservoir computing with single-walled carbon nanotube/porphyrin-polyoxometalate (SWNT/Por-POM) composite for optimizing Boolean function, Deep Banerjee et al [28] The accuracy for each logic gate in their case all above 90 %, especially for two complicated gate XOR/XNOR archived 93 %, based on the presence of negative differential resistance dynamics intrinsic of SWNT/Por-POM network, analogous to a mathematical additive and subtractive operation, making it desirable for the varied Boolean operations
Figure 4.8 Boolean logic operations task results Prediction of target logic gates: AND (a),
OR (b), XOR (c), NAND (d), NOR (e) and XNOR (f) from supervised learning of multiple nonlinear outputs voltage In these plots, the black solid line, blue dot line and red dot line are the target Boolean logic function, training part and predicted part respectively The test accuracy of fitting precited part to target were calculated from Equation (9) All the desired Boolean logic function was reconstructed with test accuracy over 80%
Spoken digits classification
Voice information is one of the most known and utilized time series data for RC tasks
In the majority of cases, researchers are interested in voice classification and recognition Can be mentioned as, the utilizing software modeling of several nonlinear responses executed spoken-digit classification [31] Moreover, Yuki Usami at el [32] demonstrated sulfonated polyaniline (SPAN) organic electrochemical network device (OEND) acts as an in-materio reservoir was succeeded to performed spoken-digit classification with accuracy up to 70 % Following those researchs, we carried out spoken-digit classification using the Ag/Ag2S NPs device The spoken- digit classification method is depicted schematically in Figure 4.9, with the free spoken-digit dataset (FSDD) v1.0.10 as input dataset [33] The digit data consists of ten numbers (from 0 to 9) pronounced 50 times each by six male speakers (George, Jackson, Lucas, Nicolas, Theo, and Yweweler) Lyon’s auditory model filtering [34] was used to generate cochleagrams from spoken-digit time-series signals to resampled (130Hz) intensities in four signal frequency regions, each cochleagram was made up of 100 timesteps [32] Four cochleagrams were normalized in the range of 0 to 4 V and simultaneously applied to Ag/Ag2S NPs device as time-series bias voltages using LabVIEW software Output response from the rest 12 electrodes were recorded, then, all generated signals were labeled as supervision signals for classification In this case, a one-hot vector was utilized as a target to optimize the classification for predicting the number The weights of the correctly classified numbers were optimized as a target vector value of “1,” while the others were optimized to the value of “0” The trained weights for individual number were optimized by ridge regression and used for testing Target length and the timesteps of the output signal are same The ratio of training to test data was 90 % and 10 % The ratio for splitting a dataset depends on the type of dataset, data characters, data size etc Hence, the partitioning ratio might be different between each task demonstration
It must be ensured that the training dataset should include all possible patterns used for defining the problem and should extend to edge of the modeling domain
Figure 4.9 A diagram of spoken-digit classification Using Lyon’s auditory model filtering, the spoken-digit time series signals in the dataset were transformed to cochleagrams by separating the intensities in four frequency bands.The cochleagrams were normalized and used as time series bias voltages on the Ag/Ag 2 S NPs network.Following the recording and labeling of the device’s output, the labeled outputs were categorized using a ridge regression to a one-hot target vector with training (90 %) and prediction (10 %)
Figure 4.10 (a) (a)Normalized confusion matrix of spoken-digit classification of Lucas one speaker from the FSDD dataset when using output readouts from Ag/Ag 2 S NPs RC device, the accuracy 72 % was attained (b) Dependence of spoken-digit classification on sampling rate
Figure 4.10(a) shows a normalized confusion matrix of the actual and predicted labels acquired from Lucas's vocal by using output readouts from Ag/Ag2S NPs RC device, with 1000 points/s sampling rate To confirm the role of sampling rate, we investigate
48 the dependence of spoken-digit classification on duration time of input data regulated by sampling rate The cochleagram was made up of 100 timesteps, by adjusting input sampling rate the duration time of injecting data can be modified The input and output sampling rate were unified to modulate duration time Figure 4.10(b) shows the accuracy versus sampling rate for spoken-digit classification with Lucas, one of male speaker in FSDD dataset From above result, the effective sample rate for input was between 1000 and 3000 point/s, which means the input duration time is in range 0.1s−0.03s, it’s corresponding to the time constant calculated in the equivalent RC circuit mentioned above As a result, time constant is one again confirmed the crucial role in this voice classification task Based on this investigation, we conducted spoken digits classification task with 1000 and 3000 point/s to validate the appropriate sampling rate for optimizing the classification ability
Figure 4.11 (a) Comparison of the accuracy of spoken-digit classification between the software simulation and Ag/Ag 2 S output signals for each speaker in the FSDD dataset (b) Normalized confusion matrix of classification for 6 speakers using output readouts from Ag/Ag 2 S NPs RC device, 61.7 % accuracy achieved
For reservoir computing software simulation, the same four normalized cochleagrams fed into Ag/Ag2S NPs device were introduced in an echo state network, consisting of
12 fully connected nodes, ten outputs were linearly combined to optimize the target of a one-hot-vector, and the greatest unit was considered to be predicted number The spoken-digit classification ability of Ag/Ag2S NPs device was comparable with
49 software simulation of an echo state network, with an accuracy of up to 70% for all six speakers, as shown in Figure 4.11(a) Moreover, as mentioned, we compared two efficient sampling to verify which one is more effective for optimizing the classification of spoken digit The result depicted that 3000 points/s sampling rate is got better accuracy in most of the cases It was coincident with the time constant as calculated, hence, under this condition the duration time of input data is within the time constant, once again emphasized its critical impact The confusion matrix for all six speakers is shown in Figure 4.11(b), the accuracy for this classification task was archived 61.7 %, whereas software simulation for this task got 63 % accuracy, which indicated that Ag/Ag2S network could extract feature value of voice signals well, and improved accuracy of classification by utilizing the time-dynamics obtain various output readouts The outcome of this spoken digit classification is similar with previous report of Yuki Usami at el implemented by a sulfonated polyaniline network
RC device [32] The accuracy archived almost comparable for each speaker, as well as 6 people classification This finding suggests that Ag/Ag2S NPs functions as an in- materio reservoir in classification for time series dynamics
SUMMARY AND CONCLUSION
In conclusion, the Ag/Ag2S NPs were successfully synthesized by following modified Brust-Schiffrin procedure The structural properties of Ag/Ag2S NPs were confirmed by X-ray diffractometry and transmission electron microscopy (TEM), the average diameter of particles also calculated Characteristics requirements for building the physical reservoir computing (RC), such as nonlinearity, phase shift, high dimensionality, have been investigated The current-voltage curve, after repeated sweeping of forward and reversed bias 0-4 V to the device, shows nonlinear response and fluctuations of current occurred, indicating the forming process randomly occurred at various gap points among NPs Another essential required property for
RC also studied by applying sine wave input then record output signal and converted by a fast Fourier transformation process to obtain output amplitude characteristics in the frequency domain, the output current amplitude was observed at integer multiples of the input frequency, which indicates high dimensionality Furthermore, the Lissajous plots shown elliptical shape represent the phase-shifting property Based on the above results the Ag/Ag2S NPs device possess important properties for realizing reservoir computing device: non-linearity, phase shift, high dimensionality By utilizing the non-linear, phase shift and high dimensional properties, the device was used to perform some RC tasks in the role of reservoir layer Ag/Ag2S NPs device succeeded in learning and generating waveform by applying a sine wave and performing linear combination to a desired waveform (cosine, triangle, square, sawtooth, sin2ω, sin3ω wave) exhibited over 80% accuracy for all waveform targets The analysis of degree of non-linearity and memory inherent were carried out to establish the sort of RC task that the device can accomplish For object classification task, after supervised training, a binary testing dataset of pairs of objects was successfully classified for both type of classification objects groups by using one-hot vector encoding In the case of Boolean logic task, a reservoir with nonlinear dynamics is necessary to implement those logic operations with increasing classifier complexity The results show the testing accuracy for all gate targets (AND, OR,
XOR, NAND, NOR, XNOR) are more than 80%, indicating the successful reconstruct of all logic gates by using Ag/Ag2S NPs RC device Moreover, a complicated classification task for time series data also carried out The spoken digit classification was realized with up to 70 % accuracy, proving that Ag/Ag2S NPs device can execute time series dynamic data operation in RC by combining nonlinear and dynamic electronic properties Based on these results, the Ag/Ag2S nanoparticles device proved to be used as an in-materio reservoir device, which has an extraordinary potential for further complex supervised learning
1 H Tanaka, S Azhari, Y Usami, D Banerjee, T Kotooka, O Srikimkaew,
T.T Dang, S Murazoe, R Oyabu, K Kimizuka and M Hakoshima, "In- materio computing in random networks of carbon nanotubes complexed with chemically dynamic molecules: a review" Neuromorphic Computing and Engineering vol 2, no 2, p 022002, May 2022, doi: 10.1088/2634-
2 T.T Dang, O Srikimkaew, D Banerjee, S Azhari, Y Usami and H Tanaka,
“Effect of nonlinearity induced by atomic switch in Ag/Ag2S nanoparticles on performance of in-materio reservoir computing” Applied Physics Letters vol
[1] M Hilbert and P López, “The World’s Technological Capacity to Store, Communicate, and Compute Information,” Science (80-.)., vol 332, no 6025, pp 60–
[2] A Calimera, E Macii, and M Poncino, “The Human Brain Project and neuromorphic computing,” Funct Neurol., vol 28, no 3, 2013, doi: 10.11138/FNeur/2013.28.3.191
[3] C Mead, “Neuromorphic electronic systems,” Proc IEEE, vol 78, no 10, pp 1629–
[4] H Moravec, “When will computer hardware matches the human brain?” J Evol Technol., vol 1, no 1, 1998
[5] Hadiyawarman, F Budiman, D G O Hernowo, R R Pandey, and H Tanaka,
“Recent progress on fabrication of memristor and transistor-based neuromorphic devices for high signal processing speed with low power consumption,” Jpn J Appl
Phys., vol 57, no 3S2, p 03EA06, Mar 2018, doi: 10.7567/JJAP.57.03EA06
[6] D Kuzum, R G D Jeyasingh, B Lee, and H.-S P Wong, “Nanoelectronic Programmable Synapses Based on Phase Change Materials for Brain-Inspired Computing,” Nano Lett., vol 12, no 5, pp 2179–2186, May 2012, doi:
[7] L DECASTRO, “Fundamentals of natural computing: an overview,” Phys Life Rev., vol 4, no 1, pp 1–36, Mar 2007, doi: 10.1016/j.plrev.2006.10.002
[8] W Sha and K L Edwards, “The use of artificial neural networks in materials science- based research,” Mater Des., vol 28, no 6, pp 1747–1752, Jan 2007, doi:
[9] H Jaeger and H Haas, “Harnessing Nonlinearity: Predicting Chaotic Systems and Saving Energy in Wireless Communication,” Science (80-.)., vol 304, no 5667, pp 78–80, Apr 2004, doi: 10.1126/science.1091277
[10] H Ryu and S Kim, “Implementation of a reservoir computing system using the short- term effects of Pt/HfO2/TaOx/TiN memristors with self-rectification,” Chaos, Solitons
& Fractals, vol 150, p 111223, Sep 2021, doi: 10.1016/j.chaos.2021.111223
[11] G Tanaka et al., “Recent advances in physical reservoir computing: A review,” Neural Networks, vol 115, pp 100–123, Jul 2019, doi: 10.1016/j.neunet.2019.03.005
[12] Hadiyawarman, Y Usami, T Kotooka, S Azhari, M Eguchi, and H Tanaka,
“Performance of Ag–Ag2S core–shell nanoparticle-based random network reservoir computing device,” Jpn J Appl Phys., vol 60, no SC, p SCCF02, Jun 2021, doi: 10.35848/1347-4065/abe206
[13] K Terabe, T Hasegawa, T Nakayama, and M Aono, “Quantized conductance atomic switch,” Nature, vol 433, no 7021, pp 47–50, Jan 2005, doi:
[14] T Hasegawa et al., “Learning Abilities Achieved by a Single Solid-State Atomic
Switch,” Adv Mater., vol 22, no 16, pp 1831–1834, Apr 2010, doi:
[15] E C Demis, R Aguilera, K Scharnhorst, M Aono, A Z Stieg, and J K Gimzewski,
“Nanoarchitectonic atomic switch networks for unconventional computing,” Jpn J
Appl Phys., vol 55, no 11, p 1102B2, Nov 2016, doi: 10.7567/JJAP.55.1102B2
[16] S K Bose et al., “Evolution of a designless nanoparticle network into reconfigurable Boolean logic,” Nat Nanotechnol., vol 10, no 12, pp 1048–1052, Dec 2015, doi: 10.1038/nnano.2015.207
[17] C Lutz, T Hasegawa, and T Chikyow, “Ag 2 S atomic switch-based ‘tug of war’ for decision making,” Nanoscale, vol 8, no 29, pp 14031–14036, 2016, doi:
[18] S Lilak et al., “Spoken Digit Classification by In-Materio Reservoir Computing With Neuromorphic Atomic Switch Networks,” Front Nanotechnol., vol 3, May 2021, doi: 10.3389/fnano.2021.675792
[19] M Brust, M Walker, D Bethell, D J Schiffrin, and R Whyman, “Synthesis of thiol- derivatised gold nanoparticles in a two-phase Liquid–Liquid system,” J Chem Soc.,
Chem Commun., no 7, pp 801–802, 1994, doi: 10.1039/C39940000801
[20] C Battocchio et al., “Silver Nanoparticles Stabilized with Thiols: A Close Look at the Local Chemistry and Chemical Structure,” J Phys Chem C, vol 116, no 36, pp 19571–19578, Sep 2012, doi: 10.1021/jp305748a
[21] E Karaca, D Gửkcen, N ệ Pekmez, and K Pekmez, “Galvanostatic synthesis of nanostructured Ag‐Ag2O dispersed PPy composite on graphite electrode for supercapacitor applications,” Int J Energy Res., vol 44, no 1, pp 158–170, Jan
[22] R Wiesinger et al., “In situ time-lapse synchrotron radiation X-ray diffraction of
55 silver corrosion,” J Anal At Spectrom., vol 30, no 3, pp 694–701, 2015, doi:
[23] D B Strukov, G S Snider, D R Stewart, and R S Williams, “The missing memristor found,” Nature, vol 453, no 7191, pp 80–83, May 2008, doi:
[24] A Bernacchia, H Seo, D Lee, and X.-J Wang, “A reservoir of time constants for memory traces in cortical neurons,” Nat Neurosci., vol 14, no 3, pp 366–372, Mar
[25] D Banerjee et al., “Emergence of In‐Materio Intelligence from an Incidental Structure of a Single‐Walled Carbon Nanotube–Porphyrin Polyoxometalate Random Network,”
Adv Intell Syst., p 2100145, Jan 2022, doi: 10.1002/aisy.202100145
[26] M Inubushi and K Yoshimura, “Reservoir Computing Beyond Memory- Nonlinearity Trade-off,” Sci Rep., vol 7, no 1, p 10199, Dec 2017, doi:
[27] S Tokuno, Y Tanaka, T Kawasetsu, K Hosoda, and H Tamukoh, “Object Recognition Using Flexible Tactile Sensor,” in Asia Pacific Conference on Robot IoT
System Development and Platform 2020 (APRIS2020) Nov 2020, pp 81–82,
Available: http://id.nii.ac.jp/1001/00210235/
[28] D Banerjee, S Azhari, Y Usami, and H Tanaka, “Room temperature demonstration of in-materio reservoir computing for optimizing Boolean function with single-walled carbon nanotube/porphyrin-polyoxometalate composite,” Appl Phys Express, vol
14, no 10, p 105003, Oct 2021, doi: 10.35848/1882-0786/ac24db
[29] Chen T, van Gelder J, van de Ven B, Amitonov SV, De Wilde B, Ruiz Euler HC, Broersma H, Bobbert PA, Zwanenburg FA, van der Wiel WG, “Classification with a disordered dopant-atom network in silicon,” Nature, vol 577, no 7790, pp 341–345, Jan 2020, doi: 10.1038/s41586-019-1901-0
[30] K Scharnhorst, W Woods, C Teuscher, A Stieg, and J Gimzewski, “Non-temporal logic performance of an atomic switch network,” in 2017 IEEE/ACM International
Symposium on Nanoscale Architectures (NANOARCH), Jul 2017, pp 133–138, doi:
[31] S Kan, K Nakajima, Y Takeshima, T Asai, Y Kuwahara, and M Akai-Kasaya,
“Simple Reservoir Computing Capitalizing on the Nonlinear Response of Materials:
Theory and Physical Implementations,” Phys Rev Appl., vol 15, no 2, p 024030, Feb 2021, doi: 10.1103/PhysRevApplied.15.024030
[32] Y Usami et al., “In‐Materio Reservoir Computing in a Sulfonated Polyaniline
Network,” Adv Mater., vol 33, no 48, p 2102688, Dec 2021, doi:
[33] Jakobovski, “Free Spoken Digit Dataset,” Github, Accessed Nov 1, 2021, doi:
[34] R Lyon, “A computational model of filtering, detection, and compression in the cochlea,” in ICASSP ’82 IEEE International Conference on Acoustics, Speech, and
Signal Processing, 1982, vol 7, pp 1282–1285, doi: 10.1109/ICASSP.1982.1171644.