Browse
Submit Data
Databases
API
Help

Dataset Information

0 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Ultrafast photonic reinforcement learning based on laser chaos.

ABSTRACT: Reinforcement learning involves decision making in dynamic and uncertain environments and constitutes an important element of artificial intelligence (AI). In this work, we experimentally demonstrate that the ultrafast chaotic oscillatory dynamics of lasers efficiently solve the multi-armed bandit problem (MAB), which requires decision making concerning a class of difficult trade-offs called the exploration-exploitation dilemma. To solve the MAB, a certain degree of randomness is required for exploration purposes. However, pseudorandom numbers generated using conventional electronic circuitry encounter severe limitations in terms of their data rate and the quality of randomness due to their algorithmic foundations. We generate laser chaos signals using a semiconductor laser sampled at a maximum rate of 100 GSample/s, and combine it with a simple decision-making principle called tug of war with a variable threshold, to ensure ultrafast, adaptive, and accurate decision making at a maximum adaptation speed of 1 GHz. We found that decision-making performance was maximized with an optimal sampling interval, and we highlight the exact coincidence between the negative autocorrelation inherent in laser chaos and decision-making performance. This study paves the way for a new realm of ultrafast photonics in the age of AI, where the ultrahigh bandwidth of light wave can provide new value.

SUBMITTER: Naruse M

PROVIDER: S-EPMC5562742 | biostudies-other | 2017 Aug

REPOSITORIES: biostudies-other

ACCESS DATA

Json Xml

Similar Datasets

Private communication with quantum cascade laser photonic chaos.

Project description:Mid-infrared free-space optical communication has a large potential for high speed communication due to its immunity to electromagnetic interference. However, data security against eavesdroppers is among the obstacles for private free-space communication. Here, we show that two uni-directionally coupled quantum cascade lasers operating in the chaotic regime and the synchronization between them allow for the extraction of the information that has been camouflaged in the chaotic emission. This building block represents a key tool to implement a high degree of privacy directly on the physical layer. We realize a proof-of-concept communication at a wavelength of 5.7 μm with a message encryption at a bit rate of 0.5 Mbit/s. Our demonstration of private free-space communication between a transmitter and receiver opens strategies for physical encryption and decryption of a digital message.

| S-EPMC8184773 | biostudies-literature

Laser photonic-reduction stamping for graphene-based micro-supercapacitors ultrafast fabrication.

Project description:Micro-supercapacitors are promising miniaturized energy storage devices that have attracted considerable research interest. However, their widespread use is limited by inefficient microfabrication technologies and their low energy density. Here, a flexible, designable micro-supercapacitor can be fabricated by a single pulse laser photonic-reduction stamping. A thousand spatially shaped laser pulses can be generated in one second, and over 30,000 micro-supercapacitors are produced within 10 minutes. The micro-supercapacitor and narrow gaps were dozens of microns and 500 nm, respectively. With the unique three-dimensional structure of laser-induced graphene based electrode, a single micro-supercapacitor exhibits an ultra-high energy density (0.23 Wh cm-3), an ultra-small time constant (0.01 ms), outstanding specific capacitance (128 mF cm-2 and 426.7 F cm-3) and a long-term cyclability. The unique technique is desirable for a broad range of applications, which surmounts current limitations of high-throughput fabrication and low energy density of micro-supercapacitors.

| S-EPMC7712890 | biostudies-literature

Fusion of Renewable Ring Resonator Lasers and Ultrafast Laser Inscribed Photonic Waveguides.

Project description:We demonstrated the monolithic integration of reusable and wavelength reconfigurable ring resonator lasers and waveguides of arbitrary shapes to out-couple and guide laser emission on the same fused-silica chip. The ring resonator hosts were patterned by a single-mask standard lithography, whereas the waveguides were inscribed in the proximity of the ring resonator by using 3-dimensional femtosecond laser inscription technology. Reusability of the integrated ring resonator - waveguide system was examined by depositing, removing, and re-depositing dye-doped SU-8 solid polymer, SU-8 liquid polymer, and liquid solvent (toluene). The wavelength reconfigurability was validated by employing Rhodamine 6G (R6G) and 3,3'-Diethyloxacarbocyanine iodide (CY3) as exemplary gain media. In all above cases, the waveguide was able to couple out and guide the laser emission. This work opens a door to reconfigurable active and passive photonic devices for on-chip coherent light sources, optical signal processing, and the investigation of new optical phenomena.

| S-EPMC5013411 | biostudies-literature

Self-controlling photonic-on-chip networks with deep reinforcement learning.

Project description:We present a novel photonic chip design for high bandwidth four-degree optical switches that support high-dimensional switching mechanisms with low insertion loss and low crosstalk in a low power consumption level and a short switching time. Such four-degree photonic chips can be used to build an integrated full-grid Photonic-on-Chip Network (PCN). With four distinct input/output directions, the proposed photonic chips are superior compared to the current bidirectional photonic switches, where a conventionally sizable PCN can only be constructed as a linear chain of bidirectional chips. Our four-directional photonic chips are more flexible and scalable for the design of modern optical switches, enabling the construction of multi-dimensional photonic chip networks that are widely applied for intra-chip communication networks and photonic data centers. More noticeably, our photonic networks can be self-controlling with our proposed Multi-Sample Discovery model, a deep reinforcement learning model based on Proximal Policy Optimization. On a PCN, we can optimize many criteria such as transmission loss, power consumption, and routing time, while preserving performance and scaling up the network with dynamic changes. Experiments on simulated data demonstrate the effectiveness and scalability of the proposed architectural design and optimization algorithm. Perceivable insights make the constructed architecture become the self-controlling photonic-on-chip networks.

| S-EPMC8632908 | biostudies-literature

Adaptive model selection in photonic reservoir computing by reinforcement learning.

Project description:Photonic reservoir computing is an emergent technology toward beyond-Neumann computing. Although photonic reservoir computing provides superior performance in environments whose characteristics are coincident with the training datasets for the reservoir, the performance is significantly degraded if these characteristics deviate from the original knowledge used in the training phase. Here, we propose a scheme of adaptive model selection in photonic reservoir computing using reinforcement learning. In this scheme, a temporal waveform is generated by different dynamic source models that change over time. The system autonomously identifies the best source model for the task of time series prediction using photonic reservoir computing and reinforcement learning. We prepare two types of output weights for the source models, and the system adaptively selected the correct model using reinforcement learning, where the prediction errors are associated with rewards. We succeed in adaptive model selection when the source signal is temporally mixed, having originally been generated by two different dynamic system models, as well as when the signal is a mixture from the same model but with different parameter values. This study paves the way for autonomous behavior in photonic artificial intelligence and could lead to new applications in load forecasting and multi-objective control, where frequent environment changes are expected.

| S-EPMC7308406 | biostudies-literature

Controlling chaotic itinerancy in laser dynamics for reinforcement learning.

Project description:Photonic artificial intelligence has attracted considerable interest in accelerating machine learning; however, the unique optical properties have not been fully used for achieving higher-order functionalities. Chaotic itinerancy, with its spontaneous transient dynamics among multiple quasi-attractors, can be used to realize brain-like functionalities. In this study, we numerically and experimentally investigate a method for controlling the chaotic itinerancy in a multimode semiconductor laser to solve a machine learning task, namely, the multiarmed bandit problem, which is fundamental to reinforcement learning. The proposed method uses chaotic itinerant motion in mode competition dynamics controlled via optical injection. We found that the exploration mechanism is completely different from a conventional searching algorithm and is highly scalable, outperforming the conventional approaches for large-scale bandit problems. This study paves the way to use chaotic itinerancy for effectively solving complex machine learning tasks as photonic hardware accelerators.

| S-EPMC9728972 | biostudies-literature

Photonic Crystal Microchip Laser.

Project description:The microchip lasers, being very compact and efficient sources of coherent light, suffer from one serious drawback: low spatial quality of the beam strongly reducing the brightness of emitted radiation. Attempts to improve the beam quality, such as pump-beam guiding, external feedback, either strongly reduce the emission power, or drastically increase the size and complexity of the lasers. Here it is proposed that specially designed photonic crystal in the cavity of a microchip laser, can significantly improve the beam quality. Experiments show that a microchip laser, due to spatial filtering functionality of intracavity photonic crystal, improves the beam quality factor M2 reducing it by a factor of 2, and increase the brightness of radiation by a factor of 3. This comprises a new kind of laser, the "photonic crystal microchip laser", a very compact and efficient light source emitting high spatial quality high brightness radiation.

| S-EPMC5040951 | biostudies-literature

Filter-Based Dispersion-Managed Versatile Ultrafast Fibre Laser.

Project description:We present the operation of an ultrafast passively mode-locked fibre laser, in which flexible control of the pulse formation mechanism is readily realised by an in-cavity programmable filter the dispersion and bandwidth of which can be software configured. We show that conventional soliton, dispersion-managed (DM) soliton (stretched-pulse) and dissipative soliton mode-locking regimes can be reliably targeted by changing the filter's dispersion and bandwidth only, while no changes are made to the physical layout of the laser cavity. Numerical simulations are presented which confirm the different nonlinear pulse evolutions inside the laser cavity. The proposed technique holds great potential for achieving a high degree of control over the dynamics and output of ultrafast fibre lasers, in contrast to the traditional method to control the pulse formation mechanism in a DM fibre laser, which involves manual optimisation of the relative length of fibres with opposite-sign dispersion in the cavity. Our versatile ultrafast fibre laser will be attractive for applications requiring different pulse profiles such as in optical signal processing and optical communications.

| S-EPMC4869016 | biostudies-other

Self-evolving photonic crystals for ultrafast photonics.

Project description:Ultrafast dynamics in nanophotonic materials is attracting increasing attention from the perspective of exploring new physics in fundamental science and expanding functionalities in various photonic devices. In general, such dynamics is induced by external stimuli such as optical pumping or voltage application, which becomes more difficult as the optical power to be controlled becomes larger owing to the increase in the energy required for the external control. Here, we demonstrate a concept of the self-evolving photonic crystal, where the spatial profile of the photonic band is dynamically changed through carrier-photon interactions only by injecting continuous uniform current. Based on this concept, we experimentally demonstrate short-pulse generation with a high peak power of 80 W and a pulse width of <30 ps in a 1-mm-diameter GaAs-based photonic crystal. Our findings on self-evolving carrier-photon dynamics will greatly expand the potential of nanophotonic materials and will open up various scientific and industrial applications.

| S-EPMC9883472 | biostudies-literature

Dissociating error-based and reinforcement-based loss functions during sensorimotor learning.

Project description:It has been proposed that the sensorimotor system uses a loss (cost) function to evaluate potential movements in the presence of random noise. Here we test this idea in the context of both error-based and reinforcement-based learning. In a reaching task, we laterally shifted a cursor relative to true hand position using a skewed probability distribution. This skewed probability distribution had its mean and mode separated, allowing us to dissociate the optimal predictions of an error-based loss function (corresponding to the mean of the lateral shifts) and a reinforcement-based loss function (corresponding to the mode). We then examined how the sensorimotor system uses error feedback and reinforcement feedback, in isolation and combination, when deciding where to aim the hand during a reach. We found that participants compensated differently to the same skewed lateral shift distribution depending on the form of feedback they received. When provided with error feedback, participants compensated based on the mean of the skewed noise. When provided with reinforcement feedback, participants compensated based on the mode. Participants receiving both error and reinforcement feedback continued to compensate based on the mean while repeatedly missing the target, despite receiving auditory, visual and monetary reinforcement feedback that rewarded hitting the target. Our work shows that reinforcement-based and error-based learning are separable and can occur independently. Further, when error and reinforcement feedback are in conflict, the sensorimotor system heavily weights error feedback over reinforcement feedback.

| S-EPMC5550011 | biostudies-other

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data