Sign language video generation is critical for facilitating communication accessibility for the deaf community, yet existing methods often suffer from distorted hand gestures, limiting their practical utility. To address this, we propose HandFirst-SLG, a novel pose-guided two-stage framework for high-fidelity sign language synthesis. Stage 1 employs a HandGenerator to decouple hand synthesis with precise gesture control. Stage 2 integrates hand images to synthesize body movements while maintaining temporal coherence via motion modules. Evaluated on three datasets, our method outperforms general pose-guided frameworks and achieves significant improvements in hand gesture accuracy compared to state-of-the-art sign language models on the C4A dataset. This work advances pose-guided sign language generation by providing a robust solution for generating high-fidelity sign language videos with accurate hand gestures, which is essential for effective communication aids for the deaf community. Code will be available post-acceptance.

Trajectory data consists of sequential GPS points recording geographical movement behaviors, constituting fundamental resources for urban analytics. However, publicly accessible trajectory datasets remain scarce or privacy-encumbered. Prevailing generative methodologies often fail to adhere to trajectory-specific constraints or necessitate granular segment-level annotations to guide the generative process. Herein, we present SemTraj, a novel diffusion-Transformer framework engineered to synthesize voluminous, high-fidelity, and diverse trajectories conforming to trajectory semantic constraints such as origin and destination. Central to SemTraj is a Trajectory Denoising Transformer that integrates a novel Semantic-Adaptive Layer Normalization for fine-grained conditioning, alongside an adaptive resampling strategy that adjusts position encoding while preserving temporal fidelity and optimizing computational efficiency. We rigorously evaluate SemTraj on three diverse real-world datasets, demonstrating its superior fidelity and controllability compared to existing methods.

Gaussian splatting (GS) struggles with degraded rendering quality on low-cost devices. To address this issue, we present edge collaborative GS (ECO-GS), where each user can switch between a local small GS model to guarantee timeliness and a remote large GS model to guarantee fidelity. However, deciding how to engage the large GS model is nontrivial, due to the interdependency between rendering requirements and resource conditions. To this end, we propose integrated rendering and communication (IRAC), which jointly optimizes collaboration status (i.e., deciding whether to engage large GS) and edge power allocation (i.e., enabling remote rendering) under communication constraints across different users by minimizing a newly derived GS switching function. Despite the nonconvexity of the problem, we propose an efficient penalty majorization minimization (PMM) algorithm to obtain the critical point solution. Furthermore, we develop an imitation learning optimization (ILO) algorithm, which reduces the computational time by over 100x compared to PMM. Experiments demonstrate the superiority of PMM and the realtime execution capability of ILO.

Fine-grained urban flow inference is crucial for urban planning and intelligent transportation systems, enabling precise traffic management and resource allocation. However, the practical deployment of existing methods is hindered by two key challenges: the prohibitive computational cost of over-parameterized models and the suboptimal performance of conventional loss functions on the highly skewed distribution of urban flows. To address these challenges, we propose a unified solution that synergizes architectural efficiency with adaptive optimization. Specifically, we first introduce PLGF, a lightweight yet powerful architecture that employs a Progressive Local-Global Fusion strategy to effectively capture both fine-grained details and global contextual dependencies. Second, we propose DualFocal Loss, a novel function that integrates dual-space supervision with a difficulty-aware focusing mechanism, enabling the model to adaptively concentrate on hard-to-predict regions. Extensive experiments on 4 real-world scenarios validate the effectiveness and scalability of our method. Notably, while achieving state-of-the-art performance, PLGF reduces the model size by up to 97% compared to current high-performing methods. Furthermore, under comparable parameter budgets, our model yields an accuracy improvement of over 10% against strong baselines. The implementation is included in the supplementary material.

Building a universal trajectory foundation model is a promising solution to address the limitations of existing trajectory modeling approaches, such as task specificity, regional dependency, and data sensitivity. Despite its potential, data preparation, pre-training strategy development, and architectural design present significant challenges in constructing this model. Therefore, we introduce UniTraj, a Universal Trajectory foundation model that aims to address these limitations through three key innovations. First, we construct WorldTrace, an unprecedented dataset of 2.45 million trajectories with billions of GPS points spanning 70 countries, providing the diverse geographic coverage essential for region-independent modeling. Second, we develop novel pre-training strategies---Adaptive Trajectory Resampling and Self-supervised Trajectory Masking---that enable robust learning from heterogeneous trajectory data with varying sampling rates and quality. Finally, we tailor a flexible model architecture to accommodate a variety of trajectory tasks, effectively capturing complex movement patterns to support broad applicability. Extensive experiments across multiple tasks and real-world datasets demonstrate that UniTraj consistently outperforms existing methods, exhibiting superior scalability, adaptability, and generalization. These findings also position UniTraj as a versatile solution for a wide array of trajectory-related applications, with WorldTrace serving as an ideal yet non-exclusive training resource. The implementation codes and dataset samples are available in the Supplementary Material.

Travel Time Estimation (TTE) stands as a cornerstone of efficient transportation systems. However, the critical imperative of privacy preservation within the TTE context remains notably underexplored. This gap underscores the pressing necessity for innovative solutions that prioritize the safeguarding of users' geo-privacy, particularly in light of the expanding prevalence of data-driven TTE algorithms. In this paper, a novel privacy-preserving TTE framework, CRATE, is proposed to ensure comprehensive privacy preservation for TTE without compromising service quality. CRATE achieves this objective by identifying random routes within a transportation network that yield identical travel times to the actual, privacy-rich route. This is accomplished through exploiting the embedding representations for road segments and routes, followed by the development of a highly efficient heuristic for random route generation. Furthermore, a travel time aggregation and calibration model is devised to enhance estimation accuracy while upholding user privacy. Case studies conducted on three real-world vehicular trajectory datasets demonstrate that CRATE attains comparable estimation accuracy to state-of-the-art non-privacy-preserving TTE algorithms while maintaining strict privacy protection. Additionally, CRATE's efficiency is showcased through deployment on both high- and low-end mobile handsets spanning the past decade.

The widespread adoption of mobile devices and data collection technologies has led to an exponential increase in trajectory data, presenting significant challenges in spatio-temporal data mining, particularly for efficient and accurate trajectory retrieval. However, existing methods for trajectory retrieval face notable limitations, including inefficiencies in large-scale data, lack of support for condition-based queries, and reliance on trajectory similarity measures. To address the above challenges, we propose OmniTraj, a generalized and flexible omni-semantic trajectory retrieval framework that integrates four complementary modalities or semantics---raw trajectories, topology, road segments, and regions---into a unified system. Unlike traditional approaches that are limited to computing and processing trajectories as a single modality, OmniTraj designs dedicated encoders for each modality, which are embedded and fused into a shared representation space. This design enables OmniTraj to support accurate and flexible queries based on any individual modality or combination thereof, overcoming the rigidity of traditional similarity-based methods. Extensive experiments on two real-world datasets demonstrate the effectiveness of OmniTraj in handling large-scale data, providing flexible, multi-modality queries, and supporting downstream tasks and applications. The implementation code is available at https://anonymous.4open.science/r/OmniTraj-D78D

With the proliferation of task-specific large language models, delta compression has emerged as a method to mitigate the resource challenges with deploying numerous such models by effectively compressing the delta model parameters. Previous delta-sparsification methods either remove parameters randomly or truncate singular vectors directly after singular value decomposition (SVD). However, these methods either disregard parameter importance entirely or evaluate it with too coarse a granularity. In this work, we introduce ImPart, a novel importance-aware delta sparsification approach. Leveraging SVD, it dynamically adjusts sparsity ratios of different singular vectors based on their importance, effectively retaining crucial task-specific knowledge even at high sparsity ratios. Experiments show that ImPart achieves state-of-the-art delta sparsification performance, demonstrating 2x higher compression ratio than baselines at the same performance level. When integrated with existing methods, ImPart sets a new state-of-the-art on delta quantization and model merging.

Traffic forecasting is essential for the development of intelligent transportation systems. However, existing forecasting models often struggle to effectively capture the complex spatial-temporal dependencies inherent in traffic data. Many current approaches are limited in their ability to model node-specific patterns and to simultaneously capture both short- and long-range dependencies. In this paper, we propose a novel traffic forecasting model, the Meta Attentive Graph Convolutional Recurrent Network (MAGCRN), which addresses these limitations through two key modules: (1) NodeSpecific Meta Pattern Learning (NMPL) and (2) Node Attention Weight Generation (NAWG). The NMPL module captures the unique characteristics of each node in the traffic network by dynamically generating node-specific convolutional filters. The NAWG module enhances the model's ability to capture both short- and long-range temporal dependencies by generating attention weights that connect node-specific features with those across the entire temporal dimension. Comprehensive experiments on six real-world traffic datasets demonstrate that MAGCRN consistently outperforms state-of-the-art baselines in both traffic flow and speed prediction tasks. The code is available at \url{https://github.com/Aazeb/MAGCRN}.

Although recent advancements in end-to-end learning-based link prediction (LP) methods have shown remarkable capabilities, the significance of traditional similarity-based LP methods persists in unsupervised scenarios where there are no known link labels. However, the selection of node features for similarity computation in similarity-based LP can be challenging. Less informative node features can result in suboptimal LP performance. To address these challenges, we integrate self-supervised graph learning techniques into similarity-based LP and propose a novel method: Self-Supervised Similarity-based LP (3SLP). 3SLP is suitable for the unsupervised condition of similarity-based LP without the assistance of known link labels. Specifically, 3SLP introduces a dual-view contrastive node representation learning (DCNRL) with crafted data augmentation and node representation learning. DCNRL is dedicated to developing more informative node representations, replacing the node attributes as inputs in the similarity-based LP backbone. Extensive experiments over benchmark datasets demonstrate the salient improvement of 3SLP, outperforming the baseline of traditional similarity-based LP by up to 21.2% (AUC).

In the evolving field of urban development, precise traffic prediction is essential for optimizing traffic and mitigating congestion. While traditional graph learning-based models effectively exploit complex spatial-temporal correlations, their reliance on trivially generated graph structures or deeply intertwined adjacency learning without supervised loss significantly impedes their efficiency. This paper presents Contrastive Learning of spatial-tEmporal trAffic data Representations (CLEAR) framework, a comprehensive approach to spatial-temporal traffic data representation learning aimed at enhancing the accuracy of traffic predictions. Employing self-supervised contrastive learning, CLEAR strategically extracts discriminative embeddings from both traffic time-series and graph-structured data. The framework applies weak and strong data augmentations to facilitate subsequent exploitations of intrinsic spatial-temporal correlations that are critical for accurate prediction. Additionally, CLEAR incorporates advanced representation learning models that transmute these dynamics into compact, semantic-rich embeddings, thereby elevating downstream models' prediction accuracy. By integrating with existing traffic predictors, CLEAR boosts predicting performance and accelerates the training process by effectively decoupling adjacency learning from correlation learning. Comprehensive experiments validate that CLEAR can robustly enhance the capabilities of existing graph learning-based traffic predictors and provide superior traffic predictions with a straightforward representation decoder. This investigation highlights the potential of contrastive representation learning in developing robust traffic data representations for traffic prediction.

The recovery of coarsely sampled trajectories considering the road network topology characteristics is a crucial task for many downstream applications in intelligent transportation systems. Existing approaches in this domain primarily focus on extracting spatio-temporal correlations for the observed trajectory points but neglect the critical role of road network topology characteristics in making the recovery results more accurate and realistic. In addition, too many road segments in cities undermine the model inference performance. To address these challenges, we propose a novel Map-informed Adaptive Spatio-Temporal Autoencoder, which follows an encoder-decoder architecture for trajectory recovery. Specifically, we utilize a pre-trained attributed network embedding module to incorporate the road segment characteristics into the input data to make it easier for the model to extract the spatio-temporal dependencies from coarse trajectories. Furthermore, we construct a novel adaptive mask inference module that contains a distance-based mask matrix and a learnable adaptive mask matrix to assist the model in making segment inferences by weighting each candidate segment adaptively in the recovery process. To evaluate the performance of the proposed model, we conduct a series of comprehensive case studies on two representative real-world trajectory datasets. The experimental results demonstrate that the proposed model consistently outperforms state-of-the-art approaches.

Graph-based deep learning models are becoming prevalent for data-driven traffic prediction in the past years, due to their competence in exploiting the non-Euclidean spatial-temporal traffic data. Nonetheless, these models are approaching a limit where drastically increasing model complexity in terms of trainable parameters cannot notably improve the prediction accuracy. Furthermore, the diversity of transportation networks requires traffic predictors to be scalable to various data sizes and quantities, and ever-changing traffic dynamics also call for capacity sustainability. To this end, we propose a novel adaptive deep learning scheme for boosting graph-based traffic predictor performance. The proposed scheme utilizes domain knowledge to decompose the traffic prediction task into sub-tasks, each of which is handled by deep models with low complexity and training difficulty. Further, a stream learning algorithm based on the empirical Fisher information loss is devised to enable predictors to incrementally learn from new data without re-training from scratch. Comprehensive case studies on five real-world traffic datasets indicate outstanding performance improvement of the proposed scheme when equipped to six state-of-the-art predictors. Additionally, the scheme also provides impressive autoregressive long-term predictions and incremental learning efficacy with traffic data streams.

Travel time estimation (TTE) aims to predict travel duration and provide reliable planning for residential travel schedules. Trajectories naturally contain sequential features in form of GPS points with temporal precedence, which can be leveraged to improve prediction performance. Besides, the spatial information, i.e. the graph structure of the road network, can well represent the road highly and is commonly used to capture spatial information in traffic networks. However, extracting regional spatial information from trajectory data, in addition to its latitude and longitude information, poses a significant challenge due to the inherent format in which the trajectory data is recorded. In light of this, we propose a Graph-Transformer for Travel Time Estimation (GT-TTE) to utilize a Graph Transformer to adapt effectively to trajectories' sequential and spatial characteristics for improved TTE performance. By traversing the trajectory nodes with GT-TTE, we construct a graph structure for all trajectory points, thereby obtaining the relative spatial information of each point. Further, we obtain a region adjacency empirically more feature-rich over the sequential data. We evaluate GT-TTE on three real-world representative datasets and observe improvement by approximately 17% compared to the state-of-the-art baselines.

The cooperation between multiple microgrids (MGs) take a substantial role in enabling the process of information and energy exchange, which can increase the reliability of multi-microgrid (MMG) systems. Since MGs tend to be selfish in real-world operations, it is vital to address the way to motivate MGs to cooperate efficiently in MMG systems. In addition, considering the participated connected electric vehicles (CEVs) in CMT systems, the synergy between the MG-transportation coupled networks shall be accounted. In this paper, we propose a Stackelberg game theoretic approach for the noncooperative coupled microgrid-transportation (CMT) system by exploiting connected electric vehicles (CEVs). This formulated game can jointly trigger the MG energy trading and vehicle-to-grid coordination schemes in the system. To solve the CMT game with imperfect information, a Markov Decision Process (MDP) and a deep deterministic policy gradient-based methods are developed. The devised algorithm can learn a deterministic optimal response from the opponents. The game's Nash equilibrium can be approximately converged when the game is with imperfect information. Simulation results show that the proposed model can guarantee the effectiveness of the energy trading process in the CMT system. In addition, through the efficient CEV coordination strategies, the V2G regulation service is provided efficiently while it can further alleviate the grid power fluctuations. Furthermore, large economic benefits can be achieved under the CMT system.

Traffic speed forecasting has been a very active research area as it is essential for Intelligent Transportation Systems. Although a plethora of deep learning methods have been proposed for traffic speed forecasting, the majority of them can only make point-wise prediction, which may not provide enough information for critical real-world scenarios where prediction confidence also need to be estimated, e.g., route planning for ambulances and rescue vehicles. To address this issue, we propose a novel uncertainty-aware deep learning method coined Uncertainty-Aware Temporal Graph Convolutional Network (UAT-GCN). UAT-GCN employs a Graph Convolutional Network and Gated Recurrent Unit based architecture to capture spatio-temporal dependencies. In addition, UAT-GCN consists of a specialized regressor for estimating both epistemic (model-related) and aleatoric (data-related) uncertainty. In particular, UAT-GCN utilizes Monte Carlo dropout and predictive variances to estimate epistemic and aleatoric uncertainty, respectively. In addition, we also consider the recursive dependency between predictions to further improve the forecasting performance. An extensive empirical study with real datasets offers evidence that the proposed model is capable of advancing current state-of-the-arts in terms of point-wise forecasting and quantifying prediction uncertainty with high reliability. The obtained results suggest that, compared to existing methods, the RMSE and MAE of the proposed model on the SZ-taxi dataset are reduced by 2.15% and 7.23% , respectively; the RMSE and MAE of the proposed model on the Los-loop dataset are reduced by 4.17% and 8.53% , respectively.

Generating trajectory data is among promising solutions to addressing privacy concerns, collection costs, and proprietary restrictions usually associated with human mobility analyses. However, existing trajectory generation methods are still in their infancy due to the inherent diversity and unpredictability of human activities, grappling with issues such as fidelity, flexibility, and generalizability. To overcome these obstacles, we propose ControlTraj, a Controllable Trajectory generation framework with the topology-constrained diffusion model. Distinct from prior approaches, ControlTraj utilizes a diffusion model to generate high-fidelity trajectories while integrating the structural constraints of road network topology to guide the geographical outcomes. Specifically, we develop a novel road segment autoencoder to extract fine-grained road segment embedding. The encoded features, along with trip attributes, are subsequently merged into the proposed geographic denoising UNet architecture, named GeoUNet, to synthesize geographic trajectories from white noise. Through experimentation across three real-world data settings, ControlTraj demonstrates its ability to produce human-directed, high-fidelity trajectory generation with adaptability to unexplored geographical contexts.

Accurate and timely prediction of power system states is one of the most important challenging tasks in modern power systems. Considering the integration of renewable energy sources, recent deep learning-based models have been well studied and found to have benefits in exploiting spatial-temporal relationships in power system data. However, the complexity of different power system topology structures is not substantially captured since the existing models did not fully consider the graph-based information retrieved from power networks. To resolve the problem, a spatial-temporal attention graph-based network (ST-AGNet), an adaptive power system state prediction approach that utilizes graph-based information data to account various typologies of complex power systems, is proposed. Initially, the power flow model is used for generating historical system state data. With the graph-based topology information, the input dataset with the spatial and temporal features is fed into the proposed network for the training and validating process. Meanwhile, the connectivity of the time-varying graph-based information are accounted in the proposed model. Case studies demonstrate the superiority of the ST-AGNet model over the existing baselines under four different scales of complex systems, which can significantly support dynamic power system analysis and operational tasks.

Exploiting spatial-temporal correlations has long been regarded as the cornerstone of traffic state prediction. Among existing techniques, temporal graph neural networks (TGNNs) have recently emerged as a prominent solution for modeling complex spatial-temporal traffic data correlations. Existing studies on TGNNs mainly focus on developing new building blocks to embed hidden correlations into a unified latent representation, which is mapped to predictions of distinct horizons. However, mapping the same latent features to distinct scalar predictions makes the gradient computation challenging for updating model parameters in the relevant directions. Besides, TGNNs are biased towards the shared temporal patterns while neglecting the complex dependencies within each data series, which can be captured to enrich latent features. To handle these problems jointly, we propose a novel feature projection scheme for the traffic prediction framework of TGNNs. The proposed projection scheme is based on spatial convolutions that first generate horizon-specific feature maps and then transform them into scalar predictions of the corresponding horizons. These horizon-specific feature maps establish interactions between the unified latent representation and the corresponding output values to bring the predictions closer to the true values. Besides, the proposed scheme also serves as a pattern modeling phase that enhances the expressivity of TGNNs by enriching latent features with data source-wise patterns of distinct time steps. Comprehensive experiments on two real-world traffic datasets demonstrate that the proposed scheme enhances the predictive performance and reduces the model parameters of TGNNs.

Deep neural networks (DNNs) have emerged as a dominant approach for developing traffic forecasting models. These models are typically trained to minimize error on averaged test cases and produce a single-point prediction, such as a scalar value for traffic speed or travel time. However, single-point predictions fail to account for prediction uncertainty that is critical for many transportation management scenarios, such as determining the best- or worst-case arrival time. We present QUANTRAFFIC, a generic framework to enhance the capability of an arbitrary DNN model for uncertainty modeling. QUANTRAFFIC requires little human involvement and does not change the base DNN architecture during deployment. Instead, it automatically learns a standard quantile function during the DNN model training to produce a prediction interval for the single-point prediction. The prediction interval defines a range where the true value of the traffic prediction is likely to fall. Furthermore, QUANTRAFFIC develops an adaptive scheme that dynamically adjusts the prediction interval based on the location and prediction window of the test input. We evaluated QUANTRAFFIC by applying it to five representative DNN models for traffic forecasting across seven public datasets. We then compared QUANTRAFFIC against six uncertainty quantification methods. Compared to the baseline uncertainty modeling techniques, QUANTRAFFIC with base DNN architectures delivers consistently better and more robust performance than the existing ones on the reported datasets.

Connected Electric vehicles (CEVs), as promising core factors in smart cities, take a substantial role in advancing the quality of core transportation services in Intelligent Transportation Systems (ITSs). The application of CEVs triggers the transportability and sustainability of smart cities, especially for ride-sharing and dynamic scheduling operations. Additionally, the combined optimization of the application of these schemes can further contribute to the potential benefits in smart cities. In this paper, an online CEV system for joint ride-sharing and dynamic V2G scheduling is proposed. Specifically, we formulate the joint problem as a mixed-integer quadratic programming (MIQP) problem. To deal with the forecast uncertainties, we thereby formulate an online scheduling problem, which also accounts for the communication effect to the real-time interactions. In the meantime, a bi-level system algorithm is devised to coordinate the CEV operations through the Benders decomposition. The simulation results show that our proposed model guarantees the effectiveness of the provision of both the ride-sharing and V2G regulation services. Through efficient CEV routing strategies, the active grid power fluctuations can be well alleviated by the provisioning of the V2G regulation service. Furthermore, these promising results contribute to large economic benefits in entire system operations.

Knowledge graph (KG) embedding methods predict missing links by computing the similarities between entities. The existing embedding methods are designed with either shallow or deep architectures. Shallow methods are scalable to large KGs but are limited in capturing fine-grained semantics. Deep methods can capture rich semantic interactions, but they require numerous model parameters. This study proposes a novel embedding model that effectively combines the strengths of both shallow and deep models. In particular, the proposed model adopts the design principles of shallow models and incorporates an expressive compositional operator inspired by deep models. This approach maintains the scalability while significantly enhancing the expressive capacity of the proposed model. Moreover, the proposed model learns embeddings using the Poincaré ball model of hyperbolic geometry to preserve the hierarchies between entities. The experimental results demonstrated the effectiveness of learning Poincaré embeddings with an expressive compositional operator. Notably, a substantial improvement of 2.4% in the Mean Reciprocal Rank (MRR) and a 1.4% improvement in hit@1 was observed on the CoDEx-m and CoDEx-s datasets, respectively, when compared to the current state-of-the-art methods. The proposed model was implemented using PyTorch 1.8.1, and experiments were conducted on a server with an NVIDIA GeForce RTX 2080 Ti GPU.

The application of Internet of electric vehicles has greatly enhanced the efficiency of the urban intelligent transportation system. The coordination of Internet of electric vehicles is crucial for improving the quality of public services in smart cities, such as vehicle-to-grid regulation and edge computing service. However, existing studies have unilaterally considered the application of one of these two services, which neglects the potential benefits of their combined optimization. In this paper, we propose an urban Internet of electric vehicle parking system for vehicle-to-grid scheduling. Specifically, we solve the problems of Internet of electric vehicles allocation and scheduling with joint vehicle-to-grid regulation service and edge computing service. First of all, we formulate the joint problem as a mixed-integer quadratic programming problem. Then, through the alternating direction method of multipliers method, we decouple the main problem into sub-problems for Internet of electric vehicles. Then, we devise a distributed algorithm to solve each sub-problem. The simulation results show that our proposed model is effective in Internet of electric vehicles' allocation and vehicle-to-grid scheduling for the joint regulation and edge computing service. Furthermore, the power fluctuations of the city power grid can be well flattened by providing the vehicle-to-grid regulation service through effective communication network protocols.

Pervasive integration of GPS-enabled devices and data acquisition technologies has led to an exponential increase in GPS trajectory data, fostering advancements in spatial-temporal data mining research. Nonetheless, GPS trajectories contain personal geolocation information, rendering serious privacy concerns when working with raw data. A promising approach to address this issue is trajectory generation, which involves replacing original data with generated, privacy-free alternatives. Despite the potential of trajectory generation, the complex nature of human behavior and its inherent stochastic characteristics pose challenges in generating high-quality trajectories. In this work, we propose a spatial-temporal diffusion probabilistic model for trajectory generation (DiffTraj). This model effectively combines the generative abilities of diffusion models with the spatial-temporal features derived from real trajectories. The core idea is to reconstruct and synthesize geographic trajectories from white noise through a reverse trajectory denoising process. Furthermore, we propose a Trajectory UNet (Traj-UNet) deep neural network to embed conditional information and accurately estimate noise levels during the reverse process. Experiments on two real-world datasets show that DiffTraj can be intuitively applied to generate high-fidelity trajectories while retaining the original distributions. Moreover, the generated results can support downstream trajectory analysis tasks and significantly outperform other methods in terms of geo-distribution evaluations. The code is included in the supplementary material.

Urban mobility analysis has been extensively studied in the past decade using a vast amount of GPS trajectory data, which reveals hidden patterns in movement and human activity within urban landscapes. Despite its significant value, the availability of such datasets often faces limitations due to privacy concerns, proprietary barriers, and quality inconsistencies. To address these challenges, this paper presents a synthetic trajectory dataset with high fidelity, offering a general solution to these data accessibility issues. Specifically, the proposed dataset adopts a diffusion model as its synthesizer, with the primary aim of accurately emulating the spatial-temporal behavior of the original trajectory data. These synthesized data can retain the geo-distribution and statistical properties characteristic of real-world datasets. Through rigorous analysis and case studies, we validate the high similarity and utility between the proposed synthetic trajectory dataset and real-world counterparts. Such validation underscores the practicality of synthetic datasets for urban mobility analysis and advocates for its wider acceptance within the research community. Finally, we publicly release the trajectory synthesizer and datasets, aiming to enhance the quality and availability of synthetic trajectory datasets and encourage continued contributions to this rapidly evolving field. The dataset and code are released at https://github.com/Yasoz/SynthTraj and https://anonymous.4open.science/r/SynthTraj-code.

Generative Adversarial Networks (GANs) are a remarkable creation with regard to deep generative models. Thanks to their ability to learn from complex data distributions, GANs have been credited with the capacity to generate plausible data examples, which have been widely applied to various data generation tasks over image, text, and audio. However, as with any powerful technology, GANs have a flip side: their capability to generate realistic data can be exploited for malicious purposes. Many recent studies have demonstrated the security and privacy (S&P) threats brought by GANs, especially the attacks on machine learning (ML) systems. Nevertheless, so far as we know, there is no existing survey that has systematically categorized and discussed the threats and strategies of these GAN-based attack methods. In this paper, we provide a comprehensive survey of GAN-based attacks and countermeasures. We summarize and articulate: (1) what S&P threats of GANs expose to ML systems; (2) why GANs are useful for certain attacks; (3) what strategies can be used for GAN-based attacks; (4) what countermeasures can be effective to GAN-based attacks. Finally, we provide several promising research directions combining the existing limitations of GAN-based studies and the prevailing trend in the associated research fields.

Recent studies indicate that Graph Neural Networks (GNNs) are vulnerable to adversarial attacks. Particularly, adversarially perturbing the graph structure, e.g., flipping edges, can lead to salient degeneration of GNNs' accuracy. In general, efficiency and stealthiness are two significant metrics to evaluate an attack method in practical use. However, most prevailing graph structure-based attack methods are query-intensive, which impacts their practical use. Furthermore, while the stealthiness of perturbations has been discussed in previous studies, the majority of them focus on the attack scenario targeting a single node. To fill the research gap, we present a global attack method against GNNs, Saturation adversarial Attack with Meta-gradient (SAM), in this paper. We first propose an enhanced meta-learning-based optimization method to obtain useful gradient information concerning graph structural perturbations. Then, leveraging the notion of saturation attack, we devise an effective algorithm to determine the perturbations based on the derived meta-gradients. Meanwhile, to ensure stealthiness, we introduce a similarity constraint to suppress the number of perturbed edges. Thorough experiments demonstrate that our method can effectively depreciate the accuracy of GNNs with a small number of queries. While achieving a higher misclassification rate, we also show that the perturbations developed by our method are not noticeable.

The use of trajectory data with abundant spatial-temporal information is pivotal in Intelligent Transport Systems (ITS) and various traffic system tasks. Location-Based Services (LBS) capitalize on this trajectory data to offer users personalized services tailored to their location information. However, this trajectory data contains sensitive information about users' movement patterns and habits, necessitating confidentiality and protection from unknown collectors. To address this challenge, privacy-preserving methods like K-anonymity and Differential Privacy have been proposed to safeguard private information in the dataset. Despite their effectiveness, these methods can impact the original features by introducing perturbations or generating unrealistic trajectory data, leading to suboptimal performance in downstream tasks. To overcome these limitations, we propose a Federated Variational AutoEncoder (FedVAE) approach, which effectively generates a new trajectory dataset while preserving the confidentiality of private information and retaining the structure of the original features. In addition, FedVAE leverages Variational AutoEncoder (VAE) to maintain the original feature space and generate new trajectory data, and incorporates Federated Learning (FL) during the training stage, ensuring that users' data remains locally stored to protect their personal information. The results demonstrate its superior performance compared to other existing methods, affirming FedVAE as a promising solution for enhancing data privacy and utility in location-based applications.

Travel time estimation is a crucial component of intelligent transportation systems, affecting various applications such as navigation, ride-hailing, and route planning. Traditional methods for travel time estimation rely on subjective judgments, limited data sources, and straightforward modeling techniques. Owing to recent advances in data mining and machine learning, numerous data-driven methods are adopted to address the problem that occurred in traditional schemes, which demonstrate exceptional performance. In this paper, we present a comprehensive survey of data-driven methods for travel time estimation, encompassing application scenarios, spatial-temporal modeling approaches, and data representation learning techniques. To support and promote further research in this field, we provide a valuable list of open data sources and source codes, offering researchers a solid foundation for their future endeavors. Furthermore, this survey discusses emerging trends and key challenges faced by the research community, such as the integration of real-time data streams and the use of uncertainty estimation. We also explore the potential impact of these advancements on transportation systems, highlighting opportunities for improvement and innovation. To the best of our knowledge, this work is among the first to offer a comprehensive, in-depth review of data-driven methods for travel time estimation, providing researchers and practitioners with a valuable reference in the field.

Autonomous vehicles (AVs) have become an emerging crucial component of the intelligent transportation system (ITS) in modern smart cities. In particular, coordinated operations of AVs can potentially enhance the quality of public services, e.g. logistic and AV charging services. However, the joint logistic and AV charging scenario involves the sophisticated interactions between a large number of complicated agents, dynamic logistic, and electricity prices in real-world systems. Since AVs are individuals owned by different parties, the design of attractive incentive to motivate them to provide multiple public services becomes a fundamental issue. In this paper, we develop an urban intelligent system (UIS) by exploiting the efficient incentive mechanisms, e.g. non-cooperative and cooperative game theoretic approaches, to motivate the AVs to provide logistic and charging services in UIS. For the non-cooperative game approach, we formulate the interaction between the selfish AVs and the aggregator as a Stackelberg game. Meanwhile, the aggregator, known as the leader in the game, aims to decide the logistic and electricity trading prices, and then the AVs, executed as the followers, determine their service schedules. Furthermore, considering that all the players are willing to cooperate, we develop a cooperative potential game for the selfless AVs to maximize the social welfare of the UIS. These case studies demonstrate the effectiveness and practicability of proposed incentive mechanisms that can motivate EVs to provide high quality logistic and charging services by maximizing their utilities. Also, both the proposed schemes provide significant system revenues than that of conventional system optimization-based approaches.

In modern traffic management, one of the most essential yet challenging tasks is accurately and timely predicting traffic. It has been well investigated and examined that deep learning-based Spatio-temporal models have an edge when exploiting Spatio-temporal relationships in traffic data. Typically, data-driven models require vast volumes of data, but gathering data in small cities can be difficult owing to constraints such as equipment deployment and maintenance costs. To resolve this problem, we propose TrafficTL, a cross-city traffic prediction approach that uses big data from other cities to aid data-scarce cities in traffic prediction. Utilizing a periodicity-based transfer paradigm, it identifies data similarity and reduces negative transfer caused by the disparity between two data distributions from distant cities. In addition, the suggested method employs graph reconstruction techniques to rectify defects in data from small data cities. TrafficTL is evaluated by comprehensive case studies on three real-world datasets and outperforms the state-of-the-art baseline by around 8 to 25 percent.

As graphs are getting larger and larger, federated graph learning (FGL) is increasingly adopted, which can train graph neural networks (GNNs) on distributed graph data. However, the privacy of graph data in FGL systems is an inevitable concern due to multiparty participation. Recent studies indicated that the gradient leakage of trained GNN can be used to infer private graph data information utilizing model inversion attacks (MIA). Moreover, the central server can legitimately access the local GNN gradients, which makes MIA difficult to counter if the attacker is at the central server. In this paper, we first identify a realistic crowdsourcing-based FGL scenario where MIA from the central server towards clients' subgraph structures is a nonnegligible threat. Then, we propose a defense scheme, Subgraph-Out-of-Subgraph (SOS), to mitigate such MIA and meanwhile, maintain the prediction accuracy. We leverage the information bottleneck (IB) principle to extract task-relevant subgraphs out of the clients' original subgraphs. The extracted IB-subgraphs are used for local GNN training and the local model updates will have less information about the original subgraphs, which renders the MIA harder to infer the original subgraph structure. Particularly, we devise a novel neural network-powered approach to overcome the intractability of graph data's mutual information estimation in IB optimization. Additionally, we design a subgraph generation algorithm for finally yielding reasonable IB-subgraphs from the optimization results. Extensive experiments demonstrate the efficacy of the proposed scheme, the FGL system trained on IB-subgraphs is more robust against MIA attacks with minuscule accuracy loss.

Graphs provide a unique representation of real-world data. However, recent studies found that inference attacks can extract private property information of graph data from trained graph neural networks (GNNs), which arouses privacy concerns about graph data, especially in collaborative learning systems where model information is more accessible. While there has been a few research efforts on the property inference attacks against GNNs, how to defend against such attacks has seldom been studied. In this paper, we propose to leverage the information bottleneck (IB) principle to defend against the property inference attacks. Particularly, we involve a threat model, where the attacker can extract graph property from the graph embedding developed by GNNs. To defend against the attacks, we use IB to construct new graph structures from the original graphs. The change in graph structures enables the new graphs to contain less information related to the property information of the original graphs, making it harder for attackers to infer property information of the original graphs from the graph embeddings. Meantime, the IB principle enables task-relevant information to be sufficiently contained the new graph, enabling GNNs to develop accurate predictions. The experimental results demonstrate the efficacy of the proposed approach in resisting property inference attacks and developing accurate predictions.

Traffic speed prediction based on real-world traffic data is a classical problem in intelligent transportation systems (ITS). Most existing traffic speed prediction models are proposed based on the hypothesis that traffic data are complete or have rare missing values. However, such data collected in real-world scenarios are often incomplete due to various human and natural factors. Although this problem can be solved by first estimating the missing values with an imputation model and then applying a prediction model, the former potentially breaks critical latent features and further leads to the error accumulation issues. To tackle this problem, we propose a graph-based spatio-temporal autoencoder that follows an encoder-decoder structure for spatio-temporal traffic speed prediction with missing values. Specifically, we regard the imputation and prediction as two parallel tasks and train them sequentially to eliminate the negative impact of imputation on raw data for prediction and accelerate the model training process. Furthermore, we utilize graph convolutional layers with a self-adaptive adjacency matrix for spatial dependencies modeling and apply gated recurrent units for temporal learning. To evaluate the proposed model, we conduct comprehensive case studies on two real-world traffic datasets with two different missing patterns and a wide and practical missing rate range from 20% to 80%. Experimental results demonstrate that the model consistently outperforms the state-of-the-art traffic prediction with missing values methods and achieves steady performance in the investigated missing scenarios and prediction horizons.

Uncertainty is an essential consideration for time series forecasting tasks. In this work, we specifically focus on quantifying the uncertainty of traffic forecasting. To achieve this, we develop Deep Spatio-Temporal Uncertainty Quantification (DeepSTUQ), which can estimate both aleatoric and epistemic uncertainty. We first leverage a spatio-temporal model to model the complex spatio-temporal correlations of traffic data. Subsequently, two independent sub-neural networks maximizing the heterogeneous log-likelihood are developed to estimate aleatoric uncertainty. For estimating epistemic uncertainty, we combine the merits of variational inference and deep ensembling by integrating the Monte Carlo dropout and the Adaptive Weight Averaging re-training methods, respectively. Finally, we propose a post-processing calibration approach based on Temperature Scaling, which improves the model's generalization ability to estimate uncertainty. Extensive experiments are conducted on four public datasets, and the empirical results suggest that the proposed method outperforms state-of-the-art methods in terms of both point prediction and uncertainty quantification.

Network partitioning is recognized as an effective auxiliary approach for solving transportation tasks on largescale traffic networks in a domain-decomposition manner. Most of the existing related partitioning algorithms are explicitly designed to traffic management problems and merely focus on the implied topology of the networks. In this paper, towards the practical problems that happened to traffic forecasting tasks, we propose a network-partitioning-based domain-decomposition framework to improve GCN-based predictors' performance on large-scale transportation networks. Particularly, we devise a data-driven network-partitioning approach, namely, SpeedMatching-Partitioning, which employs not only the topological features but also the traffic speed observations of traffic networks for partitioning. Additionally, we propose a data-parallel training strategy that feeds partitioned sub-networks into independent predictors for parallel training. The proposed approach is tested by comprehensive case studies on three real-world datasets to evaluate its effectiveness. The results indicate that the proposed approach can help improve GCN-based predictors' accuracy and training efficiency on both small and relatively large traffic datasets. Furthermore, we investigate the model sensitivity to the selection of graph representations and framework parameters, and the learning efficiency of the data-parallel training strategy.

Estimation of road link travel time serves a critical role in intelligent transportation operation and management. Due to the uncertainty nature contributed by the volatile traffic, travel time estimates are better described by probability distributions than deterministic models. Existing travel time distribution estimation approaches are mostly based on predefined probability distributions. Other approaches, while relaxing the constraint, fail to utilize the topological information and are data-inefficient. In this paper, we propose a novel Bayesian and geometric deep learning-based approach to estimate the travel time distributions of road links within citywide transportation networks based on vehicular GPS trajectories. Particularly, historical or real-time trajectories are first pre-processed to construct partial travel time maps, which are input into a tailor-made Bayesian graph autoencoder to reconstruct multiple complete travel time maps. We further adopt an auxiliary neural network to facilitate the parameter training of the proposed approach following adversarial training principles. To evaluate the proposed approach, we employ a real-world vehicular trajectory dataset in a series of comprehensive case studies. The empirical results indicate that the proposed approach outperforms the best-performing state-of-the-art baseline with an approximately 10% Kullback-Leibler divergence reduction.

Recent years have witnessed the prevalence of memory-based methods for Semi-supervised Video Object Segmentation (SVOS) which utilise past frames efficiently for label propagation. When conducting feature matching, fine-grained multi-scale feature matching has typically been performed using all query points, which inevitably results in redundant computations and thus makes the fusion of multi-scale results ineffective. In this paper, we develop a new Point-based Memory Network, termed as PMNet, to perform fine-grained feature matching on hard samples only, assuming that easy samples can already obtain satisfactory matching results without the need for complicated multi-scale feature matching. Our approach first generates an uncertainty map from the initial decoding outputs. Next, the fine-grained features at uncertain locations are sampled to match the memory features on the same scale. Finally, the matching results are further decoded to provide a refined output. The pointbased scheme works with the coarsest feature matching in a complementary and efficient manner. Furthermore, we propose an approach to adaptively perform global or regional matching based on the motion history of memory points, making our method more robust against ambiguous backgrounds. Experimental results on several benchmark datasets demonstrate the superiority of our proposed method over state-of-the-art methods.

As one of the fundamental problems in the field of video understanding, video object segmentation aims at segmenting objects of interest throughout the given video sequence. Recently, with the advancements of deep learning techniques, deep neural networks have shown outstanding performance improvements in many computer vision applications, with video object segmentation being one of the most advocated and intensively investigated. In this paper, we present a systematic review of the deep learning-based video segmentation literature, highlighting the pros and cons of each category of approaches. Concretely, we start by introducing the definition, background concepts and basic ideas of algorithms in this field. Subsequently, we summarise the datasets for training and testing a video object segmentation algorithm, as well as common challenges and evaluation metrics. Next, previous works are grouped and reviewed based on how they extract and use spatial and temporal features, where their architectures, contributions and the differences among each other are elaborated. At last, the quantitative and qualitative results of several representative methods on a dataset with many remaining challenges are provided and analysed, followed by further discussions on future research directions. This article is expected to serve as a tutorial and source of reference for learners intended to quickly grasp the current progress in this research area and practitioners interested in applying the video object segmentation methods to their problems.

Accurate long-term origin-destination demand (OD) prediction can help understand traffic flow dynamics, which plays an essential role in urban transportation planning. However, the main challenge originates from the complex and dynamic spatial-temporal correlation of the time-varying traffic information. In response, a graph deep learning model for long-term OD prediction (ST-GDL) is proposed in this paper, which is among the pioneering work that obtains both short-term and long-term OD predictions simultaneously. ST-GDL avoids the conventional multi-step forecasting and thus prevents learning from prediction errors, rendering better long-term forecasts. The proposed method captures time attributes from multiple time scales, namely closeness, periodicity, and trend, to study the features with temporal dynamics. Besides, two gate mechanisms are introduced over the vanilla convolution operation to alleviates the error accumulation issue of typical recurrent forecast in long-term OD prediction. A method based on graph convolution is proposed to capture the dynamic spatial relationship, which projects the transportation network into a graphical time-series. Finally, the long-term OD prediction results are obtained by combining the extracted spatio-temporal features with external features from the meteorological information. Case studies on a practical dataset show that the proposed model is superior to existing methods in long-term OD prediction problems.

Estimated time of arrival (ETA) is one of the critical services offered by navigation and hailing providers. The majority of existing solutions approach ETA as a regression problem and leverage GPS trajectories for estimation. However, the travel time fluctuates greatly between different trips, making simple regression methods skewed. Additionally, these methods are incapable of conducting estimation in practice because the trajectories of future trips are unknown. To jointly tackle these problems, we propose a novel Categorical approximate method to Estimate Time of Arrival (CatETA). Specifically, we formulate the ETA problem as a classification problem and label it with the average time of each category. To eliminate bias in categorical labeling, we approximate travel time using the weighted average of different classes in the testing stage. Then, we design a network structure that extracts the spatio-temporal features of link sequences and integrates a set of global information. Furthermore, we merge link sequences according to network topology and graph embedding to alleviate the computational burden associated with large-scale link networks. Comprehensive experiments on real-world datasets demonstrate that CatETA considerably improves the estimation performance and significantly reduces computational effort.

Along with urbanization and the deployment of GPS sensors in vehicles and mobile phones, massive amounts of trajectory data have been generated for city areas. The analysis of these data has substantially contributed to research and advancements of travel time estimation. However, existing work focuses on estimating travel time inside a particular area, and cross-area travel time estimation has privacy security challenges due to data exchange issues among areas. Meanwhile, the majority of methods estimate a deterministic travel time for a given trajectory, which does not account for complex traffic situations and user requirements. To address these problems, we propose a cross-area travel time uncertainty estimation algorithm for estimating the uncertainty of travel times while preserving privacy among different areas. Specifically, we design a comprehensive cross-area privacy-preserving solution that trains a tailor-made neural network travel time estimator in each area by local data, and incorporates federated learning for training. Furthermore, we employ Bayesian deep learning principles and adopt Monte-Carlo dropout to quantify the uncertainty associated with travel time. To evaluate the proposed approach, we conduct a series of comprehensive case studies with two real-world trajectory datasets. Extensive results demonstrate the superiority of the proposed approach compared to baselines in the context of the cross-area setting.

As a longstanding learning paradigm, multi-task learning has been widely applied into a variety of machine learning applications. Nonetheless, identifying which tasks should be learned together is still a challenging fundamental problem because the possible task combinations grow exponentially with the number of tasks, and existing solutions heavily relying on heuristics may probably lead to ineffective groupings with severe performance degradation. To bridge this gap, we develop a systematic multi-task grouping framework with a new meta-learning problem on task combinations, which is to predict the per-task performance gains of multi-task learning over single-task learning for any combination. Our underlying assumption is that no matter how large the space of task combinations is, the relationships between task combinations and performance gains lie in some low-dimensional manifolds and thus can be learnable. Accordingly, we develop a neural meta learner, MTG-Net, to capture these relationships, and design an active learning strategy to progressively select meta-training samples. In this way, even with limited meta samples, MTG-Net holds the potential to produce reasonable gain estimations on arbitrary task combinations. Extensive experiments on diversified multi-task scenarios demonstrate the efficiency and the effectiveness of our method. Specifically, in a large-scale evaluation with tasks, which produce over one hundred million task combinations, our method almost doubles the performance obtained by the existing best solution given roughly the same computational cost. Data and code are available at https://anonymous.4open.science/r/MTG-Net-DB77.

Autonomous vehicle (AV) integration poses a significant challenge for intelligent transportation systems (ITSs). The ability to automatically coordinate complex AV operations at scale is crucial for advancing the quality of core transportation services, such as ride-sharing and parcel delivery. However, existing studies have only considered either of these two services independently from the other, disregarding the potential benefits of their combined optimization. To address this open problem, we design an autonomous vehicle intelligent system (AVIS) providing joint ride-sharing and parcel delivery services under realistic ride and route constraints. We formulate the joint optimization problem through the scope of mixed-integer linear programming and solve it using the Lagrangian dual decomposition method to ensure scalability. We conduct extensive case studies to evaluate the performance of the proposed AVIS and its constituting components. Our experimental results demonstrate that AVIS can effectively provide both ride-sharing and parcel delivery services while satisfying service requests in transportation networks of various scales. In addition, the distributed method is shown to generate near-optimal solutions in reduced computation time.

In practice, traffic data collection is often warned by missing data due to communication errors, sensor failures, storage loss, among other factors, leading to impaired data collection and hampering the effectiveness of downstream applications. However, existing imputation approaches focus exclusively on estimating the lost value from incomplete observations and ignore historical data. In this paper, we propose a novel neural network model, namely, Attention-Driven Recurrent Imputation Network (ADRIN), to address the problem of missing traffic data. Specifically, in ADRIN, we devise an Imputation-targeted Long Short-Term Memory (LSTM-I) module for filling in missing data. Meanwhile, we consider the periodicity of historical data and design a historical average calculation module in ADRIN. On this basis, we employ the multi-head self-attention mechanism for further extracting latent temporal features from the output of the two modules. ADRIN is capable of modeling both incomplete observation inputs and historical averages independently to estimate the missing values. We conducted comprehensive experiments on three real-world traffic datasets, to demonstrate that ADRIN consistently outperforms other baselines in a variety of scenarios. Furthermore, ablation experiments are conducted on the various modules of the model, and it is concluded that historical data can significantly enhance the imputation effect.

Modern power systems are incorporated with distributed energy sources to be environmental-friendly and cost-effective. However, due to system uncertainties integrated with renewable energy sources, operations require to adopt effective strategies to stabilize the entire power system. Hence, the system operator need an accurate prediction tool to forecast dynamic system states effectively. In this paper, we propose a Bayesian deep learning approach to predict the dynamic system state in a general power system. First, the input system dataset with multiple system features requires the stage of data pre-processing. Second, we obtain the dynamic state matrix of a general power system through the Newton-Raphson power flow model. Third, by incorporating the state matrix with the system features, we propose a Bayesian long short-term memory network to predict the dynamic system state variables accurately. Simulation results show that accurate prediction can be achieved at different scales of power systems through the proposed Bayesian deep learning approach.

Graph learning-based algorithms are becoming the prevalent traffic prediction solutions due to their capability of exploiting non-Euclidean spatial-temporal traffic data correlation. However, current predictors primarily employ heuristically constructed static traffic graphs in forecasting, which may not describe the latent traffic dynamics well. Existing attempts on dynamically generated traffic graphs also face challenges like prolonged model training time and undermined model expressibility. In this paper, a novel data-driven graph construction scheme based on graph adjacency learning is proposed for graph learning-based traffic predictors. The proposed scheme explores inter-time-series dependency with the graph attention mechanism to embed the sensor correlation in a latent attention space, which determines the correlation of any possible sensor pairs for traffic graph construction. Comprehensive case studies on three real-world traffic datasets reveal that the proposed scheme outperforms state-of-the-art static and dynamic graph construction baselines. Additionally, time-varying and sparse graph construction schemes are devised and assessed to boost the efficacy, and a hyper-parameter test develops guidelines for parameter and model architecture selection.

Efficient collaboration between collaborative machine learning and wireless communication technology, forming a Federated Edge Learning (FEEL) has spawned a series of next-generation intelligent applications. FEEL faces heterogeneous data and non-IID (Independent and Identically Distributed) data, and the communication cost between edge devices (or clients) is much more expensive than their local computational overhead, which is not friendly to the resource-constrained FEEL. Thus, we propose a distributed approximate Newton-type algorithm with fast convergence speed to ameliorate the problem of FEEL resource (in terms of communication resources) constraints. Specifically, the proposed algorithm is improved based on L-BFGS and allows each client to approximate the high-cost Hessian matrix by computing the low-cost Fisher matrix in a distributed manner to find a “better” descent direction, thereby speeding up convergence. Second, we prove that the proposed algorithm has linear convergence in both strongly convex and non-convex cases and analyze its computational and communication complexity. Furthermore, we design a simple but elegant training scheme, namely Federated Ove-vs-All (FedOVA) to solve the heterogeneous statistical challenge brought by heterogeneous data. In this way, FedOVA first decomposes a multi-class classification problem into more straightforward binary classification problems and then combines their respective outputs using ensemble learning. Extensive case studies show that the performance of our method is better than the classic federated average algorithm and data sharing scheme on heterogeneous data and non-IID data. Notably, compared with distributed stochastic gradient descent, the proposed algorithm needs fewer communication iterations to achieve comparable performance.

Autonomous vehicles (AVs), as one of the cores in future intelligent transportation systems (ITSs), can facilitate reliable and safe traffic operations and services. The ability to automatically perform effective AV motion planning and deploy efficient perception systems is vital for advancing the quality of core transportation services. However, existing research studies have only considered the applications of either of these approaches, which neglect their necessary interactions in real-world AV motion planning systems. To address this problem, we design an AV motion planning strategy based on motion prediction and V2V communication. Specifically, we propose the perception system and V2V communication module to provide real-time traffic and vehicular information to the participated AVs. Then, we formulate the AV lane-change motion planning problem through the scope of model predictive control based problem, as well as proposing the method on learning optimal motion planning by means of a novel deep learning technique. We conduct extensive case studies to evaluate the performance of the proposed system model. Our experimental results demonstrate the effectiveness of the proposed system model under various traffic conditions. In addition, the robustness of the perception system is guaranteed by utilizing the Car Learning to Act (CARLA) system with available V2V communication.

Traffic speed prediction is among the foundations of advanced traffic management and the gradual deployment of internet of things sensors is empowering data-driven approaches for the prediction. Nonetheless, existing research studies mainly focus on short-term traffic prediction that covers up to one hour forecast into the future. Previous long-term prediction approaches experience error accumulation, exposure bias, or generate future data of low granularity. In this paper, a novel data-driven, long-term, high-granularity traffic speed prediction approach is proposed based on recent development of graph deep learning techniques. The proposed model utilizes a predictor-regularizer architecture to embed the spatial-temporal data correlation of traffic dynamics in the prediction process. Graph convolutions are widely adopted in both sub-networks for geometrical latent information extraction and reconstruction. To assess the performance of the proposed approach, comprehensive case studies are conducted on real-world datasets and consistent improvements can be observed over baselines. This work is among the pioneering efforts on network-wide long-term traffic speed prediction. The design principles of the proposed approach can serve as a reference point for future transportation research leveraging deep learning.

Federated Learning (FL) is widely adopted in traffic forecasting tasks involving large-scale IoT-enabled sensor data since its decentralization nature enables data providers' privacy to be preserved. When employing state-of-the-art deep learning-based traffic predictors in FL systems, the existing FL frameworks confront overlarge communication overhead when transmitting these models' parameter updates since the modelling depth and breadth renders them incorporating enormous number of parameters. In this paper, we propose a practical FL scheme, namely, Clustering-based hierarchical and Two-step-optimized FL (CTFed), to tackle this issue. The proposed scheme follows a divide et impera strategy that clusters the clients into multiple groups based on the similarity between their local models' parameters. We integrate the particle swarm optimization algorithm and devises a two-step approach for local model optimization. This scheme enables only one but representative local model update from each cluster to be uploaded to the central server, thus reduces the communication overhead of the model updates transmission in FL. CTFed is orthogonal to the gradient compression- or sparsification-based approaches so that they can orchestrate to optimize the communication overhead. Extensive case studies on three real-world datasets and three state-of-the-art models demonstrate the outstanding training efficiency, accurate prediction performance and robustness to unstable network environments of the proposed scheme.

Privacy-preserving Transportation Mode Identification (TMI) is among the key challenges towards future intelligent transportation systems. With recent developments in federated learning (FL), crowdsourcing has emerged as a promising cost-effective data source for training powerful TMI classifiers without compromising users' data privacy. However, existing TMI approaches have relied heavily on the availability of transportation mode labels, which is often limited in real-world applications. While recent semi-supervised studies have partially addressed this issue by assigning pseudo-labels to unlabeled data, such practice often degrades classification performance as more unlabeled data are incorporated. In response to this issue, we present a semi-supervised FL scheme for TMI termed Mean Teacher Semi-Supervised Federated Learning (MTSSFL). MTSSFL trains a deep neural network ensemble under a novel semi-supervised FL framework, achieving highly accurate and privacy-protected crowdsourced TMI without depending on the availability of massive labeled data. MTSSFL introduces consistency-updating to insert the global model in the gradient updates of the local models that only have unlabeled data to improve their training. We also devise mean-teacher-averaging, a secure parameter aggregation mechanism that further boosts the global model's TMI performance without requiring additional training. Our extensive case studies on a real-world dataset demonstrate that MTSSFL's classification accuracy is merely 1.1% lower than the state-of-the-art semi-supervised TMI approach while being the only one to satisfy FL's privacy-preserving constraints. In addition, MTSSFL can achieve high accuracy with less training overhead due to the proposed semi-supervised learning design.

Electric vehicle (EV) dynamic wireless charging system has become an emerging application in the area of the intelligent transportation system (ITS). However, an integrated design of EV dynamic wireless charging system requires the considerations of both the economical and technical perspectives of a smart city. Specifically, most of the existing researches unilaterally considers the application of either placement strategy for power tracks (PTs) or dynamic vehicle-to-grid (V2G) scheduling. In this paper, we propose a multi-stage system framework to account for an integrated EV dynamic wireless charging system in a smart city. First of all, an optimal placement strategy for PTs is developed based on city traffic information and EV energy demand. Then, having the optimal locations of PTs through the previous stage approach, the proposed dynamic V2G scheduling scheme is formulated to coordinate the schedules of EVs with the provision of daytime V2G ancillary services. Our simulation results present that the proposed multi-stage system model achieves improvements on both the placement strategy and V2G scheduling scheme. In addition, relatively low economic system costs can be obtained through our proposed model.

The existing Federated Learning (FL) systems encounter an enormous communication overhead when employing GNN-based models for traffic forecasting tasks since these models commonly incorporate enormous number of parameters to be transmitted in the FL systems. In this paper, we propose a FL framework, namely, Clustering-based hierarchical and Two-step-optimized FL (CTFL), to overcome this practical problem. CTFL employs a divide-and-conquer strategy, clustering clients based on the closeness of their local model parameters. Furthermore, we incorporate the particle swarm optimization algorithm in CTFL, which employs a two-step strategy for optimizing local models. This technique enables the central server to upload only one representative local model update from each cluster, thus reducing the communication overhead associated with model update transmission in the FL. Comprehensive case studies on two real-world datasets and two state-of-the-art GNN-based models demonstrate the proposed framework's outstanding training efficiency and prediction accuracy, and the hyperparameter sensitivity of CTFL is also investigated.

GPS trajectories serve as a significant data source for travel mode identification along with the development of various GPS-enabled smart devices. However, such data directly integrate user private information, thus hindering users from sharing data with third parties. On the other hand, existing identification methods heavily depend on the respective manual travel mode annotations, whose production is economically inefficient and error-prone. In this paper, we propose a Semi-supervised Federated Learning (SSFL) framework that can accurately identify travel modes without using users' raw trajectories data or relying on notable data labels. Specifically, we propose a new identification model named convolutional neural network-gated recurrent unit model in SSFL to accurately infer travel modes from GPS trajectories. Second, we design a pseudo-labeling method for the clients to set pseudo-labels on their local unlabeled dataset by using a small public dataset at the server. Furthermore, we adopt a grouping-based aggregation scheme and a data flipping augmentation scheme, which can boost the convergence and performance of the proposed framework. Comprehensive evaluations on a real-world dataset show that SSFL outperforms centralized semi-supervised baselines and is robust to the non-independent and identically distributed data commonly seen in practice.

Federated learning has been applied to various tasks in intelligent transportation systems to protect data privacy through decentralized training schemes. The majority of the state-of-the-art models in intelligent transportation systems (ITS) are graph neural networks (GNN)-based for spatial information learning. When applying federated learning to the ITS tasks with GNN-based models, the existing frameworks can only protect the data privacy; however, ignore the one of topological information of transportation networks. In this work, we propose a novel federated learning framework to tackle this problem. Specifically, we introduce a differential privacy-based adjacency matrix preserving approach for protecting the topological information. We also propose an adjacency matrix aggregation approach to allow local GNN-based models to access the global network for a better training effect. Furthermore, we propose a GNN-based model named Attention-based Spatial-Temporal Graph Neural Networks (ASTGNN) for traffic speed forecasting. We integrate the proposed federated learning framework and ASTGNN as FASTGNN for traffic speed forecasting. Extensive case studies on a real-world dataset demonstrate that FASTGNN can develop accurate forecasting under the privacy preservation constraint.

Time Delay Reservoir (TDR) can exhibit effects of high dimensionality and short-term memory based on delay differential equations (DDEs), as well as having hardware-friendly characteristics. However, the predictive performance and memory capacity of the standard TDRs are still limited, and dependent on the hyperparameter of oscillation function. In this paper, we first analyze these limitations and their corresponding reasons. We find that the reasons for such limitations are fused by two aspects, which are the trade-off between the strength of self-feedback and neighboring-feedback caused by neuron separation, as well as the unsuitable order setting of the nonlinear function in DDE. Therefore, we propose a new form of TDR with second-order time delay and a hyperparameter-free nonlinear function to overcome such limitations. Our experiments show that the proposed approach achieves better predictive performance and memory capacity compared with the standard TDR.

Traffic lights control could be regarded as a multi-agent coordinated problem. A model-free reinforcement learning (RL) approach is a powerful framework for solving such coordinated policy-making problems without prior environmental knowledge. In order to approach a global policy, communication among agents needs to be built. To enable dynamic and scalable communication, we propose a new RL model, CommNet based on Local Attention Mechanism (Attn-CommNet), which uses local selection and attention mechanism between hidden layers to facilitate cooperation. We evaluated the proposed method using synthetic and real word traffic flows under multi-scale road networks. The results demonstrate that the proposed method can get better performance in multi-scale problems, especially large-scale problems compared to the state-of-the-art methods.

The deployment of Global Positioning System (GPS) sensors in modern smartphones and wearable devices has enabled the acquisition of high-coverage urban trajectories. Extracting knowledge from such diverse spatiotemporal data is essential for optimizing intelligent transportation system operations. Yet a deeper understanding of users' mobility patterns also requires identifying their associated transportation modes. Combined with growing privacy concerns, the considerable effort involved in manual data annotation means that GPS trajectories are in reality not labeled by transportation mode. This poses a significant challenge for machine learning classifiers, which often perform best when trained on large amounts of labeled data. As such, this paper investigates a wide range of time series augmentation methods aiming to improve the real-world applicability of transportation mode identification. In our extensive experiments on Microsoft's Geolife dataset, both discrete wavelet transform and flip augmentations pushed the transportation mode identification accuracy of a convolutional neural network from 85.1% to 87.3% and 87.2%, respectively.

Missing traffic data problem has a significant negative impact for data-driven applications in Intelligent Transportation Systems (ITS). However, existing models mainly focus on the imputation results under Missing Completely At Random (MCAR) task, and there is a considerable difference between MCAR with the situation encountered in real life. Furthermore, some existing state-of-the-art models can be vulnerable when dealing with other imputation tasks like block miss imputation. In this paper, we propose a novel deep learning model TINet for missing traffic data imputation problems. TINet uses the self-attention mechanism to dynamically adjust the weight for each entries in the input data. This architecture effectively avoids the limitation of the Fully Connected Network (FCN). Furthermore, TINet uses multi-dimensional embedding for representing data's spatial-temporal positional information, which alleviates the computation and memory requirements of attention-based model for multi-dimentional data. We evaluate TINet with other baselines on two real-world datasets. Different from the previous work that only employs MCAR for testing, our experiment also tested the performance of models on the Block Miss At Random (BMAR) tasks. The results show that TINet outperforms baseline imputation models for both MCAR and BMAR tasks with different missing rates.

High-quality traffic data is crucial for intelligent transportation system and its data-driven applications. However, data missing is common in collecting real-world traffic datasets due to various factors. Thus, imputing missing values by extracting traffic characteristics becomes an essential task. By using conventional convolutional neural network layers or focusing on standalone road sections, existing imputation methods cannot model the non-Euclidean spatial correlations of complex traffic networks. To address this challenge, we propose a graph attention convolutional network (GACN), a novel model for traffic data imputation. Specifically, the model follows an encoder-decoder structure and incorporates graph attention mechanism to learn spatial correlation of the traffic data collected by adjacent sensors on traffic graph. Temporal convolutional layers are stacked to extract relations in time-series after graph attention layers. Through comprehensive case studies on the dataset from the Caltrans performance measurement system (PeMS), we demonstrate that the proposed GACN consistently outperforms other baselines and has steady performance in extreme missing rate scenarios.

Intelligent transportation systems and related applications rely on high-quality traffic data. However, the data collected in real-world is often incomplete, which compromises the system performance. Traffic data imputation estimates the missing values by analyzing traffic flow features, therefore can improve the performance of related applications. Traditional imputation methods mainly focus on isolated traffic data sensors or road sections and show their limitations in representing complex spatial-temporal features. In this paper, we propose a novel ensemble model named ensemble convolutional autoencoder for the task. The observed values, together with the missing points are reconstructed into a two-dimensional matrix by the extracted spatial-temporal relation. Convolutional and deconvolutional layers are adopted to encode and decode spatial-temporal features, respectively. Besides, we train autoencoders with different input feature maps and ensemble the outputs by linear combination. Experimental results show that compared with other traffic data imputation methods, the proposed method can achieve better accuracy and has stable performance under various missing data scenarios with different types and rates.

How to obtain accurate travel time predictions is among the most critical problems in Intelligent Transportation Systems (ITS). Recent literature has shown the effectiveness of machine learning models on travel time forecasting problems. However, most of these models predict travel time in a point estimation manner, which is not suitable for real scenarios. Instead of a determined value, the travel time within a future time period is a distribution. Besides, they all use grid structure data to obtain the spatial dependency, which does not reflect the traffic network's actual topology. Hence, we propose GCGTTE to estimate the travel time in a distribution form with Graph Deep Learning and Generative Adversarial Network (GAN). We convert the data into a graph structure and use a Graph Neural Network (GNN) to build its spatial dependency. Furthermore, GCGTTE adopts GAN to approximate the real travel time distribution. We test the effectiveness of GCGTTE with other models on a real-world dataset. Thanks to the fine-grained spatial dependency modeling, GCGTTE outperforms the models that build models on a grid structure data significantly. Besides, we also compared the distribution approximation performance with DeepGTT, a Variational Inference-based model which had the state-of-the-art performance on travel time estimation. The result shows that GCGTTE outperforms DeepGTT on metrics and the distribution generated by GCGTTE is much closer to the original distribution.

With the rapid development of online ride-hailing services, people have increasingly relied on platforms providing these services to travel. The corresponding companies need to accurately obtain passengers' travel demand to allocate orders and drivers to regions. Therefore, traffic demand prediction is a critical problem of Intelligent Transportation Systems (ITS). Origin-Destination Matrix Prediction (ODMP) is a challenging extension of traffic demand prediction that needs to consider the temporal and spatial dependence of traffic data and predict the relationship between origin and destination of passengers' demand. In this paper, we proposed a method to convert order paths of passenger demand to the hexagon-based path graph. The path graph shows the origin and the destination of the paths of a period. Specifically, considering that traffic flows are time-varying, we generate different hexagon-based path graphs for different time periods. Then, we propose a Hexagon-based Dynamic-Graph Convolutional Network (Hex D-GCN) to make the GCN suitable for dynamic graphs, in which graph connections are different in time series. Furthermore, We evaluate our model on the Didi Chuxing KDD CUP 2020 dataset and get the state-of-art performance. It is shown that our method combines the spatial correlation and temporal correlation well and also captures the passenger's demand pattern.

Statistics on urban traffic speed flows are essential for thoughtful city planning. Recently, data-driven traffic prediction methods have become the state-of-the-art for a wide range of traffic forecasting tasks. However, many small cities have a limited amount of traffic data available for building data-driven models due to lack of data collection methods. With the acceleration of urbanization, the need for traffic construction of small and medium-sized cities is imminent. To tackle the above problems, we propose a TransfEr lEarning approach with graPh nEural nEtworks (TEEPEE) for traffic prediction that can forecast the traffic speed in data-scarce areas with massive value data from developed cities. In particular, TEEPEE uses graph clustering to divide the traffic network map into multiple sub-graphs. Graph clustering captures more spatial information in the transfer process. To evaluate the effectiveness of TEEPEE, we conduct experiments on two real-world datasets and compare them with other baseline models. The results demonstrate that TEEPEE is among the best efforts of baseline models. We provide a comprehensive analysis of the experimental results in this work.

Crowdsourced navigation is becoming the prevalent automobile navigation solution with the widespread adoption of smartphones over the past decade, which supports a plethora of intelligent transportation system services. However, it is subjected to Sybil attacks that inject carefully designed adversarial GPS trajectories to compromise the data aggregation system and cause false traffic jams. Successful Sybil attacks have been launched against real crowdsourced navigation systems, yet defending such critical threats has seldom been studied. In this work, a novel deep generative model based on Bayesian deep learning is devised for Sybil attack identification. The proposed model exploits time-series features to embed trajectories in a latent distribution space, which serves as a basis for identifying ones generated by Sybil attacks. Case studies on three real-world vehicular trajectory datasets reveal that the proposed model improves the performance of state-of-the-art baselines by at least 76.6%. Additionally, a hyper-parameter test develops guidelines for parameter selection, and a fast training scheme is proposed and assessed to boost the model training efficiency.

Federated Learning (FL) is a privacy-oriented framework that allows distributed edge devices to jointly train a shared global model without transmitting their sensed data to centralized servers. FL aims to balance the naturally conflicting objectives of obtaining massive amounts of data while protecting sensitive information. However, the data stored locally on each edge device are typically not independent and identically distributed (non-IID). Such data heterogeneity poses a severe statistical challenge for the optimization and convergence of the global model. In response to this issue, we propose Federated One-vs-All (FedOVA), an efficient FL algorithm that first decomposes a multi-class classification problem into more straightforward binary classification problems and then combines their respective outputs using ensemble learning. Experiments on several public datasets show that FedOVA achieves higher accuracy and faster convergence than federated averaging and data sharing. Furthermore, our approach can support practical settings with a large number of clients (up to 1000 clients) in FL.

Intelligent transportation systems (ITS) depend on accurate and reliable traffic speed prediction to improve the safety, efficiency, and sustainability of transportation activities. Recently, deep learning approaches have significantly contributed to the development of ITS, but are still facing challenges in cyber-physical context due to the aleatoric uncertainty of increasingly uncertain traffic data and epistemic uncertainty of point-to-point estimation training models. In this work, a Bayesian deep learning model reframing with a universal traffic forecasting framework is devised for traffic speed forecasting with uncertainty quantification. The key idea of proposed network is to introduce time-series features in a latent distribution space. Compared to traditional point estimation neural networks, case studies show that the proposed model can predict more reliable results in cross domain learning tests and is capable of discovering good feature representations in missing traffic data or data-deficient scenarios.

Digital humanities is an important subject because it enables developments in history, literature, and films. In this paper, we perform an empirical study of a Chinese historical text, Records of the Three Kingdoms (Records), and a historical novel of the same story, Romance of the Three Kingdoms (Romance). We employ deep learning-based natural language processing techniques to extract characters and their relationships. The adopted natural language processing approach can extract 93% and 91% characters that appeared in the two books, respectively. Then, we characterize the social networks and sentiments of the main characters in the historical text and the historical novel. We find that the social network in Romance is more complex and dynamic than that of Records, and the influence of the main characters differs. These findings shed light on the different styles of storytelling in the two literary genres and how the historical novel complicates the social networks of characters to enrich the literariness of the story.

Accurate identification in public travel modes is an essential task in intelligent transportation systems. In recent years, GPS-based identification is gradually replacing the conventional survey-based information-gathering process due to the more detailed and precise data on individual's travel patterns. Nonetheless, existing research suffers from deficient feature selection, high data dimensionality, and data under-utilization issues. In this work, we propose a novel travel mode identification mechanism based on discrete wavelet transform and recent developments of deep learning techniques. The proposed mechanism aims to take GPS trajectories of arbitrary lengths to develop accurate travel mode results in both global and online identification scenarios. In this mechanism, raw GPS data is first pre-processed to compute preliminary motion and displacement attributes, which are input into a tailor-made deep neural network. Discrete wavelet transform is also adopted to further extract time-frequency domain characteristics of the trajectories to assist the neural network in the classification task. To evaluate the performance of the proposed mechanism, a series of comprehensive case studies are conducted. The results indicate that the mechanism can notably outperform existing travel mode identifications on a same data set with minuscule computation time. Furthermore, an architecture test is performed to determine the best-performing structure for the proposed mechanism. Lastly, we demonstrate the capability of the mechanism in handling online identifications, and the performance sensitivity of the selected attributes is evaluated.

Intelligent transportation management requires not only statistical information on users' mobility patterns, but also knowledge of their corresponding transportation modes. While GPS trajectories can be readily obtained from GPS sensors found in modern smartphones and vehicles, these massive geospatial data are neither automatically annotated nor segmented by transportation mode, subsequently complicating transportation mode identification. In addition, predictive uncertainty caused by the learned model parameters or variable noise in GPS sensor readings typically remains unaccounted for. To jointly address the above issues, we propose a Bayesian deep learning framework for unsupervised GPS trajectory segmentation. After unlabeled GPS trajectories are preprocessed into sequences of motion features, they are used in unsupervised training of a channel-calibrated temporal convolutional neural network for timestep-level transportation mode identification. At test time, we approximate variational inference via Monte Carlo dropout sampling, leveraging the mean and variance of the predicted distributions to classify each input timestep and estimate its predictive uncertainty, respectively. The proposed approach outperforms both its non-Bayesian variant and established GPS trajectory segmentation baselines on Microsoft's Geolife dataset without using any labels.

Accurate traffic speed prediction is critical to modern internet of things-based intelligent transportation systems. It serves as the foundation of advanced traffic management systems and travel services. Nonetheless, the large number of roads and sensors impose great computational burden to existing forecast approaches, most of which can only handle one or few roads at a time. In this paper, a novel data-driven deep learning-based approach is proposed for citywide traffic speed prediction. The proposed approach is grounded on recent developments of geometric deep learning techniques to fully utilize the topological information of road networks in the learning process. Specifically, the approach captures the geometric traffic data dependency with graph convolution and attention mechanisms, and the temporal data correlation is extracted and expanded using the encoder-decoder architecture within a generative adversarial learning framework. Comprehensive case studies are conducted with real-world urban road networks and respective data to evaluate its performance, where consistent improvements can be observed over baseline approaches. Lastly, an architectural study is carried out to discover the best-performing structure of the proposed approach, whose sensitivity to data noise and sample frequency is also assessed.

GPS trajectory is one of the most significant data sources in intelligent transportation systems (ITS). A simple application is to use these data sources to help companies or organizations identify users' travel behavior. However, since GPS trajectory is directly related to private data (e.g., location) of users, citizens are unwilling to share their private information with the third-party. How to identify travel modes while protecting the privacy of users is a significant issue. Fortunately, Federated Learning (FL) framework can achieve privacy-preserving deep learning by allowing users to keep GPS data locally instead of sharing data. In this paper, we propose a Roust Federated Learning-based Travel Mode Identification System to identify travel mode without compromising privacy. Specifically, we design an attention augmented model architectures and leverage robust FL to achieve privacy-preserving travel mode identification without accessing raw GPS data from the users. Compared to existing models,we are able to achieve more accurate identification results than the centralized model. Furthermore, considering the problem of non-Independent and Identically Distributed (non-IID) GPS data in the real-world, we develop a secure data sharing strategy to adjust the distribution of local data for each user, thereby the proposed model with non-IID data can achieve accuracy close to the distribution of IID data. Extensive experimental studies on a real-world dataset demonstrate that the proposed model can achieve accurate identification without compromising privacy and being robust to real-world non-IID data.

Traffic speed prediction is among the key problems in intelligent transportation system (ITS). Traffic patterns with complex spatial dependency make accurate prediction on traffic networks a challenging task. Recently, a deep learning approach named Spatio-Temporal Graph Convolutional Networks (STGCN) has achieved state-of-the-art results in traffic speed prediction by jointly exploiting the spatial and temporal features of traffic data. Nonetheless, applying STGCN to large-scale urban traffic network may develop degenerated results, which is due to redundant spatial information engaging in graph convolution. In this work, we propose a motif-based graph-clustering approach to apply STGCN to large-scale traffic networks. By using graph-clustering, we partition a large urban traffic network into smaller clusters to prompt the learning effect of graph convolution. The proposed approach is evaluated on two real-world datasets and is compared with its variants and baseline methods. The results show that graph-clustering approaches generally outperform the other methods, and the proposed approach obtains the best performance.

Intelligent transportation management requires not only statistical information on users' mobility patterns, but also real-time knowledge of their selected transportation modes. The research area of GPS-based transportation mode identification aims to infer users' travel modes from their mobility data as captured by GPS sensors in their smartphones or vehicles. The recently demonstrated prevalence of deep neural networks in learning from data makes them a promising candidate for transportation mode identification. However, the massive geospatial data produced by GPS sensors are typically unlabeled. To address this problem, we first pretrain a deep convolutional autoencoder (CAE) using fixed-size trajectory segments. Then, we attach a clustering layer to the CAE's embedding layer, the former maintaining cluster centroids as trainable weights. Finally, we retrain the composite clustering model, encouraging the encoder's learned representation of the input data to be clustering-friendly by striking a balance between the model's reconstruction and clustering losses. By further incorporating features computed over each segment, we achieve a clustering accuracy of 80.5% on Microsoft's Geolife dataset without using any labels. To the best of our knowledge, this is the first work to leverage unsupervised deep learning for clustering of GPS trajectory data by transportation mode.

GPS trajectory data have become increasingly useful in traffic analysis and optimization. Nevertheless, due to sampling and communication-related issue, such trajectories suffer from data missing problems, and they further render a low quality of raw data for subsequent research. To address this problem, in this work, we propose a recurrent neural network based encoder-decoder deep learning approach. The head-direction information of trajectory, defined by the radius of curvature, is utilized together with the displacement attributed by an attention mechanism to learn from past trajectory points with different priority. Additionally, a smoothing data post-processor is adopted to make the reconstructed trajectories authentic. To evaluate the performance of the proposed reconstruction approach, a series of comprehensive case studies are conducted, which indicates that the proposed approach significantly outperforms baselines, such as the reduction of the missing impact to the original data and improvement in the prediction accuracy.

Existing traffic flow forecasting technologies achieve great success based on deep learning models on a large number of datasets gathered by organizations. However, there are two critical challenges. One is that data exists in the form of “isolated islands”. The other is the data privacy and security issue, which is becoming more significant than ever before. In this paper,we propose a Federated Learning-based Gated Recurrent Unit neural network framework (FedGRU) for traffic flow prediction(TFP) to address these challenges. Specifically, FedGRU model differs from current centralized learning methods and updates a universe learning model through a secure aggregation parameter mechanism rather than sharing data among organizations. In the secure parameter aggregation mechanism, we introduce aFederated Averaging algorithm to control the communication overhead during parameter transmission. Through extensive case studies on the Performance Measurement System (PeMS) dataset,it is shown that FedGRU model can achieve accurate and timely traffic prediction without compromising privacy.

Understanding how people choose to travel is essential for intelligent transportation planning and related smart services. Recent advances in deep learning, coupled with the increasing market penetration of GPS devices, have paved the way for novel travel mode identification methods based on GPS data mining. While many have shown promising results, most methods have often relied heavily on the few available labeled data, leaving large amounts of unlabeled ones unused. To address this issue, we propose MultiMix, a semi-supervised multi-task learning framework for travel mode identification. Our framework trains a deep autoencoder using batches of labeled, unlabeled, and synthetic data by simultaneously optimizing three corresponding objective functions. We show that MultiMix outperforms several fully- and semi-supervised baselines, achieving a classification accuracy of 66.2% on Geolife using just 1% of labeled data, with accuracy reaching 84.8% when incorporating all available labels. We also verify the necessity of its components through an ablation study designed to provide insights into the proposed approach.

Existing traffic flow forecasting approaches by deep learning models achieve excellent success based on a large volume of datasets gathered by governments and organizations. However, these datasets may contain lots of user's private data, which is challenging the current prediction approaches as user privacy is calling for the public concern in recent years. Therefore, how to develop accurate traffic prediction while preserving privacy is a significant problem to be solved, and there is a trade-off between these two objectives. To address this challenge, we introduce a privacy-preserving machine learning technique named federated learning and propose a Federated Learning-based Gated Recurrent Unit neural network algorithm (FedGRU) for traffic flow prediction. FedGRU differs from current centralized learning methods and updates universal learning models through a secure parameter aggregation mechanism rather than directly sharing raw data among organizations. In the secure parameter aggregation mechanism, we adopt a Federated Averaging algorithm to reduce the communication overhead during the model parameter transmission process. Furthermore, we design a Joint Announcement Protocol to improve the scalability of FedGRU. We also propose an ensemble clustering-based scheme for traffic flow prediction by grouping the organizations into clusters before applying FedGRU algorithm. Extensive case studies on a real-world dataset demonstrate that FedGRU can produce predictions that are merely 0.76 km/h worse then the state-of-the-art in terms of mean average error under the privacy preservation constraint, confirming that the proposed model develops accurate traffic predictions without compromising the data privacy.

Travel mode identification is among the key problems in transportation research. With the gradual and rapid adoption of GPS-enabled smart devices in modern society, this task greatly benefits from the massive volume of GPS trajectories generated. However, existing identification approaches heavily rely on manual annotation of these trajectories with their accurate travel mode information, which is both economically inefficient and error-prone. In this work, we propose a novel semi-supervised deep ensemble learning approach for travel mode identification to use a minimal number of annotated data for the task. The proposed approach accepts GPS trajectories of arbitrary lengths and extracts their latent information with a tailor-made feature engineering process. We devise a new deep neural network architecture to establish the mapping from this latent information domain to the final travel mode domain. An ensemble is accordingly constructed to develop proxy labels for unannotated data based on the rare annotated ones so that both types of data contribute to the learning process. Comprehensive case studies are conducted to assess the performance of the proposed approach, which notably outperforms existing ones with partially-labeled training data. Furthermore, we investigate its robustness to noisy data and the effectiveness of its constituting components.

Generative Adversarial Network (GAN) and its variants serve as a perfect representation of the data generation model, providing researchers with a large amount of high-quality generated data. They illustrate a promising direction for research with limited data availability. When GAN learns the semantic-rich data distribution from a dataset, the density of the generated distribution tends to concentrate on the training data. Due to the gradient parameters of the deep neural network contain the data distribution of the training samples, they can easily remember the training samples. When GAN is applied to private or sensitive data, for instance, patient medical records, as private information may be leakage. To address this issue, we propose a Privacy-preserving Generative Adversarial Network (PPGAN) model, in which we achieve differential privacy in GANs by adding well-designed noise to the gradient during the model learning procedure. Besides, we introduced the Moments Accountant strategy in the PPGAN training process to improve the stability and compatibility of the model by controlling privacy loss. We also give a mathematical proof of the differential privacy discriminator. Through extensive case studies of the benchmark datasets, we demonstrate that PPGAN can generate high-quality synthetic data while retaining the required data available under a reasonable privacy budget.

Data integrity of power system states is critical to modern power grid operation and control. Due to communication latency, state measurements are not immediately available at the control center, rendering slow responses of time-sensitive applications. In this paper, a new graph-based deep learning approach is proposed to recover and predict the states ahead of time utilizing the power network topology and existing measurements. A graph-convolutional recurrent adversarial network is devised to process available information and extract graphical and temporal data correlations. This approach overcomes drawbacks of the existing synchrophasor recovery and prediction implementation to improve the overall system performance. Additionally, the approach offers an adaptive data processing method to handle power grids of various sizes. Case studies demonstrate the outstanding recovery and prediction accuracy of the proposed approach, and investigations are conducted to illustrate its robustness against bad communication conditions, measurement noise, and system topology changes.

Real-time traffic speed estimation is an essential component of intelligent transportation system technologies. It is the foundation of modern transportation control and management applications. However, existing traffic speed acquisition systems can only provide real-time speed measurements of a small number of roads with stationary speed sensors and crowdsourcing vehicles. How to utilize these information to provide traffic speed maps for transportation networks is becoming a key problem in intelligent transportation systems. In this work, we present a novel deep learning model called graph convolutional generative autoencoder to fully address the real-time traffic speed estimation problem. The proposed model incorporates the recent development of deep learning techniques to extract the spatial correlation of the transportation network from the input incomplete historical data. To evaluate the proposed speed estimation technique, we conduct comprehensive case studies on a real-world transportation network and vehicular traces. The simulation results demonstrate that the proposed technique can notably outperform existing traffic speed estimation and deep learning techniques. In addition, the impact of dataset properties and control parameters are investigated.

Online vehicle routing is an important task of modern transportation service provider. Contributed by the ever-increasing real-time demand on the transportation system, especially small-parcel last mile delivery requests, vehicle route generation is becoming more computationally complex than before. Existing routing algorithms are mostly based on mathematical programming, which requires huge computation time in city-size transportation networks. To develop routes with minimal time, in this work we propose a novel deep reinforcement learning-based neural combinatorial optimization strategy. Specifically, we transform the online routing problem to a vehicle tour generation problem, and propose a structural graph embedded pointer network to develop these tours iteratively. Furthermore, since constructing supervised training data for the neural network is impractical due to the high computation complexity, we propose a deep reinforcement learning mechanism with an unsupervised auxiliary network to train the model parameters. A multisampling scheme is also devised to further improve the system performance. Since the parameter training process is offline, the proposed strategy can achieve a superior online route generation speed. To assess the proposed strategy, we conduct comprehensive case studies with a real-world transportation network. The simulation results show that the proposed strategy can significantly outperform conventional strategies with limited computation time in both static and dynamic logistic systems. In addition, the influence of control parameters on the system performance is investigated.

In recent years, the size (weight and volume) of cruise ships are experiencing spectacular increase, coherently with the increase in energy consumption and carbon emissions. However, the regulations about pollutant emissions imposed by the International Maritime Organization are becoming more and more strict. In order to face up to this issue, the energy system of cruise ships is constantly being modified. In this paper, the structure of the cruise ship's energy system with multiple facilities such as an internal combustion engine, gas turbine, dual fuel engine, PV panels, and the wind turbine is pre-established. Then, a multi-objective mathematical programming model is formulated to determine the selection and capacity of facilities with minimal total annual cost and size, while the emissions, energy balance and technical constraints are taken into account. By adopting the augmented ε-constraint method, the design and operation strategies could be obtained. As an illustrated example, the model is applied to a real cruise ship, and the Pareto frontier could provide ship designers with well-balanced solutions based on economic and size priorities, and with the increase in the proportion of size objective, the total annual cost increases and size decreases gradually. Compared with the reference energy system, the optimal energy system could reduce the total annual cost by 12.6% if only the economic objective is considered and reduce the size by 21.1% if only the size objective is considered. In multi-objective condition, the CO, NOx, and SOx emissions could be reduced by 29.1%-61.3%, 42.8%-61.3%, and 42.8%-61.3% per year, respectively. Moreover, a sensitivity analysis is conducted, and the result shows that the size and consumption cost of Marine Gas Oil (MGO) and Liquefied Natural Gas (LNG) are more sensitive to the change of the proportion of size objective compared to Heavy fuel oil (HFO) and Marine diesel oil (MDO).

Online traffic speed data of urban road networks serve as the foundation of modern intelligent transportation systems. Much research has been conducted on developing methods, mostly model-based or machine learning ones, to estimate the data with GPS record for one, few adjacent roads, or the entire vehicular transportation network. While the machine learning methods generally yield satisfactory estimation accuracy, their accomplishments are established on a plethora of historical GPS records which may not be readily available for many urban transportation systems. In this paper, we investigate a transfer learning approach to provide speed data estimations with few data. We ground this work on a graph convolutional generative autoencoder that can generate the estimations for an entire transportation network in one go, and modify its internal computation graph to reduce the size of network topology-dependent model parameters. Subsequently, pre-trained models from road networks with massive historical data can be re-used in other networks with few data, which are only employed to adjust a small number of parameters. To assess the effectiveness of the proposed approach, comprehensive case studies are conducted, in which outstanding speed estimations can be obtained with significantly shorter training time.

This paper presents a novel delay aware synchrophasor recovery and prediction framework to address the problem of missing power system state variables due to the existence of communication latency. This capability is particularly essential for dynamic power system scenarios where fast remedial control actions are required due to system events or faults. While a wide area measurement system can sample high-frequency system states with phasor measurement units, the control center cannot obtain them in real-time due to latency and data loss. In this work, a synchrophasor recovery and prediction framework and its practical implementation are proposed to recover the current system state and predict the future states utilizing existing incomplete synchrophasor data. The framework establishes an iterative prediction scheme, and the proposed implementation adopts recent machine learning advances in data processing. Simulation results indicate the superior accuracy and speed of the proposed framework, and investigations are made to study its sensitivity to various communication delay patterns for pragmatic applications.

Autonomous vehicles are expected to play an important role in handling the last mile logistics in intelligent transportation systems thanks to their unmanned nature and full-fledged controllability. Recently, an autonomous vehicle logistic system (AVLS) was proposed, which employs autonomous vehicles to serve logistic requests and utilize the excessive renewable energy generated by distributed generations. In this paper, we propose an optimization problem for AVLS to develop schedules for request allocation, vehicle routing, and battery charging. By considering the unique characteristics of AVLS, the proposed scheduling problem can exploit its advantages in goods delivery and renewable energy utilization over existing logistic request allocation algorithms. We formulate the problem as a mixed integer non-linear program. To improve its scalability, we also devise a two-stage scheduling methodology to approach the optimal solutions of the original problem. We conduct comprehensive simulations to assess the performance of the proposed request scheduling problem and two-stage scheduling methodology. The results indicate that the proposed problem can improve the efficacy of AVLS in terms of total travel distance and utilized renewable energy, and the two-stage methodology can develop near-optimal solutions with notably reduced computation time.

Fault detection is essential in microgrid control and operation, as it enables the system to perform fast fault isolation and recovery. The adoption of inverter-interfaced distributed generation in microgrids makes traditional fault detection schemes inappropriate due to their dependence on significant fault currents. In this paper, we devise an intelligent fault detection scheme for microgrid based on wavelet transform and deep neural networks. The proposed scheme aims to provide fast fault type, phase, and location information for microgrid protection and service recovery. In the scheme, branch current measurements sampled by protective relays are pre-processed by discrete wavelet transform to extract statistical features. Then all available data is input into deep neural networks to develop fault information. Compared with previous work, the proposed scheme can provide significantly better fault type classification accuracy. Moreover, the scheme can also detect the locations of faults, which are unavailable in previous work. To evaluate the performance of the proposed fault detection scheme, we conduct a comprehensive evaluation study on the CERTS microgrid and IEEE 34-bus system. The simulation results demonstrate the efficacy of the proposed scheme in terms of detection accuracy, computation time, and robustness against measurement uncertainty.

Autonomous vehicles (AVs) will revolutionarize ground transport and take a substantial role in the future transportation system. Most AVs are likely to be electric vehicles (EVs) and they can participate in the vehicle-to-grid (V2G) system to support various V2G services. Although it is generally infeasible for EVs to dictate their routes, we can design AV travel plans to fulfill certain system-wide objectives. In this paper, we focus on the AVs looking for parking and study how they can be led to appropriate parking facilities to support V2G services. We formulate the Coordinated Parking Problem (CPP), which can be solved by a standard integer linear program solver but requires long computational time. To make it more practical, we develop a distributed algorithm to address CPP based on dual decomposition. We carry out a series of simulations to evaluate the proposed solution methods. Our results show that the distributed algorithm can produce nearly optimal solutions with substantially less computational time. A coarser time scale can improve computational time but degrade the solution quality resulting in possible infeasible solution. Even with communication loss, the distributed algorithm can still perform well and converge with only little degradation in speed.

State estimation is critical to the operation and control of modern power systems. However, many cyber-attacks, such as false data injection attacks, can circumvent conventional detection methods and interfere the normal operation of grids. While there exists research focusing on detecting such attacks in DC state estimation, attack detection in AC systems is also critical, since AC state estimation is more widely employed in power utilities. In this paper, we propose a new false data injection attack detection mechanism for AC state estimation. When malicious data are injected in the state vectors, their spatial and temporal data correlations may deviate from those in normal operating conditions. The proposed mechanism can effectively capture such inconsistency by analyzing temporally consecutive estimated system states using wavelet transform and deep neural network techniques. We assess the performance of the proposed mechanism with comprehensive case studies on IEEE 118- and 300-bus power systems. The results indicate that the mechanism can achieve a satisfactory attack detection accuracy. Furthermore, we conduct a preliminary sensitivity test on the control parameters of the proposed mechanism.

The smart city embraces gradual adoption of autonomous vehicles (AVs) into the intelligent transportation system. Contributed by their full-fledged controllability, AVs can respond to instantaneous situations with high efficiency and flexibility. In this paper, we propose a novel AV logistic system (AVLS) to accommodate logistic demands for smart cities. We focus on determining the optimal routes for the governed AVs in consideration of various requirements imposed by the vehicles, logistic requests, renewable generations, and the underlying transportation system. By coordinating their routes and charging schedules, the system can effectively utilize the renewable energy generated by distributed generations. We formulate the joint routing and charging problem in the form of quadratic-constrained mixed integer linear program. To improve its scalability, we develop a distributed solution method via dual decomposition. We conduct extensive simulations to evaluate the performance of proposed system and solution methods. The results show that AVLS can effectively utilize excessive renewable energy while accomplishing all logistic requests. The distributed solution can develop near-optimal solutions with compelling improvement in computational speed.

The Autonomous Vehicle (AV) is expected to be an important "building block" of the future smart city. Recently, an AV-based public transportation system has been successfully developed to provide precise, effective, and intelligent public transportation services. For better quality of service, the system encourages market competition by accommodating multiple AV operators. To facilitate the pricing process, a pricing mechanism was developed but it can only process one service request each time. This can significantly impair the overall passenger admissibility, especially when there are many outstanding requests to be processed. In this paper, we re-design the pricing mechanism for handling multiple requests simultaneously. To do this, we formulate the key component of the mechanism, i.e., request-AV allocation, as a double combinatorial auction-based process. We construct a new winner determination problem that can accommodate requests of different AV service types. We also investigate its duality to devise an efficient service charge determination rule. We evaluate the performance of the proposed mechanism and charging rule with extensive simulations. The results show that the mechanism can result in better social welfare than the original scheme. Moreover, we examine the computational time required and the percentage of successfully served passengers. The simulations demonstrate that the mechanism can make the AV public transportation system more practical.

Online identification of post-contingency transient stability is essential in power system control, as it facilitates the grid operator to decide and coordinate system failure correction control actions. Utilizing machine learning methods with synchrophasor measurements for transient stability assessment has received much attention recently with the gradual deployment of wide-area protection and control systems. In this paper, we develop a transient stability assessment system based on the long short-term memory network. By proposing a temporal self-adaptive scheme, our proposed system aims to balance the trade-off between assessment accuracy and response time, both of which may be crucial in real-world scenarios. Compared with previous work, the most significant enhancement is that our system learns from the temporal data dependencies of the input data, which contributes to better assessment accuracy. In addition, the model structure of our system is relatively less complex, speeding up the model training process. Case studies on three power systems demonstrate the efficacy of the proposed transient stability assessment system.

Wide area measurement system (WAMS) is one of the essential components in the future power system. To make WAMS construction plans, practical models of the power network observability, reliability, and underlying communication infrastructures need to be considered. To address this challenging problem, in this paper we propose a unified framework for WAMS planning to cover most realistic concerns in the construction process. The framework jointly optimizes the system construction cost, measurement reliability, and volume of synchrophasor data traffic resulting in a multi-objective optimization problem, which provides multiple Pareto optimal solutions to suit different requirements by the utilities. The framework is verified on two IEEE test systems. The simulation results demonstrate the trade-off relationships among the proposed objectives. Moreover, the proposed framework can develop optimal WAMS plans for full observability with minimal cost. This work develops a comprehensive framework for most practical WAMS construction designs.

With the increasing awareness of the harmful impacts of urban air pollution, air quality monitoring stations have been deployed in many metropolitan areas. These stations provide continuous air quality monitoring data to the public. However, due to sampling device failures and data processing errors, missing data in air quality measurement is common. Data integrity becomes a critical challenge when such data are employed for public services. In this paper, we investigate the mathematical property of air quality measurements, and attempt to recover the missing data. First, we empirically study the low rank property of the measurements. Second, we formulate the low rank matrix completion optimization problem to reconstruct the missing air quality data. The problem is transformed using duality theory, and singular value thresholding (SVT) is employed to develop sub-optimal solutions. Third, to evaluate the performance of our methodology, we conduct a series of case studies including different types of missing data patterns. The simulation results demonstrate that the proposed methodology can effectively recover missing air quality data, and outperform the existing interpolation method. Finally, we investigate the parameter sensitivity of SVT. Our study can serve as a guideline for real-world missing data recovery implementation.

Renewable energy and electric vehicles (EVs) are two key developments of smart grid. To support the increasing charging demands of EVs, more charging stations need to be constructed. Some charging stations are located in remote areas and they mainly rely on renewable generations for energy provisioning. Due to dissimilar self-generations and local energy demands at different locations, it is beneficial to share the energy among themselves for a sustainable eco-system. Powered by the smart city vision that revolutionizes the energy and transportation sectors, vehicular energy network (VEN) is developed, which can distribute energy across a geographical area by means of EVs. In this paper, we formulate an optimization problem to optimally coordinate energy exchange among renewable-enabled or off-grid charging stations based on VEN. We also propose a heuristic to develop some high-quality energy tracks for energy exchange, which can significantly reduce the computational time. We evaluate the energy exchange performance on some random networks of various sizes. Simulation results demonstrate that the proposed design can effectively deliver excessive energy over VEN and the proposed heuristic can drastically reduce the computational time without significantly undermining the performance.

Recently, vehicular energy network (VEN) has been proposed to transport energy over a large geographical area by means of electric vehicles (EVs) over a road network. In the near future, an abundance of EVs, plentiful generation of renewables, and mature wireless energy transfer and vehicular communication technologies will expedite the realization of VEN. VEN routing refers to the establishment of energy paths, which are composed of segments of vehicular routes, to transmit energy from a source to a destination. In this paper, we study the fundamental energy loss minimization problem, which studies routing energy for a particular source-destination pair along possible energy paths such that the total energy loss is minimized while guaranteeing a transferable amount of energy. We first discuss how to construct energy paths for a particular source-destination pair, followed by some analytical results. Then we formulate the problem based on the established energy paths constituting linear-programming-based solution methods. We test the performance with a real-world traffic network. This paper lays the foundations of VEN routing.

Due to the increasing concern for greenhouse gas emissions and fossil fuel security, electric vehicles (EVs) have attracted much attention in recent years. EVs can aggregate together constituting the vehicle-to-grid system. Coordination of EVs is beneficial to the power system in many ways. In this paper, we formulate a novel large-scale EV charging problem with energy trading in order to maximize the aggregator profit. This problem is non-convex and can be solved with a centralized iterative approach. To overcome the computation complexity issue brought by the non-convexity, we develop a distributed optimization-based heuristic. To evaluate our proposed approach, a modified IEEE 118 bus testing system is employed with 10 aggregators serving 30 000 EVs. The simulation results indicate that our proposed distributed heuristic with energy trading can effectively increase the total profit of aggregators. In addition, the proposed distributed optimization-based heuristic strategy can achieve near-optimal performance.

Thanks to the various advantages over conventional cars, autonomous vehicles (AVs) will take a more important role in the future transportation system. Since AVs are typically electric vehicles (EVs), they can contribute to vehicle-to-grid (V2G) services. While it is generally not feasible to dictate EV routes, we can design AV travel plans to fulfill certain system-wide objectives. In this paper, we focus on the AVs looking for parking and study how they can be led to appropriate parking facilities to support V2G services. We formulate the problem as an integer linear program (ILP). It can be solved by a standard ILP solver but the required long computational time may not be acceptable in practical scenarios. To overcome this, we also develop a more efficient heuristic. We perform extensive simulations to study different perspectives on solving the problem. Simulation results reveal that the heuristic can significantly reduce the computational time with negligible degradation in objective function value. The quality of the optimal solution is insensitive to the number of available parking facilities. A coarser time scale can improve computational time but degrade the solution quality resulting in possible infeasible solution.

In this work, we investigate the joint relay and user selection problem in two different multi-relay multi-user MIMO transmission modes, namely, an existing competition mode and a proposed cooperation mode. Each user is served by a single relay in competition mode while users are served by active relays cooperatively in cooperation mode. Due to the high computational complexity of the optimal exhaustive enumeration algorithm, we propose a suboptimal capacity-based best-fit algorithm, which achieves above 86% and 89% of the system capacity of the optimal algorithm in competition and cooperation mode, respectively, while the computational complexity is linear with the number of relays and users in the system. Our simulation results also show that the proposed cooperation transmission mode has a better system performance than competition mode when SNR is high.

Economic Load Dispatch (ELD) is one of the essential components in power system control and operation. Although conventional ELD formulation can be solved using mathematical programming techniques, modern power system introduces new models of the power units which are non-convex, non-differentiable, and sometimes non-continuous. In order to solve such non-convex ELD problems, in this paper we propose a new approach based on the Social Spider Algorithm (SSA). The classical SSA is modified and enhanced to adapt to the unique characteristics of ELD problems, e.g., valve-point effects, multi-fuel operations, prohibited operating zones, and line losses. To demonstrate the superiority of our proposed approach, five widely adopted test systems are employed and the simulation results are compared with the state-of-the-art algorithms. In addition, the parameter sensitivity is illustrated by a series of simulations. The simulation results show that SSA can solve ELD problems effectively and efficiently.

The growing complexity of real-world problems has motivated computer scientists to search for efficient problem-solving methods. Metaheuristics based on evolutionary computation and swarm intelligence are outstanding examples of nature-inspired solution techniques. Inspired by the social spiders, we propose a novel Social Spider Algorithm to solve global optimization problems. This algorithm is mainly based on the foraging strategy of social spiders, utilizing the vibrations on the spider web to determine the positions of preys. Different from the previously proposed swarm intelligence algorithms, we introduce a new social animal foraging strategy model to solve optimization problems. In addition, we perform preliminary parameter sensitivity analysis for our proposed algorithm, developing guidelines for choosing the parameter values. The Social Spider Algorithm is evaluated by a series of widely-used benchmark functions, and our proposed algorithm has superior performance compared with other state-of-the-art metaheuristics.

Social Spider Algorithm (SSA) is a recently proposed general-purpose real-parameter metaheuristic designed to solve global numerical optimization problems. This work systematically benchmarks SSA on a suite of 11 functions with different control parameters. We conduct parameter sensitivity analysis of SSA using advanced non-parametric statistical tests to generate statistically significant conclusion on the best performing parameter settings. The conclusion can be adopted in future work to reduce the effort in parameter tuning. In addition, we perform a success rate test to reveal the impact of the control parameters on the convergence speed of the algorithm.

A newly proposed chemical-reaction-inspired metaheurisic, Chemical Reaction Optimization (CRO), has been applied to many optimization problems in both discrete and continuous domains. To alleviate the effort in tuning parameters, this paper reduces the number of optimization parameters in canonical CRO and develops an adaptive scheme to evolve them. Our proposed Adaptive CRO (ACRO) adapts better to different optimization problems. We perform simulations with ACRO on a widely-used benchmark of continuous problems. The simulation results show that ACRO has superior performance over canonical CRO.

With the recent explosion in mobile data, the energy consumption and carbon footprint of the mobile communications industry is rapidly increasing. It is critical to develop more energy-efficient systems in order to reduce the potential harmful effects to the environment. One potential strategy is to switch off some of the under-utilized base stations during off-peak hours. In this paper, we propose a binary Social Spider Algorithm to give guidelines for selecting base stations to switch off. In our implementation, we use a penalty function to formulate the problem and manage to bypass the large number of constraints in the original optimization problem. We adopt several randomly generated cellular networks for simulation and the results indicate that our algorithm can generate superior performance.

The set covering problem (SCP) is one of the representative combinatorial optimization problems, having many practical applications. This paper investigates the development of an algorithm to solve SCP by employing chemical reaction optimization (CRO), a general-purpose metaheuristic. It is tested on a wide range of benchmark instances of SCP. The simulation results indicate that this algorithm gives outstanding performance compared with other heuristics and metaheuristics in solving SCP.

Optimization techniques are frequently applied in science and engineering research and development. Evolutionary algorithms, as a kind of general-purpose metaheuristic, have been shown to be very effective in solving a wide range of optimization problems. A recently proposed chemical-reaction-inspired metaheuristic, Chemical Reaction Optimization (CRO), has been applied to solve many global optimization problems. However, the functionality of the inter-molecular ineffective collision operator in the canonical CRO design overlaps that of the on-wall ineffective collision operator, which can potential impair the overall performance. In this paper we propose a new inter-molecular ineffective collision operator for CRO for global optimization. To fully utilize our newly proposed operator, we also design a scheme to adapt the algorithm to optimization problems with different search space characteristics. We analyze the performance of our proposed algorithm with a number of widely used benchmark functions. The simulation results indicate that the new algorithm has superior performance over the canonical CRO.

Cognitive radio is a promising technology for increasing the system capacity by using the radio spectrum more effectively. It has been widely studied recently and one important problem in this new paradigm is the allocation of radio spectrum to secondary users effectively in the presence of primary users. We call it the cognitive radio spectrum allocation problem (CRSAP) in this paper. In the conventional problem formulation, a secondary user can be either on or off and its interference range becomes maximum or zero, respectively. We first develop a solution to CRSAP based on the newly proposed chemical reaction-inspired metaheuristic called Chemical Reaction Optimization (CRO). We study different utility functions, accounting for utilization and fairness, with the consideration of the hardware constraint, and compare the performance of our proposed CRO-based algorithm with existing ones. Simulation results show that the CRO-based algorithm always outperforms the others dramatically. Next, by allowing adjustable transmission power, we propose power-controlled CRSAP (PC-CRSAP), a new formulation to the problem with the consideration of spatial diversity. We design a two-phase algorithm to solve PC-CRSAP, and again simulation results show excellent performance.

An electric vehicle (EV) may be used as energy storage which allows the bi-directional electricity flow between the vehicle's battery and the electric power grid. In order to flatten the load profile of the electricity system, EV scheduling has become a hot research topic in recent years. In this paper, we propose a new formulation of the joint scheduling of EV and Unit Commitment (UC), called EVUC. Our formulation considers the characteristics of EVs while optimizing the system total running cost. We employ Chemical Reaction Optimization (CRO), a general-purpose optimization algorithm to solve this problem and the simulation results on a widely used set of instances indicate that CRO can effectively optimize this problem.

Optimization problems can generally be classified as continuous and discrete, based on the nature of the solution space. A recently developed chemical-reaction-inspired metaheuristic, called chemical reaction optimization (CRO), has been shown to perform well in many optimization problems in the discrete domain. This paper is dedicated to proposing a real-coded version of CRO, namely, RCCRO, to solve continuous optimization problems. We compare the performance of RCCRO with a large number of optimization techniques on a large set of standard continuous benchmark functions. We find that RCCRO outperforms all the others on the average. We also propose an adaptive scheme for RCCRO which can improve the performance effectively. This shows that CRO is suitable for solving problems in the continuous domain.

Air pollution monitoring is a very popular research topic and many monitoring systems have been developed. In this paper, we formulate the Bus Sensor Deployment Problem (BSDP) to select the bus routes on which sensors are deployed, and we use Chemical Reaction Optimization (CRO) to solve BSDP. CRO is a recently proposed metaheuristic designed to solve a wide range of optimization problems. Using the real world data, namely Hong Kong Island bus route data, we perform a series of simulations and the results show that CRO is capable of solving this optimization problem efficiently.

Chemical Reaction Optimization (CRO) is a powerful metaheuristic which mimics the interactions of molecules in chemical reactions to search for the global optimum. The perturbation function greatly influences the performance of CRO on solving different continuous problems. In this paper, we study four different probability distributions, namely, the Gaussian distribution, the Cauchy distribution, the exponential distribution, and a modified Rayleigh distribution, for the perturbation function of CRO. Different distributions have different impacts on the solutions. The distributions are tested by a set of wellknown benchmark functions and simulation results show that problems with different characteristics have different preference on the distribution function. Our study gives guidelines to design CRO for different types of optimization problems.

This paper presents an implementation of the Chemical Reaction Optimization (CRO) algorithm to solve the optimal power flow (OPF) problem in power systems with the objective of minimizing generation costs. Multiple constraints, such as the balance of the power, bus voltage magnitude limits, transmission line flow limits, transformer tap settings, etc., are considered. We adapt the CRO framework to the OPF problem by redesigning the elementary reaction operators. We perform simulations on the standard IEEE-14, -30, and -57 bus benchmark systems. We compare the perform of CRO with other reported evolutionary algorithms in the IEEE-30 test case. Simulation results show that CRO can obtain a solution with the lowest cost, when compared with other algorithms. To be more complete, we also give the average result for the IEEE-30 case, and the best and average results for the IEEE-14 and -57 test cases. The results given in this paper suggest that CRO is a better alternative for solving the OPF problem, as well as its variants for the future smart grid.

Evolutionary algorithms (EAs) are very popular tools to design and evolve artificial neural networks (ANNs), especially to train them. These methods have advantages over the conventional backpropagation (BP) method because of their low computational requirement when searching in a large solution space. In this paper, we employ Chemical Reaction Optimization (CRO), a newly developed global optimization method, to replace BP in training neural networks. CRO is a population-based metaheuristics mimicking the transition of molecules and their interactions in a chemical reaction. Simulation results show that CRO outperforms many EA strategies commonly used to train neural networks.