The existing deepfake detection methods mainly model on the basis of pixel-level clues of images, and seldom consider the impact of the synthesis process on the forged images. Although good detection results are achieved, it is difficult to explain the detection process. Therefore, a multi-modal physical prior feature fusion-based explainable detection method for deepfakes was proposed. First, optical flow features, illumination features, edge features and DCT(Discrete Cosine Transform) features were used to describe the inter-frame motion differences in temporal videos, the illumination inconsistency in single-frame videos, and edge artifact information, respectively, so as to obtain multi-modal physical prior features with explainability. Second, a multi-modal mixture of experts network was proposed to construct expert sub-networks for different modalities, and after cross-modal attention weighting, the sub-networks were fused through a gated unit and input into the discriminative network for classification. Third, the SIAM (Spatial Intersection Attention Module) was introduced into the discriminative network, and the fully connected structure was replaced by the KAN (Kolmogorov-Arnold Network) structure. Finally, the multi-modal physical prior features were used to train different expert sub-networks, respectively, and the Shapley value analysis of different input features was given, thereby constructing a pre-feature-post-explanation explainable analysis framework to provide pixel-level explanations for model inference and prediction. Experimental results show that compared with algorithms such as CORE(COnsistent REpresentation learning), SRM(Rich Models for Steganalysis), and UCF(Uncovering Common Features), the proposed method achieves the best performance on AUC and accuracy, with an accuracy range of 97.35% to 98.75% and an average accuracy of 98.22% on FaceForensics++ dataset, and the model’s interpretability also is improved significantly.
As the uncertainty of user requirements in the cloud-edge environment causes the microservice composition logic to be dynamically adjusted with the changes of user needs, a Dynamic Evolution method for Microservice Composition system (DE4MC) in the cloud-edge environment was proposed. Firstly, the user's operation was automatically recognized to implement the corresponding algorithm strategy. Secondly, in the deployment stage, the better node was selected by the system for deployment through the deployment algorithm in the proposed method after the user submitting the business process. Finally, in the dynamic adjustment stage, the dynamic evolution was performed by the system through the dynamic adjustment algorithm in the proposed method after the user adjusting the business process instances. In both algorithms in the proposed method, the migration cost of microservice instances, the data communication cost between microservices and users, and the data flow transmission cost between microservices were comprehensively considered to select better nodes for deployment, which shortened the running time and reduced the evolution cost. In the simulation experiment, in the deployment stage, the deployment algorithm in the proposed method has average running time of all scales 9.7% lower and total evolution cost 16.8% lower than those of the combination algorithm of Heuristic Algorithm (HA) with Non-dominated Sorting Genetic Algorithm-Ⅱ (NSGA-Ⅱ); in the dynamic adjustment stage, compared with the combination algorithm of HA and NSGA-Ⅱ, the dynamic adjustment algorithm in the proposed method has the average running time of all scales 6.3% lower, and the total evolution cost 21.7% lower. Experimental results show that the proposed method ensures timely evolution of the microservice composition system in the cloud-edge environment with low evolution cost and short business process time, and provides users with satisfactory quality of service.
Self generating neural networks have been presented as a better alternative to fixed structure in data mining application. The paper provided the algorithm of Self Organising Map(SOM), and presented an version of Growing Self Organising Map(GSOM) model which can extend into a nearest prototype classifier, and gave an application in data mining using GSOM.