Quantifying the Impact of Complementary Visual and Textual Cues Under Image Captioning

Image captioning generates a semantic description of an image. It deals with image understanding and text mining, which has made great progress in recent years. However, it is still a great challenge to bridge the “semantic gap” between low-level features and high-level semantics in remote sensing images, in spite of the improvement of image resolutions. In this paper, we present a new model with an attribute attention mechanism for the description generation of remote sensing images. Therefore, we have explored the impact of the attributes extracted from remote sensing images on the attention mechanism. The results of our experiments demonstrate the validity of our proposed model. The proposed method obtains six higher scores and one slightly lower, compared against several state of the art techniques, on the Sydney Dataset and Remote Sensing Image Caption Dataset (RSICD), and receives all seven higher scores on the UCM Dataset for remote sensing image captioning, indicating that the proposed framework achieves robust performance for semantic description in high-resolution remote sensing images.

Download Full-text

Image Captioning System

International Journal for Modern Trends in Science and Technology - RTT2020 ◽

10.46501/ijmtst061208 ◽

2020 ◽

Vol 6 (12) ◽

pp. 40-44

Author(s):

Gaurav Joshi, Dr. Amita Goel Vasudha Bahl and Nidhi Sengar

Keyword(s):

Mental Illness ◽

Deep Learning ◽

Image Captioning ◽

Huge Impact ◽

The Impact ◽

The Relationship

Deep Learning is relatively a new field and it has grabbed a lot of attention because it provides higher level of accuracy in recognizing objects than ever earlier. NLP is also one field that has created a huge impact in our life. NLP has come a long way from producing a readable summary of the texts to analysis of mental illness, it shows the impact of NLP. Image captioning task combines both NLP and Deep Learning. Describing images in a meaningful way can be done using Image captioning. Describing an image don’t just mean recognizing objects, to describe an image properly we first need to identify objects present in the image and then the relationship between those objects. In this study we have used CNN-LSTM based framework. CNN will be used to extract features of the image while with the help of LSTM we will try to generate meaningful sentences. This study also discusses applications of Image captioning and major challenges faced in achieving this task.

Download Full-text

Integration of textual cues for fine-grained image captioning using deep CNN and LSTM

Neural Computing and Applications ◽

10.1007/s00521-019-04515-z ◽

2019 ◽

Vol 32 (24) ◽

pp. 17899-17908 ◽

Cited By ~ 3

Author(s):

Neeraj Gupta ◽

Anand Singh Jalal

Keyword(s):

Image Captioning ◽

Fine Grained ◽

Deep Cnn ◽

Textual Cues

Download Full-text

Formation of Lunar Craters and Bright Rays as a Result of Meteorite Impacts

Symposium - International Astronomical Union ◽

10.1017/s0074180900178404 ◽

1962 ◽

Vol 14 ◽

pp. 415-418

Author(s):

K. P. Stanyukovich ◽

V. A. Bronshten

Keyword(s):

Explosive Charge ◽

The Moon ◽

Meteorite Impacts ◽

The Earth ◽

Lunar Craters ◽

The Impact

The phenomena accompanying the impact of large meteorites on the surface of the Moon or of the Earth can be examined on the basis of the theory of explosive phenomena if we assume that, instead of an exploding meteorite moving inside the rock, we have an explosive charge (equivalent in energy), situated at a certain distance under the surface.

Download Full-text

The Geosciences Applied to Lunar Exploration

Symposium - International Astronomical Union ◽

10.1017/s0074180900178222 ◽

1962 ◽

Vol 14 ◽

pp. 169-257 ◽

Cited By ~ 9

Author(s):

J. Green

Keyword(s):

Lunar Surface ◽

Probable Mechanism ◽

Point Of View ◽

Lunar Exploration ◽

Geological Model ◽

Apply Geophysics ◽

Surface Features ◽

The Impact

The term geo-sciences has been used here to include the disciplines geology, geophysics and geochemistry. However, in order to apply geophysics and geochemistry effectively one must begin with a geological model. Therefore, the science of geology should be used as the basis for lunar exploration. From an astronomical point of view, a lunar terrain heavily impacted with meteors appears the more reasonable; although from a geological standpoint, volcanism seems the more probable mechanism. A surface liberally marked with volcanic features has been advocated by such geologists as Bülow, Dana, Suess, von Wolff, Shaler, Spurr, and Kuno. In this paper, both the impact and volcanic hypotheses are considered in the application of the geo-sciences to manned lunar exploration. However, more emphasis is placed on the volcanic, or more correctly the defluidization, hypothesis to account for lunar surface features.

Download Full-text

Asteroid and Comet Impact Speeds upon Mars: Significance for Panspermia and the Supply of Organics

International Astronomical Union Colloquium ◽

10.1017/s0252921100014718 ◽

1997 ◽

Vol 161 ◽

pp. 197-201 ◽

Cited By ~ 1

Author(s):

Duncan Steel

Keyword(s):

Probability Distributions ◽

Regions Of Interest ◽

Significant Fraction ◽

Organic Chemicals ◽

Impact Speed ◽

The Mean ◽

The Impact

AbstractWhilst lithopanspermia depends upon massive impacts occurring at a speed above some limit, the intact delivery of organic chemicals or other volatiles to a planet requires the impact speed to be below some other limit such that a significant fraction of that material escapes destruction. Thus the two opposite ends of the impact speed distributions are the regions of interest in the bioastronomical context, whereas much modelling work on impacts delivers, or makes use of, only the mean speed. Here the probability distributions of impact speeds upon Mars are calculated for (i) the orbital distribution of known asteroids; and (ii) the expected distribution of near-parabolic cometary orbits. It is found that cometary impacts are far more likely to eject rocks from Mars (over 99 percent of the cometary impacts are at speeds above 20 km/sec, but at most 5 percent of the asteroidal impacts); paradoxically, the objects impacting at speeds low enough to make organic/volatile survival possible (the asteroids) are those which are depleted in such species.

Download Full-text

Organic Syntheses During the Impact of a Comet with a Gaseous Planet

International Astronomical Union Colloquium ◽

10.1017/s0252921100014706 ◽

1997 ◽

Vol 161 ◽

pp. 189-195

Author(s):

Cesare Guaita ◽

Roberto Crippa ◽

Federico Manzini

Keyword(s):

Polymeric Material ◽

Molecular Form ◽

Parent Compound ◽

Blue Filter ◽

Organic Syntheses ◽

The Impact

AbstractA large amount of CO has been detected above many SL9/Jupiter impacts. This gas was never detected before the collision. So, in our opinion, CO was released from a parent compound during the collision. We identify this compound as POM (polyoxymethylene), a formaldehyde (HCHO) polymer that, when suddenly heated, reformes monomeric HCHO. At temperatures higher than 1200°K HCHO cannot exist in molecular form and the most probable result of its decomposition is the formation of CO. At lower temperatures, HCHO can react with NH3 and/or HCN to form high UV-absorbing polymeric material. In our opinion, this kind of material has also to be taken in to account to explain the complex evolution of some SL9 impacts that we observed in CCD images taken with a blue filter.

Download Full-text

Hydrogen Cyanide Polymers from the Impact of Comet P/Shoemaker-Levy 9 on Jupiter

International Astronomical Union Colloquium ◽

10.1017/s025292110001469x ◽

1997 ◽

Vol 161 ◽

pp. 179-187

Author(s):

Clifford N. Matthews ◽

Rose A. Pesce-Rodriguez ◽

Shirley A. Liebman

Keyword(s):

Amino Acids ◽

Solar System ◽

Hydrogen Cyanide ◽

Nitrogen Heterocycles ◽

Laboratory Studies ◽

Heterogeneous Solids ◽

The Many ◽

Comet Halley ◽

The Impact ◽

By Products

AbstractHydrogen cyanide polymers – heterogeneous solids ranging in color from yellow to orange to brown to black – may be among the organic macromolecules most readily formed within the Solar System. The non-volatile black crust of comet Halley, for example, as well as the extensive orangebrown streaks in the atmosphere of Jupiter, might consist largely of such polymers synthesized from HCN formed by photolysis of methane and ammonia, the color observed depending on the concentration of HCN involved. Laboratory studies of these ubiquitous compounds point to the presence of polyamidine structures synthesized directly from hydrogen cyanide. These would be converted by water to polypeptides which can be further hydrolyzed to α-amino acids. Black polymers and multimers with conjugated ladder structures derived from HCN could also be formed and might well be the source of the many nitrogen heterocycles, adenine included, observed after pyrolysis. The dark brown color arising from the impacts of comet P/Shoemaker-Levy 9 on Jupiter might therefore be mainly caused by the presence of HCN polymers, whether originally present, deposited by the impactor or synthesized directly from HCN. Spectroscopic detection of these predicted macromolecules and their hydrolytic and pyrolytic by-products would strengthen significantly the hypothesis that cyanide polymerization is a preferred pathway for prebiotic and extraterrestrial chemistry.

Download Full-text