While Abe and Trump were at the golf course, their wives Melania and Akie enjoyed a display of "digital art" at an exhibition that has been a smash hit in Tokyo.
Later, the first couple took in a sumo wrestling tournament at Ryōgoku Kokugikan Stadium.
The Japan Sumo Association instituted some safety precautions due to Trump's participation, including selling fewer same-day tickets and banning the ritual of throwing seat cushions as an expression of disappointment.
"While cooperating closely with the USA and other related countries, we are planning to tackle this appropriately by strengthening enforcement of related UN Security Council resolutions", he said.
He added: "We bought that attractive trophy which they'll have hopefully for many hundreds of years".
Trump and Abe are expected to play golf and Trump also scheduled to attend a championship sumo match in Tokyo where he will give the victor a custom-made trophy, apparently to be called the Trump Cup.
US President Donald Trump on Saturday urged Japanese business leaders to bolster investments in the United States at the start of a four-day state visit to Japan. Trump sponsored major events, appeared in bits and was inducted into the World Wrestling Entertainment Hall of Fame in 2013.
Mrs. Trump drew the fish for a girl named Julia, and wrote underneath it: "Julia, Best Wishes, Melania Tump". Naruhito is to welcome Trump to the Imperial Palace on Monday and share a banquet in his honor.
Melania Trump looked gorgeous when she stepped out for dinner in a handsome pink dress during her and President Donald Trump's three-day trip in Japan.
Mr Abe has rolled out the carpet for Mr Trump as part of a continued charm offensive, giving him the honour of being the first head of state invited to meet Emperor Naruhito since he ascended to the throne on May 1.
"In terms of violating U.N. Security Council resolutions, there is no doubt about that", Bolton said, adding that Trump and Abe would "talk about making sure the integrity of the Security Council resolutions are maintained".
Golf has been a bonding activity for two leaders who love the game.
The trip kicks off an intensive schedule of foreign travel that will take Trump to Europe and then back to Asia over the next month.
"We were able to exchange our views frankly in a cozy atmosphere". In fact, this entire State Visit is evidence that Prime Minister Abe has figured out what other world leaders have learned, that the way to influence the President is to fawn over him and stroke his ego.
North Korea fired a number of missiles over Japan in 2017, leading Mr Trump to tell Mr Abe his country could intercept missiles "if necessary".
"The Japanese have not decided officially yet whether they'll procure the F-35B, but there's an bad lot of interest", he said.
On Friday May 10, 2019 President Donald Trump imposed sanctions on $200 billion (€178 billion) worth of Chinese goods.
Mr Trump had predicted that a US-Japan trade deal could be finalised during his trip.
Trump has sought a bilateral deal with Tokyo since he pulled the USA from the multinational Trans-Pacific Partnership trade agreement two years ago, though analysts expect no breakthroughs during the trip.
After golf on Sunday, he tweeted that "great progress" was being made in the negotiations but "much will wait" until after Japanese upper house elections expected in July.
For all the smiles, there is a deep uneasiness between the US and Japan after the president threatened to impose stiff tariffs on Japanese cars and parts.
Trump also embraced Kim's verbal attack on Joe Biden, one of Trump's Democratic presidential rivals. Agriculture and beef heavily in play. He has suggested he will go ahead with the trade penalties if U.S. Trade Representative Robert Lighthizer fails to win concessions from Japan and the European Union.
In April, Japan's trade surplus surged nearly 18 percent to $6.6bn.